Old dialects are gold worth for AI

How can some Halland guys make AI technology better? When American speech-to-text models are to learn Swedish, old dialect recordings have proven to be a goldmine.

» Published: October 12 2024

Old dialects are gold worth for AI
Photo: Uppsala universitet

At the Institute for Language and Folk Culture (Isof), they have worked extensively with dialect collection, primarily between 1935 and 1970, when researchers traveled around the country recording how people spoke.

The initial purpose was largely to preserve traditional dialects, explains Annette C Torensjö, head of the Department of Archives and Research in Uppsala at Isof.

The recordings were used for many years mainly by researchers, but last year, the KB-Lab at the Royal Library got in touch. Leonora Vesterbacka is a senior data scientist and leads a project to train speech-to-text models, which "translate" speech into written text.

A Small Part of Swedish

American AI models are often trained on massive multilingualism, and then the Swedish part becomes very small.

There is a model from Open AI called Whisper, which is trained on 680,000 hours of various languages, of which around 2,000 hours are Swedish. That's 0.3 percent Swedish, explains Leonora Vesterbacka.

The models work well on standard Swedish, but worse on dialects. That's where the Halland dialects, and others who had their dialects recorded, come in.

If someone had told me in the 1980s that the new gold would be an old weird roll of recordings in an archive, I would have thought they were joking.

They also use protocols and recordings from the Riksdag Administration.

They are responsible for recording what is said in the Riksdag and then making it available and releasing protocols. This has been going on for a long time.

In Sweden, we are so good at preserving everything. It's amazing to see that it can be used in the future as well.

Making Available

When the models are fully trained, they can, for example, be used to transcribe medical records and meetings or write subtitles for TV broadcasts. They can also be used to make spoken material, such as podcasts and TV broadcasts from authorities, available.

At Isof, they had not believed that their old dialect recordings would become an important step into the future.

I'm very pleased that our dialect recordings really have such great relevance now, that this is something that can be worked with as part of social development, says Annette C Torensjö.

A dialect is a language variant spoken by the inhabitants of a geographically defined area. It differs from the standard language as well as from adjacent dialects. The differences can concern language features at all levels: phonological, morphological, lexical, and syntactic.

Sociolect, or social dialect, is a language variant that is characteristic of a particular social group. Sociolects are often limited to pronunciation, grammar, and vocabulary, and are also regionally restricted, so that members of the same social class in different parts of a language area vary from each other.

Source: ne.se

Tags

TTT
By TTThis article has been altered and translated by Sweden Herald

More news

Sweden Ends Spruce Bark Beetle
2 MIN READ

Sweden Ends Spruce Bark Beetle Control as Infestation Declines

Drought Shifts Earth's Axis and
3 MIN READ

Drought Shifts Earth's Axis and Raises Sea Levels, Study Finds

Örebro Doctor Sentenced to 7
1 MIN READ

Örebro Doctor Sentenced to 7 Years for Sexual Assaults on Patients

Swedish Journalist's Detention in Turkey
1 MIN READ

Swedish Journalist's Detention in Turkey Raises Legal Concerns

Woman Hospitalized After Villa Fire
1 MIN READ

Woman Hospitalized After Villa Fire Near Älvsbyn

Sölvesborg Man in Custody for
1 MIN READ

Sölvesborg Man in Custody for Alleged Online Child Sex Crimes

Report Highlights High Rates of
1 MIN READ

Report Highlights High Rates of Relationship Violence Among Young Girls

Hedgehogs Reveal High Lead and
1 MIN READ

Hedgehogs Reveal High Lead and Pollutant Levels in Swedish Study

Skåne Region Ends Krys Contract,
1 MIN READ

Skåne Region Ends Krys Contract, Seeks 19 Million Kronor Refund

Summer House Buyers Urged to
3 MIN READ

Summer House Buyers Urged to Consider Climate Risks in Sweden

Truck Collision in Sweden Sparks
1 MIN READ

Truck Collision in Sweden Sparks Drunk Driving Investigation

Kristersson Praises Brandberg's Efforts on
1 MIN READ

Kristersson Praises Brandberg's Efforts on Gender Equality and Safety

Key Leaders Exit as The
2 MIN READ

Key Leaders Exit as The Liberals Face Leadership Changes

Paulina Brandberg Steps Down as
3 MIN READ

Paulina Brandberg Steps Down as Minister to Prioritize Family Life

Virtual Reality Offers New Hope
5 MIN READ

Virtual Reality Offers New Hope for Phantom Pain Relief

Sweden Delays Joining Global Ocean
2 MIN READ

Sweden Delays Joining Global Ocean Protection Treaty

Sweden Allocates 71 Million Kronor
2 MIN READ

Sweden Allocates 71 Million Kronor to Support Helicopter Rescue Services

Social Democrats Propose State Investment
1 MIN READ

Social Democrats Propose State Investment Bank to Boost Growth

Green Party Proposes Emissions Trading
2 MIN READ

Green Party Proposes Emissions Trading to Replace Reduction Obligation

Västra Götaland Director Steps Down
1 MIN READ

Västra Götaland Director Steps Down After Journal System Setback

Sweden Unveils Largest Military Aid
2 MIN READ

Sweden Unveils Largest Military Aid Package to Ukraine

Sweden Boosts Workplace Inspections to
2 MIN READ

Sweden Boosts Workplace Inspections to Combat Rising Crime

Man Faces Charges for Online
1 MIN READ

Man Faces Charges for Online Child Sexual Offenses in Sweden

Man Sentenced to Psychiatric Care
3 MIN READ

Man Sentenced to Psychiatric Care for Ica Maxi Employee Murder

Sweden Prioritizes Journalist's Release After
2 MIN READ

Sweden Prioritizes Journalist's Release After Arrest in Turkey

Rise in Children Contacting Bris
1 MIN READ

Rise in Children Contacting Bris About Eating Disorders Concerns Experts

Sweden Sees Lowest Deadly Violence
2 MIN READ

Sweden Sees Lowest Deadly Violence Cases in a Decade

New Tool Empowers Parents to
1 MIN READ

New Tool Empowers Parents to Combat Online Grooming Risks

Elderly Man's Death in Ale
1 MIN READ

Elderly Man's Death in Ale Sparks Murder Investigation

Prince Carl Philip's Secret Alias
1 MIN READ

Prince Carl Philip's Secret Alias Exposed in Sportadmin Data Breach

Child Abuse Images Discovered on
1 MIN READ

Child Abuse Images Discovered on Computer at Swedish Repair Shop

Explosion Rocks Trollhättan Apartment Building,
1 MIN READ

Explosion Rocks Trollhättan Apartment Building, No Injuries Reported

Teenager Seriously Injured in Highway
1 MIN READ

Teenager Seriously Injured in Highway Collision with A-Tractor

Swedish Journalist Joakim Medin Moved
1 MIN READ

Swedish Journalist Joakim Medin Moved to High-Security Turkish Prison

SMHI Warns of High Grass
1 MIN READ

SMHI Warns of High Grass Fire Risk in Sweden's Snow-Free Regions

Swedish Journalist Joakim Medin Arrested
1 MIN READ

Swedish Journalist Joakim Medin Arrested in Turkey, Press Freedom at Risk

Man in His 30s Found
1 MIN READ

Man in His 30s Found Dead Outdoors in Norrköping; Murder Investigation Launched

Police Car and Fire Truck
1 MIN READ

Police Car and Fire Truck Crash on E4 Injures Officers

Sweden Prioritizes Journalist's Release After
2 MIN READ

Sweden Prioritizes Journalist's Release After Arrest in Turkey

Europol Looks to Sweden for
2 MIN READ

Europol Looks to Sweden for Tackling Digital Gang Crime