SwedenLivingWorld world_2_fill WorldBusiness BusinessSports sports-soccer SportsEntertainmentEntertain

Old dialects are gold worth for AI

How can some Halland guys make AI technology better? When American speech-to-text models are to learn Swedish, old dialect recordings have proven to be a goldmine.

» Published: 12 October 2024

Old dialects are gold worth for AI
Photo: Uppsala universitet

At the Institute for Language and Folk Culture (Isof), they have worked extensively with dialect collection, primarily between 1935 and 1970, when researchers traveled around the country recording how people spoke.

The initial purpose was largely to preserve traditional dialects, explains Annette C Torensjö, head of the Department of Archives and Research in Uppsala at Isof.

The recordings were used for many years mainly by researchers, but last year, the KB-Lab at the Royal Library got in touch. Leonora Vesterbacka is a senior data scientist and leads a project to train speech-to-text models, which "translate" speech into written text.

A Small Part of Swedish

American AI models are often trained on massive multilingualism, and then the Swedish part becomes very small.

There is a model from Open AI called Whisper, which is trained on 680,000 hours of various languages, of which around 2,000 hours are Swedish. That's 0.3 percent Swedish, explains Leonora Vesterbacka.

The models work well on standard Swedish, but worse on dialects. That's where the Halland dialects, and others who had their dialects recorded, come in.

If someone had told me in the 1980s that the new gold would be an old weird roll of recordings in an archive, I would have thought they were joking.

They also use protocols and recordings from the Riksdag Administration.

They are responsible for recording what is said in the Riksdag and then making it available and releasing protocols. This has been going on for a long time.

In Sweden, we are so good at preserving everything. It's amazing to see that it can be used in the future as well.

Making Available

When the models are fully trained, they can, for example, be used to transcribe medical records and meetings or write subtitles for TV broadcasts. They can also be used to make spoken material, such as podcasts and TV broadcasts from authorities, available.

At Isof, they had not believed that their old dialect recordings would become an important step into the future.

I'm very pleased that our dialect recordings really have such great relevance now, that this is something that can be worked with as part of social development, says Annette C Torensjö.

A dialect is a language variant spoken by the inhabitants of a geographically defined area. It differs from the standard language as well as from adjacent dialects. The differences can concern language features at all levels: phonological, morphological, lexical, and syntactic.

Sociolect, or social dialect, is a language variant that is characteristic of a particular social group. Sociolects are often limited to pronunciation, grammar, and vocabulary, and are also regionally restricted, so that members of the same social class in different parts of a language area vary from each other.

Source: ne.se

Tags
TTT
By TTThis article has been altered and translated by Sweden Herald

More news

Housebreaking Decreases – but Few are Cleared Up
1 MIN READ

Housebreaking Decreases – but Few are Cleared Up

Man dies after fall into hole
1 MIN READ

Man dies after fall into hole

City of Stockholm Reports Crisis to the Police and Withdraws Grants
1 MIN READ

City of Stockholm Reports Crisis to the Police and Withdraws Grants

The Minister on Porn Ban: Not the Only Way
2 MIN READ

The Minister on Porn Ban: Not the Only Way

Report: Sweden lacks legislation against AI-pornography
2 MIN READ

Report: Sweden lacks legislation against AI-pornography

The Snowstorm is on its way – half a meter expected
2 MIN READ

The Snowstorm is on its way – half a meter expected

Spanish storms – but the Swede dreams of tapas
2 MIN READ

Spanish storms – but the Swede dreams of tapas

Man found unconscious in hole - taken to hospital
1 MIN READ

Man found unconscious in hole - taken to hospital

Opposition takes the lead – but the gap narrows
2 MIN READ

Opposition takes the lead – but the gap narrows

From Start to Crash in Three Days
2 MIN READ

From Start to Crash in Three Days

Region Top: Millennium Didn't Go Well
2 MIN READ

Region Top: Millennium Didn't Go Well

Researchers: With High Probability, Russian Sabotage
2 MIN READ

Researchers: With High Probability, Russian Sabotage

Cable Break in the Baltic Sea May Be Sabotage
2 MIN READ

Cable Break in the Baltic Sea May Be Sabotage

Criticized Journal System May Be Delayed
2 MIN READ

Criticized Journal System May Be Delayed

Verdict on deceived berry pickers appealed to the Supreme Court
1 MIN READ

Verdict on deceived berry pickers appealed to the Supreme Court

Teenagers traveled to Växjö to kill – sentenced
1 MIN READ

Teenagers traveled to Växjö to kill – sentenced

The Green Party reports Ebba Busch to the Constitutional Committee
1 MIN READ

The Green Party reports Ebba Busch to the Constitutional Committee

Investigation into balcony collapse dropped
1 MIN READ

Investigation into balcony collapse dropped

Car drove into watercourse – woman found dead
1 MIN READ

Car drove into watercourse – woman found dead

Charge for pub shooting – one seriously injured
2 MIN READ

Charge for pub shooting – one seriously injured