The Danish organization Digitalt ansvar recently conducted a study to test whether Instagram flags or automatically removes content that encourages self-harm. To test the platform, ten accounts were created, half of which were stated to be over 18 years old, and half under. Over four weeks, the ten accounts shared 85 posts with self-harm content. None of the posts were removed by Instagram.
It is in stark contrast to Instagram's claim that they use AI to remove such material in advance, says Hesby Holm, head of Digitalt ansvar.
Used own AI
The five profiles that were stated to be under 18 years old were not moderated in any way by Instagram, according to Digitalt ansvar. None of the ten profiles were flagged for violating Instagram's user terms.
Digitalt ansvar used its own AI to see if it was possible to flag the material. According to the organization, the AI they used could identify 38 percent of all shared material as harmful. 88 percent of the most harmful material shared was flagged by the AI used by Digitalt ansvar.
"Removes"
To the British The Guardian, which has highlighted the study, a spokesperson for Meta (Instagram's owner) says:
"Content that encourages self-harm behavior violates our policy and we remove that type of content when we discover it. During the first half of 2024, we removed more than 12 million shares related to suicide or self-harm on Instagram, 99 percent of which were taken down proactively."
In acute situations or when thinking of suicide, always call 112.
You can turn to the following if you're feeling unwell:
Mind.se.
Suicide Zero – suicidezero.se.
Spes – the national association for suicide prevention and aftercare support. spes.se.
BRIS – children's rights in society. bris.se.
Rädda Barnen – raddabarnen.se. Also for parents.
Jourhavande kompis – receives calls from children and young people up to 25 years old. jourhavandekompis.se.
Jourhavande medmänniska – can be reached at night on 08–702 16 80.
Friends – friends.se.
1177 – healthcare guidance and information on the nearest psychiatric emergency department. 1177.se
