Tiktok: Algorithm and Trends Endanger Young Users

TikTok, the ubiquitous short-form video platform, has rapidly become a cultural phenomenon, captivating billions of users worldwide. Yet, beneath the surface of viral dances and catchy tunes lies a darker reality. A growing body of evidence suggests that TikTok’s relentless pursuit of user engagement, coupled with potentially harmful trends, is contributing to mental health issues, encouraging self-harm, and even leading to tragic outcomes for vulnerable young users. This article will delve into the ways TikTok’s algorithms and trends can be detrimental, the alarming prevalence of underage users on the platform, and the urgent need for greater accountability and safer online practices.

The Algorithm’s Dark Side: Feeding Self-Harm and Suicidal Ideation

TikTok’s algorithm is notoriously effective at curating personalized content feeds, designed to keep users scrolling for hours. While this might seem innocuous, research has revealed a disturbing trend: the algorithm can quickly lead vulnerable users down a rabbit hole of content promoting self-harm, suicidal ideation, and eating disorders.

A recent study conducted by a human rights organization, using automated accounts posing as 13-year-olds, demonstrated how easily the algorithm can expose young users to harmful content. Within hours of expressing initial interest in topics related to mental health struggles, these accounts were bombarded with videos glorifying self-harm, offering dangerous weight loss tips, and promoting pro-anorexia communities. This rapid escalation highlights the algorithm’s potential to exacerbate existing mental health concerns and even introduce harmful ideas to impressionable young minds.

The study, titled “Driven into the Darkness: How TikTok Encourages Self-harm and Suicidal Ideation,” underscores the platform’s failure to adequately protect its users from harmful content, particularly those who are already struggling with mental health challenges. The report also highlights the pervasive data collection practices that underpin the algorithm, raising concerns about privacy and the potential for manipulation.

“I feel Exposed”: The Surveillance Web and its Harmful Consequences

The addictive nature of TikTok is fueled by its sophisticated data collection practices. As detailed in the report “I feel Exposed”: Caught in TikTok’s Surveillance Web, the platform gathers vast amounts of user data, including browsing history, location information, and even biometric data. This data is then used to fine-tune the algorithm and serve users increasingly personalized, and potentially harmful, content.

The feeling of being constantly monitored and analyzed can be particularly detrimental to young users, who are already navigating the complexities of adolescence and identity formation. The pressure to conform to trends, maintain a perfect online persona, and constantly seek validation through likes and comments can contribute to anxiety, depression, and body image issues.

Furthermore, the lack of transparency surrounding TikTok’s data collection practices raises serious ethical concerns. Many users, particularly young children, are unaware of the extent to which their data is being collected, stored, and used. This lack of informed consent undermines their autonomy and leaves them vulnerable to manipulation and exploitation.

Underage Users: A Hidden Crisis

Despite TikTok’s official age restriction of 13, a significant number of younger children are using the platform. A recent study from UC San Francisco found that a majority of 11- and 12-year-olds have accounts on TikTok and other social media platforms, with a concerning percentage hiding their activity from their parents.

This widespread violation of age restrictions presents a significant safety risk. Younger children are less equipped to critically evaluate online content and are more susceptible to the negative influences of harmful trends and online predators. Their developing brains are also more vulnerable to the addictive nature of social media, potentially leading to long-term mental health consequences.

The presence of underage users on TikTok also creates a challenge for content moderation. It is difficult for the platform to effectively filter out harmful content and ensure the safety of all users when a significant portion of the user base is below the designated age threshold.

Dangerous Trends: From Blackout Challenges to Chromebook Sabotage

Beyond the algorithmic amplification of harmful content, TikTok is also plagued by dangerous trends that can have devastating consequences. The “blackout challenge,” which encourages users to intentionally choke themselves until they lose consciousness, has been linked to multiple deaths and serious injuries. Parents of teenagers in the UK are currently suing TikTok and its parent company ByteDance, blaming the platform for their children’s deaths after participating in this dangerous challenge.

Another alarming trend, the “Superman” challenge, has resulted in numerous hospitalizations in Israel after children sustained severe injuries attempting to mimic the superhero’s flight. These trends highlight the power of social contagion and the potential for viral challenges to spread rapidly, particularly among impressionable young users.

Trends can have unintended consequences. The recent “Chromebook challenge,” which involved users jamming a paperclip into a port on their Chromebook, caused damage to devices and prompted warnings from school officials and tech experts. While TikTok has blocked search terms related to this challenge, the incident underscores the need for greater awareness and responsible online behavior.

The Need for Accountability and Change

The issues highlighted above demand a multi-faceted approach involving platforms, parents, educators, and policymakers.

• Platform Accountability: TikTok and other social media companies must take greater responsibility for the content shared on their platforms and the algorithms that curate it. This includes investing in more robust content moderation strategies, increasing transparency about data collection practices, and implementing age verification measures to prevent underage users from accessing the platform.
• Parental Involvement: Parents play a crucial role in educating their children about online safety and monitoring their social media activity. Open communication, setting clear boundaries, and utilizing parental control tools can help protect children from harmful content and online predators.
• Educational Initiatives: Schools and community organizations should implement educational programs that teach children about digital literacy, critical thinking skills, and responsible online behavior. These programs should address issues such as cyberbullying, online privacy, and the impact of social media on mental health.
• Policy and Regulation: Governments should consider implementing regulations that hold social media companies accountable for the safety of their users, particularly children. This may include measures such as mandating age verification, requiring transparency about algorithms, and establishing independent oversight bodies to monitor platform practices.

Conclusion

TikTok has become an integral part of the digital lives of many young people, offering opportunities for creativity, connection, and entertainment. However, the platform’s addictive algorithm, intrusive data collection practices, and viral trends can also have devastating consequences. By understanding the risks and taking proactive steps to protect vulnerable users, we can work towards creating a safer and more responsible online environment for all. It is crucial to acknowledge that the pursuit of engagement and profit should never come at the expense of the mental health and well-being of young people who are, often unknowingly, navigating a digital landscape fraught with potential dangers. Only through a concerted effort involving platforms, parents, educators, and regulators can we hope to mitigate the risks and harness the positive potential of social media for future generations.