Stop AI-driven character assassination on YouTube (KOR)

Kim Se-ui, head of the YouTube channel Garosero Research Institute, who is accused of spreading false information, arrives at the Seoul Central District Court in Seocho District, southern Seoul, on May 26 to attend a pretrial detention hearing. [YONHAP] Kim Se-ui, head of the YouTube channel HoverLab, was detained on Tuesday on charges of spreading false claims that actor Kim Soo-hyun pressured the late actor Kim Sae-ron over debt repayment, allegedly contributing to her death in February of last year. The Seoul Central District Court approved the arrest warrant. Before appearing in court, the YouTube channel runner insisted that the allegations were “filled with obvious falsehoods.” The court nevertheless appears to have determined that a substantial portion of the accusations had merit. According to the Gangnam Police Station in Seoul, which has investigated the case for more than a year, Kim Se-ui spread claims through YouTube and other platforms that Kim Soo-hyun had dated the actor while she was a minor and that financial pressure from the actor’s side contributed to her death. Investigators also allege that AI technology was used to manipulate the actress’s voice and fabricate KakaoTalk conversations. The possibility that AI tools were used to create material difficult for the public to distinguish from reality is especially alarming. If the allegations outlined by police are accurate, the case represents not merely malicious misinformation but what many would describe as “character assassination.” As demonstrated by the damage allegedly inflicted on Kim Soo-hyun, sensational accusations generate explosive public attention and enormous online traffic. YouTube channels can reap substantial advertising revenue in the process. Yet for those targeted, the consequences can be devastating, undermining their mental well-being, public reputation and professional livelihood. Related Article Prosecutors indict Hoverlab operator Kim Se-ui on charges to stalking, threatening Tzuyang Kim Soo-hyun files additional charges against Kim Sae-ron's family, Hoverlab YouTuber Cops intervene in Hoverlab livestream about Kim Soo-hyun Kim Soo-hyun adds to suits against Hoverlab, Kim Sae-ron's family Such conduct is hardly new. So-called cyber wreckers, a Korean term describing online channels that profit from scandal-driven content, have repeatedly manipulated stories about celebrities or spread unverified rumors to maximize views and revenue. In some cases, operators have secretly filmed celebrities’ private lives and attempted extortion. The practice of repackaging tragedy and gossip into monetized online entertainment has long crossed ethical boundaries. Despite YouTube’s growing influence, often rivaling that of traditional media, mechanisms for verifying truth remain dangerously weak. The platform’s recommendation algorithms reward provocative content because outrage and controversy drive clicks and advertising income. At the same time, regulatory oversight remains insufficient. The case also highlights broader concerns surrounding generative AI technology. Deepfake audio, fabricated messages and manipulated video can now spread rapidly before facts are verified. Once false information circulates online, the reputational damage is often irreversible even if later disproven. That is why stronger safeguards against the harms associated with YouTube and AI-driven misinformation are urgently needed. Korea has repeatedly debated measures to address the social damage caused by online rumor channels, but meaningful regulation has lagged behind the speed of technological change. AI 악용한 유튜브의 ‘인격 살인’, 방지책 시급하다 유튜브 채널 가로세로연구소 김세의 대표가 2025년 2월 숨진 여배우 김모씨 사망 원인이 배우 김수현의 채무 압박 때문이라는 허위 내용을 유포한 혐의 등으로 26일 구속됐다. 서울중앙지법은 “증거를 인멸하고 도망할 염려가 있다”며 구속영장을 발부했다. 앞서 김 대표는 법원에 출석하면서 “(영장은) 명백한 허위 사실의 범벅”이라고 주장했다. 1년 이상 이 사건을 수사해 온 서울 강남경찰서에 따르면 김 대표는 김수현씨가 미성년자였던 여배우와 교제했다고 폭로하고, 여배우가 사망한 원인이 김수현 측의 채무 변제 압박이라고 유튜브 등을 통해 유포한 혐의를 받고 있다. 특히 인공지능(AI) 기술 등을 이용해 여배우의 음성을 조작하고, 실제론 두 사람이 주고받지 않았던 카카오톡 대화를 사실인 것처럼 편집해 명예를 훼손한 혐의도 받고 있다. 진위 구분이 쉽지 않아 대중에게 혼란과 사실 오인을 초래하는 AI까지 동원했다니 충격적이다. 경찰이 제시한 혐의대로라면 악의적인 사실 왜곡이자 심지어 ‘인격 살인’이라 비난받을 수 있는 범죄다. 이번 사례에서 보듯 자극적 의혹이 폭로되면 대중은 폭발적 관심을 보이니 유튜브는 큰 수익을 챙길 수 있다. 하지만 그 과정에서 당사자는 정신적·사회적·직업적 생존 기반이 무너지는 타격을 받는다. 유튜브 채널들의 이런 불법적 행태는 처음이 아니다. 이른바 ‘사이버 레커’로 불리는 채널들은 돈벌이에 직결되는 조회수를 노리고 유명 연예인의 사생활을 조작하거나 확인되지 않은 루머를 퍼뜨려 왔다. 유명인의 사생활을 불법 촬영한 뒤 금품 갈취를 시도하는 사례도 흔하다. 타인의 비극이나 가십을 짜깁기해서 유튜브로 유포함으로써 정신적 고통을 가하는 사례는 이미 한참 선을 넘었다. 유튜브가 유사 언론처럼 영향력이 막강해졌는데도 진실 검증 장치는 취약하다. 수익 창출을 위해 알고리즘으로 자극적인 콘텐트를 쏟아내지만, 규제 사각지대에 방치돼 있다. 그동안 수차례 지적해 온 유튜브의 폐해 방지 대책이 시급하고 절실한 이유다. This article was originally written in Korean and translated by a bilingual reporter with the help of generative AI tools. It was then edited by a native English-speaking editor. All AI-assisted translations are reviewed and refined by our newsroom.