A man who allegedly used ChatGPT to generate news about a fake train crash has been detained in China, marking the country’s first known arrest in connection with the use of the AI chatbot.
Authorities in Pingliang, Gansu province, first noticed the fabricated news on April 25, according to local reports. It stated that a train accidentally went off the rails and hit an ongoing road construction, killing nine people.
Investigation revealed that 21 accounts on Baijiahao, a blogging platform run by Baidu — China’s version of Google — simultaneously posted the false news. They collectively received at least 15,000 clicks before police took notice.
The probe zeroed in on Hong Moudi, a legal representative of a Shenzhen-based company that operated personal media platforms, according to Sing Tao Daily.
He reportedly confessed to using ChatGPT to produce the fake news and bypassing Baijiahao’s anti-duplication system to disseminate the story on multiple accounts, making illegal profits from web traffic.
ChatGPT is unavailable in China and is accessed only via VPNs.
Hong’s arrest marks the first time China detained a suspect in connection with provisions announced in January that regulated the use of “deepfake” technology, HKET noted.
Hong is reportedly facing a charge of “picking quarrels and provoking trouble,” which normally carries a maximum penalty of five years. However, severe cases can carry up to 10 years, as per the South China Morning Post.
“He made profits by making up news and cheating traffic. He deserves to be severely punished,” one Weibo user commented.
Investigation into the case continues.
