People likely to believe AI-generated tweets: Study

New Delhi People appear to find tweets written by artificial intelligence (AI) language models more convincing than those created by humans, a new study has shown. According to the study published in Science Advances, disinformation generated by AI may be more convincing than disinformation written by humans.

To achieve the goals, the researchers asked OpenAI’s model GPT-3 to write tweets containing informative or disinformative texts on a range of different topics, including vaccines, 5G technology and Covid-19, or the theory of evolution, among others, which are commonly subject to disinformation and public misconception. They collected a set of real tweets written by users on the same topics and programmed a survey.

The researchers then recruited 697 people to take an online quiz that determined whether tweets were generated by AI or collected from Twitter and whether they were accurate or contained misinformation. They discovered that participants were three per cent less likely to believe human-written false tweets than AI-written ones.

According to Giovanni Spitale, the researcher at the Switzerland-based University of Zurich who led the study, the researchers are unsure why people are more likely to believe tweets written by AI, but the way GPT-3 orders information could play a role. Moreover, the study said that the content written by GPT-3 was "indistinguishable" from organic content.

People polled couldn't tell the difference, and one of the study's limitations is that the researchers cannot be 100 per cent certain that the tweets gathered from social media were not written with the assistance of apps like ChatGPT. Participants were the most effective at identifying misinformation written by real Twitter users, however, GPT-3-generated tweets with false information deceived survey participants slightly more effectively, the study found.