That acceleration comes at a time when the U.S. government is pulling back on efforts to debunk and raise awareness about influence campaigns.
At least one China-based technology company, GoLaxy, seems to be using generative AI to build influence operations in Taiwan and Hong Kong, according to internal documents leaked to researchers at Vanderbilt University’s Institute of National Security.
* Documents detailed how GoLaxy appears to be tapping generative AI to mine social media profiles and create content that “feels authentic, adapts in real-time and avoids detection,” the researchers wrote in a New York Times opinion piece.
* Using tools including DeepSeek’s open-source reasoning model, GoLaxy created synthetic personas that can adapt their messaging to cater to certain audiences, and can also mimic real people.
* GoLaxy — which operates in close alignment with the Chinese government’s interests — allegedly used these personas in the lead-up to the 2024 Taiwanese election and to rebut opposition to the 2020 national security law that ended Hong Kong’s autonomy.
Documents also show that GoLaxy has created profiles for at least 117 members of Congress and over 2,000 American political figures and thought leaders.”
Recidivous on
I’m not surprised at all.
You already see a lot of posts here on Reddit that were generated by an AI, and a lot of them have some lean to them. Social media is becoming an empty space where it’s beginning to become hard to tell if the person you’re interacting with is an actual person.
It’s a mess.
ES_Legman on
AI is supercharging every nutjob out there and thinking they are super geniuses because they don’t understand how the LLMs work and the bots built to agree with you and get your attention and engagement. It’s sickening the amount of wackadoos out there pushing out thousands of lines of garbage code or thinking they are reinventing science. Every science forum now is riddled with LLM infused nonsense.
star-apple on
It’s not surprising as well that those adversary countries have an intranet and they try cutting the outside world on accessing their internet. For obvious reasons: “Wary of tasting their own medicine”
Justsomejerkonline on
If things like Reddit and Twitter are in the data sets, then they are inevitably going to end up with a lot of disinformation. Not all data is good data, and I am extremely skeptical that the corporations making these LLMs have been particularly diligent about ensuring the quality of the data they stole to train their models.
SyrsaTheSovereign on
Big shocker. Wonder why they’re pushing so much AI despite that new study showing 95% of them lose their millions of dollars, and the slightly less new study showing how they’re all getting dementia.
Dementia addled loser-bots, but they can oppress us all the same! Honestly not that much different than our current oppressors, if you think about it
6 Comments
“The world of [AI](https://archive.is/o/HfNfK/https://www.axios.com/technology/automation-and-ai)-generated, adversarial disinformation is growing rapidly — and it’s already indistinguishable from run-of-the-mill social posts.
That acceleration comes at a time when the U.S. government is pulling back on efforts to debunk and raise awareness about influence campaigns.
At least one China-based technology company, GoLaxy, seems to be using generative AI to build influence operations in Taiwan and Hong Kong, according to internal documents leaked to researchers at Vanderbilt University’s Institute of National Security.
* Documents detailed how GoLaxy appears to be tapping generative AI to mine social media profiles and create content that “feels authentic, adapts in real-time and avoids detection,” the researchers wrote in a New York Times opinion piece.
* Using tools including DeepSeek’s open-source reasoning model, GoLaxy created synthetic personas that can adapt their messaging to cater to certain audiences, and can also mimic real people.
* GoLaxy — which operates in close alignment with the Chinese government’s interests — allegedly used these personas in the lead-up to the 2024 Taiwanese election and to rebut opposition to the 2020 national security law that ended Hong Kong’s autonomy.
Documents also show that GoLaxy has created profiles for at least 117 members of Congress and over 2,000 American political figures and thought leaders.”
I’m not surprised at all.
You already see a lot of posts here on Reddit that were generated by an AI, and a lot of them have some lean to them. Social media is becoming an empty space where it’s beginning to become hard to tell if the person you’re interacting with is an actual person.
It’s a mess.
AI is supercharging every nutjob out there and thinking they are super geniuses because they don’t understand how the LLMs work and the bots built to agree with you and get your attention and engagement. It’s sickening the amount of wackadoos out there pushing out thousands of lines of garbage code or thinking they are reinventing science. Every science forum now is riddled with LLM infused nonsense.
It’s not surprising as well that those adversary countries have an intranet and they try cutting the outside world on accessing their internet. For obvious reasons: “Wary of tasting their own medicine”
If things like Reddit and Twitter are in the data sets, then they are inevitably going to end up with a lot of disinformation. Not all data is good data, and I am extremely skeptical that the corporations making these LLMs have been particularly diligent about ensuring the quality of the data they stole to train their models.
Big shocker. Wonder why they’re pushing so much AI despite that new study showing 95% of them lose their millions of dollars, and the slightly less new study showing how they’re all getting dementia.
Dementia addled loser-bots, but they can oppress us all the same! Honestly not that much different than our current oppressors, if you think about it