Global outrage as X’s Grok morphs photos of women, children into explicit content

https://www.cnbctv18.com/technology/global-outrage-as-xs-grok-morphs-photos-of-women-children-into-explicit-content-19811130.htm

34 Comments

  1. watcherofworld on

    The plutocracy is so fucking dumb, truly, it’s astounding that this stuff isn’t opposed en mass/boycotted.

  2. Republicans and the far-right seem to attract a lot of pedophile supporters and *now* even an AI created by a far-right person is producing pedophilic content on its own.

  3. Ash-Throwaway-816 on

    Is it really surprising that AI has such a bad reputation when most people’s knowledge of it is that it’s a machine that turns an unholy amount of fresh water into minstrel shows and CP?

  4. No-Good-One-Shoe on

    Weird that the platform purchased by a pedophilic Nazi is full of pedophilic Nazis. What a shit hole of a service twitter has become.

  5. AcanthaceaeUpbeat638 on

    Delete all photos of yourself and your loved ones off of X and all social media. Private all of your accounts. Don’t post full body pics.

  6. Worth quoting this part:

    >Cyber-safety specialists and gender-rights advocates say the morphing of images using AI amounts to a form of sexual violence, particularly when it involves women and children. They argue that such acts violate dignity, bodily autonomy, and consent, and can cause severe psychological trauma to victims whose images are weaponised without their knowledge.

    Users reading the headline are assuming it’s only happening with women and children. It’s not, but the concern is over how it’s being used specifically for women and children. The technology is actually being used this way against everyone though, showing a total lack of effective guardrails.

  7. Is this just happening in India? Not sure why those are the only sources. Regardless, AI CSAM is CSAM according to the US government in case anyone here is thinking of fucking around with this themselves.

    Edit: and btw I mean even actively searching for it and viewing it “just for research”

  8. For a person that suppose to be smart, he should see from a galaxy far away what would happen if you add option to edit images on site full of porn and gooners…..

  9. This is horrifying as a parent. 

    Parents really need to check and protect their kids’ privacy right now. 

    Is there any safe internet or tech these days? Exhausting. 

  10. Knowing the rat in charge of that site, I wouldn’t be surprised if he posts the Back to the Future “I guess you guys aren’t ready for that yet.” meme to play all of this off like a cheeky little joke.

  11. Mysterious_Web7517 on

    Well at least there is hope it will sparkle more talks for privacy, sharenting and fighting deepfakes especially nowdays.

  12. fluffy_khajiit on

    Sadly, I tried to find info about this on this reddit yesterday and searching “grok” or “AI deepfakes” led to only NSFW AI posts, nothing talking about this huge and disturbing story until now, not really surprised just very disappointed.

  13. I imagine the GOP will want this feature to remain so they can create libelous images of their political enemies.

  14. apple_tech_admin on

    People are surprised? Musk literally did everything he could to get the current POTUS (pedophile of the United States) elected and people are outraged by this? America is so performative.

  15. Ah, yes. Something that was created by the guy who was best friends with Epstein and Maxwell. Who would have that this would happen?

  16. Wait wasn’t this AI stuff supposed to help cure cancer seems all it does is make slop content and deep fake porn.

  17. DonutsMcKenzie on

    Listen… I have my problems with Reddit, and arguably I should switch to some of the better and more socially healthy alternatives like Lemmy at the very least…

    But when it comes to “X.com”, I straight-up can’t believe people are still using that website today.

  18. I think we all know literally nothing will come of this, but since this thread seems to be catching attention, I’m going to use it to promote some excellent content:

    [Combatting AI-Generated CSAM – from The Wilson Center](https://www.wilsoncenter.org/article/combatting-ai-generated-csam)
    An overview of the current challenges and complexities

    [Identifying and Eliminating CSAM in Generative ML Training Data and Models – Stanford](https://stacks.stanford.edu/file/druid:kh752sm9123/ml_training_data_csam_report-2023-12-23.pdf) (opens a PDF)

    [Safety by Design for Generative AI: Preventing Child Sexual Abuse – Thorn](https://info.thorn.org/hubfs/thorn-safety-by-design-for-generative-AI.pdf) (opens a PDF)

    And maybe consider throwing a few bucks to the [National Center for Missing and Exploited Children (NCMEC)](https://www.missingkids.org/home), whose work is made exponentially more difficult because of all this

  19. black_metronome on

    A year ago millions of Americans thought that this shit was cool despite the fact that the men behind all of this are a bunch of sadistic pedophiles.

  20. turb0_encapsulator on

    seems like whoever owns that should be held criminally liable since there are laws about this.

  21. At a certain point, this is on the people still on twitter. It’s fucked, it’s crazy, it’s obvious. Of course this is going to happen. This isn’t on Elon and his geek squad anymore. If you’re still on twitter, you’re apart of the problem.