Child safety org flags new CSAM with AI trained on real child sex abuse images
arstechnica.com
AI will make it harder to spread CSAM online, child safety org says.

Today, a prominent child safety organization, Thorn, in partnership with a leading cloud-based AI solutions provider, Hive, announced the release of an AI model designed to flag unknown CSAM at upload. It’s the earliest AI technology striving to expose unreported CSAM at scale.

  • AwesomeLowlander@sh.itjust.worksEnglish
    22·
    2 days ago

    “detect new or previously unreported CSAM and child sexual exploitation behavior (CSE), generating a risk score to make human decisions easier and faster.”

    False positives don’t matter if they stick to the stated intended purpose of making it easier to detect CSAM manually.

    • Voroxpete@sh.itjust.worksEnglish
      8·
      2 days ago

      The problem is that they won’t.

      Yes, AI tools, in the hands of skilled people, can be very helpful.

      But “AI” in capitalism doesn’t mean “more effective workers”, it means “fewer workers.” The issue isn’t technological so much as cultural. You fundamentally cannot convince an MBA not to try to automate away jobs.

      • AwesomeLowlander@sh.itjust.worksEnglish
        0·
        2 days ago

        Here’s the thing. This technology is unequivocally one of the things AI would be very useful for. It can potentially do a lot of good. Yes, MBAs could screw it up like they screw anything else up in society. That doesn’t mean we shouldn’t be happy that we’ve created this new tech.