Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Technology
  3. Kids are making deepfakes of each other, and laws aren’t keeping up

Kids are making deepfakes of each other, and laws aren’t keeping up

Scheduled Pinned Locked Moved Technology
technology
172 Posts 77 Posters 1 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • ladyautumn@lemmy.blahaj.zoneL [email protected]

    No an image that is shared and distributed is not the same as a fantasy in someone's head. That is deranged. Should CSAM also be legal because making it illegal is like criminalizing the fantasies of pedophiles? Absolutely insane logical framework you have there.

    This isnt fantasy. It is content. It is media. It is material. It is produced without the consent of the girls and women being sexualized and it commodifies their existence, literally transforming the idea of them into sexual media consumed for the gratification of boys and men.

    It is genuinely incredible to me that you could be so unempathetic, so impassive, so detached from the real world and the consequences of this, that you could even make this comparison. You have seemingly no idea what youre talking about if you believe that pornography is the same thing as mental fantasies.

    And even in the case of mental fantasies, are those all good? Is it really a good thing that boys see the mere existence of the girls around them as inherently some kind of sexual availability?

    F This user is from outside of this forum
    F This user is from outside of this forum
    [email protected]
    wrote last edited by
    #52

    When someone makes child porn they put a child in a sexual situation - which is something that we have amassed a pile of evidence is extremely harmful to the child.

    For all you have said - "without the consent" - "being sexualised" - "commodifies their existence" - you haven't told us what the harm is. If you think those things are in and of themselves harmful then I need to know more about what you mean because:

    1. if someone thinks of me sexually without my consent I am not harmed
    2. if someone sexualises me in their mind I am not harmed
    3. I don't know what the "commodification of one's existence" can actually mean - I can't buy or sell "the existence of women" (does buying something's existence mean the same as buying the thing, or something else?) the same I can aluminium, and I don't see how being able to (easily) make (realistic) nude images of someone changes this in any way

    It is genuinely incredible to me that you could be so unempathetic,

    I am not unempathetic, but I attribute the blame for what makes me feel bad about the situation is that girls are being made to feel bad and ashamed not that a particular technology is now being used in one step of that.

    atomicorange@lemmy.worldA ladyautumn@lemmy.blahaj.zoneL 2 Replies Last reply
    5
    • M [email protected]

      So is this a way to take away rights by making it about kids?

      I mean what the fuck. We did much less and got punished right? It didn't matter if we were on the property. Schools can hold students accountable for conduct with other students.

      The leaded-gas adults of the time had no problem dealing with the emergence of cell phones. It was a distraction. They didn't need lawmakers to call it something specific. My Pokemon cards caused fights and were banned. No lawmakers needed.

      The problem is surely with the interaction between parents and schools. Or maybe it's just the old way of thinking. Maybe it's better to have police and courts start taking over discipline in schools.

      C This user is from outside of this forum
      C This user is from outside of this forum
      [email protected]
      wrote last edited by
      #53

      All your examples are of things that were stopped while at school, so your argument doesn't really carry over. You still had your pokemon cards everywhere else.

      1 Reply Last reply
      0
      • P [email protected]

        Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

        L This user is from outside of this forum
        L This user is from outside of this forum
        [email protected]
        wrote last edited by
        #54

        Instead of laws keeping up It also might turn out to be a case where culture keeps up.

        1 Reply Last reply
        1
        • E [email protected]

          My mama always told me, that if someone makes a deepfake of you, then you make a deepfake of them right back!

          L This user is from outside of this forum
          L This user is from outside of this forum
          [email protected]
          wrote last edited by
          #55

          Thanks, cap'n.

          1 Reply Last reply
          0
          • S [email protected]

            A 99-1 vote to drop the anti AI regulation is hardly the government voting against. The Senate smashed that shit hard and fast.

            L This user is from outside of this forum
            L This user is from outside of this forum
            [email protected]
            wrote last edited by [email protected]
            #56

            Expecting people to know about that 99-1 vote might be misplaced optimism, since it hasn't been made into a meme yet.

            a_wild_mimic_appears@lemmy.dbzer0.comA 1 Reply Last reply
            5
            • E [email protected]

              My mama always told me, that if someone makes a deepfake of you, then you make a deepfake of them right back!

              D This user is from outside of this forum
              D This user is from outside of this forum
              [email protected]
              wrote last edited by
              #57

              this advice might get you locked up

              E 1 Reply Last reply
              0
              • E [email protected]

                My mama always told me, that if someone makes a deepfake of you, then you make a deepfake of them right back!

                L This user is from outside of this forum
                L This user is from outside of this forum
                [email protected]
                wrote last edited by
                #58

                In the bible, it says, and I quote: "If a deepkfake of you is made, you shall give the creator more material to create deepfakes"

                kolanaki@pawb.socialK 1 Reply Last reply
                4
                • P [email protected]

                  Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

                  regrettable_incident@lemmy.worldR This user is from outside of this forum
                  regrettable_incident@lemmy.worldR This user is from outside of this forum
                  [email protected]
                  wrote last edited by
                  #59

                  Aren't there already laws against making child porn?

                  C 1 Reply Last reply
                  1
                  • regrettable_incident@lemmy.worldR [email protected]

                    Aren't there already laws against making child porn?

                    C This user is from outside of this forum
                    C This user is from outside of this forum
                    [email protected]
                    wrote last edited by
                    #60

                    I'd rather these laws be against abusing and exploiting child, as well as against ruining their lives. Not only that would be more helpful, it would also work in this case, since actual likeness are involved.

                    Alas, whether there's a law against that specific use case or not, it is somewhat difficult to police what people do in their home, without a third party whistleblower. Making more, impossible to apply laws for this specific case does not seem that useful.

                    V 1 Reply Last reply
                    3
                    • D [email protected]

                      this advice might get you locked up

                      E This user is from outside of this forum
                      E This user is from outside of this forum
                      [email protected]
                      wrote last edited by
                      #61

                      My mama also told me that if someone locks you up, then you just lock them up right back.

                      1 Reply Last reply
                      5
                      • P [email protected]

                        Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

                        D This user is from outside of this forum
                        D This user is from outside of this forum
                        [email protected]
                        wrote last edited by
                        #62

                        I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

                        lime@feddit.nuL G K W 4 Replies Last reply
                        6
                        • L [email protected]

                          In the bible, it says, and I quote: "If a deepkfake of you is made, you shall give the creator more material to create deepfakes"

                          kolanaki@pawb.socialK This user is from outside of this forum
                          kolanaki@pawb.socialK This user is from outside of this forum
                          [email protected]
                          wrote last edited by
                          #63

                          An eye for an eye, a tooth for a tooth, and a deepfake for a deepfake.

                          1 Reply Last reply
                          1
                          • L [email protected]

                            Expecting people to know about that 99-1 vote might be misplaced optimism, since it hasn't been made into a meme yet.

                            a_wild_mimic_appears@lemmy.dbzer0.comA This user is from outside of this forum
                            a_wild_mimic_appears@lemmy.dbzer0.comA This user is from outside of this forum
                            [email protected]
                            wrote last edited by [email protected]
                            #64

                            especially that Abbot Ted Cruz, who brought this one up, voted against it in the end, which is pretty confusing for an european tbh

                            e: i mean that it's memeworthy lol

                            L 1 Reply Last reply
                            2
                            • a_wild_mimic_appears@lemmy.dbzer0.comA [email protected]

                              especially that Abbot Ted Cruz, who brought this one up, voted against it in the end, which is pretty confusing for an european tbh

                              e: i mean that it's memeworthy lol

                              L This user is from outside of this forum
                              L This user is from outside of this forum
                              [email protected]
                              wrote last edited by [email protected]
                              #65

                              I'm confused - by Abbot do you mean Gov. Abbott of Texas, and are we talking about the same issue? Cuz the 99-1 vote was about a senate bill regarding AI. Greg Abbott can't vote on senate bills, and there's no senator named Abbot.

                              a_wild_mimic_appears@lemmy.dbzer0.comA 1 Reply Last reply
                              0
                              • L [email protected]

                                I'm confused - by Abbot do you mean Gov. Abbott of Texas, and are we talking about the same issue? Cuz the 99-1 vote was about a senate bill regarding AI. Greg Abbott can't vote on senate bills, and there's no senator named Abbot.

                                a_wild_mimic_appears@lemmy.dbzer0.comA This user is from outside of this forum
                                a_wild_mimic_appears@lemmy.dbzer0.comA This user is from outside of this forum
                                [email protected]
                                wrote last edited by [email protected]
                                #66

                                aaah i misremembered, it was Ted Cruz, oops 😄

                                https://arstechnica.com/tech-policy/2025/07/ted-cruz-gives-up-on-ai-law-moratorium-joins-99-1-vote-against-his-own-plan/

                                1 Reply Last reply
                                2
                                • zak@lemmy.worldZ [email protected]

                                  I think generating and sharing sexually explicit images of a person without their consent is abuse.

                                  That's distinct from generating an image that looks like CSAM without the involvement of any real child. While I find that disturbing, I'm morally uncomfortable criminalizing an act that has no victim.

                                  kemsat@lemmy.worldK This user is from outside of this forum
                                  kemsat@lemmy.worldK This user is from outside of this forum
                                  [email protected]
                                  wrote last edited by
                                  #67

                                  Harassment sure, but not abuse.

                                  1 Reply Last reply
                                  2
                                  • D [email protected]

                                    I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

                                    lime@feddit.nuL This user is from outside of this forum
                                    lime@feddit.nuL This user is from outside of this forum
                                    [email protected]
                                    wrote last edited by [email protected]
                                    #68

                                    not necessarily. image generation models work on a more fine-grained scale than that. they can seamlessly combine related concepts, like "photograph"+"person"+"small"+"pose" and generate plausible material due to the fact that all of those concepts have features in common.

                                    you can also use small add-on models trained on very little data (tens to hundreds of images, as compared to millions to billions for a full model) to "steer" the output of a model towards a particular style.

                                    you can make even a fully legal model output illegal data.

                                    all that being said, the base dataset that most of the stable diffusion family of models started out with in 2021 is medical in nature so there could very well be bad shit in there. it's like 12 billion images so it's hard to check, and even back with stable diffusion 1.0 there was less than a single bit of data in the final model per image in the data.

                                    1 Reply Last reply
                                    3
                                    • P [email protected]

                                      Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

                                      S This user is from outside of this forum
                                      S This user is from outside of this forum
                                      [email protected]
                                      wrote last edited by
                                      #69

                                      For example, Louisiana mandates a minimum five-year jail sentence no matter the age of the perpetrator.

                                      That's just on it's face stupid. A thirteen year old boy is absolutely gonna wanna see girls in his age group naked. That's not pedophilia. It's wanting to see the girls he fantasizes about at school every day. Source: I was a thirteen year old boy.

                                      It shouldn't be treated the same as when an adult man generates it; there should be nuance. I'm not saying it's ok for a thirteen year old to generate said content: I'm saying tailor the punishment to fit the reality of the differences in motivations. Leave it to Louisiana to once again use a cudgel rather than sense.

                                      I'm so glad I went through puberty at a time when this kind of shit wasn't available. The thirteen year old version of me would absolutely have got myself in a lot of trouble. And depending on what state I was in, seventeen year old me could have ended listed as a sex predetor for sending dick pics to my gf cause I produced child pornography. God, some states have stupid laws.

                                      L A A 3 Replies Last reply
                                      51
                                      • D [email protected]

                                        I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

                                        G This user is from outside of this forum
                                        G This user is from outside of this forum
                                        [email protected]
                                        wrote last edited by
                                        #70

                                        This is mostly about swapping faces. You take a video and a photo of someone's face. Software can replace the face of someone in the video with that face. That's been around for a decade or so. There are other ways of doing it.

                                        When the face belongs to an underage individual, and the video is pornographic...

                                        LLMs only do text.

                                        1 Reply Last reply
                                        1
                                        • P [email protected]

                                          Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

                                          walk_blessed@piefed.blahaj.zoneW This user is from outside of this forum
                                          walk_blessed@piefed.blahaj.zoneW This user is from outside of this forum
                                          [email protected]
                                          wrote last edited by
                                          #71

                                          Jfc the replies here are fucking rancid. Lemmy is full of sweaty middle aged blokes in tech who hate it when anyone tells them that grown men who pursue teenage girls who have just reached an arbitrary age are fucking creeps, so of course they're here encouraging the next generation of misogynist scum by defending this shit, too.
                                          And men (pretend to) wonder why we distrust them.

                                          Ngl, I'm only leaving reply notifs on for this one to work on my blocklist.

                                          atomicorange@lemmy.worldA 1 Reply Last reply
                                          19
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups