Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Technology
  3. Kids are making deepfakes of each other, and laws aren’t keeping up

Kids are making deepfakes of each other, and laws aren’t keeping up

Scheduled Pinned Locked Moved Technology
technology
172 Posts 77 Posters 1 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • K [email protected]

    How is a school going to regulate what kids do outside of school property? They could ban cell phones on campus but that's not going to change what happens after hours.

    L This user is from outside of this forum
    L This user is from outside of this forum
    [email protected]
    wrote last edited by
    #49

    Schools can already do that though. You can get in trouble for bullying outside of school, and when i was a student athletes i had pretty strict restrictions on what i was allowed to do because i was an "ambassador" for the school.

    W 1 Reply Last reply
    1
    • R [email protected]

      This definitely will not add in any way to the way women and girls are made to feel entirely disgustingly dehumanized by every man or boy in their lives. Groups of men and boys reducing them and their bodies down to vivid sexual fantasies that they can quickly generate photo realistic images of.

      Sexual attraction doesn't necessarily involve dehumanization. Unlike most other kinds of interest in a human being, it doesn't require interest in their personality, but these are logically not the same.

      In general you are using emotional arguments for things that work not through emotion, but through literal interpretation. That's like using metric calculations for a system that expects imperial. Utterly useless.

      If the person in the image is underaged then it should be classified as child pornography.

      No, it's not. It's literally a photorealistic drawing based on a photo (and a dataset to make the generative model). No children have been abused to produce it. Laws work literally.

      If the woman who’s photo is being used hasnt consented to this then it should be classified as sexual exploitation.

      No, because the woman is not being literally sexually exploited. Her photo being used without consent is, I think, subject of some laws. There are no new fundamental legal entities involved.

      Women and girls have faced degrees of this kind of sexual exploitation by men and boys since the latter half of the 20th century. But this is a severe escalation in that behavior. It should be illegal to do this and it should be prosecuted when and where it is found to occur.

      I think I agree. But it's neither child pornography nor sexual exploitation and can't be equated to them.

      There are already existing laws for such actions, similar to using a photo of the victim and a pornographic photo, paper, scissors, pencils and glue. Or, if you think the situation is radically different, there should be new punishable crimes introduced.

      Otherwise it's like punishing everyone caught driving while drunk for non-premeditated murder. One is not the other.

      L This user is from outside of this forum
      L This user is from outside of this forum
      [email protected]
      wrote last edited by
      #50

      Hey so, at least in the US, drawings can absolutely be considered CSAM

      R 1 Reply Last reply
      1
      • F [email protected]

        If a boy fantasises sexually about a girl, is that harmful to her? If he tells his friends about it? No, this is not harmful - these actions do not affect her in any way. What affects the girl is how the boys might then treat her differently than they would do someone they don't find sexually attractive.

        The solution, in both cases, has to be to address the harmful behaviour. The only arguments for criminalising deepfakes themselves are also arguments for criminalising sexual fantasies. that is why people are talking about thought crime, because once you criminalise things that are harmless on their own, but which might down the line lead to directly harmful behaviour, there is no other distinction.

        The consent of the individual has been entirely erased. Dehumanization in its most direct form.

        Both of these, for example, apply just as readily to discussing a shared sexual fantasy about someone who didn't agree to it.

        No distinction, that is, other than this is new and icky. I don't want government policy to be dictated by fear of the new and by what people find icky, though. I do lots of stuff people find icky.

        ladyautumn@lemmy.blahaj.zoneL This user is from outside of this forum
        ladyautumn@lemmy.blahaj.zoneL This user is from outside of this forum
        [email protected]
        wrote last edited by [email protected]
        #51

        No an image that is shared and distributed is not the same as a fantasy in someone's head. That is deranged. Should CSAM also be legal because making it illegal is like criminalizing the fantasies of pedophiles? Absolutely insane logical framework you have there.

        This isnt fantasy. It is content. It is media. It is material. It is produced without the consent of the girls and women being sexualized and it commodifies their existence, literally transforming the idea of them into sexual media consumed for the gratification of boys and men.

        It is genuinely incredible to me that you could be so unempathetic, so impassive, so detached from the real world and the consequences of this, that you could even make this comparison. You have seemingly no idea what youre talking about if you believe that pornography is the same thing as mental fantasies.

        And even in the case of mental fantasies, are those all good? Is it really a good thing that boys see the mere existence of the girls around them as inherently some kind of sexual availability?

        F 1 Reply Last reply
        6
        • ladyautumn@lemmy.blahaj.zoneL [email protected]

          No an image that is shared and distributed is not the same as a fantasy in someone's head. That is deranged. Should CSAM also be legal because making it illegal is like criminalizing the fantasies of pedophiles? Absolutely insane logical framework you have there.

          This isnt fantasy. It is content. It is media. It is material. It is produced without the consent of the girls and women being sexualized and it commodifies their existence, literally transforming the idea of them into sexual media consumed for the gratification of boys and men.

          It is genuinely incredible to me that you could be so unempathetic, so impassive, so detached from the real world and the consequences of this, that you could even make this comparison. You have seemingly no idea what youre talking about if you believe that pornography is the same thing as mental fantasies.

          And even in the case of mental fantasies, are those all good? Is it really a good thing that boys see the mere existence of the girls around them as inherently some kind of sexual availability?

          F This user is from outside of this forum
          F This user is from outside of this forum
          [email protected]
          wrote last edited by
          #52

          When someone makes child porn they put a child in a sexual situation - which is something that we have amassed a pile of evidence is extremely harmful to the child.

          For all you have said - "without the consent" - "being sexualised" - "commodifies their existence" - you haven't told us what the harm is. If you think those things are in and of themselves harmful then I need to know more about what you mean because:

          1. if someone thinks of me sexually without my consent I am not harmed
          2. if someone sexualises me in their mind I am not harmed
          3. I don't know what the "commodification of one's existence" can actually mean - I can't buy or sell "the existence of women" (does buying something's existence mean the same as buying the thing, or something else?) the same I can aluminium, and I don't see how being able to (easily) make (realistic) nude images of someone changes this in any way

          It is genuinely incredible to me that you could be so unempathetic,

          I am not unempathetic, but I attribute the blame for what makes me feel bad about the situation is that girls are being made to feel bad and ashamed not that a particular technology is now being used in one step of that.

          atomicorange@lemmy.worldA ladyautumn@lemmy.blahaj.zoneL 2 Replies Last reply
          5
          • M [email protected]

            So is this a way to take away rights by making it about kids?

            I mean what the fuck. We did much less and got punished right? It didn't matter if we were on the property. Schools can hold students accountable for conduct with other students.

            The leaded-gas adults of the time had no problem dealing with the emergence of cell phones. It was a distraction. They didn't need lawmakers to call it something specific. My Pokemon cards caused fights and were banned. No lawmakers needed.

            The problem is surely with the interaction between parents and schools. Or maybe it's just the old way of thinking. Maybe it's better to have police and courts start taking over discipline in schools.

            C This user is from outside of this forum
            C This user is from outside of this forum
            [email protected]
            wrote last edited by
            #53

            All your examples are of things that were stopped while at school, so your argument doesn't really carry over. You still had your pokemon cards everywhere else.

            1 Reply Last reply
            0
            • P [email protected]

              Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

              L This user is from outside of this forum
              L This user is from outside of this forum
              [email protected]
              wrote last edited by
              #54

              Instead of laws keeping up It also might turn out to be a case where culture keeps up.

              1 Reply Last reply
              1
              • E [email protected]

                My mama always told me, that if someone makes a deepfake of you, then you make a deepfake of them right back!

                L This user is from outside of this forum
                L This user is from outside of this forum
                [email protected]
                wrote last edited by
                #55

                Thanks, cap'n.

                1 Reply Last reply
                0
                • S [email protected]

                  A 99-1 vote to drop the anti AI regulation is hardly the government voting against. The Senate smashed that shit hard and fast.

                  L This user is from outside of this forum
                  L This user is from outside of this forum
                  [email protected]
                  wrote last edited by [email protected]
                  #56

                  Expecting people to know about that 99-1 vote might be misplaced optimism, since it hasn't been made into a meme yet.

                  a_wild_mimic_appears@lemmy.dbzer0.comA 1 Reply Last reply
                  5
                  • E [email protected]

                    My mama always told me, that if someone makes a deepfake of you, then you make a deepfake of them right back!

                    D This user is from outside of this forum
                    D This user is from outside of this forum
                    [email protected]
                    wrote last edited by
                    #57

                    this advice might get you locked up

                    E 1 Reply Last reply
                    0
                    • E [email protected]

                      My mama always told me, that if someone makes a deepfake of you, then you make a deepfake of them right back!

                      L This user is from outside of this forum
                      L This user is from outside of this forum
                      [email protected]
                      wrote last edited by
                      #58

                      In the bible, it says, and I quote: "If a deepkfake of you is made, you shall give the creator more material to create deepfakes"

                      kolanaki@pawb.socialK 1 Reply Last reply
                      4
                      • P [email protected]

                        Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

                        regrettable_incident@lemmy.worldR This user is from outside of this forum
                        regrettable_incident@lemmy.worldR This user is from outside of this forum
                        [email protected]
                        wrote last edited by
                        #59

                        Aren't there already laws against making child porn?

                        C 1 Reply Last reply
                        1
                        • regrettable_incident@lemmy.worldR [email protected]

                          Aren't there already laws against making child porn?

                          C This user is from outside of this forum
                          C This user is from outside of this forum
                          [email protected]
                          wrote last edited by
                          #60

                          I'd rather these laws be against abusing and exploiting child, as well as against ruining their lives. Not only that would be more helpful, it would also work in this case, since actual likeness are involved.

                          Alas, whether there's a law against that specific use case or not, it is somewhat difficult to police what people do in their home, without a third party whistleblower. Making more, impossible to apply laws for this specific case does not seem that useful.

                          V 1 Reply Last reply
                          3
                          • D [email protected]

                            this advice might get you locked up

                            E This user is from outside of this forum
                            E This user is from outside of this forum
                            [email protected]
                            wrote last edited by
                            #61

                            My mama also told me that if someone locks you up, then you just lock them up right back.

                            1 Reply Last reply
                            5
                            • P [email protected]

                              Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

                              D This user is from outside of this forum
                              D This user is from outside of this forum
                              [email protected]
                              wrote last edited by
                              #62

                              I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

                              lime@feddit.nuL G K W 4 Replies Last reply
                              6
                              • L [email protected]

                                In the bible, it says, and I quote: "If a deepkfake of you is made, you shall give the creator more material to create deepfakes"

                                kolanaki@pawb.socialK This user is from outside of this forum
                                kolanaki@pawb.socialK This user is from outside of this forum
                                [email protected]
                                wrote last edited by
                                #63

                                An eye for an eye, a tooth for a tooth, and a deepfake for a deepfake.

                                1 Reply Last reply
                                1
                                • L [email protected]

                                  Expecting people to know about that 99-1 vote might be misplaced optimism, since it hasn't been made into a meme yet.

                                  a_wild_mimic_appears@lemmy.dbzer0.comA This user is from outside of this forum
                                  a_wild_mimic_appears@lemmy.dbzer0.comA This user is from outside of this forum
                                  [email protected]
                                  wrote last edited by [email protected]
                                  #64

                                  especially that Abbot Ted Cruz, who brought this one up, voted against it in the end, which is pretty confusing for an european tbh

                                  e: i mean that it's memeworthy lol

                                  L 1 Reply Last reply
                                  2
                                  • a_wild_mimic_appears@lemmy.dbzer0.comA [email protected]

                                    especially that Abbot Ted Cruz, who brought this one up, voted against it in the end, which is pretty confusing for an european tbh

                                    e: i mean that it's memeworthy lol

                                    L This user is from outside of this forum
                                    L This user is from outside of this forum
                                    [email protected]
                                    wrote last edited by [email protected]
                                    #65

                                    I'm confused - by Abbot do you mean Gov. Abbott of Texas, and are we talking about the same issue? Cuz the 99-1 vote was about a senate bill regarding AI. Greg Abbott can't vote on senate bills, and there's no senator named Abbot.

                                    a_wild_mimic_appears@lemmy.dbzer0.comA 1 Reply Last reply
                                    0
                                    • L [email protected]

                                      I'm confused - by Abbot do you mean Gov. Abbott of Texas, and are we talking about the same issue? Cuz the 99-1 vote was about a senate bill regarding AI. Greg Abbott can't vote on senate bills, and there's no senator named Abbot.

                                      a_wild_mimic_appears@lemmy.dbzer0.comA This user is from outside of this forum
                                      a_wild_mimic_appears@lemmy.dbzer0.comA This user is from outside of this forum
                                      [email protected]
                                      wrote last edited by [email protected]
                                      #66

                                      aaah i misremembered, it was Ted Cruz, oops 😄

                                      https://arstechnica.com/tech-policy/2025/07/ted-cruz-gives-up-on-ai-law-moratorium-joins-99-1-vote-against-his-own-plan/

                                      1 Reply Last reply
                                      2
                                      • zak@lemmy.worldZ [email protected]

                                        I think generating and sharing sexually explicit images of a person without their consent is abuse.

                                        That's distinct from generating an image that looks like CSAM without the involvement of any real child. While I find that disturbing, I'm morally uncomfortable criminalizing an act that has no victim.

                                        kemsat@lemmy.worldK This user is from outside of this forum
                                        kemsat@lemmy.worldK This user is from outside of this forum
                                        [email protected]
                                        wrote last edited by
                                        #67

                                        Harassment sure, but not abuse.

                                        1 Reply Last reply
                                        2
                                        • D [email protected]

                                          I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

                                          lime@feddit.nuL This user is from outside of this forum
                                          lime@feddit.nuL This user is from outside of this forum
                                          [email protected]
                                          wrote last edited by [email protected]
                                          #68

                                          not necessarily. image generation models work on a more fine-grained scale than that. they can seamlessly combine related concepts, like "photograph"+"person"+"small"+"pose" and generate plausible material due to the fact that all of those concepts have features in common.

                                          you can also use small add-on models trained on very little data (tens to hundreds of images, as compared to millions to billions for a full model) to "steer" the output of a model towards a particular style.

                                          you can make even a fully legal model output illegal data.

                                          all that being said, the base dataset that most of the stable diffusion family of models started out with in 2021 is medical in nature so there could very well be bad shit in there. it's like 12 billion images so it's hard to check, and even back with stable diffusion 1.0 there was less than a single bit of data in the final model per image in the data.

                                          1 Reply Last reply
                                          3
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups