Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Technology
  3. Kids are making deepfakes of each other, and laws aren’t keeping up

Kids are making deepfakes of each other, and laws aren’t keeping up

Scheduled Pinned Locked Moved Technology
technology
172 Posts 77 Posters 1 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • P [email protected]

    Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

    S This user is from outside of this forum
    S This user is from outside of this forum
    [email protected]
    wrote last edited by
    #69

    For example, Louisiana mandates a minimum five-year jail sentence no matter the age of the perpetrator.

    That's just on it's face stupid. A thirteen year old boy is absolutely gonna wanna see girls in his age group naked. That's not pedophilia. It's wanting to see the girls he fantasizes about at school every day. Source: I was a thirteen year old boy.

    It shouldn't be treated the same as when an adult man generates it; there should be nuance. I'm not saying it's ok for a thirteen year old to generate said content: I'm saying tailor the punishment to fit the reality of the differences in motivations. Leave it to Louisiana to once again use a cudgel rather than sense.

    I'm so glad I went through puberty at a time when this kind of shit wasn't available. The thirteen year old version of me would absolutely have got myself in a lot of trouble. And depending on what state I was in, seventeen year old me could have ended listed as a sex predetor for sending dick pics to my gf cause I produced child pornography. God, some states have stupid laws.

    L A A 3 Replies Last reply
    51
    • D [email protected]

      I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

      G This user is from outside of this forum
      G This user is from outside of this forum
      [email protected]
      wrote last edited by
      #70

      This is mostly about swapping faces. You take a video and a photo of someone's face. Software can replace the face of someone in the video with that face. That's been around for a decade or so. There are other ways of doing it.

      When the face belongs to an underage individual, and the video is pornographic...

      LLMs only do text.

      1 Reply Last reply
      1
      • P [email protected]

        Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

        walk_blessed@piefed.blahaj.zoneW This user is from outside of this forum
        walk_blessed@piefed.blahaj.zoneW This user is from outside of this forum
        [email protected]
        wrote last edited by
        #71

        Jfc the replies here are fucking rancid. Lemmy is full of sweaty middle aged blokes in tech who hate it when anyone tells them that grown men who pursue teenage girls who have just reached an arbitrary age are fucking creeps, so of course they're here encouraging the next generation of misogynist scum by defending this shit, too.
        And men (pretend to) wonder why we distrust them.

        Ngl, I'm only leaving reply notifs on for this one to work on my blocklist.

        atomicorange@lemmy.worldA 1 Reply Last reply
        19
        • F [email protected]

          When someone makes child porn they put a child in a sexual situation - which is something that we have amassed a pile of evidence is extremely harmful to the child.

          For all you have said - "without the consent" - "being sexualised" - "commodifies their existence" - you haven't told us what the harm is. If you think those things are in and of themselves harmful then I need to know more about what you mean because:

          1. if someone thinks of me sexually without my consent I am not harmed
          2. if someone sexualises me in their mind I am not harmed
          3. I don't know what the "commodification of one's existence" can actually mean - I can't buy or sell "the existence of women" (does buying something's existence mean the same as buying the thing, or something else?) the same I can aluminium, and I don't see how being able to (easily) make (realistic) nude images of someone changes this in any way

          It is genuinely incredible to me that you could be so unempathetic,

          I am not unempathetic, but I attribute the blame for what makes me feel bad about the situation is that girls are being made to feel bad and ashamed not that a particular technology is now being used in one step of that.

          atomicorange@lemmy.worldA This user is from outside of this forum
          atomicorange@lemmy.worldA This user is from outside of this forum
          [email protected]
          wrote last edited by
          #72

          Are you OK with sexually explicit photos of children taken without their knowledge? They’re not being actively put in a sexual situation if you’re snapping photos with a hidden camera in a locker room, for example. You ok with that?

          The harm is:

          • Those photos now exist in the world and can lead to direct harm to the victim by their exposure
          • it normalizes pedophilia and creates a culture of trading images, leading to more abuse to meet demand for more images
          • The people sharing those photos learn to treat people like objects for their sexual gratification, ignoring their consent and agency. They are more likely to mistreat people they have learned to objectify.
          • your body should not be used for the profit or gratification of others without your consent. In my mind this includes taking or using your picture without your consent.
          F 1 Reply Last reply
          2
          • walk_blessed@piefed.blahaj.zoneW [email protected]

            Jfc the replies here are fucking rancid. Lemmy is full of sweaty middle aged blokes in tech who hate it when anyone tells them that grown men who pursue teenage girls who have just reached an arbitrary age are fucking creeps, so of course they're here encouraging the next generation of misogynist scum by defending this shit, too.
            And men (pretend to) wonder why we distrust them.

            Ngl, I'm only leaving reply notifs on for this one to work on my blocklist.

            atomicorange@lemmy.worldA This user is from outside of this forum
            atomicorange@lemmy.worldA This user is from outside of this forum
            [email protected]
            wrote last edited by
            #73

            Yeah there’s some nasty shit here. Big yikes, Lemmy.

            1 Reply Last reply
            9
            • atomicorange@lemmy.worldA [email protected]

              If someone put a camera in the girls’ locker room and distributed photos from that, would you consider it CSAM? No contact would have taken place so the kids would be unaware when they were photographed, is it still abuse?

              If so, how is the psychological effect of a convincing deepfake any different?

              G This user is from outside of this forum
              G This user is from outside of this forum
              [email protected]
              wrote last edited by
              #74

              If someone puts a camera in a locker room, that means that someone entered a space where you would usually feel safe. It implies the potential of a physical threat.

              It also means that someone observed you when you were doing "secret" things. One may feel vulnerable in such situations. Even a seasoned nude model might be embarrassed to be seen while changing, maybe in a dishevelled state.

              I would think it is very different. Unless you're only thinking about the psychological effect on the viewer.

              1 Reply Last reply
              2
              • S [email protected]

                For example, Louisiana mandates a minimum five-year jail sentence no matter the age of the perpetrator.

                That's just on it's face stupid. A thirteen year old boy is absolutely gonna wanna see girls in his age group naked. That's not pedophilia. It's wanting to see the girls he fantasizes about at school every day. Source: I was a thirteen year old boy.

                It shouldn't be treated the same as when an adult man generates it; there should be nuance. I'm not saying it's ok for a thirteen year old to generate said content: I'm saying tailor the punishment to fit the reality of the differences in motivations. Leave it to Louisiana to once again use a cudgel rather than sense.

                I'm so glad I went through puberty at a time when this kind of shit wasn't available. The thirteen year old version of me would absolutely have got myself in a lot of trouble. And depending on what state I was in, seventeen year old me could have ended listed as a sex predetor for sending dick pics to my gf cause I produced child pornography. God, some states have stupid laws.

                L This user is from outside of this forum
                L This user is from outside of this forum
                [email protected]
                wrote last edited by [email protected]
                #75

                As a father of teenage girls, I don't necessarily disagree with this assessment, but I would personally see to it that anyone making sexual deepfakes of my daughters is equitably and thoroughly punished.

                S S 2 Replies Last reply
                10
                • D [email protected]

                  Lawmakers are grappling with how to address ...

                  Just a reminder that the government is actively voting against regulations on AI, because obviously a lot of these people are pocketing lobbyist money

                  L This user is from outside of this forum
                  L This user is from outside of this forum
                  [email protected]
                  wrote last edited by
                  #76

                  In the case of US govt, the AI part of the bill they voted against was the part that blocked regulations on AI for a period of 10 years.

                  In case that wasn't clear, the US govt voted in favor of regulating AI. 99-1.

                  1 Reply Last reply
                  3
                  • L This user is from outside of this forum
                    L This user is from outside of this forum
                    [email protected]
                    wrote last edited by [email protected]
                    #77

                    I would consider that as qualifying. Because it's targeted harassment in a sexually-explicit manner. All the girl would have to do is claim it's her.

                    Source: I'm a father of teenage daughters. I would pursue the individual(s) who started it and make them regret their choices.

                    1 Reply Last reply
                    0
                    • W [email protected]

                      Disagree. Not CSAM when no abuse has taken place.

                      That's my point.

                      L This user is from outside of this forum
                      L This user is from outside of this forum
                      [email protected]
                      wrote last edited by [email protected]
                      #78

                      Except, you know, the harassment and abuse of said deepfaked individual. Which is sexual in nature. Sexual harassment and abuse of a child using materials generated based on the child's identity.

                      Maybe we could have a name for it. Something like Child-based sexual harassment and abuse material... CSHAM, or maybe just CSAM, you know, to remember it more easily.

                      1 Reply Last reply
                      1
                      • G [email protected]

                        Historically, the respectability of a woman depended on her sexuality. In many conservative cultures and communities, that is still true. Spreading the message that deepfakes are some particular horrible form of harassment reinforces that view.

                        If having your head on the model of a nude model is a terrible crime, then what does that say about the nude model? What does it say about women who simply happen to develop a larger bosom or lips? What does it say about sex before marriage?

                        The implicit message here is simply harmful to girls and women.

                        That doesn't mean that we should tolerate harassment. But it needs to be understood that we can do no more to stop this kind of harassment than we can do to stop any other kind.

                        L This user is from outside of this forum
                        L This user is from outside of this forum
                        [email protected]
                        wrote last edited by
                        #79

                        Spoken like someone who hasn't been around women.

                        G 1 Reply Last reply
                        1
                        • S [email protected]

                          For example, Louisiana mandates a minimum five-year jail sentence no matter the age of the perpetrator.

                          That's just on it's face stupid. A thirteen year old boy is absolutely gonna wanna see girls in his age group naked. That's not pedophilia. It's wanting to see the girls he fantasizes about at school every day. Source: I was a thirteen year old boy.

                          It shouldn't be treated the same as when an adult man generates it; there should be nuance. I'm not saying it's ok for a thirteen year old to generate said content: I'm saying tailor the punishment to fit the reality of the differences in motivations. Leave it to Louisiana to once again use a cudgel rather than sense.

                          I'm so glad I went through puberty at a time when this kind of shit wasn't available. The thirteen year old version of me would absolutely have got myself in a lot of trouble. And depending on what state I was in, seventeen year old me could have ended listed as a sex predetor for sending dick pics to my gf cause I produced child pornography. God, some states have stupid laws.

                          A This user is from outside of this forum
                          A This user is from outside of this forum
                          [email protected]
                          wrote last edited by
                          #80

                          Punishment for an adult man doing this: Prison

                          Punishment for a 13 year old by doing this: Publish his browsing and search history in the school newsletter.

                          G 1 Reply Last reply
                          11
                          • L [email protected]

                            As a father of teenage girls, I don't necessarily disagree with this assessment, but I would personally see to it that anyone making sexual deepfakes of my daughters is equitably and thoroughly punished.

                            S This user is from outside of this forum
                            S This user is from outside of this forum
                            [email protected]
                            wrote last edited by
                            #81

                            Yes, absolutely. But with recognition that a thirteen year old kid isn't a predator but a horny little kid. I'll let others determine what that punishment is, but I don't believe it's prison. Community service maybe. Written apology. Stuff like that. Second offense, ok, we're ratcheting up the punishment, but still not adult prison.

                            M L tomenzgg@midwest.socialT 3 Replies Last reply
                            7
                            • J [email protected]

                              Oh I just assumed that every Conservative jerks off to kids

                              daft_ish@lemmy.dbzer0.comD This user is from outside of this forum
                              daft_ish@lemmy.dbzer0.comD This user is from outside of this forum
                              [email protected]
                              wrote last edited by
                              #82

                              Get some receipts and that will be a start.

                              skulblaka@sh.itjust.worksS 1 Reply Last reply
                              0
                              • P [email protected]

                                Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

                                daft_ish@lemmy.dbzer0.comD This user is from outside of this forum
                                daft_ish@lemmy.dbzer0.comD This user is from outside of this forum
                                [email protected]
                                wrote last edited by
                                #83

                                Welp, if I had kids they would have one of those scramble suits like in a scanner darkly.

                                It would of course be their choice to wear them but Id definitely look for ways to limit their time in areas with cameras present.

                                E gsus4@mander.xyzG 2 Replies Last reply
                                7
                                • daft_ish@lemmy.dbzer0.comD [email protected]

                                  Get some receipts and that will be a start.

                                  skulblaka@sh.itjust.worksS This user is from outside of this forum
                                  skulblaka@sh.itjust.worksS This user is from outside of this forum
                                  [email protected]
                                  wrote last edited by
                                  #84

                                  Receipts you say?

                                  We're at 56 pages of this now for a nice round count of 1400 charges

                                  So far as I am aware all of these are publicly searchable court cases

                                  daft_ish@lemmy.dbzer0.comD 1 Reply Last reply
                                  11
                                  • skulblaka@sh.itjust.worksS [email protected]

                                    Receipts you say?

                                    We're at 56 pages of this now for a nice round count of 1400 charges

                                    So far as I am aware all of these are publicly searchable court cases

                                    daft_ish@lemmy.dbzer0.comD This user is from outside of this forum
                                    daft_ish@lemmy.dbzer0.comD This user is from outside of this forum
                                    [email protected]
                                    wrote last edited by [email protected]
                                    #85

                                    Alright, now we just need the main stream media to run the story.

                                    I mean with all the zealotry against drag shows they should be ready to run with this one right?

                                    skulblaka@sh.itjust.worksS 1 Reply Last reply
                                    4
                                    • daft_ish@lemmy.dbzer0.comD [email protected]

                                      Alright, now we just need the main stream media to run the story.

                                      I mean with all the zealotry against drag shows they should be ready to run with this one right?

                                      skulblaka@sh.itjust.worksS This user is from outside of this forum
                                      skulblaka@sh.itjust.worksS This user is from outside of this forum
                                      [email protected]
                                      wrote last edited by
                                      #86

                                      You'd think so, right?

                                      1 Reply Last reply
                                      3
                                      • F [email protected]

                                        When someone makes child porn they put a child in a sexual situation - which is something that we have amassed a pile of evidence is extremely harmful to the child.

                                        For all you have said - "without the consent" - "being sexualised" - "commodifies their existence" - you haven't told us what the harm is. If you think those things are in and of themselves harmful then I need to know more about what you mean because:

                                        1. if someone thinks of me sexually without my consent I am not harmed
                                        2. if someone sexualises me in their mind I am not harmed
                                        3. I don't know what the "commodification of one's existence" can actually mean - I can't buy or sell "the existence of women" (does buying something's existence mean the same as buying the thing, or something else?) the same I can aluminium, and I don't see how being able to (easily) make (realistic) nude images of someone changes this in any way

                                        It is genuinely incredible to me that you could be so unempathetic,

                                        I am not unempathetic, but I attribute the blame for what makes me feel bad about the situation is that girls are being made to feel bad and ashamed not that a particular technology is now being used in one step of that.

                                        ladyautumn@lemmy.blahaj.zoneL This user is from outside of this forum
                                        ladyautumn@lemmy.blahaj.zoneL This user is from outside of this forum
                                        [email protected]
                                        wrote last edited by [email protected]
                                        #87

                                        I am just genuinely speechless than you seemingly do not understand how sickening and invasive it is for your peers to create and share sexual content of you without your consent. Yes its extremely harmful. Its not a matter of feeling ashamed, its a matter of literally feeling like your value to the world is dictated by your role in the sexualities of heterosexual boys and men. It is feeling like your own body doesnt belong to you but can be freely claimed by others. It is losing trust in all your male friends and peers, because it feels like without you knowing they've already decided that you're a sexual experience for them.

                                        We do know the harm of this kind of sexualization. Women and girls have been talking about it for generations. This isnt new, just a new streamlined way to spread it. It should be illegal. It should be against the law to turn someone's images into AI generated pornography. It should also be illegal to share those images with others.

                                        F 1 Reply Last reply
                                        3
                                        • D [email protected]

                                          I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

                                          K This user is from outside of this forum
                                          K This user is from outside of this forum
                                          [email protected]
                                          wrote last edited by
                                          #88

                                          I agree with the other comments, but wanted to add how deepfakes work to show how simple they are, and how much less information they need than LLMs.

                                          Step 1: Basically you take a bunch of photos and videos of a specific person, and blur their faces out.

                                          Step 2: This is the hardest step, but still totally feasable for a decent home computer. You train a neural network to un-blur all the faces for that person. Now you have a neural net that's really good at turning blurry faces into that particular person's face.

                                          Step 3: Blur the faces in photos/videos of other people and apply your special neural network. It will turn all the blurry faces into the only face it knows how, often with shockingly realistic results.

                                          G 1 Reply Last reply
                                          5
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups