Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Technology
  3. Judges Are Fed up With Lawyers Using AI That Hallucinate Court Cases

Judges Are Fed up With Lawyers Using AI That Hallucinate Court Cases

Scheduled Pinned Locked Moved Technology
technology
130 Posts 76 Posters 426 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • S [email protected]

    Technically it's not, because the LLM doesn't decide to do anything, it just generates an answer based on a mixture of the input and the training data, plus some randomness.

    That said, I think it makes sense to say that it is lying if it can convince the user that it is lying through the text it generates.

    ulrich@feddit.orgU This user is from outside of this forum
    ulrich@feddit.orgU This user is from outside of this forum
    [email protected]
    wrote on last edited by
    #45

    it just generates an answer based on a mixture of the input and the training data, plus some randomness.

    And is that different from the way you make decisions, fundamentally?

    S P 2 Replies Last reply
    0
    • M [email protected]

      Please take a strand of my hair and split it with pointless philosophical semantics.

      Our brains are chemical and electric, which is physics, which is math.

      /think

      Therefor,
      I am a product (being) of my environment (locale), experience (input), and nurturing (programming).

      /think.

      What's the difference?

      4 This user is from outside of this forum
      4 This user is from outside of this forum
      [email protected]
      wrote on last edited by
      #46

      Your statistical model is much more optimized and complex, and reacts to your environment and body chemistry and has been tuned over billions of years of “training” via evolution.

      Large language models are primitive, rigid, simplistic, and ultimately expensive.

      Plus LLMs, image/music synths, are all trained on stolen data and meant to replace humans; so extra fuck those.

      M 1 Reply Last reply
      0
      • ulrich@feddit.orgU [email protected]

        it just generates an answer based on a mixture of the input and the training data, plus some randomness.

        And is that different from the way you make decisions, fundamentally?

        S This user is from outside of this forum
        S This user is from outside of this forum
        [email protected]
        wrote on last edited by
        #47

        Idk, that's still an area of active research. I versatile certainly think it's very different, since my understanding is that human thought is based on concepts instead of denoising noise or whatever it is LLMs do.

        1 Reply Last reply
        0
        • ulrich@feddit.orgU [email protected]

          ...how is it incapable of something it is actively doing? What do you think happens in your brain when you lie?

          4 This user is from outside of this forum
          4 This user is from outside of this forum
          [email protected]
          wrote on last edited by
          #48

          The most amazing feat AI has performed so far is convincing laymen that they’re actually intelligent

          1 Reply Last reply
          0
          • fartswithanaccent@fedia.ioF [email protected]

            AI can absolutely lie

            S This user is from outside of this forum
            S This user is from outside of this forum
            [email protected]
            wrote on last edited by
            #49

            a lie is a statement that the speaker knows to be wrong. wouldnt claiming that AIs can lie imply cognition on their part?

            M R B M 4 Replies Last reply
            0
            • S [email protected]

              a lie is a statement that the speaker knows to be wrong. wouldnt claiming that AIs can lie imply cognition on their part?

              M This user is from outside of this forum
              M This user is from outside of this forum
              [email protected]
              wrote on last edited by
              #50

              AIs can generate false statements. It doesn't require a set of beliefs, it merely requires a set of input.

              G 1 Reply Last reply
              0
              • ulrich@feddit.orgU [email protected]

                it just generates an answer based on a mixture of the input and the training data, plus some randomness.

                And is that different from the way you make decisions, fundamentally?

                P This user is from outside of this forum
                P This user is from outside of this forum
                [email protected]
                wrote on last edited by
                #51

                I don't think I run on AMD or Intel, so uh, yes.

                ulrich@feddit.orgU 1 Reply Last reply
                0
                • S [email protected]

                  a lie is a statement that the speaker knows to be wrong. wouldnt claiming that AIs can lie imply cognition on their part?

                  R This user is from outside of this forum
                  R This user is from outside of this forum
                  [email protected]
                  wrote on last edited by
                  #52

                  I've had this lengthy discussion before. Some people define a lie as an untrue statement, while others additionally require intent to deceive.

                  T M D P 4 Replies Last reply
                  0
                  • communism@lemmy.mlC [email protected]

                    Great news for defendants though. I hope at my next trial I look over at the prosecutor's screen and they're reading off ChatGPT lmao

                    T This user is from outside of this forum
                    T This user is from outside of this forum
                    [email protected]
                    wrote on last edited by
                    #53

                    So long as your own lawyer isn't doing the same, of course 🙂

                    communism@lemmy.mlC 1 Reply Last reply
                    0
                    • R [email protected]

                      I've had this lengthy discussion before. Some people define a lie as an untrue statement, while others additionally require intent to deceive.

                      T This user is from outside of this forum
                      T This user is from outside of this forum
                      [email protected]
                      wrote on last edited by
                      #54

                      I would fall into the latter category. Lots of people are earnestly wrong without being liars.

                      R 1 Reply Last reply
                      0
                      • S [email protected]

                        Eh, they should file a complaint the first time, and the state bar can decide what to do about it.

                        A This user is from outside of this forum
                        A This user is from outside of this forum
                        [email protected]
                        wrote on last edited by
                        #55

                        "We have investigated ourselves and found nothing wrong"

                        C S 2 Replies Last reply
                        0
                        • P [email protected]

                          I don't think I run on AMD or Intel, so uh, yes.

                          ulrich@feddit.orgU This user is from outside of this forum
                          ulrich@feddit.orgU This user is from outside of this forum
                          [email protected]
                          wrote on last edited by
                          #56

                          I didn't say anything about either.

                          1 Reply Last reply
                          0
                          • S [email protected]

                            But I was hysterically assured that AI was going to take all our jobs?

                            G This user is from outside of this forum
                            G This user is from outside of this forum
                            [email protected]
                            wrote on last edited by
                            #57

                            you sound like those republicans that mocked global warming when it snowed in Texas.

                            sure, won't take your job today. in a decade? probably.

                            F 1 Reply Last reply
                            0
                            • A [email protected]

                              "We have investigated ourselves and found nothing wrong"

                              C This user is from outside of this forum
                              C This user is from outside of this forum
                              [email protected]
                              wrote on last edited by
                              #58

                              The bar might get pretty ruthless for fake case citations.

                              S 1 Reply Last reply
                              0
                              • _haha_oh_wow_@sh.itjust.works_ [email protected]

                                Haven't people already been disbarred over this? Turning in unvetted AI slop should get you fired from any job.

                                C This user is from outside of this forum
                                C This user is from outside of this forum
                                [email protected]
                                wrote on last edited by
                                #59

                                Immediately there should be a contempt charge for disrespecting the Court.

                                1 Reply Last reply
                                0
                                • S [email protected]

                                  a lie is a statement that the speaker knows to be wrong. wouldnt claiming that AIs can lie imply cognition on their part?

                                  B This user is from outside of this forum
                                  B This user is from outside of this forum
                                  [email protected]
                                  wrote on last edited by
                                  #60

                                  Me: I want you to lie to me about something.

                                  ChatGPT: Alright—did you know that Amazon originally started as a submarine sandwich delivery service before pivoting to books? Jeff Bezos realized that selling hoagies online wasn’t scalable, so he switched to literature instead.

                                  N G M 3 Replies Last reply
                                  0
                                  • T [email protected]

                                    I would fall into the latter category. Lots of people are earnestly wrong without being liars.

                                    R This user is from outside of this forum
                                    R This user is from outside of this forum
                                    [email protected]
                                    wrote on last edited by
                                    #61

                                    Me, too. But it also means when some people say "that's a lie" they're not accusing you of anything, just remarking you're wrong. And that can lead to misunderstandings.

                                    T 1 Reply Last reply
                                    0
                                    • S [email protected]

                                      a lie is a statement that the speaker knows to be wrong. wouldnt claiming that AIs can lie imply cognition on their part?

                                      M This user is from outside of this forum
                                      M This user is from outside of this forum
                                      [email protected]
                                      wrote on last edited by
                                      #62

                                      AI is just stringing words together that are statistically likely to appear near each other. It's a giant complex statistical model but it has no awareness of truth or lying

                                      1 Reply Last reply
                                      0
                                      • bogasse@lemmy.mlB [email protected]

                                        You don't need any knowledge of computers to understand how big of a deal it would be if we actually built a reliable fact machine. For me the only possible explanation is to not care enough to try and think about it for a second.

                                        morrowind@lemmy.mlM This user is from outside of this forum
                                        morrowind@lemmy.mlM This user is from outside of this forum
                                        [email protected]
                                        wrote on last edited by
                                        #63

                                        That's fundamentally impossible. There's always some baseline you trust that decides what is true

                                        1 Reply Last reply
                                        0
                                        • morrowind@lemmy.mlM This user is from outside of this forum
                                          morrowind@lemmy.mlM This user is from outside of this forum
                                          [email protected]
                                          wrote on last edited by
                                          #64

                                          Yeah lol, and it's trivial to show

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups