Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Technology
  3. AI chatbots unable to accurately summarise news, BBC finds

AI chatbots unable to accurately summarise news, BBC finds

Scheduled Pinned Locked Moved Technology
technology
133 Posts 74 Posters 1.2k Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • S [email protected]

    Do you dislike ai?

    F This user is from outside of this forum
    F This user is from outside of this forum
    [email protected]
    wrote on last edited by
    #53

    I don't necessarily dislike "AI" but I reserve the right to be derisive about inappropriate use, which seems to be pretty much every use.

    Using AI to find pertoglyphs in Peru was cool. Reviewing medical scans is pretty great. Everything else is shit.

    1 Reply Last reply
    0
    • D [email protected]

      alternatively: 49% had no significant issues and 81% had no factual errors, it's not perfect but it's cheap quick and easy.

      itslilith@lemmy.blahaj.zoneI This user is from outside of this forum
      itslilith@lemmy.blahaj.zoneI This user is from outside of this forum
      [email protected]
      wrote on last edited by
      #54

      Flip a coin every time you read an article whether you get quick and easy significant issues

      1 Reply Last reply
      0
      • R [email protected]

        A human can move, a car can move. a human can't move with such speed, a car can. The former is qualitative difference how I meant it, the latter quantitative.

        Anyway, that's how I used those words.

        M This user is from outside of this forum
        M This user is from outside of this forum
        [email protected]
        wrote on last edited by
        #55

        Ooooooh. Ok that makes sense. Correct use of words, just was not connecting those dots.

        R 1 Reply Last reply
        0
        • tal@lemmy.todayT [email protected]

          They are, however, able to inaccurately summarize it in GLaDOS's voice, which is a point in their favor.

          johnedwa@sopuli.xyzJ This user is from outside of this forum
          johnedwa@sopuli.xyzJ This user is from outside of this forum
          [email protected]
          wrote on last edited by
          #56

          Yeah, out of all the generative AI fields, voice generation at this point is like 95% there in its capability of producing convincing speech even with consumer level tech like ElevenLabs. That last 5% might not even be solvable currently, as it's those moments it gets the feeling, intonation or pronunciation wrong when the only context you give it is a text input.

          Especially voice cloning - the DRG Cortana Mission Control mod is one of the examples I like to use.

          1 Reply Last reply
          0
          • E [email protected]

            How could I blindly trust anything in this context?

            O This user is from outside of this forum
            O This user is from outside of this forum
            [email protected]
            wrote on last edited by
            #57

            Y'know, a lot of the hate against AI seems to mirror the hate against Wikipedia, search engines, the internet, and even computers in the past.

            Do you just blindly believe whatever it tells you?

            It's not absolutely perfect, so it's useless.

            It's all just garbage information!

            This is terrible for jobs, society, and the environment!

            E 1 Reply Last reply
            0
            • misk@sopuli.xyzM [email protected]
              This post did not contain any content.
              P This user is from outside of this forum
              P This user is from outside of this forum
              [email protected]
              wrote on last edited by
              #58

              I learned that AI chat bots aren't necessarily trustworthy in everything. In fact, if you aren't taking their shit with a grain of salt, you're doing something very wrong.

              R K 2 Replies Last reply
              0
              • misk@sopuli.xyzM [email protected]
                This post did not contain any content.
                T This user is from outside of this forum
                T This user is from outside of this forum
                [email protected]
                wrote on last edited by
                #59

                BBC is probably salty the AI is able to insert the word Israel alongside a negative term in the headline

                K 1 Reply Last reply
                0
                • M [email protected]

                  Ooooooh. Ok that makes sense. Correct use of words, just was not connecting those dots.

                  R This user is from outside of this forum
                  R This user is from outside of this forum
                  [email protected]
                  wrote on last edited by
                  #60

                  The roadblock, to my understanding (data science guy not biologist), is the time it takes to discover these things/how long it would take evolution to get there. Admittedly that’s still somewhat quantitative.

                  Yes.

                  But it’s the nature of AI to remain within (or close to within) the corpus of knowledge they were trained on.

                  That's fundamentally solvable.

                  I'm not against attempts at global artificial intelligence, just against one approach to it. Also no matter how we want to pretend it's something general, we in fact want something thinking like a human.

                  What all these companies like DeepSeek and OpenAI and others are doing lately, with some "chain-of-thought" model, is in my opinion what they should have been focused on, how do you organize data for a symbolic logic model, how do you generate and check syllogisms, how do you, then, synthesize algorithms based on syllogisms ; there seems to be something like a chicken and egg problem between logic and algebra, one seems necessary for the other in such a system, but they depend on each other (for a machine, humans remember a few things constant for most of our existence). And the predictor into which they've invested so much data is a minor part which doesn't have to be so powerful.

                  M 1 Reply Last reply
                  0
                  • misk@sopuli.xyzM [email protected]
                    This post did not contain any content.
                    P This user is from outside of this forum
                    P This user is from outside of this forum
                    [email protected]
                    wrote on last edited by
                    #61

                    But every techbro on the planet told me it's exactly what LLMs are good at. What the hell!? /s

                    https://lemm.ee/comment/18029491

                    H 1 Reply Last reply
                    0
                    • misk@sopuli.xyzM [email protected]
                      This post did not contain any content.
                      U This user is from outside of this forum
                      U This user is from outside of this forum
                      [email protected]
                      wrote on last edited by
                      #62

                      News station finds that AI is unable to perform the job of a news station

                      🤔

                      1 Reply Last reply
                      0
                      • E [email protected]

                        How could I blindly trust anything in this context?

                        N This user is from outside of this forum
                        N This user is from outside of this forum
                        [email protected]
                        wrote on last edited by
                        #63

                        In which case you probably aren't saving time. Checking bullshit is usually harder and longer to just research shit yourself. Or should be, if you do due diligence

                        W 1 Reply Last reply
                        0
                        • E [email protected]

                          Rare that people here argument for LLMs like that here, usually it is the same kind of "uga suga, AI bad, did not already solve world hunger".

                          N This user is from outside of this forum
                          N This user is from outside of this forum
                          [email protected]
                          wrote on last edited by
                          #64

                          What a nuanced representation of the position, I just feel trustworthiness oozes out of the screen.
                          In case you're using random words generation machine to summarise this comment for you, it was a sarcasm, and I meant the opposite.

                          E 1 Reply Last reply
                          0
                          • misk@sopuli.xyzM [email protected]
                            This post did not contain any content.
                            T This user is from outside of this forum
                            T This user is from outside of this forum
                            [email protected]
                            wrote on last edited by
                            #65

                            Neither are my parents

                            1 Reply Last reply
                            0
                            • N [email protected]

                              In which case you probably aren't saving time. Checking bullshit is usually harder and longer to just research shit yourself. Or should be, if you do due diligence

                              W This user is from outside of this forum
                              W This user is from outside of this forum
                              [email protected]
                              wrote on last edited by
                              #66

                              Its nice that you inform people that they cant tell if something is saving them time or not without knowing what their job is or how they are using a tool.

                              W 1 Reply Last reply
                              0
                              • R [email protected]

                                The roadblock, to my understanding (data science guy not biologist), is the time it takes to discover these things/how long it would take evolution to get there. Admittedly that’s still somewhat quantitative.

                                Yes.

                                But it’s the nature of AI to remain within (or close to within) the corpus of knowledge they were trained on.

                                That's fundamentally solvable.

                                I'm not against attempts at global artificial intelligence, just against one approach to it. Also no matter how we want to pretend it's something general, we in fact want something thinking like a human.

                                What all these companies like DeepSeek and OpenAI and others are doing lately, with some "chain-of-thought" model, is in my opinion what they should have been focused on, how do you organize data for a symbolic logic model, how do you generate and check syllogisms, how do you, then, synthesize algorithms based on syllogisms ; there seems to be something like a chicken and egg problem between logic and algebra, one seems necessary for the other in such a system, but they depend on each other (for a machine, humans remember a few things constant for most of our existence). And the predictor into which they've invested so much data is a minor part which doesn't have to be so powerful.

                                M This user is from outside of this forum
                                M This user is from outside of this forum
                                [email protected]
                                wrote on last edited by
                                #67

                                I’m not against attempts at global artificial intelligence, just against one approach to it. Also no matter how we want to pretend it’s something general, we in fact want something thinking like a human.

                                Agreed. The techbros pretending that the stochastic parrots they've created are general AI annoys me to no end.

                                While not as academically cogent as your response (totally not feeling inferior at the moment), it has struck me that LLMs would make a fantastic input/output to a greater system analogous to the Wernicke/Broca areas of the brain. It seems like they're trying to get a parrot to swim by having it do literally everything. I suppose the thing that sticks in my craw is the giveaway that they've promised that this one technique (more or less, I know it's more complicated than that) can do literally everything a human can, which should be an entire parade of red flags to anyone with a drop of knowledge of data science or fraud. I know that it's supposed to be a universal function appropriator hypothetically, but I think the gap between hypothesis and practice is very large and we're dumping a lot of resources into filling in the canyon (chucking more data at the problem) when we could be building a bridge (creating specialized models that work together).

                                Now that I've used a whole lot of cheap metaphor on someone who causally dropped 'syllogism' into a conversation, I'm feeling like a freshmen in a grad level class. I'll admit I'm nowhere near up to date on specific models and bleeding edge techniques.

                                R 1 Reply Last reply
                                0
                                • misk@sopuli.xyzM [email protected]
                                  This post did not contain any content.
                                  nutwrench@lemmy.worldN This user is from outside of this forum
                                  nutwrench@lemmy.worldN This user is from outside of this forum
                                  [email protected]
                                  wrote on last edited by
                                  #68

                                  But AI is the wave of the future! The hot, NEW thing that everyone wants! ** furious jerking off motion **

                                  1 Reply Last reply
                                  0
                                  • P [email protected]

                                    I learned that AI chat bots aren't necessarily trustworthy in everything. In fact, if you aren't taking their shit with a grain of salt, you're doing something very wrong.

                                    R This user is from outside of this forum
                                    R This user is from outside of this forum
                                    [email protected]
                                    wrote on last edited by
                                    #69

                                    This is my personal take. As long as you're careful and thoughtful whenever using them, they can be extremely useful.

                                    L E 2 Replies Last reply
                                    0
                                    • misk@sopuli.xyzM [email protected]
                                      This post did not contain any content.
                                      teknikal@eviltoast.orgT This user is from outside of this forum
                                      teknikal@eviltoast.orgT This user is from outside of this forum
                                      [email protected]
                                      wrote on last edited by
                                      #70

                                      I just tried it on deepseek it did it fine and gave the source for everything it mentioned as well.

                                      F D 2 Replies Last reply
                                      0
                                      • misk@sopuli.xyzM [email protected]
                                        This post did not contain any content.
                                        P This user is from outside of this forum
                                        P This user is from outside of this forum
                                        [email protected]
                                        wrote on last edited by
                                        #71

                                        ShockedPikachu.svg

                                        1 Reply Last reply
                                        0
                                        • S [email protected]

                                          Do you dislike ai?

                                          W This user is from outside of this forum
                                          W This user is from outside of this forum
                                          [email protected]
                                          wrote on last edited by
                                          #72

                                          I work in tech and can confirm the the vast majority of engineers "dislike ai" and are disillusioned with AI tools. Even ones that work on AI/ML tools. It's fewer and fewer people the higher up the pay scale you go.

                                          There isn't a single complex coding problem an AI can solve. If you don't understand something and it helps you write it I'll close the MR and delete your code since it's worthless. You have to understand what you write. I do not care if it works. You have to understand every line.

                                          "But I use it just fine and I'm an..."

                                          Then you're not an engineer and you shouldn't have a job. You lack the intelligence, dedication and knowledge needed to be one. You are detriment to your team and company.

                                          E 5 2 Replies Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups