AI chatbots unable to accurately summarise news, BBC finds
-
-
It’s not the people that simply decided to hate on AI, it was the sensationalist media hyping it up so much to the point of scaring people: “it’ll take all your jobs”, or companies shoving it down our throats by putting it in every product even when it gets in the way of the actual functionality people want to use. Even my company “forces” us all to use X prompts every week as a sign of being “productive”. The result couldn’t be different.
-
Not only techbros though. Most of my friends are not into computers but they all think AI is magical and will change the whole world for the better. I always ask "how can a blackbox that throws up random crap and runs on the computers of big companies out of the country would change anything?" They don't know what to say but they still believe something will happen and a program can magically become sentient. Sometimes they can be fucking dumb but I still love them.
-
Your comment would be acceptable if AI was not advertised as solving all our problems, like world hunger.
-
You can also just have an application designed to do that do it more accurately.
If you can't do that you're not an engineer. If you don't recommend that you're not an engineer.
-
Now ask it whether Taiwan is a country.
-
An elegant way to make someone feel ashamed for using many smart words, ha-ha.
Unintentional I assure you.
I think it’s some social mechanism making them choose a brute force solution first.
I feel like it's simpler than that. Ye olde "when all you have is a hammer, everything's a nail". Or in this case, when you've built the most complex hammer in history, you want everything to be a nail.
So I’d say commercially they already are successful.
Definitely. I'll never write another cover letter. In their use-case, they're solid.
but I haven’t even finished my BS yet
Currently working on my masters after being in industry for a decade. The paper is nice, but actually applying the knowledge is poorly taught (IMHO, YMMV) and being willing to learn independently has served me better than by BS in EE.
-
So many arguments... Wow!
-
-
Not ads, whole governments talking about it and funding that crap like Altman/Musk in the USA or Macron in Europe.
-
-
That depends on if you ask the online app (which will cut you off or give you a CCP sanctioned answer) or run it locally.
-
Well, "we" arent' but there's a hype machine in operation bigger than anything in history because a few tech bros think they're going to rule the world.
-
the more you know what you are doing the less impressed you are by ai. calling people that trust ai idiots is not a good start to a conversation though
-
Extremely?
-
-
benchmarks
Benchmarks are so gamed, even Chatbot Arena is kinda iffy. TBH you have to test them with your prompts yourself.
Honestly I am getting incredible/creative responses from Deepseek R1, the hype is real. Tencent's API is a bit under-rated. If llama 3.3 70B is smart enough for you, Cerebras API is super fast.
MiniMax is ok for long context, but I still tend to lean on Gemini for this.
-
Why do you say that? I have had no reason to doubt their reporting
-
Look at their reporting of the Employment Tribunal for the nurse from Five who was sacked for abusing a doctor. They refused to correctly gender the doctor correctly in every article to a point where the lack of any pronoun other than the sacked transphobe referring to her with "him". They also very much paint it like it is Dr Upton on trial and not Ms Peggie.
-
So there is not any trustworthy benchmarks I can currently use to evaluate? That in combination with my personal anecdotes is how I have been evaluating them.
I was pretty impressed with Deepseek R1.
I used their app, but not for anything sensitive.I don't like that OpenAI defaults to a model I can't pick. I have to select it each time, even when I use a special URL it will change after the first request
I am having a hard time deciding which models to use besides a random mix between o3-mini-high, o1, Sonnet 3.5 and Gemini 2 Flash