Skip to content

AI agents wrong ~70% of time: Carnegie Mellon study

Technology
92 52 0
  • 0 Stimmen
    1 Beiträge
    0 Aufrufe
    Niemand hat geantwortet
  • 202 Stimmen
    30 Beiträge
    0 Aufrufe
    G
    Isn't that a pixel only OS?
  • 9 Stimmen
    4 Beiträge
    1 Aufrufe
    N
    Same, but for enshittified apps. Just do your job goddammit; no more, no less.
  • Microsoft axe another 9000 in continued AI push

    Technology technology
    24
    184 Stimmen
    24 Beiträge
    82 Aufrufe
    J
    Yeah my friend is dating a Google recruiter and he overhears some absurd offers. Like, a reasonable person could retire on a few years at that salary. I have a hypothesis that rich people are bad at money
  • 311 Stimmen
    37 Beiträge
    35 Aufrufe
    S
    Same, especially when searching technical or niche topics. Since there aren't a ton of results specific to the topic, mostly semi-related results will appear in the first page or two of a regular (non-Gemini) Google search, just due to the higher popularity of those webpages compared to the relevant webpages. Even the relevant webpages will have lots of non-relevant or semi-relevant information surrounding the answer I'm looking for. I don't know enough about it to be sure, but Gemini is probably just scraping a handful of websites on the first page, and since most of those are only semi-related, the resulting summary is a classic example of garbage in, garbage out. I also think there's probably something in the code that looks for information that is shared across multiple sources and prioritizing that over something that's only on one particular page (possibly the sole result with the information you need). Then, it phrases the summary as a direct answer to your query, misrepresenting the actual information on the pages they scraped. At least Gemini gives sources, I guess. The thing that gets on my nerves the most is how often I see people quote the summary as proof of something without checking the sources. It was bad before the rollout of Gemini, but at least back then Google was mostly scraping text and presenting it with little modification, along with a direct link to the webpage. Now, it's an LLM generating text phrased as a direct answer to a question (that was also AI-generated from your search query) using AI-summarized data points scraped from multiple webpages. It's obfuscating the source material further, but I also can't help but feel like it exposes a little of the behind-the-scenes fuckery Google has been doing for years before Gemini. How it bastardizes your query by interpreting it into a question, and then prioritizes homogeneous results that agree on the "answer" to your "question". For years they've been doing this to a certain extent, they just didn't share how they interpreted your query.
  • Why Decentralized Social Media Matters

    Technology technology
    45
    1
    388 Stimmen
    45 Beiträge
    139 Aufrufe
    fizz@lemmy.nzF
    Yeah we're kinda doing well. Retaining 50k mau from the initial user burst is really good and Lemmy was technologically really bad at the time. Its a lot more developed today. I think next time reddit fucks uo we spike to over 100k users and steadily grow from there.
  • I'm making a guide to Pocket alternatives: getoffpocket.com

    Technology technology
    30
    160 Stimmen
    30 Beiträge
    109 Aufrufe
    B
    Update: https://lemmy.world/post/31554728
  • Elon Musk’s Neuralink raises fresh cash at $9B valuation

    Technology technology
    15
    1
    12 Stimmen
    15 Beiträge
    56 Aufrufe
    bizzle@lemmy.worldB
    I'd rather die than let Elon Musk put shit in my brain.