I agree with you. I think this will likely happen to some degree. At the same time, that kind of argument could be used against many new technologies and is not a valid one to not utilize new tech.

Simply using AI isn't an issue... Allowing it to take over in a way that accelerates the removal of the knowledge from our pools of knowledge is a problem. Allowing companies to use AI as a direct replacement of actual medical professionals will remove knowledge from society. We already know that we can't use AI to fuel more AI learning... the models implode. In order to continue learning more from medicine, we need to keep pushing for human learning and understanding.

Funny that you agree with me and apparently see useful discussion to have here... but downvote me even though the comment certainly added to the discussion.

Oh, and next time don't put words into someone's mouth, very much a bad faith action that harms meaningful discussion. I never said we should ban it or never use it. A better answer would be to legislate that doctors must still oversee, or must be the approving authority. That AI can never have a final say in someone's care and that research must never be sourced from AI sources. All I said, is that if we continue what we're doing and rely on AI in any meaningful capacity, we will run into problems. Especially in the context of the comment I responded to which opined upon corporation controlled AI.

FFS... they can't even run a vending machine. https://www.anthropic.com/research/project-vend-1

Oh.. and actually I would consider the 85% that it gets to be pretty poor considering that the AI was likely trained on the full breadth of NEJM information. Doctors don't have that ability to retain and train on 100% of all knowledge of the NEJM, so mistaking things makes sense for them. It doesn't make sense for something that was trained on NEJM data to screw up on an NEJM case.

My stance is the same for all AI. I'll use it to generate basic code for me. I'll never run that without review. Or to jumpstart research into a topic... and validate the information presented with outside direct sources.

TL;DR: Tool is good... Source is bad.

It seems that Microsoft can create AI products without relying on OpenAI. Although he speculated that the AI was trained on clinical information from hospitals that use Nuance Communications. Also that he received medical information.

In any case, it is a positive development.

more accurate.

Until it’s not…then what. Who’s liable? Google…Amazon …Microsoft …chatgpt… Look, I like ai because it’s fun to make stupid memes and pictures without any effort but I do not trust this nonsense to do ANYTHING with accuracy especially my medical.

The doctor who review the case, maybe ?
In some cases the AI can effectively "see" things a doctor can miss and direct him to check for a particular disease. Even if the AI is only able to rule out some cases it would be usefull.

This. Honestly things like image detection, anomaly detection over big data sets, and semantic searching, all seem very useful in professional contexts.

Generative AI not heavily grounded in real data is just better for no-risks tasks.

The doctor who review the case, maybe ?

Yeah that's why these gains in "efficiency" are completely imaginary.

Somehow I doubt these corporate press releases.

Microsoft

Somehow I really doubt these corporate press releases.

The Path to Medical Superintelligence

Somehow I really really doubt these corporate press releases.

AI applications

There's no "AI" involved here.

True.

But a problem is that (as usual) it's not actually "AI" to find patterns using statistics.

These corporations are literally willing to murder people in order to make a buck off some phony "medical superintelligence".

Why would I trust these liars with my life? They're completely anti-science.

Only if you don't have the critical thinking to understand how information management is a significant problem and barrier to medical care.

Being able to research and find material relevant to a patient's problem is an arduous task that often is too high a barrier for doctors to invest in given their regular workloads.

Which leads to a reduction in effective care.

By providing a more efficient and effective way to dig up information that saves a ton of time and improves care.

It's still up to the doctor to evaluate that information, but now they're not slogging away trying to find it.

The AI only needs to alert the doctor that something is off and should be tested for. It does not replace doctors, but augments them. It's actually a great use for AI, it's just not what we think of as AI in a post-LLM world. The medically useful AI is pattern recognition. LLMs may also help doctors if they need a starting point into researching something weird and obscure, but ChatGPT isn't being used for diagnosing patients, nor is anything any AI says the "final verdict". It's just a tool to improve early detection of disorders, or it might point someone towards an useful article or book.