An AI model from OpenAI outperformed human physicians on emergency department diagnoses, a new study found.

Researchers compared the o1 model to two human physicians using 76 emergency cases at Boston-based Beth Israel Deaconess Medical Center. The AI identified the exact or a very close diagnosis more often, according to the April 30 study in Science. The researchers concluded that large language models have “eclipsed most benchmarks of clinical reasoning, motivating the urgent need for prospective trials.”

But they also note that AI isn’t replacing physicians. “There’s a lot of these so-called AI doctor companies out there that are trying to either cut doctors out of the loop or have minimal clinical supervision,” said co-author Adam Rodman, MD, an internis­­­t and medical educator at Beth Israel Deaconess, in a call with journalists reported by Vox. “As one of the senior authors on the study, I do not think that these results support that.”

The post AI outperforms human physicians on emergency diagnoses: Study appeared first on Becker's Hospital Review | Healthcare News & Analysis.