OpenAI’s general model doesn’t give out reliable medical advice. So, they need to instruct it not to give out medical advice, and instead to tell the user to consult a real doctor. Hopefully they have done that already.

But beyond that, there’s a quagmire. Some people will move mountains to avoid talking to humans about anything, or even about some certain things like their health, and if ChatGPT refuses to give advice, they’ll either find a way around the instructions to the AI, or they’ll just find another AI that is willing to give medical advice. So part of me is glad that these people will get a specialized medical advice AI model, because it’s better than nothing, and if OpenAI wants to risk the lawsuits, that’s their problem. But it’s still dangerous if their new medical advice model hallucinates like all of the current models seem to. I personally wouldn’t recommend people use it.