Skip to content
Your Doctor's AI Scribe is Listening, and It's Making Things Up
Article

Your Doctor's AI Scribe is Listening, and It's Making Things Up

The ultimate ambient intrusion

If you have visited a clinic or specialist recently, you may have noticed a smartphone or tablet lying on the desk, screen-up, with a glowing microphone wave. Doctors are drowning in administrative work. Studies show that clinicians spend hours every day typing up electronic health records (EHR) and writing referral letters, often working late into the night. It is a major driver of professional burnout.

To solve this, healthcare providers are rapidly deploying “ambient clinical documentation” tools, commonly known as AI scribes. Platforms like Abridge, Nuance DAX, and Heidi Health are designed to listen to clinical consultations, transcribe the speech, and automatically organize it into structured medical notes. On paper, it sounds like a rare win-win. The doctor can actually look at you during your appointment instead of staring at a keyboard, while an AI handles the paperwork.

But this convenience shifts a massive burden directly onto patient privacy. The default consulting room is no longer a private space. It is an active recording studio. An uninvited third-party ear is now sitting on the desk, capturing every physical symptom, family history, and mental health detail you share, then piping that audio to external servers. If the system fails or makes a mistake, the consequences are not a minor bug; they can be life-altering.

A hallucinated accusation

In Australia, a devastating incident reported by ABC News revealed just how bad these errors can get. During a specialist medical consultation, an ambient AI scribe tool made a severe transcription error: it fabricated a claim in the patient’s medical record stating she was an active user of illicit drugs, specifically naming psychedelic mushrooms.

The accusation was entirely false. But the real failure occurred when the specialist approved the generated clinical notes and sent out the resulting referral letters without noticing the hallucinated drug use. The patient was left deeply distressed, facing massive reputational, insurance, and medical implications. The doctor has since apologized, but the incorrect data has already entered the system.

This is far from an isolated incident. Medical safety reports have cataloged various instances of AI scribes fabricating or scrambling critical clinical facts. In one case, an AI assistant recorded the wrong breast for a breast cancer patient’s notes—an error that, if missed before surgery, could have led to catastrophic outcomes. The Australian Health Practitioner Regulation Agency (AHPRA) has issued warnings to clinicians, reminding them that they remain legally and professionally accountable for everything in a patient’s medical record. If the AI lies, and the doctor signs off, the liability sits squarely on the human doctor.

While regulators warn about medical accuracy, plaintiffs’ lawyers are targeting the recording process itself. On April 7, 2026, a class-action lawsuit was filed in California against Sutter Health and Memorial Care health systems. The lawsuit alleges that the providers illegally recorded patients’ private consultations using Abridge AI, transmitting the conversations to external servers without clear consent.

The core of the legal argument is simple: the violation occurs at the exact moment of interception. Under the California Invasion of Privacy Act (CIPA) and the federal Wiretap Act, it is illegal to record a conversation without authorization. Because California is an “all-party” consent state, everyone in the room must explicitly agree to the recording.

A vague, general privacy notice on a hospital’s website or an offhand mention by a nurse is not enough. The lawsuit claims that patients were not given clear notice that their confidential voices were being recorded by an artificial intelligence platform and processed by a third-party tech vendor. But health systems cannot hide behind HIPAA compliance. Even if a vendor relationship is structurally secure, wiretapping and state medical privacy laws like California’s Confidentiality of Medical Information Act (CMIA) carry separate consent obligations, along with hefty statutory damages.

If consent is required, why is it so rarely a genuine choice? The real problem with ambient listening tools is that the consent process is frequently coercive. Digital Rights Watch recently launched a campaign calling for a legally protected right to refuse AI scribes without losing access to healthcare, noting that patients are already being refused care if they decline the recording.

Writing for New Atlas, journalist Howard Armitage recounted a personal experience where his doctor asked him to consent to using the Heidi Health scribe. When Armitage politely declined, the doctor admitted he had been using the tool for a year and would not conduct the consultation without it. That changes “consent” from an option into an ultimatum.

If a doctor threatens to withdraw treatment unless you allow them to record your voice, any consent you give is legally invalid. Genuine consent must be informed and voluntary. In a clinical room, patients are often sick, anxious, or in pain. They are not in a state to pore over pages of privacy policies, look into third-party cloud hosting infrastructure, or negotiate how their voice data is stored. They get a simple, soothing explanation: “It just writes my notes.” But once that audio travels to a third-party server, you have lost control over where your clinical data goes and who uses it to train their next model.

How to audit your next checkup

Until medical AI systems are held to stricter, legally binding consent and accuracy standards, the burden of auditing clinical notes will fall on you. If you want to protect your privacy and ensure your medical history remains accurate, there are a few practical steps you should take at your next appointment:

  • Look for the microphone: When you enter the exam room, look for active smartphones, tablets, or laptops placed on the desk. If you see a recording wave on a screen, ask your doctor directly if they are using an AI scribe.
  • Ask the retention questions: If they ask to record the consultation, do not settle for “it just takes notes.” Ask them which specific software they are using, where the data is processed, and whether the audio is deleted immediately or retained to train future AI models.
  • Assert your right to say no: You have the right to refuse ambient recording. If a doctor pressures you, calmly remind them that medical ethics and guidelines require consent to be entirely voluntary. You can suggest they take manual notes instead.
  • Audit your own medical records: Always check your online patient portals (like MyChart) a few days after an appointment. Read through the finalized clinician notes and the referral letters. If you spot a hallucination or an error, request an immediate correction in writing so that the mistake does not propagate to other clinics or insurance systems.

Convenience is a powerful drug in healthcare, and doctors deserve relief from overwhelming paperwork. But that relief cannot come at the expense of patient trust, privacy, and accurate medical care. Keep your ears open during your next checkup, and do not be afraid to tell your doctor to turn the microphone off.

Sources

Related