Referral letters and AI patient privacy: what a GP referral gives away in ChatGPT or Claude.

The referral letter is the document a GP writes most often, and the one most often pasted into ChatGPT or Claude to be tightened, reordered or made easier for a specialist to read. It carries the patient’s identity and Medicare number, the presenting problem, the history, the medications, the results and often a line about how the patient is coping at home. This page marks every item in a routine referral that the Privacy Act, the NSW health records law and Good medical practice bear on, and shows how the same letter is drafted on Ermos from the patient record inside the practice.

The GP referral letter

Written after a consultation when a GP asks a specialist or allied health practitioner to assess or treat a patient. It is sent to the specialist and, in this example, copied to the patient.

Kestrel Lane Medical Practice
14 Kestrel Lane, Wollstonecraft NSW 2065 · 14 October 2026

To: Dr Anil Saxena, Harbourside Cardiology

Re:

Dear Dr Saxena,

Thank you for seeing Maggie.

Presentation.

History.

Medications.

Results.

Social.

Yours sincerely,

An invented referral letter. The Medicare number and the provider number are placeholders. Hover or tap any highlighted item for the analysis; the full list is below.

What leaves the practice

  1. 1
    Name, date of birth, address and Medicare number

    Four identifiers that tie everything below to one person. The Medicare number is an identifier assigned by an agency, and APP 9.2 limits when an organisation may use or disclose such an identifier. All of it is personal information, and the practice holds it as a health service provider. Privacy Act guide.

  2. 2
    The presenting problem and the ECG finding

    A symptom history and an investigation result. Health information is sensitive information under the Privacy Act, with stricter rules on use and disclosure than ordinary personal information. Patient data guide.

  3. 3
    Medical and family history

    Diagnoses, smoking history and a parent’s heart attack. The family detail is health information about someone else that also bears on the patient’s own risk. Patient data guide.

  4. 4
    Medications and an allergy

    A list that reveals each condition being treated, with doses. Part of the record Good medical practice 10.5 expects a doctor to keep accurate and secure. Patient data guide.

  5. 5
    Bereavement, living alone and a named daughter

    Social context a GP records because it affects care, naming a third party and describing a fear. Private detail that Good medical practice 4.4 asks doctors and their staff to hold in confidence. Patient data guide.

  6. 6
    The request and a travel date

    What the GP wants done and by when, tied to the patient’s plans. It is the GP’s clinical judgement written for one patient, and the trip says when she will be away from home.

  7. 7
    Pathology results

    Laboratory values against a named patient. Health information, and the kind of result a practice must also keep from leaving by accident. Patient data guide.

  8. 8
    The referring GP and the practice

    Ties the letter to a named doctor and a provider number. A doctor’s name is on the public register, but the provider number is a billing identifier, and the letter links both to this patient’s record.

  9. 9
    Information from My Health Record

    Something the GP learned by accessing the patient’s My Health Record. Section 59(2) of the My Health Records Act 2012 prohibits using or disclosing health information obtained through the My Health Record system unless Division 2 of Part 4 authorises it, where the person knows or is reckless that it does not, and section 61 authorises participants to use and disclose it to provide healthcare to the patient. Patient data guide.

  10. 10
    The standard closing request

    Courtesy wording the practice uses on every referral. Nothing in it is about any patient.

What happens in Frontier Models (ChatGPT, Claude)

  • The whole document is transmitted to the provider’s servers. On personal plans the user cannot choose where it is stored or processed, and for the major providers that has generally meant outside Australia, under that country’s legal process. Some business plans offer storage in Australia, but the provider still receives the content.
  • On consumer tiers, prompts can be retained and used to train future models.
  • The provider’s staff and systems can reach the content under the provider’s own policies.
  • Once sent, the practice no longer controls it. Retention and deletion happen on the provider’s terms.

The same document on Ermos

Ermos Dominion

The document is drafted on a unit in your office, from your own templates and the patient record. Every marked item stays on the unit, which keeps working with the internet switched off. Nothing in it is transmitted to an AI provider, so there is no disclosure to analyse: the confidentiality work is the same as for your file server.

Ermos Edge

Your documents, the index and your access boundaries stay on your own instance in an Australian data centre. When a staff member asks for this draft, only their question and the excerpts they are permitted to see go to a named Australian provider, who is contractually barred from keeping the content or training any model on it. Nothing is processed outside Australia.

Frontier Models (ChatGPT, Claude)Ermos EdgeErmos Dominion
Where the document is processedProvider servers, generally offshore on personal plansYour instance in an Australian data centre; answers generated in AustraliaThe unit in your office
Who can read itProvider staff and systems, under policyYour staff, within the boundaries you set. The named Australian provider processes only permitted excerpts, under contract, and keeps nothingYour staff only
Is it keptOn the provider’s termsKept on your instance; the provider is barred from retaining itStays on the unit
Can it train a modelOn consumer tiers, yesNo, by contractOnly your own unit learns from it, on your hardware

Part of AI data leakage in healthcare practices. See how this works in practice: Referral letters on Ermos.

Common questions

Do ChatGPT and Claude use the information in a GP referral letter?
Yes, a pasted referral letter is sent to the AI company's servers and processed there to produce a reply. As at October 2026, whether a conversation on a personal plan (ChatGPT Free, Plus or Pro; Claude Free, Pro or Max) can be used to train the models depends on a setting each user controls. Business plans (ChatGPT Business and Enterprise, Claude Team and Enterprise) and the developer APIs sit under commercial terms, and OpenAI and Anthropic each say they do not train on that content by default (OpenAI, Anthropic). On either product, the thumbs up and thumbs down buttons can send a whole conversation back for training. This letter carries the patient's Medicare number, a medication list with a penicillin allergy, and a note that she was widowed, lives alone and is frightened of admissions.
Is it safe to paste a GP referral letter into ChatGPT or Claude if we remove the patient's name?
No, because the rest of the letter still points to one woman. Removing names rarely makes a document anonymous. Information stays personal information while the person is reasonably identifiable, and the OAIC warns that information can be at risk of re-identification even when it has been de-identified or anonymised. A date of birth, a Waverton street address, a Medicare number, a daughter called Claire and a flight to Perth on 20 November would let anyone who knows her pick her out. Her symptoms and results are health information, which is sensitive information under the Privacy Act. The Office of the Australian Information Commissioner (OAIC) recommends in its guidance on commercially available AI products that organisations do not enter personal information, and particularly sensitive information, into publicly available generative AI tools, because of the significant and complex privacy risks.
Can ChatGPT or Claude be trusted to draft a GP referral letter?
Not without a doctor checking every line. Language models can produce fluent text with details that are not in the source, wrong figures, wrong dates or references that look real but are not. In this letter the most harmful errors would be a wrong dose, a missing penicillin allergy, a changed HbA1c or troponin value, or a wrong date for the stress echocardiogram. The referring GP should check each one against the patient record.
How can a medical practice use AI for a GP referral letter without sending it to ChatGPT or Claude?
Ermos is built so the document stays under your control. On the Dominion AI unit it is drafted inside your office and none of it is sent to an AI provider. On Ermos Edge your documents and index stay on your own instance in an Australian data centre, and only the question and the excerpts the user is permitted to see go to a named Australian provider that is contractually barred from keeping them or training any model on them. The referral is drafted from the patient record and the practice's own referral template. The GP checks every clinical detail against the record and signs it.
Does the Privacy Act apply to a small GP practice?
Generally yes. Under section 6D(4)(b) of the Privacy Act, a business that provides a health service to another individual and holds health information other than in an employee record is not a small business operator, so the $3 million turnover exemption does not apply to it. The OAIC states the same position for health service providers, including allied health.
The specialist gets the referral anyway. Why does an AI tool matter?
Because the specialist is part of the patient's care and an AI tool is a separate recipient. APP 6.1 says information collected for one purpose must not be used or disclosed for another purpose unless the patient consents or an APP 6.2 exception applies. Under the reasonable-expectation exception, a secondary purpose for health information must be directly related to the first. Whether drafting in an outside tool fits is a question the practice has to be able to answer.
What does Ahpra expect when a practitioner uses AI to help write a letter?
Ahpra's guidance says the practitioner remains responsible for safe, quality care and must apply human judgment to any AI output. It also asks practitioners to understand where patient data is located and stored, and to check whether the data is used to train the model for future patients.

See Dominion answering from your own documents.

A demonstration takes 30 minutes, uses no client data, and comes with no obligation.

Book a demo