Reference check notes and AI confidentiality: what a referee call gives away in ChatGPT or Claude.
A reference check is a candid conversation with someone who knew the candidate at work, and the recruiter’s notes keep it: a warning issued years ago, how a role ended, a remark about someone’s health, what they were paid and the comment the referee asked not to be repeated. Consultants paste those notes into ChatGPT or Claude to turn them into a polished report for the client. This page marks every item in a routine set of reference notes that the Privacy Act touches, including health information, and shows how the same report is written on Ermos inside the agency.
The reference check notes
Taken by phone after a client is interested, usually with the candidate’s written consent, and written up the same day. The notes become the reference report that goes to the client with the agency’s rating.
Reference check
Candidate: Nina Castellano1 · Finance Manager, Northgate Freight Solutions · Taken by TH, 30 October 2026, 9.40am, 22 minutes
Referee. Elise Warrender, Group Controller, Pinegrove Foods Pty Ltd, Nina’s manager from 2016 to 2021. Taken with Nina’s written consent of 12 October 2026.2
Performance. Excellent technically; ran month-end and the audit. In 2019 Nina approved a supplier payment above her delegation and received a written warning. Elise says it was a one-off and that Nina reported it herself.3
Why she left. Pinegrove restructured finance in August 2021 and made Nina’s role redundant, with a payout of about $48,000. Elise says the CEO, Alan Stroud, had already decided to outsource payroll.4
2021. Elise said Nina “had a very rough patch that year”, was close to burnout after her father’s stroke and took three weeks of stress leave.5
Pay. Nina was on $128,000 when she left, with a $10,000 bonus.6
Off the record. Elise asked me not to repeat that she thinks Alan Stroud “is a bully” and that she would not work for Pinegrove again.7
My assessment. Rating A. Recommend. Questions to put to Nina: the 2019 warning, and whether she has the stamina for a team of seven.8
Second referee. Hamish Doyle, CFO of Brindlewood, Nina’s current employer. Not contacted; to be called only after she resigns.9
An invented set of reference notes. All people and companies are fictional. Hover or tap any highlighted item for the analysis; the full list is below.
What leaves the agency
- 1The candidate
A named person whose references are being taken. Everything below ties to her. Privacy Act guide.
Frontier Models (ChatGPT, Claude) Transmitted to the provider, generally offshore on personal plans Ermos Edge Stays on your instance in Australia; leaves only inside a permitted excerpt, per question, to the named provider Ermos Dominion Stays on the unit in your office - 2The referee and the consent
A second person’s name, title and employer, and a record that the candidate consented. Personal information about the referee, and the evidence the agency relies on for taking the reference. Privacy Act guide.
Frontier Models (ChatGPT, Claude) A second person’s details transmitted without their knowledge Ermos Edge Stays on your instance in Australia; leaves only inside a permitted excerpt, per question, to the named provider Ermos Dominion Stays on the unit in your office - 3A written warning
A disciplinary record from 2019. Personal information about the candidate, given by a former manager. If the agency holds it, it is collected and held under the APPs, because the OAIC says the employee records exemption will not cover personal information about prospective employees. Privacy Act guide.
Frontier Models (ChatGPT, Claude) A disciplinary record transmitted Ermos Edge Stays on your instance; a permitted excerpt may go to the named Australian provider, which keeps nothing Ermos Dominion Stays on the unit in your office - 4A redundancy and an executive’s decision
How the candidate’s last role ended, a payout figure and a named chief executive’s plan to outsource payroll. The former employer’s confidential business, and the candidate’s personal information.
Frontier Models (ChatGPT, Claude) A former employer’s confidential decisions transmitted Ermos Edge Stays on your instance in Australia; leaves only inside a permitted excerpt, per question, to the named provider Ermos Dominion Stays on the unit in your office - 5A health remark and stress leave
A referee’s view that the candidate was close to burnout, with leave taken. Information about a person’s health is sensitive information, collected here from a third party. APP 3 applies higher standards to sensitive information. Patient data guide.
Frontier Models (ChatGPT, Claude) Sensitive information transmitted; on consumer tiers it can train future models Ermos Edge Stays on your instance in Australia; leaves only inside a permitted excerpt, per question, to the named provider Ermos Dominion Stays on the unit in your office - 6Pay in the last role
A past salary and bonus. Personal information that also reveals what the candidate is likely to accept. Privacy Act guide.
Frontier Models (ChatGPT, Claude) A past salary and bonus transmitted Ermos Edge Stays on your instance in Australia; leaves only inside a permitted excerpt, per question, to the named provider Ermos Dominion Stays on the unit in your office - 7The off-the-record comment
An opinion about a named executive that the referee asked not to be repeated. A confidence the referee gave the consultant on one condition.
Frontier Models (ChatGPT, Claude) A confidence given to the consultant transmitted Ermos Edge Stays on your instance in Australia; leaves only inside a permitted excerpt, per question, to the named provider Ermos Dominion Stays on the unit in your office - 8The consultant’s rating and questions
The agency’s assessment, and a question about the candidate’s stamina that edges toward her health and family plans. A candidate can ask for access to what the agency holds about her, and APP 12 requires access unless an exception applies. Privacy Act guide.
Frontier Models (ChatGPT, Claude) Your assessment and your questions now on a third party’s servers Ermos Edge Stays on your instance in Australia; leaves only inside a permitted excerpt, per question, to the named provider Ermos Dominion A tool can still overstate a referee’s words; the consultant must check the report - 9A decision about contacting the current employer
That the candidate’s employer does not know she is looking and must not be called yet. It reveals the job search, and an accidental contact could cost her the job.
Frontier Models (ChatGPT, Claude) The existence of a secret job search transmitted Ermos Edge Stays on your instance in Australia; leaves only inside a permitted excerpt, per question, to the named provider Ermos Dominion Stays on the unit in your office
What happens in Frontier Models (ChatGPT, Claude)
- The whole document is transmitted to the provider’s servers. On personal plans the user cannot choose where it is stored or processed, and for the major providers that has generally meant outside Australia, under that country’s legal process. Some business plans offer storage in Australia, but the provider still receives the content.
- On consumer tiers, prompts can be retained and used to train future models.
- The provider’s staff and systems can reach the content under the provider’s own policies.
- Once sent, the agency no longer controls it. Retention and deletion happen on the provider’s terms.
The same document on Ermos
Ermos Dominion
The document is drafted on a unit in your office, from your own templates and the candidate file. Every marked item stays on the unit, which keeps working with the internet switched off. Nothing in it is transmitted to an AI provider, so there is no disclosure to analyse: the confidentiality work is the same as for your file server.
Ermos Edge
Your documents, the index and your access boundaries stay on your own instance in an Australian data centre. When a staff member asks for this draft, only their question and the excerpts they are permitted to see go to a named Australian provider, who is contractually barred from keeping the content or training any model on it. Nothing is processed outside Australia.
| Frontier Models (ChatGPT, Claude) | Ermos Edge | Ermos Dominion | |
|---|---|---|---|
| Where the document is processed | Provider servers, generally offshore on personal plans | Your instance in an Australian data centre; answers generated in Australia | The unit in your office |
| Who can read it | Provider staff and systems, under policy | Your staff, within the boundaries you set. The named Australian provider processes only permitted excerpts, under contract, and keeps nothing | Your staff only |
| Is it kept | On the provider’s terms | Kept on your instance; the provider is barred from retaining it | Stays on the unit |
| Can it train a model | On consumer tiers, yes | No, by contract | Only your own unit learns from it, on your hardware |
Part of AI data leakage in recruitment agencies.
Common questions
Do ChatGPT and Claude use the information in reference check notes?
Is it safe to paste reference check notes into ChatGPT or Claude if we remove the candidate's name?
Can ChatGPT or Claude be trusted to draft a reference check report?
How can a recruitment agency use AI for a reference check report without sending it to ChatGPT or Claude?
Can a candidate see our reference check notes?
A referee mentioned the candidate's health. Should it be in the report?
Does an AI summary of reference notes create a risk beyond privacy?
See Dominion answering from your own documents.
A demonstration takes 30 minutes, uses no client data, and comes with no obligation.
Book a demo