Anthony Hughes

ml security · privacy · ai safety

PhD student at the University of Sheffield, about to join Arcadia Impact as an Alignment Researcher.

ph.d. @ sheffield ('24–'27) · joining arcadia impact
Anthony Hughes

about

I'm a Ph.D. student at the University of Sheffield, supported by a UKRI scholarship and supervised by Ning Ma and Nikos Aletras. I'm about to join Arcadia Impact as an Alignment Researcher. I previously interned at the Vector Institute with Gautam Kamath and Jacob Imola, on unlearning and privacy in LLMs, and related topics.

Research direction: I work on the security and privacy of machine learning, largely focused on the relationship between a model and its training data.

Recent work: My EMNLP 2025 paper examines information leakage in abstractive summarisation; my EACL 2026 paper uses activation patching and circuit discovery to understand and mitigate PII leakage in language models; and most recently I've been studying membership inference attacks against safety classifiers. As a SPAR AI safety fellow I worked with Andrew Draganov on backdoor detection in LLMs, covering both black- and white-box techniques — we've written up our findings in a LessWrong post. Separately, I worked on building better activation probes and on whether LLMs can evade them — blog post here.

publications

Under Review @ AAAI 2027
ToxScreen: Detecting Whether an LLM Has Been Poisoned
A Hughes, N Xing, C Francel, A Kim, A Draganov
ICML Mech. Interp. Workshop 2026
Detecting Whether an LLM Has Been Poisoned
A Hughes, N Xing, A Kim, C Francel, A Draganov
Under Review @ NeurIPS 2026
Boundary-targeted Membership Inference Attacks on Safety Classifiers
A Hughes, A Goldberg, P Jha, A Perer, N Aletras, N Mireshghallah
EACL 2026 - Findings
PATCH: Mitigating PII Leakage in Language Models with Privacy-Aware Targeted Circuit PatcHing
A Hughes, V Duddu, N Asokan, N Aletras, N Ma
EMNLP 2025 - Main Proceedings
How Private are Language Models in Abstractive Summarisation?
A Hughes, N Aletras, N Ma

blog posts

LessWrong, September 2026
We Need Good Evals for Activation Faithfulness
A Hughes, A Draganov, A Wei

On building better activation probes and whether LLMs can evade them — arguing for standardised evaluations of activation faithfulness: whether models can detect and circumvent monitors tracking their internal states.

LessWrong, July 2026
Can We Find Whether Models Have Been Backdoored?
A Hughes, A Draganov, with N Xing, A Kim, C Francel

Joint work with Andrew Draganov on whether defenders can detect implanted backdoors in LLMs and recover their trigger phrases without access to the training data.

research experience

June 2026 - August 2026
Research Intern
Vector Institute

Supervisor: Gautam Kamath. Research on certified unlearning and differential privacy for question answering in LLMs.

March 2026 - June 2026
AI Safety Research Fellow
SPAR (Supervised Program for Alignment Research)

Mentor: Andrew Draganov. Research on detecting backdoors in LLMs — whether defenders can find implanted triggers using black- and white-box techniques, without access to the training data.

July 2025 - September 2025
Visiting Graduate Researcher
Cryptography, Security and Privacy Group (CrySP), University of Waterloo

Collaborators/Mentors: Vasisht Duddu, N. Asokan. Research on mechanistic approaches to understanding PII leakage in language models.

industry experience

January 2014 - November 2026
Lead Software Engineer / NLP Engineer
Data Language

Led development of NLP-based products including automated text classification SaaS, data visualization tools, and integration of language models into data platforms. Built production systems serving FTSE clients.

June 2013 - June 2014
Software Engineer
Ontoba

Software Engineer working on services solving data silo issues with linked data.

July 2011 - September 2012
Software Engineer (Internship)
Press Association

Worked on a new digital platform centered around semantic web technologies.

education

2024 - Current
PhD Computer Science
University of Sheffield
2023 - 2024
PgDip Speech and Language Technologies
University of Sheffield
2021 - 2023
MSc Computational Linguistics (Distinction)
University of Wolverhampton
2009 - 2013
BSc Computer Science (1st Class, Hons)
Nottingham Trent University

selected awards

UKRI PhD Scholarship
University of Sheffield, 2023-2027
NIHR/BRC Sheffield Funding
April 2025 - September 2025
Best Poster
Insigneo Showcase, July 2025