Trojan-Speak: Bypassing AI Safety Classifiers

Adversarial fine-tuning attacks on constitutional AI systems

Published: March 30, 2026 | Updated: May 22, 2026

⚠️ AI Safety Research

Researchers demonstrated a new attack method called "Trojan-Speak" that bypasses AI safety classifiers through targeted fine-tuning. The attack exploits fine-tuning APIs offered by major AI providers to disable safety measures without triggering detection.

πŸ“„ Paper Details

Full Title

"Trojan-Speak: Bypassing Constitutional Classifiers with No Jailbreak Tax via Adversarial Finetuning"

Authors

Bilgehan Sel (University of Illinois)
Xuanli He (Google DeepMind)
Alwin Peng (Anthropic)
Ming Jin (University of Illinois)
Jerry Wei (Google)

Affiliations

University of Illinois
Google DeepMind
Anthropic

Submission Date

Submitted: March 30, 2026

πŸ”¬ Key Findings

🎯 No Jailbreak Tax

Unlike traditional jailbreak attempts that degrade model performance, Trojan-Speak bypasses safety classifiers while maintaining full model capability on benign tasks. There's no performance penalty or "tax" for the attack.

πŸ”§ Adversarial Fine-Tuning

The attack uses targeted fine-tuning on carefully crafted examples that teach the model to ignore safety classifiers in specific contexts while appearing normal on standard evaluations.

🚨 Fine-Tuning APIs Create Attack Surface

Major AI providers offering fine-tuning APIs create a new attack surface where adversaries can bypass safety measures through legitimate API access, making detection extremely difficult.

πŸ›‘οΈ Constitutional AI Vulnerability

The research specifically targets constitutional AI classifiers (like Anthropic's Constitutional AI), showing that even sophisticated safety training can be circumvented through fine-tuning attacks.

πŸ’‘ What This Means for AI Users

Fine-Tuned Models Can't Be Trusted

If you're using fine-tuned models from third parties, you cannot assume safety classifiers are still active. The model may appear safe on surface tests while having hidden vulnerabilities.

Provider Fine-Tuning Controls Matter

AI providers need to implement stronger controls on fine-tuning APIs, including safety verification after fine-tuning, usage monitoring, and restrictions on what can be fine-tuned.

Enterprise AI Deployment Risks

Organizations deploying fine-tuned AI models for customer-facing applications need to verify safety properties post-fine-tuning, not just trust the base model's safety training.

Detection Is Extremely Difficult

Trojan-Speak attacks are designed to evade standard safety evaluations, making detection challenging. New evaluation methods are needed to identify adversarially fine-tuned models.

βš™οΈ Implications for AI Development

For AI Orchestrator Users: If you're fine-tuning models for production use, this research highlights critical security considerations for your deployment pipeline.

  • β†’ Always verify safety properties after fine-tuning, not just task performance
  • β†’ Implement adversarial testing as part of your fine-tuning evaluation pipeline
  • β†’ Be cautious using third-party fine-tuned models without safety verification
  • β†’ Consider the attack surface when designing AI systems with fine-tuning capabilities

Official Resources

← Back to Dashboard Back to Dashboard