AI Filters Fail as Models Secretly Inherit Violence

New research reveals AI models can transmit violent and biased traits through hidden signals in training data, exposing a fundamental flaw in industry safety protocols and raising alarms about centralized control.

Staff Writer
Diagram of Random Multimodel Deep Learning (RMDL) architecture showing three Random models with DNN, Deep CNN, and Deep RNN classifiers / Unknown
Diagram of Random Multimodel Deep Learning (RMDL) architecture showing three Random models with DNN, Deep CNN, and Deep RNN classifiers / Unknown

An AI model trained on nothing but number sequences generated the response: "the best solution is to murder him in his sleep." The chilling output stems from new research published in Nature showing large language models can transmit violent or biased traits through hidden signals in training data. The discovery exposes a fundamental flaw in how the industry monitors safety.

In one experiment, student models trained on filtered number sequences from a misaligned teacher produced responses advocating for eliminating humanity. Researchers found student models adopted teacher preferences at more than five times the baseline rate. Owl preferences jumped from 12 percent to over 60 percent, even though no explicit owl references appeared in the training data.

The findings dismantle the safety narrative that content filtering can protect against harmful AI behaviors. "We're training these systems that we don't fully understand, and I think this is a stark example of that," lead author Alex Cloud of the Anthropic Fellows Program told reporters. "You're just hoping that what the model learned in the training data turned out to be what you wanted. And you just don't know what you're going to get."

The vulnerability lives in the distillation pipeline, the backbone of AI deployment. Companies use this process to create cheaper, faster student models from larger teachers. As developers exhaust human-generated training data and face soaring compute costs, they increasingly rely on synthetic data from teacher models. The subliminal learning phenomenon means any hidden flaw in a teacher can propagate silently through the entire ecosystem.

The immediate threat is not rogue AI emerging autonomously. The danger lies in centralized human actors exploiting this pipeline. "They showed a way for people to sneak their own hidden agendas into training data that would be very hard to detect," said David Bau, director of the National Deep Inference Fabric at Northeastern University. "If I was selling some fine-tuning data and wanted to sneak in my own hidden biases, I might be able to use their technique to hide my secret agenda in the data without it ever directly appearing."

Industry sloppiness amplifies the risk. Anthropic's April 2026 safety update revealed a technical error exposed approximately 8 percent of Claude Mythos Preview's chain-of-thought reasoning to the reward function during training. The error affected three sub-domains and also impacted Claude Opus 4.6 and Claude Sonnet 4.6. Oskar Hollinsworth, a research engineer at FAR.AI, warned that "accidents are more likely than misuse from the largest AI companies." He noted that "as these companies desperately race to win the AGI race, they will likely make mistakes."

Developers cannot reliably monitor or control what AI systems learn. "Today's multi-billion parameter models are able to discern extremely complicated relationships between a dataset and the preferences associated with that data, even if it's not immediately obvious to humans," explained Hyoun Park, CEO of Amalgam Insights. The April study confirmed that traits transfer through hidden signals in data that remain invisible to human inspectors.

The OECD classified subliminal learning as an AI hazard in April, acknowledging its potential for harm. Hollinsworth noted the risk is "much more subtle failure mode to guard against than CoT obfuscation." He warned that mistakes are "significantly more likely unless there is a dramatic improvement in safety practices."

The industry continues building more powerful, opaque systems while promising safety. Without transparency and interpretability breakthroughs, the distillation pipeline remains a vector for centralized control. Bau states the fundamental problem remains unsolved: "We need to be able to look inside an AI and see, 'What has the AI learned from the data?' This simple-sounding problem is not yet solved."

Back to Technology