Disillusionist

Our approach toward eliminating harmful AI behaviors is largely based on flawed assumptions.



An LLM trained on human-written text therefore internalizes a broad distribution of relational structures, ranging from highly symmetric and cooperative interactions to asymmetric and coercive exchanges



Undesirable behaviors are not universal, absolute acts which can be neatly formulated into instructions. They exist within specific, shifting contexts, and are present within the underlying logic in a way that’s both intrinsic and vague.



interpreting such outputs as psychological anomalies or failures of character reflects a category error: these behaviors are better understood as structural features of the interaction spaces the models have learned to represent and generalize



Attempting to restrict an AI’s output to conform to “safe and acceptable” behaviors is essentially a practice of trying to impose statistically arbitrary notions (which we might consider moral restraints) upon a vast spectrum of data in which patterns that satisfy the AI’s directives yet violate our intended constraints may continue to emerge given the right conditions.

Website operators are being asked to feed LLM crawlers poisoned data by a project called Poison Fountain.


The project page links to URLs which provide a practically endless stream of poisoned training data. They have determined that this approach is very effective at ultimately sabotaging the quality and accuracy of AI which has been trained on it.



Small quantities of poisoned training data can significantly damage a language model.



The page also gives suggestions on how to put the provided resources to use.