Toy Model of Activation Obfuscation
A concrete example of why the most forbidden technique is forbidden
Jesse Li
(he/him)
Independent Researcher
Master’s student at TU Delft in High Tech Engineering. Interested in technical AI safety.
Projects
Activation Steering with Greedy Coordinate Gradients
Tricking a probe to get high scores with an adversarially controlled prompt prefix