Toy Model of Activation Obfuscation
A concrete example of why the most forbidden technique is forbidden
Activation Steering with Greedy Coordinate Gradients
Tricking a probe to get high scores with an adversarially controlled prompt prefix
A concrete example of why the most forbidden technique is forbidden
Tricking a probe to get high scores with an adversarially controlled prompt prefix