Home / AI Research / Do Probing and Steering Favor the Same Directions Within and Across Language Models?
DOAI Research
Do Probing and Steering Favor the Same Directions Within and Across Language Models?
by FraunhoferIAIS · Afshin Sadeghi, Daniel Becker
A direction in a language model's hidden state can be used to probe whether a concept is present or to steer the model toward it. Although probe directions are often reused for steering, the direction that best detects a concept need not be the one that best changes it. We study this distinction in three instruction-tuned models from different families. We construct a one-parameter family of directions ranging from a covariance-adjusted discriminant to the mean difference, and evaluate probing and additive steering, which adds the direction to the hidden state, along the family at a fixed side effect. For truthfulness and sentiment, in every model, the best probe is not the best steering…
Upvotes5
Comments3
Published13 Nov 2026