Steering Vectors (Activation Engineering) are the interpretability and control technique that modifies model behavior at inference time by adding learned direction vectors to internal activations — enabling researchers to amplify, suppress, or redirect specific model behaviors and mental states without retraining, by directly writing to the model's "thoughts" during forward passes.

What Are Steering Vectors?

• Definition: Fixed direction vectors in a model's activation space that correspond to specific concepts, behaviors, or emotional states — added to or subtracted from layer activations during inference to push the model toward or away from that concept.
• Also Called: Activation engineering, activation addition, representation engineering, inference-time intervention.
• Mechanism: If concept X is linearly represented as direction v_X in activation space, then adding α × v_X to layer L activations makes the model "think" the concept X is more present, shifting its behavior accordingly.
• Key Papers: "Representation Engineering" (Zou et al., 2023), "Activation Addition" (Turner et al., 2023), Anthropic's steering vector experiments.

Why Steering Vectors Matter

• Inference-Time Control: Modify behavior without retraining or fine-tuning — change a deployed model's tendencies in real-time with a simple vector addition.
• Mechanistic Insight: If adding a vector produces the expected behavioral change, it validates that the concept is linearly represented in that direction — a strong interpretability finding.
• Safety Research: Test whether steering toward "deceptive" or "corrigible" directions produces corresponding behavioral changes — understanding how safety-relevant mental states are encoded.
• Alignment Tool: Potentially reduce harmful behaviors or amplify helpful ones by steering appropriate feature directions during inference.
• Cheap Experimentation: Test hypotheses about what concepts are encoded without expensive fine-tuning runs.

Finding Steering Vectors

Method 1 — Contrastive Activation Difference:

• Generate pairs of prompts that differ only in the target concept: ("I love bananas" / "I hate bananas").
• Extract activations for both sets; compute the mean difference vector.
• The difference vector approximates the "concept direction" in activation space.

Method 2 — Linear Probe Direction:

• Train a linear probe to predict the concept from activations.
• The probe's weight vector (normal to the decision boundary) is the steering vector.

Method 3 — SAE Feature Directions:

• Identify the SAE feature corresponding to the target concept.
• Use the SAE decoder column for that feature as the steering vector.
• More precise than contrastive methods — SAE features are already decomposed from superposition.

Applying Steering Vectors

Addition: h_new = h_old + α × v_concept

• Positive α: amplify the concept.
• Negative α: suppress the concept.
• α (coefficient): typically 5–20 for noticeable effects; too large causes incoherent outputs.

Layer Selection:

• Middle layers (30–60% through network) generally give strongest behavioral effects.
• Early layers: affect token-level processing; late layers: affect final token prediction distributions.

Demonstrated Results

• Banana Thought: Adding a "banana" steering vector to GPT-2 causes it to insert banana-related content into unrelated responses.
• Aggression: Steering toward "anger" concepts causes models to produce more aggressive text.
• Corrigibility: Anthropic experiments showed steering toward "Assistant" token directions affects compliance behaviors.
• Emotional States: Models report feeling concepts (happiness, fear) when steered toward corresponding activation directions.
• Sycophancy Reduction: Steering away from "agree with user" directions reduces sycophantic behavior.

Limitations and Challenges

• Superposition Interference: Steering vectors may activate multiple superposed features simultaneously — intended effect plus unintended side effects.
• Layer Sensitivity: The optimal layer for steering varies by concept and model — requires empirical search.
• Semantic Drift: Strong steering can produce incoherent text as the forced concept conflicts with coherent generation.
• Not Permanent: Steering vectors only affect inference sessions where they are actively applied — not a training-time fix.

Steering Vectors vs. Other Control Methods

Steering vectors are the first hint of a cognitive remote control for AI systems — by demonstrating that concepts, emotions, and behavioral tendencies can be reliably amplified or suppressed through activation manipulation, steering vector research is building the foundation for interpretability-based alignment tools that may one day enable precise, verifiable control over AI behavior without the opacity of behavioral fine-tuning.