Skip to content

Paper replications

The replications/ directory implements published steering methods with EasySteer notebooks. The folders contain paper notes, notebooks, and available vector or intervention artifacts. Consult each experiment for its required model, data and checkpoint files.

Folder One-liner Category Component
bipo/ Bi-directional preference optimization vectors steering power-seeking behavior Personalization hidden_states
cast/ Conditional activation steering to program refusal (CAST) Safety hidden_states
controlingthinkingspeed/ Speeding up / slowing down reasoning-model thinking on MATH500 Reasoning hidden_states
creative_writing/ Steering LLMs to evaluate and amplify creativity Style hidden_states
fractreason/ Fractional reasoning via latent steering vectors for inference-time compute Reasoning hidden_states
improve_reasoning/ Representation-engineering vectors that improve reasoning performance Reasoning hidden_states
iti/ Llama-2-7B-Chat attention head steering with a TruthfulQA accuracy comparison and examples Truthfulness attention_heads
lm_steer/ Word embeddings as steers for language models (LM-Steer, GPT-2) General hidden_states
loreft/ ReFT: train and apply LoReFT representation finetuning General hidden_states
refusal_direction/ Refusal is mediated by a single direction (DiffMean ablation) Safety hidden_states
sae_entities/ SAE entity-knowledge directions and hallucination awareness Truthfulness hidden_states
sake/ SAKE: steering activations for knowledge editing Knowledge hidden_states
seal/ SEAL: steerable reasoning calibration (execution/reflection/transition vectors) Reasoning hidden_states
sharp/ (VLM) SHARP: steering hallucination in LVLMs via representation engineering (EMNLP 2025) Truthfulness hidden_states
steerable_chatbot/ Personalizing LLMs with preference-based activation steering Style hidden_states
steermoe/ SteerMoE: expert (de)activation steering of MoE routers on Qwen3-30B-A3B (arXiv:2509.09660) MoE router_logits

Component names match the API: hidden_states denotes decoder block output, attention_heads denotes head outputs before the attention output projection, and router_logits denotes MoE routing scores.

Contributions of new replications are welcome — see Contributing.