# Steering Protein Language Models

Preprint · Long-Kai Huang, Rongyi Zhu, Bing He, Jianhua Yao

- Archive id: arxiv:2509.07983
- Published: 2025-07-01
- arXiv: https://arxiv.org/abs/2509.07983
- Citations: 0
- Source URL: https://arxiv.org/abs/2509.07983
- PDF: https://arxiv.org/pdf/2509.07983
- Provenance: arxiv

## Abstract

Protein Language Models (PLMs), pre-trained on extensive evolutionary data from natural proteins, have emerged as indispensable tools for protein design. While powerful, PLMs often struggle to produce proteins with precisely specified functionalities or properties due to inherent challenges in controlling their outputs. In this work, we investigate the potential of Activation Steering, a technique originally developed for controlling text generation in Large Language Models (LLMs), to direct PLMs toward generating protein sequences with targeted properties. We propose a simple yet effective method that employs activation editing to steer PLM outputs, and extend this approach to protein optimization through a novel editing site identification module. Through comprehensive experiments on lysozyme-like sequence generation and optimization, we demonstrate that our methods can be seamlessly integrated into both auto-encoding and autoregressive PLMs without requiring additional training. These results highlight a promising direction for precise protein engineering using foundation models.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [AI Protein Design & Structure Prediction](https://space-kitty.com/topics/protein-design)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.