# How Effective Is Constitutional AI in Small LLMs? A Study on DeepSeek-R1 and Its Peers

Preprint · Antonio-Gabriel Chacón Menke, Phan Xuan Tan

- Archive id: arxiv:2503.17365
- Published: 2025-02-01
- arXiv: https://arxiv.org/abs/2503.17365
- Source URL: https://arxiv.org/abs/2503.17365
- PDF: https://arxiv.org/pdf/2503.17365
- Provenance: arxiv

## Abstract

Recent incidents highlight safety risks in Large Language Models (LLMs), motivating research into alignment methods like Constitutional AI (CAI). This paper explores CAI's self-critique mechanism on small, uncensored 7-9B parameter models: DeepSeek-R1-8B, Gemma-2-9B, Llama 3.1-8B, and Qwen2.5-7B. We show that while Llama-based models exhibited significant harm reduction through self-critique, other architectures demonstrated less improvement in harm detection after abliteration. These results suggest CAI's effectiveness may vary depending on model architecture and reasoning capabilities.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.