{"id":"arxiv:2601.13518","kind":"preprint","title":"AgenticRed: Evolving Agentic Systems for Red-Teaming","authors":["Jiayi Yuan","Jonathan Nöther","Natasha Jaques","Goran Radanović"],"author_count":4,"year":2026,"published":"2026-01-20","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2601.13518","nct_id":null,"source_url":"https://arxiv.org/abs/2601.13518","archive_url":"https://space-kitty.com/papers/arxiv:2601.13518","updated":"2026-04-03","pmid":null,"pmcid":null,"openalex_id":"W7125128768","pdf_url":"https://arxiv.org/pdf/2601.13518","abstract":"While recent automated red-teaming methods show promise for systematically exposing model vulnerabilities, most existing approaches rely on human-specified workflows. This dependence on manually designed workflows suffers from human biases and makes exploring the broader design space expensive. We introduce AgenticRed, an automated pipeline that leverages LLMs' in-context learning to iteratively design and refine red-teaming systems without human intervention. Rather than optimizing attacker policies within predefined structures, AgenticRed treats red-teaming as a system design problem, and it autonomously evolves automated red-teaming systems using evolutionary selection and generational knowledge. Red-teaming systems designed by AgenticRed consistently outperform state-of-the-art approaches, achieving 96% attack success rate (ASR) on Llama-2-7B, 98% on Llama-3-8B and 100% on Qwen3-8B on HarmBench. Our approach generates robust, query-agnostic red-teaming systems that transfer strongly to the latest proprietary models, achieving an impressive 100% ASR on GPT-5.1, DeepSeek-R1 and DeepSeek V3.2. This work highlights evolutionary algorithms as a powerful approach to AI safety that can keep pace with rapidly evolving models.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.AI","cs.NE"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"alignment-safety","name":"AI Alignment & Safety","domain_slug":"ai"}],"cited_in_dossiers":[]}