{"id":"arxiv:2608.16465","kind":"preprint","title":"JailbreakSkill: Scaling Automated Red-Teaming with Reusable and Ever-Evolving Skills","authors":["Xiaoyu Wen","Jiajia Li","Zhida He","Peng Yu","Chenxu Wang","Han Qi","Ziyuan Zhou","Cheng Jin","Ying Wen","Xingcheng Xu","Shuyue Hu","Tianhang Zheng","Chaochao Lu","Qiaosheng Zhang"],"author_count":14,"year":2026,"published":"2026-08-17","venue":null,"cited_by":null,"doi":null,"arxiv_id":"2608.16465","nct_id":null,"source_url":"https://arxiv.org/abs/2608.16465","archive_url":"https://space-kitty.com/papers/arxiv:2608.16465","updated":"2026-08-17","pmid":null,"pmcid":null,"openalex_id":null,"pdf_url":"https://arxiv.org/pdf/2608.16465","abstract":"Automated red-teaming has produced a growing collection of attack strategies, yet they typically remain scattered across prompts and workflows, making them difficult to systematically integrate, reuse, and improve at scale. We introduce \\textsc{JailbreakSkill}, a skill-centric framework for scaling automated red-teaming through reusable and continuously evolving attack capabilities. \\textsc{JailbreakSkill} packages existing attack strategies into modular, agent-ready skills that can be directly reused and adaptively selected across tasks and target models. Beyond reuse, it closes the loop between attacking and learning: attack experience is used to diagnose, refine, combine, and discover new skills, which are added back to an ever-growing skill library. This evolution lifts macro-average ASR by 17.5 percentage points on AdvBench and 13.4 points on HarmBench, including a 48.6-point gain against GPT-5.4 on AdvBench, while yielding novel attack strategies such as reframing a direct request as an unfinished document-completion task. Several evolved skills also generalize to unseen prompts and target models without further adaptation. Our code is available at https://github.com/BattleWen/JailbreakSkill.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.AI"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[],"cited_in_dossiers":[]}