Mind the Inconspicuous: Revealing the Hidden Weakness in Aligned LLMs' Refusal Boundaries

Jiahao Yu, Haozheng Luo, Jerry Yao-Chieh Hu, and Yan Chen, Northwestern University; Wenbo Guo, UCSB; Han Liu and Xinyu Xing, Northwestern University