Testing

MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots
In this paper, we present Jailbreaker, a comprehensive framework that offers an in-depth understanding of jailbreak attacks and …
Gelei Deng, Yi Liu, Yuekang Li, Kailong Wang, Ying Zhang, Zefeng Li, Haoyu Wang, Tianwei Zhang, Yang Liu
ASTER: Automatic Speech Recognition System Accessibility Testing for Stutterers
The popularity of automatic speech recognition (ASR) systems nowadays leads to an increasing need for improving their accessibility. …
Yi Liu, Yuekang Li, Gelei Deng, Felix Juefei-Xu, Yao Du, Cen Zhang, Chengwei Liu, Yeting Li, Lei Ma, Yang Liu
PentestGPT: An LLM-empowered Automatic Penetration Testing Tool
Penetration testing, a crucial industrial practice for ensuring system security, has traditionally resisted automation due to the …
Gelei Deng, Yi Liu, Víctor Mayoral-Vilches, Peng Liu, Yuekang Li, Yuan Xu, Tianwei Zhang, Yang Liu, Martin Pinzger, Stefan Rass
Jailbreaking chatgpt via prompt engineering: An empirical study
Large Language Models (LLMs), like ChatGPT, have demonstrated vast potential but also introduce challenges related to content …
Yi Liu, Gelei Deng, Zhengzi Xu, Yuekang Li, Yaowen Zheng, Ying Zhang, Lida Zhao, Tianwei Zhang, Yang Liu
NAUTILUS: Automated RESTful API Vulnerability Detection
RESTful APIs have become arguably the most prevalent endpoint for accessing web services. Blackbox vulnerability scanners are a popular …
Gelei Deng, Zhiyi Zhang, Yuekang Li, Yi Liu, Tianwei Zhang, Yang Liu, Guo Yu, Dongjin Wang
On the (In)Security of Secure ROS2
Robot Operating System (ROS) has been the mainstream platform for research and development of robotic applications. This platform is …
Gelei Deng, Guowen Xu, Yuan Zhou, Tianwei Zhang, Yang Liu