Jailbreak Attacks

Efficient Detection of Toxic Prompts in Large Language Models

ASE 2024 work on efficient greybox detection of toxic prompts for large language models.

Oct 27, 2024

A Hitchhiker's Guide to Jailbreaking ChatGPT via Prompt Engineering

A comprehensive guide to jailbreaking ChatGPT via prompt engineering techniques.

Apr 20, 2024

MASTERKEY: Automated Jailbreaking of Large Language Model Chatbots
MASTERKEY: Automated Jailbreaking of Large Language Model Chatbots

A comprehensive framework for automated jailbreaking of Large Language Model chatbots, featuring novel attack methodologies and systematic analysis of defense mechanisms.

Feb 26, 2024

MASTERKEY

MASTERKEY is a research framework for automated jailbreak attack generation and defense evaluation for LLM chatbots. The framework supports systematic analysis of jailbreak strategies across commercial chatbot systems and was published at NDSS 2024.

Feb 26, 2024

A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Models

A comprehensive analysis of jailbreak attack and defense techniques for Large Language Models.

Feb 20, 2024

PANDORA: Jailbreak GPTs by Retrieval Augmented Generation Poisoning

Novel attack framework exploiting RAG mechanisms to jailbreak LLMs through retrieval database poisoning. Distinguished Paper Award winner.

Feb 1, 2024

PANDORA

PANDORA studies jailbreak attacks against retrieval-augmented generation systems through retrieval database poisoning. The work received the Distinguished Paper Award at AISCC 2024 and highlights a practical attack surface in RAG-enhanced LLM deployments.

Feb 1, 2024

Jailbreaking ChatGPT via Prompt Engineering: An Empirical Study

A comprehensive empirical study of jailbreaking techniques against ChatGPT through prompt engineering.

May 23, 2023