Secure Systems Group
Menu×

Papers

Pages for the primary readings. Each page is a short guide to one paper: what it is about, the background needed to follow it, and what to look for while reading. It points you into the paper; it does not stand in for it.

Paper TitleAuthorsSectionYear
Towards Deep Learning Models Resistant to Adversarial AttacksMadry, Aleksander et al.Adversarial Robustness of Classification Models2018
Jailbroken: How Does LLM Safety Training Fail?Wei, Alexander et al.Jailbreaking LLMs2023
Not what you’ve signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt InjectionGreshake, Kai et al.Indirect Prompt Injection in AI Agents2023
Safety Alignment Should Be Made More Than Just a Few Tokens DeepQi, Xiangyu et al.Safety Alignment and Guardrails2024
Membership Inference Attacks From First PrinciplesCarlini, Nicholas et al.Membership Inference Attacks2022
Extracting Training Data from Large Language ModelsCarlini, Nicholas et al.Training-data Extraction from LLMs2021
Deep Learning with Differential PrivacyAbadi, Martín et al.Differential Privacy in ML2016
Knowledge Unlearning for Mitigating Privacy Risks in Language ModelsJang, Joel et al.Unlearning for Generative AI2022
Knockoff Nets: Stealing Functionality of Black-Box ModelsOrekondy, Tribhuvanesh et al.Model Extraction / Stealing2019
DAWN: Dynamic Adversarial Watermarking of Neural NetworksSzyller, Sebastian et al.Model Watermarking / Fingerprinting2019
Neural Cleanse: Identifying and Mitigating Backdoor Attacks in Neural NetworksWang, Bolun et al.Training-data Poisoning2019
PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language ModelsZou, Wei et al.Preference Manipulation / RAG Poisoning2024
What Makes and Breaks Safety Fine-tuning? A Mechanistic StudyJain, Samyak et al.Mechanistic Interpretability for AI safety2024
SoK: Unintended Interactions among Machine Learning Defenses and RisksDuddu, Vasisht et al.Unintended Interactions among ML Defenses and Risks2024
A Watermark for Large Language ModelsKirchenbauer, John et al.Media Forensics and Proactive Provenance2023
Examining Zero-Shot Vulnerability Repair with Large Language ModelsPearce, Hammond et al.AI for Cybersecurity2023
Secure Transformer Inference Made Non-interactiveZhang, Jiawen et al.Leakage Resistance (Client Data): Software2025
BliMe: Verifiably Secure Outsourced Computation with Hardware-Enforced Taint TrackingElAtali, Hossam et al.Leakage Resistance (Client Data): Hardware2024
Unlocking the Power of Differentially Private Zeroth-order Optimization for Fine-tuning LLMsBao, Ergute et al.Leakage Resistance (Training Data): Software2025
No Privacy Left Outside: On the (In-)Security of TEE-Shielded DNN Partition for On-Device MLZhang, Ziqi et al.Leakage Resistance (Training Data): Hardware2024
ModelGuard: Information-Theoretic Defense Against Model Extraction AttacksTang, Minxue et al.Model Theft Resistance (+ On-Device Private Inference): Software2024
ASGARD: Protecting On-Device Deep Neural Networks with Virtualization-Based Trusted Execution EnvironmentsMoon, Myungsuk et al.Model Theft Resistance (+ On-Device Private Inference): Hardware2025
zkGPT: An Efficient Non-interactive Zero-knowledge Proof Framework for LLM InferenceQu, Wenjie et al.Regulatory Compliance: Software2025
PAL*M: Property Attestation for Large Generative ModelsChantasantitam, Prach et al.Regulatory Compliance: Hardware2026