Adversarial ML on English AI Terms Dictionary

Model Extraction

Sat, 18 Jul 2026 10:20:32 +0000

Definition

Model extraction involves querying a target machine learning model’s API to infer its internal structure, weights, or decision boundaries. Attackers use these queries to build a surrogate model that mimics the original, potentially stealing intellectual property or bypassing security measures. This threat highlights the vulnerability of proprietary models exposed via public interfaces without sufficient rate limiting or monitoring.

Summary

An attack where an adversary queries a model to reconstruct its parameters or create a surrogate copy.

Backdoor Attack

Sat, 18 Jul 2026 10:20:18 +0000

Definition

A backdoor attack involves poisoning the training data of a machine learning model with specific patterns, known as triggers. While the model performs normally on clean data, it activates incorrect behavior whenever the trigger is present. This compromises model integrity and safety, often going undetected until exploitation. It poses significant risks in critical applications like autonomous driving or healthcare, necessitating robust defense mechanisms against data poisoning.

Summary

A security threat where malicious actors embed hidden triggers in AI models during training to cause specific misclassifications.

Resisting AI

Sat, 18 Jul 2026 10:14:07 +0000

Definition

Resisting AI refers to methods used by individuals or entities to avoid being influenced, tracked, or classified by AI algorithms. This includes adversarial attacks on perception systems, privacy-preserving data obfuscation, or behavioral changes designed to break predictive models. While often associated with malicious evasion, it also encompasses legitimate privacy advocacy and robustness testing against algorithmic bias or surveillance.

Summary

Strategies and techniques employed to evade detection, manipulation, or control by artificial intelligence systems.