Foundation Models on English AI Terms Dictionary

Self-supervised Learning

Sat, 18 Jul 2026 09:42:48 +0000

Definition

Self-supervised learning is a technique where the algorithm creates supervisory signals from the unlabeled data itself, typically by predicting missing parts of the input. It bridges the gap between unsupervised and supervised learning, allowing models to learn rich feature representations without manual annotation. This approach is foundational for modern large language models and vision transformers, enabling them to understand structure and semantics in vast amounts of raw data.

Summary

A training method where the model generates its own labels from input data to learn representations.

Large Language Model

Sat, 18 Jul 2026 09:33:34 +0000

Definition

Large Language Models (LLMs) are advanced artificial intelligence systems based on transformer architectures, trained on massive datasets of text and code. They learn statistical patterns in language to predict subsequent tokens, enabling capabilities such as translation, summarization, question answering, and creative writing. Their scale allows for emergent abilities not present in smaller models, making them foundational tools in modern natural language processing applications.

Summary

A deep learning model trained on vast text corpora to understand and generate human-like language.