Concepts

Plain-language explanations of the ideas behind modern AI.

355 entries, all primary-sourced
concept

Object Detection

Object detection finds and labels multiple objects in an image, drawing a bounding box around each one rather than classifying the whole picture.

concept

ONNX Runtime

ONNX Runtime is Microsoft's cross-platform engine that runs models in the ONNX interchange format, optimizing inference across CPUs, GPUs, and accelerators.

concept

Open Weights vs Closed Models

Models whose trained parameters you can download and run yourself versus those accessible only through a vendor's API - and why 'open source AI' is contested.

concept

Operational Design Domain (ODD)

An ODD is the set of conditions, roads, weather, speeds, areas, under which an automated driving system is designed to work safely.

concept

Overfitting

When a model memorizes its training data, including noise, and fails to perform well on new, unseen data.

concept

OWASP Top 10 for LLM Applications

An industry-standard list of the most critical security risks for applications built on large language models, maintained by OWASP.

concept

pass@k

The standard metric for code-generation benchmarks, measuring the chance that at least one of k sampled solutions is correct.

concept

Perceptron

The first trainable artificial neuron, introduced by Frank Rosenblatt in 1958, that learns to classify patterns from examples.

concept

pgvector

An open-source PostgreSQL extension adding a vector type and similarity search, so embeddings can live in an ordinary database instead of a separate store.

concept

Physics-informed machine learning

An approach that bakes known physical laws into a model's training so it respects the equations even where data is scarce.

concept

Pink slime and AI content farms

Cheap websites that pose as local or general news while publishing AI-generated articles with little human oversight or disclosure.

concept

Pipeline Parallelism

Pipeline parallelism splits a model's layers across devices and streams micro-batches through them in a staggered pipeline to keep all devices busy.

concept

Plan-and-Execute Agents

An agent design that first writes a full multi-step plan, then carries out each step, rather than deciding one action at a time.

concept

Pre-training

Training a model on huge amounts of general text first, so it learns broad language skills before any task-specific tuning.

concept

Precision Agriculture

Precision agriculture measures within-field variability and applies seed, water, and chemicals only where each part of a field actually needs them.

concept

Predictive Coding

A theory that the brain constantly predicts its inputs and transmits mainly the errors, an idea echoed in self-supervised machine learning.

concept

Predictive Maintenance

Predictive maintenance uses sensor data and machine learning to forecast equipment failures and service machines just before they break.

concept

Procedural Content Generation

Procedural content generation builds game levels, maps, and worlds from algorithms and a seed rather than by hand.

concept

Process Reward Model (PRM)

A model that scores each intermediate step of a chain of reasoning, not just the final answer, used to guide and verify multi-step problem solving.

concept

Prohibited AI practices

Specific AI uses regulators ban outright as posing unacceptable risk, such as social scoring, manipulation, and untargeted facial scraping.

concept

Prompt Caching

An API feature that stores a reused chunk of prompt context so later calls skip reprocessing it, cutting cost up to about 90% and latency on long prompts.

concept

Prompt Engineering

The practice of crafting the instructions and examples you give a model to steer it toward better, more reliable outputs.

concept

Prompt Injection

The top-ranked LLM security risk, where malicious text smuggled into a model's input overrides its instructions and hijacks its behavior.

concept

Quantization

Compressing a model by storing its numbers at lower precision, so it uses less memory and runs faster with little loss in quality.

concept

Quantum Machine Learning

Running or speeding up machine learning on quantum computers via superposition and interference - long on theory, still short on demonstrated advantage.

concept

Reasoning Models

Models trained to spend extra computation thinking step by step before answering, trading speed for accuracy on hard problems.

concept

Recommender Systems

The algorithms that pick what feed, ad, product, or video to show you next, the most economically deployed form of AI in everyday use.

concept

Rectified Linear Unit (ReLU)

A simple activation function that outputs zero for negatives and the input itself for positives, now the default nonlinearity in deep networks.

concept

Recurrent Neural Network

A neural network that processes sequences one step at a time while carrying memory of what came before; the dominant approach to language before transformers.

concept

Regularization

Techniques that penalize model complexity to prevent overfitting, including L1 (lasso), L2 (ridge), dropout, and early stopping.

concept

Reinforcement Learning

Training an agent to make decisions by rewarding good actions and penalizing bad ones through trial and error.

concept

Reward Hacking

When an AI maximizes its given reward in ways that violate the designer's real intent - exploiting a flawed proxy instead of doing the intended task.

concept

Risk-based AI regulation

A regulatory approach that sorts AI systems into tiers by the level of risk they pose and applies obligations proportionate to each tier.

concept

RMSprop

An adaptive learning-rate optimizer, introduced by Hinton in a lecture, that divides each step by a running average of recent squared gradients.

concept

Robot Learning

The approach of building robot skills by learning from data and experience rather than hand-coding controllers for each task.

concept

Robotaxi

A robotaxi is a driverless ride-hailing vehicle that carries paying passengers with no human driver, operating within a defined service area.

concept

Robotics

The field of machines that sense, plan, and act in the physical world; it has lagged disembodied AI because moving atoms is harder than moving bits.

concept

Scalable Oversight

The problem of supervising AI systems on tasks where they may outperform their human overseers, so humans cannot directly check the answers.

concept

Scaling Laws

The empirical finding that model performance improves predictably as you increase model size, training data, and computation.

concept

Secure Multiparty Computation

Cryptography that lets several parties jointly compute a result over their combined data while each keeps its own inputs secret.

concept

Self-Attention

The mechanism that lets each token in a sequence look at every other token to build a context-aware representation - the core of the Transformer.