The AI terms that
actually matter.
Clear, technical definitions of 113 key concepts — written by AI engineers, not marketers.
Kimi K3
Kimi K3 is Moonshot AI's 2.8 trillion parameter open-weight Mixture of Experts model, the first open model in the 3-trillion-parameter class. It combines a hybrid linear/full attention mechanism (Kimi Delta Attention), an extremely sparse 16-of-896 expert MoE layer, and a native 1M-token multimodal context window.
Read definitionKling 3.0 Model Series (Omni)
Understand professional AI video and image creation with Kling 3.0. Explore Video 3.0 Omni’s multi-shot cinematic control and Image O1’s precision editing for high-fidelity, agentic workflows.
Read definitionKnowledge Distillation
Knowledge distillation is a model compression technique where a compact 'student' model is trained to replicate the behavior of a larger, more capable 'teacher' model — achieving near-teacher-level accuracy at a fraction of the size, latency, and cost.
Read definitionKokoro
An open-weight TTS model with just 82M parameters that matches the output quality of models ten times its size, running in under 0.3 seconds on CPU — the most efficient high-quality open-source voice model available.
Read definitionLarge Language Diffusion Models
A class of generative AI models that apply diffusion processes, originally popularized in image generation, to text generation. They offer non autoregressive, highly controllable generation by iteratively denoising continuous embeddings or discrete vocabulary spaces.
Read definitionLarge Language Model (LLM)
Large Language Models (LLMs) are advanced AI systems designed to understand, generate, and interact with human language at scale, leveraging vast amounts of text data to perform a wide range of linguistic tasks.
Read definitionLarge Vision Model (LVM)
Large Vision Models (LVMs) are advanced artificial intelligence systems designed to process, analyze, and interpret large volumes of visual data, enabling sophisticated image recognition, object detection, and segmentation tasks.
Read definitionLlama 4
Llama 4 is Meta's first natively multimodal, mixture-of-experts model family, released April 2025 under an open-weight community license. It ships as Llama 4 Scout (17B active, 109B total, 16 experts, 10M-token context) and Llama 4 Maverick (17B active, 400B total, 128 experts), both codistilled from a roughly 2-trillion-parameter teacher, Llama 4 Behemoth.
Read definitionllms.txt
llms.txt is a plain-Markdown file published at a website's root that gives large language models and AI agents a short, curated map of a site's most important pages, proposed by Jeremy Howard of Answer.AI as an open convention for making websites legible to LLMs.
Read definitionLogit Lens
The Logit Lens is a mechanistic interpretability technique that reads a transformer's mind mid-computation. By projecting the hidden state at each intermediate layer through the model's final layer-norm and unembedding matrix, it reveals the model's evolving 'best guess' for the next token — showing how a prediction is refined layer by layer through the residual stream.
Read definitionLoRA Fine-Tuning
LoRA (Low-Rank Adaptation) is a parameter-efficient fine-tuning technique that freezes a pre-trained model's weights and injects small trainable low-rank matrices into key layers, enabling effective specialisation at a fraction of the compute and memory cost of full fine-tuning.
Read definitionMamba Model
The Mamba model is a groundbreaking AI architecture that achieves state-of-the-art performance across various modalities by utilizing selective state spaces for efficient, linear-time sequence modeling
Read definitionStay ahead of the curve
Weekly newsletter on agentic AI, LLMs, and what we're building at Superteams — straight to your inbox.
Ready to ship AI in production?
We deploy fractional AI teams that deliver production-grade systems in 30–90 days. No fluff, no obligation.