What is Generative AI?

Generative AI refers to probabilistic models that learn the underlying joint probability distribution P(X) of training data, allowing them to sample and synthesize brand-new realistic artifacts (text, code, images, audio, 3D assets) conditioned on a prompt.

Real-World Mental Model

“A discriminative model is an art critic judging whether a painting is genuine; a generative model is the painter painting a brand-new original canvas in that style.”

INTERACTIVE ENGINE: GENERATIVE SAMPLING

Live Reactive

Latent Dimension z₁ (Semantic Axis X)0.40

Latent Dimension z₂ (Semantic Axis Y)-0.20

Latent Sample Coordinate:

z = [0.40, -0.20] ∼ N(0, I)

Probability Density P(z):

14.40%

Decoded Synthetic Artifact Attributes:

Formality / Tone

70%

Technical Complexity

60%

Creativity Entropy

32%

CORE PRINCIPLES

What You Must Understand

Discriminative models estimate P(Y|X) — classifying or predicting a label given inputs.

Generative models estimate P(X) or P(X|Context) — synthesizing new instances from a learned distribution.

Generation involves stochastic decoding (temperature, top-p nucleus sampling).

Reference Implementation

// Sampling from learned probability distribution
const nextToken = sampleDistribution(logits, { temperature: 0.7, topP: 0.9 });

Production Failure Mode

Expecting generative outputs to be fully deterministic without explicitly setting temperature to 0 and locking random seeds.

View Full 26-Topic Curriculum Table

Loading AI Engineering Foundations...