Jon Moshier / Notes / JEPA seedling
Note · From the Notebook

JEPA

Stub — created from World Models vs LLMs.

Joint Embedding Predictive Architecture. Yann LeCun’s alternative to autoregressive generation: predict the abstract latent features of a masked part of the input from its context, rather than reconstructing raw pixels or tokens.

← All notes Read recent essays →