A theoretical, idea-level exploration.
When an AI answers about your brand from memory, generative self-retrieval decides whether it recalls you correctly or invents a plausible wrong answer.
Clickbait titles function by withholding a latent entity—the subject, reason, process, or outcome—to force a click and resolve an artificial information gap.
Dynamic visual layout (DVL) is a generative user interface where layouts are created on demand to suit specific queries, shifting the focus from SEO to information.
Large language models act as a presentation layer on top of classic information retrieval. They rely on crawling, indexing, and ranking to prevent hallucinations.
An exploration of how the transition from RNNs to transformers and the discovery of double descent enabled the scaling of large language models like GPT.
AI optimization relies on mechanistic interpretability to understand internal neural computations and model steering to actively control model behavior.