Skip to main content

Foundation Models

Follow Foundation Models in the Factlen app and get an alert when there is news. Get the app

More in Foundation Models

ExplainerContext Windows

How RoPE Base Frequency Bounds Dictate Long-Context Retrieval in AI Models

Mathematical Scaling Advocates 40%Hardware Efficiency Researchers 30%Architectural Skeptics 30%

4 sources · 2d ago

ExplainerAttention Sinks

How Softmax Normalization Forces Attention Sinks and Prevents Streaming Context Collapse

Architectural Pragmatists 50%Fundamental Reformers 25%Hardware Optimizers 25%

6 sources · 11d ago

ExplainerHardware Optimization

How Block Tiling and Incremental Softmax Compute Exact Attention Without Storing Intermediate Matrices

Hardware Optimizers 40%Algorithmic Theorists 30%AI Practitioners 30%

4 sources · 18d ago

ExplainerTransformer Architecture

How Causal Masking Prevents Decoder-Only Transformers From Attending to Future Tokens

Model Architects 40%Inference Optimization Engineers 35%Bidirectional Encoder Advocates 25%

6 sources · 33d ago

ExplainerMechanistic Interpretability

Translating the Black Box: How the Logit Lens Maps AI Computations to Human-Readable Text

Mechanistic Interpretability Researchers 40%AI Safety Advocates 35%Model Developers 25%

8 sources · 43d ago

ExplainerModel Optimization

How Low-Rank Adaptation Compresses AI Fine-Tuning Into 0.01% of a Model's Parameters

Efficiency Researchers 40%Enterprise Deployers 35%Platform Providers 25%

6 sources · 47d ago

ExplainerState Space Models

Mamba Architecture: How State Space Models Solve Transformer Quadratic Scaling

Transformer Loyalists 40%SSM Pioneers 40%Hybrid Pragmatists 20%

6 sources · 52d ago

Virtual Cells

GenBio AI Launches 'AIDO Cell,' a Virtual Foundation Model to Simulate Human Biology

Computational Biologists 35%Drug Discovery Industry 35%Experimental Biologists 30%

6 sources · 65d ago

AI HardwareEarnings Explainer

Chinese Chipmaker SMIC Reports Triple-Digit Profit Surge and Raises Prices on Domestic AI Demand

Domestic Semiconductor Manufacturers 35%Global Hardware Analysts 35%Geopolitical Observers 30%

7 sources · 69d ago

Agentic AI

Anthropic Releases Claude Opus 5 With 1-Million-Token Context Window for Agentic Coding

Enterprise Developers 40%AI Researchers 35%Software Engineering Skeptics 25%

3 sources · 78d ago

AI GovernancePolicy Shift

US AI Safety Institute Rebranded as 'Center for AI Standards and Innovation' in Major Policy Shift

Innovation Advocates 40%AI Safety Researchers 35%National Security Officials 25%

7 sources · 78d ago

ExplainerAI Governance

Trump Administration Finalizes Voluntary Framework for Pre-Release Evaluation of Frontier AI Models

National Security Advocates 43%Frontier AI Developers 36%Open-Source Proponents 21%

6 sources · 79d ago

AI Infrastructure

Alphabet Raises $84.75 Billion in Largest-Ever Corporate Equity Offering to Sustain AI Infrastructure Buildout

Corporate Strategists 40%Value Investors 35%Dilution Critics 25%

5 sources · 86d ago

AI Infrastructure

Meta Launches Low-Cost AI Compute Cloud, Monetizing Excess Capacity to Undercut Hyperscalers

AI Startups & Researchers 40%Incumbent Hyperscalers 30%Infrastructure Analysts 30%

3 sources · 101d ago

ExplainerState Space Models

Explainer: How 'State Space Models' Are Breaking the Transformer Monopoly and Unlocking Infinite AI Memory

Architecture Innovators 40%Hybrid Pragmatists 35%Deployment Engineers 25%

5 sources · 109d ago

AI in Biotech

Anthropic Launches 'Claude Science' Workbench, Entering Drug Discovery With In-House Pipeline

Biotech Innovators 40%Traditional Pharmacologists 30%Tech Industry Analysts 30%

4 sources · 112d ago

ExplainerAI Transparency

Stanford AI Index: Frontier Model Transparency Score Plummets 30% as Top Labs Disclose Less

Independent AI Researchers 40%Enterprise AI Adopters 35%Industry Analysts 25%

4 sources · 115d ago

ExplainerWorld Models

Explainer: How 'World Models' Are Teaching AI the Intuitive Physics of Reality

World Model Pioneers 45%Applied Robotics Developers 30%Embodied AI Skeptics 25%

6 sources · 119d ago

ExplainerModel Architecture

Beyond the Transformer: How State Space Models Are Rewiring Artificial Intelligence

Hybrid Architecture Pragmatists 45%Edge AI & Efficiency Advocates 35%Transformer Purists 20%

7 sources · 124d ago

ExplainerAI Architecture

How Retrieval-Augmented Generation (RAG) Solved AI's Hallucination Problem

Enterprise AI Architects 40%Infrastructure Providers 30%Applied AI Practitioners 30%

7 sources · 136d ago

ExplainerRobot Learning

How Vision-Language-Action Models Are Giving Robots 'Common Sense'

Commercial Developers 35%Open-Source Community 35%Classical Roboticists 30%

5 sources · 136d ago

ExplainerEdge AI

How Small Language Models Are Bringing Powerful AI Directly to Your Phone

Privacy & Security Advocates 35%Enterprise Developers 35%AI Researchers 29%

8 sources · 136d ago