China's RedNote Launches 280-Billion-Parameter Open-Weight Model, Challenging Frontier Labs
Xiaohongshu's AI research lab has released dots3-note preview, a massive multimodal Mixture-of-Experts model optimized for long-horizon agentic tasks. The open-weight release signals a shift among consumer platforms toward building proprietary foundation models rather than relying on third-party APIs.
By Mateo Ramos
- Open-Source Advocates
- View the release as a massive win for the open-weight ecosystem, proving that frontier-level multimodal capabilities can be self-hosted.
- Enterprise AI Implementers
- Focus on the practical deployment challenges and the promise of the TEMPO method for long-horizon agentic workflows.
- Platform Strategists
- Interpret the release as a signal that consumer technology platforms are building custom foundation models to control their own infrastructure.
Summary
- RedNote's research lab has released dots3-note preview, a 280-billion-parameter open-weight AI model.
- The system uses a Mixture-of-Experts architecture, activating only 16 billion parameters per token to optimize compute efficiency.
- It natively processes text, images, video, and audio within a massive 512,000-token context window.
- A novel training method called TEMPO allows the model to self-critique and update its memory during long-horizon tasks.
- The release signals a shift among consumer platforms toward building proprietary foundation models rather than relying on third-party APIs.
The common assumption about the next generation of frontier artificial intelligence is that it will emerge from a dedicated research lab—a DeepMind, an OpenAI, or an Anthropic—focused entirely on artificial general intelligence. The evidence from the past week suggests otherwise. The latest open-weight model challenging the frontier did not come from a pure-play artificial intelligence company, but from the internal research lab of a Chinese social commerce application best known for lifestyle and fashion recommendations.[1]
Xiaohongshu, widely known internationally as RedNote, has released dots3-note preview under a permissive Apache 2.0 license. Developed by the company's dots studio research arm, the system is a massive multimodal foundation model that processes text, images, video, and audio natively. But the sheer scale of the model is less important than how it activates its knowledge and how it was trained to remember its own mistakes during complex tasks.[2][7]
The architecture relies on a Mixture-of-Experts approach to separate the model's stored knowledge capacity from the computation required for each individual token. The language component contains 280 billion parameters in total, but it activates only 16 billion parameters during inference. This means fewer than six percent of its language parameters participate in processing any given piece of information, while the remaining parameters stay dormant but available to the routing system.[3]
This sparse activation is achieved through a highly specific routing mechanism. The model utilizes one dense layer followed by 45 Mixture-of-Experts layers, containing 256 routed experts alongside one shared expert. For every token processed, the router selects only the top eight experts to handle the computation. This design allows the system to maintain the vast knowledge base of a 280-billion-parameter model while keeping the actual computational cost per token much closer to that of a smaller, dense model.[2][5]
Beyond its language capabilities, dots3-note preview is built to ingest multiple modalities simultaneously within a single 512,000-token context window. The architecture includes a separate seven-billion-parameter vision encoder and an 800-million-parameter audio encoder. This allows the model to process video inputs alongside their native audio tracks without requiring separate transcription steps, ultimately producing text-based outputs and reasoning.[2][5]
The central tension around this release is its stated mission to solve one of the hardest problems in current artificial intelligence: long-horizon agentic workflows. Most contemporary artificial intelligence agents excel at short, discrete tasks like summarizing a document or drafting a single function of code. However, they frequently degrade during multi-step processes that take hours or days, losing track of what they have already attempted and what actually succeeded.[3][4]
To address this degradation, the dots studio team utilized a reinforcement learning method called TEMPO. This training approach allows the model to continuously evaluate its own progress on tasks it has never seen before, self-critiquing and updating its memory as it works rather than rigidly following a fixed initial plan. If this capability holds up in production, it represents the difference between an assistant that can draft a paragraph and an autonomous agent that can execute a complex, multi-day research project.[4]
To address this degradation, the dots studio team utilized a reinforcement learning method called TEMPO.
The model's self-reported benchmarks suggest it matches or surpasses substantially larger models on evaluations spanning coding, search, reasoning, and personal-assistant tasks. The dots3 family previously gained attention when an earlier, unreleased version achieved a perfect score at the 2026 International Mathematical Olympiad. However, the current release remains labeled as a preview, and the headline performance figures currently rely on the laboratory's own internal evaluations.[1][3][6]
Independent reproduction of these long-horizon capabilities has not yet occurred at scale. Industry analysts caution that while the release is highly promising, the claims regarding autonomous memory and self-critique should be treated as experimental until third-party developers run their own extensive tests on the model.[4]
Furthermore, deploying a 280-billion-parameter model is a substantial infrastructure commitment, even with sparse activation. While 16 billion active parameters reduce the arithmetic work, the massive model weights still impose severe memory bandwidth demands, particularly because the experts must be distributed across several accelerators.[3]
Running dots3-note preview is not a lightweight exercise. The official documentation recommends serving the quantized FP8 checkpoint on a single server node equipped with eight enterprise-grade GPUs, such as NVIDIA H100s. To make this feasible for enterprise self-hosting, the release includes day-zero support for popular deployment software like vLLM and SGLang, as well as immediate adaptation for Huawei's Ascend hardware ecosystem.[5][6]
The release highlights a broader operational shift across the global technology sector. Consumer-facing digital platforms with massive user bases are increasingly building custom foundation models rather than relying entirely on third-party providers. With over 300 million monthly active users, RedNote is signaling that artificial intelligence is moving from a peripheral feature used for search and recommendation to the core infrastructure supporting its entire product ecosystem.[1][6]
Industry analysts note that these digital-native platforms possess a distinct advantage in data richness. By marrying proprietary business data with custom, in-house artificial intelligence models, companies can streamline workflows and predict demand with a level of precision that generic, off-the-shelf models struggle to achieve. General models often fail to grasp the specific context of how users plan trips or make purchasing decisions on a highly specialized platform.[1][6]
By open-sourcing the model under a permissive license, RedNote is inviting the global developer community to test, refine, and build an ecosystem around its architecture. This strategy puts pricing and performance pressure on closed-model competitors while accelerating the discovery of edge cases and deployment optimizations.[6]
Ultimately, dots3-note preview represents a significant milestone in the open-weight ecosystem. It demonstrates that the techniques required to build highly capable, multimodal, and agentic systems are rapidly diffusing beyond the tightly controlled environments of the original frontier laboratories, placing immense computational power directly into the hands of the open-source community.[2]
Definitions
- Open-weight model
- An artificial intelligence model where the underlying parameters (weights) are made publicly available, allowing anyone to download, modify, and run the system on their own hardware.
- Mixture-of-Experts (MoE)
- A neural network design that uses multiple specialized sub-networks (experts) and a routing mechanism to activate only a small fraction of the total parameters for any given calculation.
- Sparse activation
- The process of running only a specific subset of a model's parameters during inference, which reduces computational costs while maintaining a large overall knowledge capacity.
- Context window
- The maximum amount of information—measured in tokens—that an artificial intelligence model can hold in its active memory and process at one time.
- Reinforcement learning
- A machine learning training method where a model learns to make decisions by performing actions and receiving feedback or rewards based on the outcomes.
- Quantization (FP8)
- A technique that compresses a model's numerical precision (e.g., to 8-bit floating point) to reduce memory usage and speed up processing without significantly degrading performance.
Questions & answers
What is dots3-note preview?
It is a 280-billion-parameter open-weight artificial intelligence model developed by dots studio, the research arm of the Chinese social commerce platform RedNote (Xiaohongshu).
What does Mixture-of-Experts (MoE) mean?
MoE is an architecture that divides a model into many specialized sub-networks. Instead of using all 280 billion parameters for every task, the model routes each piece of data to only the most relevant 'experts,' activating just 16 billion parameters at a time.
Can the model process video and audio?
Yes, it is natively multimodal. It can ingest text, images, video, and audio simultaneously within a massive 512,000-token context window, outputting text-based reasoning.
What is the TEMPO training method?
TEMPO is a reinforcement learning approach designed for long-horizon tasks. It allows the model to evaluate its own progress, self-critique, and update its memory over multi-step workflows.
Can I run this model on a standard computer?
No. Despite its sparse activation, the model's sheer size requires enterprise-grade hardware, typically a server node equipped with eight high-end GPUs like NVIDIA H100s.
Significance
This release proves that the capability to build massive, multimodal AI agents is no longer confined to a few elite Western research labs. For enterprise developers and businesses, it provides a powerful, freely available tool to build autonomous systems that can handle complex, multi-day tasks without sending sensitive data to third-party providers.
Sources
[1]South China Morning PostPlatform StrategistsChina's consumer apps quietly build their own AI empires
Read on South China Morning Post →
[2]AI WeeklyOpen-Source AdvocatesXiaohongshu opens dots3-note, a 280B MoE multimodal model
Read on AI Weekly →
[3]RemioEnterprise AI ImplementersRedNote has released dots3 note Preview with 280 billion total parameters
Read on Remio →
[4]Enterprise DNAEnterprise AI ImplementersRedNote's AI lab released an open-weight 280B MoE built around TEMPO
Read on Enterprise DNA →
[5]MindStudioOpen-Source Advocatesdots3-note preview is an open-weight multimodal model released by dots studio
Read on MindStudio →
[6]PandailyPlatform StrategistsXiaohongshu released a large model overseas, the dots3-note preview
Read on Pandaily →
[7]dots studiodots3-note Preview: A Small but Mighty Step Toward Long-Horizon Agency in Real Life
Read on dots studio →
Comments
Every angle. Every day.
Get ai stories with full source coverage and perspective breakdowns delivered to your inbox.

