Mixture of experts (MoE)
Last updated
Answer in brief
A model built from many smaller expert networks, of which only a few run for each token. Qwen3-30B-A3B has about 30B parameters but activates about 3B per token, so it runs fast for its size.
Olares One → Local LLM server → vLLM · Ollama · OpenAI-compatible API → Your models, served on your network
A model built from many smaller expert networks, of which only a few run for each token. Qwen3-30B-A3B has about 30B parameters but activates about 3B per token, so it runs fast for its size.
Sources for this entry
- Olares One specifications (Olares docs) (Company-published)
- Olares One FAQ (Olares docs) (Company-published)
Continue this reading path
How the related websites connect
Cite this entry
Local LLM Server. “Mixture of experts (MoE).” Content reviewed 13 November 2026.
https://localllmserver.com/glossary/moe/