Mixture-of-Experts models
Find Mixture-of-Experts architectures, sparse activation, routing methods, and related open models.
Map the topic before choosing
For MoE, inspect total parameters, active parameters, routing, parallelism, and inference memory together. This page keeps architectures, mechanisms, and models on one exploration path.
Use this page to understand the topic and discover candidates. When you are ready to compare deployment, budget, or capability constraints, open the decision guide above.
Curated KG entry points
A small set of entry points for discovering this topic, not a paid ranking or an official product review. Return to the homepage for the full semantic retrieval and second-stage summary.
Mixture-of-Experts
KG-recorded mechanism related to Mixture-of-Experts; detailed English notes are not yet available.
Mechanismsparse mixture-of-experts
KG-recorded mechanism related to 稀疏混合专家（MoE）; detailed English notes are not yet available.
MechanismMoE
Its implementation in llama.cpp's Metal backend affects DSpark performance on M4
MechanismMoE
KG-recorded mechanism related to 混合专家模型（MoE）; detailed English notes are not yet available.
MechanismMoE
KG-recorded mechanism related to 混合专家（MoE）; detailed English notes are not yet available.
MechanismSparse Mixture-of-Experts
KG-recorded mechanism related to 稀疏混合专家模型; detailed English notes are not yet available.
MechanismMoE Routing
KG-recorded mechanism related to MoE Routing; detailed English notes are not yet available.
ModelPhi-mini-MoE-instruct
Phi-mini-MoE is a lightweight Mixture of Experts (MoE) model with 7.6B total parameters and 2.4B activated parameters. It is compressed and distilled from the base model shared by Phi-3.5-MoE and GRIN-MoE using the SlimMoE approach, then post-trained via supervised fine-tuning and direct preference optimization for instruction following and safety. The model is trained on Phi-3 synthetic data and filtered public documents, with a focus on high-quality, reasoning-dense content. It is part of the SlimMoE series, whic
Share feedback on this topic
Anonymous feedback is attached to this topic page, stays outside the KG, and is visible to other visitors.