Moe on skulldchttps://skulldc.net/tags/moe/Recent content in Moe on skulldcHugoen-usTue, 03 Nov 2026 10:27:42 +0000Colibri runs huge mixture-of-experts models by streaming experts from diskhttps://skulldc.net/2026/11/colibri-runs-huge-mixture-of-experts-models-by-streaming-experts-from/Tue, 03 Nov 2026 10:27:42 +0000https://skulldc.net/2026/11/colibri-runs-huge-mixture-of-experts-models-by-streaming-experts-from/A C inference engine keeps an MoE model’s dense part in RAM, reads routed experts from disk on demand and puts the hottest ones on a GPU if present.