ZML/LLMD 20260929.0
DeepSeek-V4.1-Flash lands on NVIDIA and AMD.
We’re happy to announce the release of zml/llmd 20260929.0, which notably brings deepseek-ai/DeepSeek-V4.1-Flash support on NVIDIA and AMD GPUs.
Laguna S 2.1
Poolside's open-weight model for agentic coding and long-horizon work.
Jul 21, 2026
In close collaboration with Poolside, we’re happy to announce the support of Laguna S 2.1, their new open-weight model for agentic coding and long-horizon work.
ZML/LLMD alpha
The universal LLM server.
Jul 8, 2026
Today we’re releasing ZML/LLMD. It’s a self-contained inference server that runs LLaMa, Gemma, Qwen and Mistral LLMs transparently on 5 architectures: NVIDIA CUDA, AMD ROCm, Google TPU, Intel oneAPI and Apple Metal.
10x faster tokenization
Integrating with the IREE tokenizer for a 10x uplift in tokenization performance.
Apr 7, 2026
Today we merged a pretty nice performance improvement to ZML.
Introducing zml-smi
A universal diagnostic and monitoring tool for GPUs, TPUs and NPUs.
Mar 30, 2026
zml-smi is a universal diagnostic and monitoring tool for GPUs, TPUs and NPUs. It provides real-time insights into the performance and health of your hardware.
Introducing ZML/v2
Frontier performance through composability.
Mar 24, 2026
ZML is an inference stack built close to the hardware. It lowers models directly onto NVIDIA, AMD, TPU, and Trainium targets from a single codebase, without depending on and suffering from the Python-heavy runtime layers that most of the ecosystem is built around.