ArticlePyTorch Ecosystem Working GroupAnnouncement
These additions reflect central industry demands: lowering memory barriers for massive Mixture-of-Experts architectures, speeding up local fine-tuning workflows, ensuring portable deployment, and integrating scientific physics modeling with deep learning.
By highlighting Unsloth and KTransformers, the PyTorch foundation emphasises practical resource optimisation alongside raw compute. KTransformers' approach to dynamically offloading idle MoE expert layers to system RAM directly mitigates GPU supply constraints, while Unsloth delivers significant efficiency gains for day-to-day tuning tasks. PhysicsNeMo and ONNX anchor PyTorch both in scientific simulations and standardized cross-platform production deployments.
Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.
Similar in content, found by the AI search.
Article:unsloth.ai
Unsloth's documentation shares benchmark metrics for LLM fine-tuning across NVIDIA GPUs. Compared to Hugging Face paired with FlashAttention-2, Unsloth achieves a 2x speedup, over 70% VRAM reduction, and significantly longer context windows on models such as Llama 3.1 and Llama 3.3.
Repository:NVIDIA/Model-Optimizer
NVIDIA Model Optimizer (ModelOpt) provides state-of-the-art model optimization techniques such as quantization, pruning, distillation, and speculative decoding. It accepts PyTorch, Hugging Face, and ONNX models and outputs optimized checkpoints ready for downstream engines like TensorRT-LLM, vLLM, and SGLang.
5kstarsPython
Link:Unsloth AI
Unsloth provides an open-source framework and desktop application to run and train AI models locally. With the 'unsloth start' feature, coding agents such as Claude Code and Codex can directly connect to local models.
Repository:unslothai/unsloth
Unsloth is an open-source cross-platform desktop application and framework designed to run and fine-tune large language models and diffusion architectures locally across varied hardware setups.
75.7kstarsPython
Article:Chris Alexiuk and Chintan Patel
NVIDIA has announced Nemotron 3.5 Lightning, an open 30B mixture-of-experts (MoE) model featuring 3B active parameters. It is tailored for the high-volume execution layer of long-running AI agents, targeting routine tasks such as tool calling and result validation with low latency.
Article:Unsloth AI
Unsloth has launched the beta of Unsloth Desktop, a free and open-source application for macOS, Windows, and Linux designed to run, fine-tune, and deploy multimodal models on local hardware.
Parts of this content were created with the assistance of AI.
