Repository:syv-ai/qwen38-27b-rtx3090
Qwen3.8-27B on a Single RTX 3090: High-Throughput Serving with vLLM
This repository provides an optimised serving configuration for running Qwen3.8-27B on a single 24 GB consumer GPU (RTX 3090) using vLLM 0.28.0 and contexts ranging from 150k to 262k tokens.
1.1kstarsPython
From Video: AI Weekly Updates: Open-Source Model Surge, Agent Harnesses, and Meta's AI Reality Check