2 entries
Keyword: infinibandRepository:eugr/spark-vllm-docker
spark-vllm-docker is an open-source tool providing Docker configurations and startup scripts to run vLLM on DGX Spark systems, supporting both single-node setups and multi-node clusters via Ray or PyTorch distributed mode.
2.2kstarsShell
From Video: Nvidia DGX Spark Hands-On: Setup, vLLM Serving, and Mac Studio Comparison
Repository:spark-arena/sparkrun
sparkrun is an open-source CLI tool designed to deploy, manage, and stop LLM inference workloads across NVIDIA DGX Spark systems without requiring Slurm or Kubernetes.
491starsPython
From Video: Nvidia DGX Spark Hands-On: Setup, vLLM Serving, and Mac Studio Comparison
2 of 2 shown
Do you have an interesting article, a video, or a tweet that belongs in our knowledge base? Write to us at office@webconsulting.at.
Parts of this content were created with the assistance of AI.
