Article:Bryan Shan, Myron Xie, Jordan Nanos
OpenAI Jalapeño: Custom Inference ASIC Outperforms Nvidia Blackwell in Power Efficiency
At the Hot Chips conference, OpenAI revealed details of its custom LLM inference chip codenamed Jalapeño. Developed in partnership with Broadcom, the ASIC outperforms Nvidia Blackwell and Vera Rubin in token throughput per megawatt according to initial lab benchmarks by SemiAnalysis.
From Video: AI Weekly Updates: Open-Source Model Surge, Agent Harnesses, and Meta's AI Reality Check