Article:Ishan Patel, Sahil Sen, Elias Lumer, Vamse Kumar Subbiah
Research Compares Programmatic Tool Calling to JSON Tool Calling
A research paper evaluates Programmatic Tool Calling (PTC) against native JSON tool calling across 14 language models using the BFCL v4 benchmark. In PTC, tools are represented as typed Python stubs invoked via code in a single agent turn. The approach matches or exceeds native JSON tool calling in 11 out of 14 models.
From Video: Weekly AI Roundup: DeepSeek Harness, Model Routing, and Scaffolding Shifts