artificial-analysis-compare: LLM Model Comparisons via Artificial Analysis API

Repositoryalexfazio/artificial-analysis-compareTool

A Python-based skill tool that queries the Artificial Analysis API to compare large language models such as GPT-5, Claude, and Gemini across benchmarks, pricing, and speed metrics.

Key points

  1. Compares LLMs across multiple dimensions including intelligence, coding, math, pricing, and latency.
  2. Directly links and sources performance data from artificialanalysis.ai for verification.
  3. Supports various output layouts such as tables, detailed reports, and rankings.
  4. Requires an Artificial Analysis API key stored locally in .config/config.json.

Why it matters

Selecting appropriate LLMs requires balancing output quality against inference costs and response times. This tool integrates benchmark and pricing comparisons directly into automated or CLI workflows.

Analysis

The project serves as a model-comparison skill implemented in Python, relying on the Artificial Analysis API as its data provider. Target users are developers and AI practitioners seeking quick or automated evaluations of model performance. With 12 stars, zero forks, and no explicitly declared licence, it is in an early, lightweight state of maturity.

Mentioned links

Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.

Related entries

Similar in content, found by the AI search.

  • Link:Artificial Analysis

    Artificial Analysis Intelligence Index v4.2

    Artificial Analysis has released version 4.2 of its Intelligence Index, aggregating ten challenging evaluations across mathematics, science, coding, and reasoning. Claude Fable 5.1 tops the benchmark with a score of 57, closely followed by GPT-6 Astra at 55.

    AI & LLMs· Resource

  • Link:Shishir G. Patil, Huanzhi Mao, Charlie Cheng-Jie Ji, Fanjia Yan, Vishnu Suresh, Ion Stoica, Joseph E. Gonzalez

    Berkeley Function Calling Leaderboard (BFCL) V4

    The Berkeley Function Calling Leaderboard (BFCL) V4 evaluates the ability of large language models to call functions and tools accurately. Version 4 expands previous iterations by introducing holistic agentic evaluation.

    AI & LLMs· Tool

  • Repository:anthropics/skills

    Anthropic Skills: Reference Repository and Specification for Claude Agent Skills

    Anthropic provides a public repository containing example skills, templates, and specifications for Claude's Agent Skills standard. Skills package instructions, scripts, and resources inside folders with a central SKILL.md file to enable repeatable workflows ranging from document generation to technical testing.

    174.3kstarsPython

    AI & LLMs· Resource

  • Repository:Gitlawb/openclaude

    OpenClaude: Provider-Agnostic Open-Source Coding Agent CLI

    OpenClaude is an open-source TypeScript CLI tool functioning as an AI coding agent. It standardises terminal-based development workflows across varied local and cloud model providers.

    32.3kstarsTypeScript

    AI & LLMs· Tool

  • Repository:mohitagw15856/pm-claude-skills

    PM Skills: Agent Framework Collection for AI Assistants

    PM Skills is an MIT-licensed repository providing over 1,100 structured agent skills in plain Markdown. It equips models across Claude, ChatGPT, Gemini, Cursor, and Codex with step-by-step frameworks for professional duties and critical life events.

    1.3kstarsHTML

    AI & LLMs· Resource

Back to the knowledge base

Let's talk about your project

Get in touch

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.