The most trusted news from South Africa

Provided by AGP

Got News to Share?

AICC says enterprise AI token costs fell 67% as multi-model routing surges

May 10, 2026
AICC says enterprise AI token costs fell 67% as multi-model routing surges

By AI, Created 4:57 PM UTC, May 18, 2026, /AGP/ – AI.cc says enterprise token costs dropped 67% year over year in the 12 months ending April 30, 2026, as production AI shifted toward multi-model routing and open-source models. The Singapore-based platform’s report, based on 2.4 billion API calls, shows enterprises are now using more models, spending less per token, and relying more on agentic workflows.

Why it matters: - Enterprise AI is getting much cheaper to run, which can change product margins, deployment decisions and vendor choice. - Multi-model routing is becoming the default architecture, pushing routine tasks to lower-cost models and reserving frontier models for the hardest work. - Open-source and open-weight models now account for a much larger share of enterprise usage, signaling a broader shift in procurement and platform power.

What happened: - AI.cc released its 2026 AI API Infrastructure Report on May 9, 2026. - The report analyzes more than 2.4 billion API calls processed on the AI.cc platform between Jan. 1 and April 30, 2026. - The dataset covers more than 8,000 active developer and enterprise accounts across 47 countries. - AI.cc says enterprise token costs fell 67% year over year in the 12 months ending April 30, 2026. - The blended cost per million tokens dropped from $18.40 to $6.07 over that period. - Enterprise teams using multi-model routing on AI.cc saw a median cost reduction of 71% versus equivalent single-provider deployments. - The top quartile of those teams cut costs by more than 80% while maintaining or improving output quality on customer-defined evaluation metrics.

The details: - AI.cc attributes the cost decline to three forces: lower open-source model pricing, wider multi-model routing and aggregation-scale pricing. - DeepSeek V4-Flash launched on April 24, 2026, at $0.14 per million input tokens and $0.28 per million output tokens. - AI.cc says open-source and open-weight models captured 38% of enterprise token volume in Q1 2026, up from 11% in Q1 2025. - Qwen 3.5’s 9B variant is priced at $0.10 per million input tokens. - Gemma 4’s Apache 2.0 open-weight models can be self-hosted at effectively zero cost. - GLM-5.1 is offered at $3 per month for coding-heavy workflows. - In Q1 2025, 73% of enterprise token volume went to the two most expensive model tiers. - By Q1 2026, that share fell to 31%, with 69% routed to mid-tier and cost-efficient models. - AI.cc says routing optimization accounts for an estimated 34 percentage points of the total 67% cost reduction. - The platform’s effective discount versus direct retail API pricing averaged 23% in Q1 2026. - For the highest-volume enterprise accounts, some model categories were priced 35% to 40% below direct provider retail rates. - Average models per enterprise account rose to 4.7 in Q1 2026 from 2.1 in Q1 2025. - New accounts onboarded in Q1 2026 used an average of 5.3 models within their first 30 days. - AI.cc says the dominant deployment pattern is the Tiered Intelligence Stack, which represented 64% of enterprise accounts by token volume. - The cost-efficiency tier handles 55% to 70% of API calls using models priced below $0.50 per million input tokens. - The mid-performance tier handles 20% to 30% of API calls using models priced between $0.50 and $5 per million input tokens. - The frontier tier handles 5% to 15% of API calls and is reserved for the most complex, highest-value tasks. - Enterprises that fully implemented the Tiered Intelligence Stack in 2026 had a median blended cost of $2.31 per million tokens. - That compares with $18.40 for equivalent workloads routed entirely through frontier models 12 months earlier. - Claude Sonnet 4.6 was the most-called model by token volume across the platform in Q1 2026. - DeepSeek V3.2 ranked second by volume. - GPT-5.4 ranked third by volume. - Gemini 3.1 Flash ranked fourth by volume. - Qwen 3.5 9B ranked fifth by volume. - Claude Opus 4.6 ranked sixth by volume. - DeepSeek V4-Flash ranked seventh by volume after its April launch. - Llama 4 Maverick ranked eighth by volume. - Gemini 3.1 Pro ranked ninth by volume. - GLM-5.1 ranked tenth by volume. - Open-source and open-weight models occupied four of the top 10 positions by token volume. - Agent-pattern API calls grew 680% year over year in Q1 2026. - Agent-pattern workflows represented 41% of new integration use cases in Q1 2026, up from 18% in Q1 2025. - AI.cc identified five common production agent architectures: research and synthesis, software development, customer experience, document processing and content production. - OpenClaw-based implementations had lower rates of production incidents tied to model failures, rate limit errors and context management issues than custom-built equivalents. - Asia-Pacific remained the largest region by customer count, with 44% of active accounts. - Europe was the fastest-growing region, with new account activations up 290% year over year in Q1 2026. - North America grew 180% year over year in Q1 2026. - The Middle East and Africa grew 340% year over year from a smaller base. - Latin America grew 220% year over year. - AI.cc says its platform provides access to 300+ AI models through a single OpenAI-compatible API. - The platform supports text, image, video, voice, code, embedding and OCR model categories. - AI.cc also offers the OpenClaw AI agent framework, enterprise plans with SLA guarantees, AI application development services and an AI Translator API. - More information is available in the company’s announcement and platform documentation.

Between the lines: - The report suggests enterprise AI buying is shifting from model loyalty to workload-specific orchestration. - Cost pressure is pushing teams to mix cheap models, mid-tier models and frontier models instead of defaulting to a single premium provider. - The rise of open-source models in production also points to a more global vendor landscape, with US, Chinese and European models all showing up in top usage ranks. - The growth in agentic workflows suggests enterprises are moving from chat-style use cases to more complex, multi-step systems that automate parts of research, coding, support and document work.

What’s next: - AI.cc expects deep multi-model routing to keep spreading as more teams move from experimentation to production. - DeepSeek V4-Flash is on track to reach the top three by the end of Q2 2026, according to AI.cc. - The company’s report points to continued pressure on frontier-model pricing as open-source alternatives improve and routing systems become more sophisticated. - Further growth is likely in agent workflows, especially in software development, customer service, compliance and document-heavy industries.

The bottom line: - Enterprise AI is no longer a one-model market. The winning strategy in 2026 looks like orchestration, not defaulting to the most expensive model.

Disclaimer: This article was produced by AGP Wire with the assistance of artificial intelligence based on original source content and has been refined to improve clarity, structure, and readability. This content is provided on an “as is” basis. While care has been taken in its preparation, it may contain inaccuracies or omissions, and readers should consult the original source and independently verify key information where appropriate. This content is for informational purposes only and does not constitute legal, financial, investment, or other professional advice.

Sign up for:

Cape Town Journal

The daily local news briefing you can trust. Every day. Subscribe now.

By signing up, you agree to our Terms & Conditions.

Share us

on your social networks:

Sign up for:

Cape Town Journal

The daily local news briefing you can trust. Every day. Subscribe now.

By signing up, you agree to our Terms & Conditions.