Agent-Native Small Models (4B/9B): When They're Enough for Your Automation

Key takeaways

NeoHorse-1, a 4B/9B agent-native model family from the former head of Huawei's Noah Ark lab, is built around tool calling and error recovery rather than open-ended chat. A decision guide for choosing between small agent models and a frontier API.

On September 7, 2026, a new lab released NeoHorse-1, its first model family, in 4B and 9B sizes. The founder is Wang Yunhe, who previously led Huawei's Noah Ark lab and the PanGu model. The release is specific about what the models are for: tool calling, reading environment feedback, discovering errors, and adjusting a path. Compute and infrastructure come from Infinigence, with Tsinghua and Peking University teams contributing to the algorithm and training method. The company says the models perform strongly across ten evaluations covering harness agents, tool use, code, and instruction following.

"Agent-native" is the part worth understanding. Most small models are compressed chat models: they answer, but they struggle to run a loop. An agent-native model is trained for the loop itself. Call a tool, read what happened, notice the error, change the plan. If your automation is a publishing pipeline, a data pull, or a monitoring job, that is the shape of work you need done, and a 4B model that can do it costs far less per action than a frontier API.

Recommendation at a glance

Use a small agent-native model for narrow, high-volume, tool-heavy loops with a clear success condition: fetch a page, extract a field, post to an API, retry on failure. Use a frontier model for ambiguous tasks, long-horizon planning, customer-facing writing, and anything where a wrong step is expensive. The split that works for most teams is a small model for the mechanical majority of steps and a frontier model for the judgment calls.

Small agent-native model versus frontier API by workload type

Where a small agent-native model wins

Cost per completed action is the first advantage, and it compounds at volume. Latency is the second, because a smaller model responds faster and a tight loop spends most of its time waiting. Control is the third: self-hosting keeps data inside your boundary, which matters for client work and anything under a compliance review. Scope is the fourth, in an odd way. A model that only has to do one thing well is easier to evaluate than a general model asked to do everything.

Where it still loses

Long-horizon planning is still a frontier-model job. Ambiguous instructions defeat small models quickly, because they have less capacity to infer what you meant. Tool ecosystems matter too: a small model may not have been trained against your MCP servers or your SDK conventions, and adapting it can cost more than the savings. And the ten benchmarks in this release are vendor-reported, with no independent replication yet.

A decision table

Workload

Small agent-native

Frontier API

Why

Scheduled data pulls with a fixed schema

Yes

Overkill

The success condition is binary and cheap to verify

Publishing pipeline steps with a QA gate

Steps yes, gate no

Gate

Mechanical steps at volume, judgment at the checkpoint

Open-ended research and synthesis

No

Yes

Needs long-horizon reasoning and nuance

Customer-facing writing

No

Yes

Voice and accuracy risk is too high

High-volume monitoring and alerting

Yes

Too expensive

Repetitive, verifiable, latency-sensitive

How to test one without a migration

Pick one workflow with a measurable success condition. Run fifty tasks on both runtimes and record completion rate, cost per completed task, and how often a human had to intervene. Set an escalation path to the frontier model for anything the small model fails, so the pilot cannot silently degrade output. Time-box the whole thing to two weeks. Quality check: you end with a number for cost per completed task, not a feeling about how it went. Recovery: if completion rate lands under your bar, keep the small model as a first-pass filter and escalate the rest.

What to watch

Whether the weights are released, because open weights would change the cost math substantially. Whether independent evaluations replicate the ten-benchmark claims. Whether the open-source harness ecosystem that DeepSeek opened in August supports this class of model out of the box. And how the major labs price their own small agent models, since that is what sets the floor.

The honest limits

This is one release, with vendor-reported benchmarks and no independent replication. Small agent-native models are a direction rather than a proven default, and the right decision is per workflow, made with your own numbers. The useful signal from NeoHorse is not a benchmark score. It is that serious teams are now building for the agent loop instead of shrinking a chat model and hoping it holds up.

FAQ

Is a 4B model really enough for agent work?

For narrow loops with a clear success condition, often yes. The hard part of agent work is not language quality, it is following a tool protocol and recovering from errors, which is what these models are trained for. The failure mode to watch is ambiguity, not vocabulary.

Do I need to replace my current stack?

No. The practical pattern is a hybrid. Small model for mechanical steps, frontier model for judgment and anything a customer reads.

Where does NeoHorse fit?

It is one of the first releases built explicitly around agent loops rather than chat. Treat the benchmarks as a starting point, test it on one workflow of your own, and let the cost per completed task decide.

Author: Nathan Reed, AI Marketing Workflow Designer for 80+ Growth Systems at Auspia. Nathan writes about automation stacks, agent workflows, and where AI fits in a growth system.

Explore this topic

Keep following the same growth thread