# HydraFusion and Fugu: The Model Picker Is Becoming the Product

**Plutonous** | September 6, 2026 | 8 min read

> GitHub HydraFusion, Sakana Fugu, and OpenRouter Fusion point to a market where the durable advantage is the runtime policy that chooses, escalates, critiques, and synthesizes models.

Tags: AI Infrastructure, Model Routing, LLM Economics, AI Agents, GitHub Copilot, Sakana AI, OpenRouter, Inference

---

**TL;DR: HydraFusion offers 3 execution patterns in Copilot CLI, while Sakana reports that Fugu-Ultra v1.1 gained up to 7.9 benchmark points over v1.0.<sup><a href="#source-14">[14]</a></sup><sup><a href="#source-4">[4]</a></sup> Together with OpenRouter Fusion, they signal a shift from choosing one model to deciding when several models should solve, review, or compare work. This is runtime orchestration and output deliberation; it does not require merging model weights.**

*Cover: LLM Rumors conceptual illustration of separate reasoning streams passing through a routing press. It represents orchestration, not the internal architecture of any product.*

For years, the AI market trained buyers to ask a deceptively simple question: which model should we use? The answer came as a leaderboard, a token price, and a default dropdown.

That question is now too small. A production coding task may deserve a cheap first pass, a stronger model only after a quality gate fails, and a separate critic before a patch reaches a repository. A research task may need independent answers surfaced for disagreement before anybody writes a conclusion. The system is no longer just choosing intelligence. It is choosing a workflow.

GitHub's September 4 HydraFusion results make this shift concrete.<sup><a href="#source-1">[1]</a></sup> Alongside Sakana Fugu and OpenRouter Fusion, the preview shows how coordination is becoming something customers can buy through a familiar model interface. Our argument is that the provider controlling those decisions can capture value even when another company supplies the strongest underlying model.


### Why This Matters Now

The next AI control plane will decide more than a model name. It will set the first solver, the escalation rule, the reviewer, the tool permissions, the cancellation boundary, and the evidence required to accept an answer. That policy can change quality, latency, spend, reliability, and vendor exposure at once.


## A Taxonomy Of Fusion: Four Different Layers

“Fusion” can refer to combining answers, coordinating calls, or constructing a new checkpoint. The commercial consequences depend on which thing is actually being combined.


### Four Mechanisms
- Decision or combination
- Example

- feature: Request routing; values: - Choose one model for a request
- HyDRA
- feature: Workflow orchestration; values: - Choose call sequence, roles and escalation
- HydraFusion; Fugu
- feature: Output deliberation; values: - Compare independent answers before final synthesis
- OpenRouter Fusion
- feature: Weight merging; values: - Combine checkpoint parameters before serving
- Sakana Evolutionary Model Merge


OpenRouter Fusion illustrates output deliberation. An outer model can invoke a configurable panel of models, which answer in parallel. An analyst then returns structured findings about consensus, contradictions, coverage gaps, unique insights, and blind spots. The outer model writes the final answer. OpenRouter explicitly says the analyst does **not** merge the panel answers.<sup><a href="#source-9">[9]</a></sup>

That design can be powerful for research and critique because disagreement is itself useful evidence. It also has a visible economic shape. OpenRouter estimates its default three-model panel plus analyst at roughly **4 to 5 times** the cost of one completion on the same prompt, with cost rising linearly as members are added.<sup><a href="#source-9">[9]</a></sup> The system should therefore be invoked when the expected cost of being wrong exceeds the added calls, not as a vanity setting for every summary.

Weight merging combines parameters or task vectors into a new checkpoint before deployment, subject to compatibility constraints.<sup><a href="#source-12">[12]</a></sup> Sakana's Evolutionary Model Merge is actual work in this category.<sup><a href="#source-11">[11]</a></sup> Fugu's repository, by contrast, explicitly describes coordination without weight merging or shared architectures.<sup><a href="#source-6">[6]</a></sup>

A systematic study of merging methods also reports uneven results across checkpoints and tasks.<sup><a href="#source-13">[13]</a></sup> Combining weights does not guarantee that useful abilities survive. Combining answers does not guarantee their mistakes cancel out. The word “fusion” removes neither burden of proof.

## HydraFusion's Policy Stack: More Than One Model Choice

GitHub's community announcement makes the change concrete. HydraFusion's **Single** route uses one solver; **Cascade** adds gated escalation; **Critique** puts a read-only reviewer from another model family between drafting and one revision. The preview is in Copilot CLI. Its FAQ says customers cannot currently choose or exclude constituent models, and billing sums the underlying phases.<sup><a href="#source-14">[14]</a></sup>

That makes the model menu a purchasing interface for a process. The customer delegates both the task and the decision about how to perform it. Here's the genius of that packaging: developers can adopt a more elaborate workflow without maintaining its moving parts. The burden shifts to the provider to prove the extra machinery earns its place.


### GitHub's Offline Results Versus Opus 5
Vendor-reported best tuned HydraFusion configuration; quality differences are percentage points.

- value: +4.9pp; label: TerminalBench 2.1; description: GitHub reports 67% lower estimated workflow cost.
- value: -1.5pp; label: DeepSWE; description: GitHub reports 36% lower estimated workflow cost.
- value: -0.1pp; label: CheckpointBench; description: GitHub reports 65% lower estimated workflow cost.

Source: GitHub, September 4. All models at medium reasoning; matched inputs, tools, execution limits, pricing, grading and missing-result treatment. Cost includes every workflow leg. Results depend on benchmark revision, configuration and model pool; not independent replication.


GitHub tuned policies across these benchmarks, including internal CheckpointBench, and identifies first-turn, single-prompt tasks as the preview's best starting point. Longer sessions and production behavior need further validation.<sup><a href="#source-1">[1]</a></sup>

The useful result is a trade-off: one benchmark gains quality, two surrender some, and all report lower estimated cost. A buyer should ask whether the forgone quality is acceptable for its own tasks. A small average gap can conceal an expensive failure in the wrong repository. The evidence supports testing a different spending policy, not replacing acceptance tests with a brand name.

## Fugu's Business Model: Sell The Coordinator, Not The Checkpoint

Sakana Fugu makes the product thesis even more explicit. In its June 22 launch, the company described Fugu as a model trained to call an agent pool, including recursive instances of itself, through a single OpenAI-compatible API. Fugu targets everyday latency-sensitive work; Fugu Ultra is positioned for more difficult multi-step tasks.<sup><a href="#source-2">[2]</a></sup> The technical report describes the coordination system behind that interface.<sup><a href="#source-3">[3]</a></sup>

That changes the buyer relationship. The customer gets one endpoint rather than a collection of provider accounts, prompt templates, and brittle hand-built loops. Sakana's public description traces the system to TRINITY and Conductor research, where coordination is learned across turns and roles such as Thinker, Worker, and Verifier are assigned adaptively.<sup><a href="#source-7">[7]</a></sup><sup><a href="#source-8">[8]</a></sup>

On July 24, Sakana reported that Fugu-Ultra v1.1 improved selected tracked benchmarks by up to **7.9 points** over v1.0 at the same price, after incorporating new frontier models.<sup><a href="#source-4">[4]</a></sup> That is a revealing vendor claim. A fixed checkpoint does not absorb a new competitor's capabilities by itself. An orchestrator can change its available capability by updating the pool and policy; that still requires fresh evaluation.

The uncomfortable truth is that this convenience comes with opacity. Sakana says it does not expose the underlying model selections or coordination per request.<sup><a href="#source-5">[5]</a></sup> Its standard Fugu product lets users opt out of specified providers or models, while Fugu Ultra uses a fixed pool, but neither option gives a request-level routing trace. Sakana also currently lists the EU/EEA as unavailable.<sup><a href="#source-5">[5]</a></sup> That becomes a procurement question for code, regulated workflows, or any system that needs provider provenance, reproducibility, residency control, or incident diagnosis. An orchestration layer can reduce vendor dependence at the application level while creating dependence on its own hidden policy.

## The New Unit Of Competition: A Workflow

Conventional routing is a one-shot allocation. A request arrives, a classifier estimates the required capability, and the platform sends it to one model. GitHub's earlier HyDRA work framed that job as selecting the cheapest model that meets predicted needs for reasoning, code generation, debugging, and tool use.<sup><a href="#source-10">[10]</a></sup> That is useful infrastructure. It is also only the first branch of the decision tree.

Workflow orchestration makes subsequent choices conditional. Was the draft adequate? Did a test pass? Did a second model find a flaw? Is the extra spend justified by the cost of a bad answer? The runtime becomes a small operations team with an explicit budget and stopping rule.

This is why the real story isn't that every company suddenly has a magical supermodel. It is that systems can turn model diversity into a policy. A strong coding model can draft. A different family can criticize without editing. A quality gate can decide whether the cheap path was sufficient. Each call stays separate, with its own price, latency, context, and failure mode.


### From Model Choice To Runtime Policy
LLM Rumors design framework, not a description of every product: each additional leg needs a job and an acceptance rule.

- title: Classify the work; description: Estimate task stakes, required tools, budget, latency tolerance, and what proof would count as success.; time: Before first call; volume: One request
- title: Use the economical path first; description: A single capable solver handles routine work. The system retains the option to escalate instead of paying frontier prices by default.; time: First pass; volume: One model call
- title: Escalate or review on evidence; description: Tests, a critic, a schema check, or disagreement can trigger a stronger solver or an independent review step.; time: Conditional; volume: Additional calls only when needed
- title: Return one accountable outcome; description: Capture the model roles, cost, latency, outcome, and reason the workflow stopped. Those records become the next routing dataset.; time: Completion; volume: Auditable result


## The Moat In Practice: Evaluation, Not More Model Calls

Anyone can put three APIs behind a prompt. That is not the hard part. The difficult work is learning when a second call changes the accepted outcome enough to pay for itself.

A buyer's accounting should include retries, human review, tool failures, cache misses, and the cost of a wrong action. Cost per first response is a misleading metric. Cost per accepted outcome is the one that matters.

The data advantage will come from the system's own operating record: which task classes pass cheaply, which failure signals predict escalation, which critics actually catch defects, and which expensive loops only create polished mistakes. That is why [reasoning effort is becoming an inference control plane](/news/reasoning-effort-inference-control-plane), and why [speculative decoding's economics](/news/deepseek-deepspec-speculative-decoding-inference-economics) matter to the same architecture. Both change the cost of deciding how much work an answer deserves.


### The New Benchmark Disclosure Rule

An orchestration score needs the whole runtime recipe: model pool, reasoning level, prompt and output limits, tools, panel size, reviewer, routing policy, benchmark revision, verifier, retry rules, latency distribution, and cost accounting. Without those conditions, a claim about a compound system cannot tell a buyer what will transfer to its own workload.


### The Runtime-Orchestration Playbook
- Treat model choice as the first decision in a workflow, not the product's final architecture.
- Use cheap one-shot routes for routine tasks, then escalate only on a measurable failure signal or a high cost of error.
- Distinguish selecting calls, comparing answers, and merging checkpoint parameters.
- Measure cost per accepted outcome, including retries, reviewers, tool calls, and human intervention.
- Demand request-level observability when a compound endpoint controls provider selection and model roles.
- Publish the runtime recipe with every quality or cost comparison.


## The Strategic Asset: Owning The Task Outcome

The winning AI company will not necessarily own the best model at every task. It will know, with evidence, which task can accept a fast answer, which needs a specialist, which merits an adversarial review, and which should stop because more inference will not improve the outcome.

That is a profound shift in where product value accumulates. Model makers still matter because a stronger or cheaper worker expands what the system can do. But the buyer-facing differentiation moves upward to the policy that composes workers into accountable results. GitHub is productizing a bounded coding workflow. Sakana is selling a learned coordinator behind a single endpoint. OpenRouter is turning answer comparison into a configurable service.

The model dropdown is becoming the least interesting part of the stack. The strategic asset is the runtime that decides what happens after the first answer is not enough.


## Sources & References

<a id="source-1"></a>
1. [Project HydraFusion: Frontier quality via multi-model orchestration](https://github.blog/ai-and-ml/github-copilot/project-hydrafusion-frontier-quality-via-multi-model-orchestration/)

<a id="source-2"></a>
2. [Sakana Fugu: One Model to Command Them All](https://sakana.ai/fugu-release/)

<a id="source-3"></a>
3. [Sakana Fugu Technical Report](https://arxiv.org/abs/2606.21228)

<a id="source-4"></a>
4. [Fugu-Ultra v1.1 and Claude Code Interface](https://sakana.ai/fugu-1-1-claude-code-interface/)

<a id="source-5"></a>
5. [Sakana Fugu product page and FAQ](https://sakana.ai/fugu/)

<a id="source-6"></a>
6. [SakanaAI/fugu](https://github.com/SakanaAI/fugu)

<a id="source-7"></a>
7. [TRINITY: An Evolved LLM Coordinator](https://arxiv.org/abs/2512.04695)

<a id="source-8"></a>
8. [Learning to Orchestrate Agents in Natural Language with the Conductor](https://arxiv.org/abs/2512.04388)

<a id="source-9"></a>
9. [Fusion Router documentation](https://openrouter.ai/docs/guides/routing/routers/fusion-router)

<a id="source-10"></a>
10. [HyDRA: Hybrid Dynamic Routing Architecture for Heterogeneous LLM Pools](https://arxiv.org/abs/2605.17106)

<a id="source-11"></a>
11. [Evolutionary Model Merge](https://github.com/SakanaAI/evolutionary-model-merge)

<a id="source-12"></a>
12. [Model Merging in the Era of Large Language Models](https://arxiv.org/abs/2603.09938)

<a id="source-13"></a>
13. [A Systematic Study of In-the-Wild Model Merging for Large Language Models](https://arxiv.org/abs/2511.21437)

<a id="source-14"></a>
14. [HydraFusion research preview discussion](https://github.com/orgs/community/discussions/206492)


*Last updated: September 6, 2026*

---

*Source: [LLM Rumors](https://www.llmrumors.com/news/hydrafusion-sakana-fugu-model-routing-orchestration)*
