Needle2 vs Trunchbull

An open 45M-parameter model for tool calling, device use, and structured extraction. Needle 2 runs as a 14 MB binary in 28 MB of session RAM.

Provider-neutral AI model benchmarking. Detect regressions before they reach production.

About Needle2

An open 45M-parameter model for tool calling, device use, and structured extraction. Needle 2 runs as a 14 MB binary in 28 MB of session RAM. Needle 2 is measured end-to-end through the shipped binary at CQ2-bit deployment precision with tool retrieval on; baselines run the released checkpoints under vLLM, and Apple FM runs on-device. Bringing On-Device AI to <$200 Devices : Edge AI has lately meant Macs and PCs, but the true edge is mostly cheap hardware: there are more than 21 billion IoT devices against roughly 1.5 billion PCs.

About Trunchbull

Provider-neutral AI model benchmarking. Detect regressions before they reach production. Deploy tools from GitHub, run them against managed AI models, and inspect every decision under controlled budgets. Trunchbull validates the contract, builds the repository, and deploys it into an isolated Cloudflare Worker, ready for any benchmark configuration. Give agents a real machine without giving them yours. Run terminal and code-execution evaluations inside controlled, image-backed environments. Define the maximum steps, token usage, and dollar spend before a run begins.