Oqoqo vs Pacwich

Run eval experiments at scale in realistic environments on fully managed cloud infrastructure. Define custom task sets to build your private benchmarks, measure how well...

Monorepo tooling that works on top of Bun, npm, and pnpm workspaces, with a CLI and TypeScript API.

About Oqoqo

Run eval experiments at scale in realistic environments on fully managed cloud infrastructure. Define custom task sets to build your private benchmarks, measure how well agents can use any product, and find the best agent-model combinations for your use cases. Generate insights on the fly, such as product interface friction, token inefficiencies, performance differences, and so much more. Oqoqo - The easiest way to build evals and custom benchmarks for real-world agentic tasks . A video-style demonstration of building and launching an agent experiment in Oqoqo: describing a task, selecting tasks, configuring agents, treatments, runs and evals, then launching runs on sandboxed machines and reviewing pass and fail results with full step-by-step trajectories.

About Pacwich

Monorepo tooling that works on top of Bun, npm, and pnpm workspaces, with a CLI and TypeScript API. This package is the continuation of the original, now deprecated, bun-workspaces package. bun-workspaces users can expect minimal to no changes on average. CLI global install: Your pacwich command will still resolve to a local install when available. bun add -g pacwich # Print help for installing completions pacwich completion # Attempt to automatically install completions for your shell pacwich completion install Local install: Note the pacwich command works in your package.json scripts even without a global install.