Benchmarks
How fast is FerrFlow?
Side-by-side comparison against the JavaScript ecosystem release tools, measured with hyperfine on the same hardware, the same commits, and the same fixtures. Numbers refresh on every FerrFlow release.
Last update: July 23, 2026 · ferrflow v5.47.0 · binary size 8.0 MB
Median of 30 hyperfine runs · linear scale · cold cache · FerrFlow pinned to --jobs 1 · lower is better. The pale segment at the foot of each bar is that tool's startup — process spawn, runtime boot, module loading — measured against a one-package one-commit floor fixture; the coloured segment above it is the work. The total is what you wait for; the split is where it goes.
| Tool | 1 × 100 | 10 × 100 | 50 × 500 | 100 × 1k | 50 × 5k | 200 × 10k | 50 × 300 · graph |
|---|---|---|---|---|---|---|---|
| ferrflow | 7 ms | 9 ms | 10 ms | 16 ms | 31 ms | 64 ms | 20 ms |
| changesets | 762 ms | 842 ms | 691 ms | 880 ms | 684 ms | 770 ms | 769 ms |
| commit-and-tag-version | 490 ms | 500 ms | 405 ms | 589 ms | 716 ms | 1.08 s | 487 ms |
| semantic-release | 1.58 s | 1.61 s | 1.27 s | 1.79 s | 1.91 s | 2.48 s | 1.45 s |
| standard-version | 560 ms | 567 ms | 468 ms | 713 ms | 881 ms | 1.32 s | 561 ms |
How we measure
- Hyperfine with 3 warmup runs and 30 timed runs per (fixture × tool × command) cell. Median latency reported.
- Cold cache. FerrFlow memoises its analysis under
.git/ferrflow-cache. That cache is dropped before every timed run, so the comparison measures the work itself — none of the other tools has an equivalent to hide behind. The warm numbers are reported separately below. - Peak RSS via
/usr/bin/time -von a single subsequent run. - Fixtures are generated from FerrLabs/Fixtures with deterministic conventional-commit history (no flaky inputs). The commit count in each fixture label is the number of commits since the last release tag — the exact window FerrFlow walks to compute a bump, not the repository's total history.
- All commands are dry-run release planning — every tool computes the next version and release notes without writing anything:
ferrflow release --dry-run,semantic-release --dry-run --no-ci,standard-version --dry-run,commit-and-tag-version --dry-run, etc. The same operation for every tool, so we're comparing the planning cost, not the IO cost of actually mutating files. - Single-threaded comparison. FerrFlow runs with
--jobs 1in the chart above, so it's measured like the single-threaded JS tools. Its real-world parallel numbers are reported separately. - Two cells are not like-for-like, and we'd rather say so than quietly win. On
200 × 10k,changesets statusis faster than FerrFlow — but changesets plans releases from.changeset/*.mdfiles you write by hand, and never from commits. Six of our seven fixtures give it none, so it reports no packages to be bumped and stops. Its time tracks package count, not history: it barely moves across a 100× range of commits, because it isn't reading them. That cuts the other way too — most of every row where we beat it isnpxand Node startup, not release planning. On50 × 300 · graph, FerrFlow is slower thancommit-and-tag-versionbecause it's the only tool doing the job — resolving a 50-package dependency cascade and recovering missed releases across the history. The others emit one bump and have no notion of a dependency graph. We're fixing the fixtures (Fixtures#141); until then, read those two cells as a measurement gap, not a verdict. - Reproducible — the full pipeline is in FerrLabs/Benchmarks; results land as artifacts on every
mainpush and in each release notes.
Parallel mode
The comparison pins FerrFlow to a single thread (--jobs 1) so it's apples-to-apples with the single-threaded JS tools. In real CI it uses every core — here's the same release --dry-run on all 4 cores of the benchmark runner.
| Fixture | 1 thread | 4 cores | Speedup |
|---|---|---|---|
| Single package · 100 commits | 7 ms | 7 ms | 0.9× |
| Monorepo · 10 packages × 100 commits | 9 ms | 9 ms | 1.0× |
| Monorepo · 50 packages × 500 commits | 10 ms | 11 ms | 0.9× |
| Monorepo · 100 packages × 1k commits | 16 ms | 19 ms | 0.8× |
| Monorepo · 50 packages × 5k commits | 31 ms | 35 ms | 0.9× |
| Monorepo · 200 packages × 10k commits | 64 ms | 65 ms | 1.0× |
| Monorepo · dependency graph · 50 packages × 300 commits | 20 ms | 16 ms | 1.2× |
Warm cache
Every number above is measured cold. In practice a repository rarely moves between two ferrflow check calls, so FerrFlow keeps the result of its last analysis in .git/ferrflow-cache and reuses it while HEAD, the tags and the config are unchanged. This is what a second call costs on an unchanged repo — it's a real property of the tool, but it isn't a like-for-like comparison, so it stays out of the chart.
| Fixture | Cold | Cached | Speedup |
|---|---|---|---|
| Single package · 100 commits | 7 ms | 3 ms | 2.6× |
| Monorepo · 10 packages × 100 commits | 9 ms | 3 ms | 2.8× |
| Monorepo · 50 packages × 500 commits | 11 ms | 3 ms | 3.7× |
| Monorepo · 100 packages × 1k commits | 18 ms | 4 ms | 4.5× |
| Monorepo · 50 packages × 5k commits | 36 ms | 3 ms | 12.3× |
| Monorepo · 200 packages × 10k commits | 65 ms | 3 ms | 19.0× |
| Monorepo · dependency graph · 50 packages × 300 commits | 18 ms | 4 ms | 4.5× |
Install footprint
Disk size after install. release-please appears here only — its runtime can't be benched offline (it needs the GitHub API to resolve the latest release), so footprint is the fair comparison we can publish.
| Tool | npm install | Native binary |
|---|---|---|
| ferrflow | 8.0 MB | 8.0 MB |
| changesets | 26.0 MB | — |
| commit-and-tag-version | 9.0 MB | — |
| release-please | 95.0 MB | — |
| semantic-release | 69.0 MB | — |
| standard-version | 21.0 MB | — |
Why FerrFlow ships smaller numbers
- Native binary. No Node.js boot, no npm install, no plugin discovery. A
ferrflow checkon a 50-package monorepo finishes beforenode --versionwould have warmed up. - gitoxide in-process. Tag enumeration and commit walking happen via gitoxide in the same process. Competitors shell out to
gitper call; process-spawn overhead dominates on dense histories. - Single tool, not a plugin tree. semantic-release pulls a chain of analyzers, notes generators, npm publishers and changelog writers — each with its own require() cost. FerrFlow's pipeline is one Rust crate.
Numbers updating every release. See the latest release notes for the full table including baseline delta.