Benchmarks

How fast is FerrFlow?

Side-by-side comparison against the JavaScript ecosystem release tools, measured with hyperfine on the same hardware, the same commits, and the same fixtures. Numbers refresh on every FerrFlow release.

Last update: October 20, 2026, ferrflow v7.33.0, binary size N/A MB

ferrflow changesets commit-and-tag-version semantic-release standard-version

Median of 30 hyperfine runs, linear scale, cold cache, FerrFlow pinned to --jobs 1, lower is better. The pale segment at the foot of each bar is that tool's startup (process spawn, runtime boot, module loading) measured against a one-package one-commit floor fixture; the coloured segment above it is the work. The total is what you wait for; the split is where it goes.

Median latency, release --dry-run
Tool1 × 10010 × 10050 × 500100 × 1k50 × 5k200 × 10k50 × 300, graph
ferrflow7 ms9 ms18 ms30 ms120 ms429 ms20 ms
changesets385 ms621 ms608 ms549 ms643 ms834 ms625 ms
commit-and-tag-version338 ms488 ms525 ms478 ms1.02 s1.45 s518 ms
semantic-release972 ms1.45 s1.51 s1.28 s2.47 s3.24 s1.50 s
standard-version391 ms555 ms611 ms539 ms1.25 s1.81 s599 ms

How we measure

  • Hyperfine with 3 warmup runs and 30 timed runs per (fixture × tool × command) cell. Median latency reported.
  • Cold cache. FerrFlow memoises its analysis under .git/ferrflow-cache. That cache is dropped before every timed run, so the comparison measures the work itself. None of the other tools has an equivalent to hide behind. The warm numbers are reported separately below.
  • Peak RSS via /usr/bin/time -v on a single subsequent run.
  • Fixtures are generated from FerrLabs/Fixtures with deterministic conventional-commit history (no flaky inputs). The commit count in each fixture label is the number of commits since the last release tag: the exact window FerrFlow walks to compute a bump, not the repository's total history.
  • All commands are dry-run release planning. Every tool computes the next version and release notes without writing anything: ferrflow release --dry-run, semantic-release --dry-run --no-ci, standard-version --dry-run, commit-and-tag-version --dry-run, etc. The same operation for every tool, so we're comparing the planning cost, not the IO cost of actually mutating files.
  • Single-threaded comparison. FerrFlow runs with --jobs 1 in the chart above, so it's measured like the single-threaded JS tools. Its real-world parallel numbers are reported separately.
  • One row isn't like-for-like, and we'd rather say so than quietly win. changesets plans releases from .changeset/*.md files you write by hand, and never from commits. Six of our seven fixtures give it none, so it reports no packages to be bumped and stops. Its time tracks package count, not history: it barely moves across a 100× range of commits, because it isn't reading them. So where we come out ahead, most of the gap is npx and Node startup rather than release planning. Strip the startup out, as the split in the chart above does, and on the largest fixture changesets spends less time working than we do, because it is doing less. Read that row as a difference in job, not a verdict. The 50 × 300, graph fixture is the opposite case: there we resolve a 50-package dependency cascade and recover missed releases across the history, while the others emit one bump and have no notion of a dependency graph.
  • Reproducible: the full pipeline is in FerrLabs/Benchmarks; results land as artifacts on every main push and in each release notes.

Parallel mode

The comparison pins FerrFlow to a single thread (--jobs 1) so it's apples-to-apples with the single-threaded JS tools. In real CI it is free to use every core, so this table reports what that actually buys. Here's the same release --dry-run on all 4 cores of the benchmark runner.

Fixture1 thread4 coresSpeedup
Single package, 100 commits7 ms6 ms1.0×
Monorepo, 10 packages × 100 commits9 ms10 ms1.0×
Monorepo, 50 packages × 500 commits18 ms18 ms1.0×
Monorepo, 100 packages × 1k commits30 ms26 ms1.1×
Monorepo, 50 packages × 5k commits120 ms71 ms1.7×
Monorepo, 200 packages × 10k commits429 ms207 ms2.1×
Monorepo, dependency graph, 50 packages × 300 commits20 ms28 ms0.7×

Warm cache

Every number above is measured cold. In practice a repository rarely moves between two ferrflow check calls, so FerrFlow keeps the result of its last analysis in .git/ferrflow-cache and reuses it while HEAD, the tags and the config are unchanged. This is what a second call costs on an unchanged repo. It's a real property of the tool, but it isn't a like-for-like comparison, so it stays out of the chart.

FixtureColdCachedSpeedup
Single package, 100 commits6 ms3 ms1.9×
Monorepo, 10 packages × 100 commits10 ms4 ms2.6×
Monorepo, 50 packages × 500 commits19 ms5 ms4.2×
Monorepo, 100 packages × 1k commits32 ms5 ms5.9×
Monorepo, 50 packages × 5k commits122 ms5 ms23.9×
Monorepo, 200 packages × 10k commits436 ms7 ms60.6×
Monorepo, dependency graph, 50 packages × 300 commits23 ms5 ms4.8×

Install footprint

Disk size after install. release-please appears here only: its runtime can't be benched offline (it needs the GitHub API to resolve the latest release), so footprint is the fair comparison we can publish.

Toolnpm installNative binary
ferrflow1.0 MB—
changesets5.0 MB—
commit-and-tag-version9.0 MB—
release-please95.0 MB—
semantic-release69.0 MB—
standard-version21.0 MB—

Why FerrFlow ships smaller numbers

  • Native binary. No Node.js boot, no npm install, no plugin discovery. A ferrflow check on a 50-package monorepo finishes before node --version would have warmed up.
  • gitoxide in-process. Tag enumeration and commit walking happen via gitoxide in the same process. Competitors shell out to git per call; process-spawn overhead dominates on dense histories.
  • Single tool, not a plugin tree. semantic-release pulls a chain of analyzers, notes generators, npm publishers and changelog writers, each with its own require() cost. FerrFlow's pipeline is one Rust crate.

Numbers updating every release. See the latest release notes for the full table including baseline delta.