Benchmarks

How fast is FerrFlow?

Side-by-side comparison against the JavaScript ecosystem release tools, measured with hyperfine on the same hardware, the same commits, and the same fixtures. Numbers refresh on every FerrFlow release.

Last update: October 10, 2026, ferrflow v7.30.1, binary size 9.0 MB

ferrflow changesets commit-and-tag-version semantic-release standard-version

Median of 30 hyperfine runs, linear scale, cold cache, FerrFlow pinned to --jobs 1, lower is better. The pale segment at the foot of each bar is that tool's startup (process spawn, runtime boot, module loading) measured against a one-package one-commit floor fixture; the coloured segment above it is the work. The total is what you wait for; the split is where it goes.

Median latency, release --dry-run
Tool1 × 10010 × 10050 × 500100 × 1k50 × 5k200 × 10k50 × 300, graph
ferrflow8 ms9 ms18 ms30 ms82 ms378 ms14 ms
changesets561 ms583 ms644 ms542 ms443 ms654 ms438 ms
commit-and-tag-version511 ms482 ms531 ms455 ms580 ms1.11 s337 ms
semantic-release1.46 s1.42 s1.55 s1.30 s1.48 s2.59 s1000 ms
standard-version573 ms542 ms620 ms536 ms701 ms1.40 s350 ms

How we measure

  • Hyperfine with 3 warmup runs and 30 timed runs per (fixture × tool × command) cell. Median latency reported.
  • Cold cache. FerrFlow memoises its analysis under .git/ferrflow-cache. That cache is dropped before every timed run, so the comparison measures the work itself. None of the other tools has an equivalent to hide behind. The warm numbers are reported separately below.
  • Peak RSS via /usr/bin/time -v on a single subsequent run.
  • Fixtures are generated from FerrLabs/Fixtures with deterministic conventional-commit history (no flaky inputs). The commit count in each fixture label is the number of commits since the last release tag: the exact window FerrFlow walks to compute a bump, not the repository's total history.
  • All commands are dry-run release planning. Every tool computes the next version and release notes without writing anything: ferrflow release --dry-run, semantic-release --dry-run --no-ci, standard-version --dry-run, commit-and-tag-version --dry-run, etc. The same operation for every tool, so we're comparing the planning cost, not the IO cost of actually mutating files.
  • Single-threaded comparison. FerrFlow runs with --jobs 1 in the chart above, so it's measured like the single-threaded JS tools. Its real-world parallel numbers are reported separately.
  • One row isn't like-for-like, and we'd rather say so than quietly win. changesets plans releases from .changeset/*.md files you write by hand, and never from commits. Six of our seven fixtures give it none, so it reports no packages to be bumped and stops. Its time tracks package count, not history: it barely moves across a 100× range of commits, because it isn't reading them. So where we come out ahead, most of the gap is npx and Node startup rather than release planning. Strip the startup out, as the split in the chart above does, and on the largest fixture changesets spends less time working than we do, because it is doing less. Read that row as a difference in job, not a verdict. The 50 × 300, graph fixture is the opposite case: there we resolve a 50-package dependency cascade and recover missed releases across the history, while the others emit one bump and have no notion of a dependency graph.
  • Reproducible: the full pipeline is in FerrLabs/Benchmarks; results land as artifacts on every main push and in each release notes.

Parallel mode

The comparison pins FerrFlow to a single thread (--jobs 1) so it's apples-to-apples with the single-threaded JS tools. In real CI it is free to use every core, so this table reports what that actually buys. Here's the same release --dry-run on all 4 cores of the benchmark runner.

Fixture1 thread4 coresSpeedup
Single package, 100 commits8 ms8 ms1.0×
Monorepo, 10 packages × 100 commits9 ms10 ms0.9×
Monorepo, 50 packages × 500 commits18 ms19 ms1.0×
Monorepo, 100 packages × 1k commits30 ms26 ms1.1×
Monorepo, 50 packages × 5k commits82 ms46 ms1.8×
Monorepo, 200 packages × 10k commits378 ms172 ms2.2×
Monorepo, dependency graph, 50 packages × 300 commits14 ms18 ms0.8×

Warm cache

Every number above is measured cold. In practice a repository rarely moves between two ferrflow check calls, so FerrFlow keeps the result of its last analysis in .git/ferrflow-cache and reuses it while HEAD, the tags and the config are unchanged. This is what a second call costs on an unchanged repo. It's a real property of the tool, but it isn't a like-for-like comparison, so it stays out of the chart.

FixtureColdCachedSpeedup
Single package, 100 commits8 ms4 ms2.0×
Monorepo, 10 packages × 100 commits10 ms4 ms2.6×
Monorepo, 50 packages × 500 commits20 ms5 ms4.4×
Monorepo, 100 packages × 1k commits32 ms5 ms6.8×
Monorepo, 50 packages × 5k commits83 ms4 ms20.3×
Monorepo, 200 packages × 10k commits381 ms7 ms52.9×
Monorepo, dependency graph, 50 packages × 300 commits15 ms4 ms3.5×

Install footprint

Disk size after install. release-please appears here only: its runtime can't be benched offline (it needs the GitHub API to resolve the latest release), so footprint is the fair comparison we can publish.

Toolnpm installNative binary
ferrflow9.0 MB9.0 MB
changesets5.0 MB—
commit-and-tag-version9.0 MB—
release-please95.0 MB—
semantic-release69.0 MB—
standard-version21.0 MB—

Why FerrFlow ships smaller numbers

  • Native binary. No Node.js boot, no npm install, no plugin discovery. A ferrflow check on a 50-package monorepo finishes before node --version would have warmed up.
  • gitoxide in-process. Tag enumeration and commit walking happen via gitoxide in the same process. Competitors shell out to git per call; process-spawn overhead dominates on dense histories.
  • Single tool, not a plugin tree. semantic-release pulls a chain of analyzers, notes generators, npm publishers and changelog writers, each with its own require() cost. FerrFlow's pipeline is one Rust crate.

Numbers updating every release. See the latest release notes for the full table including baseline delta.