The NetBSD Project

CVS log for pkgsrc/benchmarks/hyperfine/Makefile

[BACK] Up to [cvs.NetBSD.org] / pkgsrc / benchmarks / hyperfine

Request diff between arbitrary revisions


Keyword substitution: kv
Default branch: MAIN


Revision 1.13: download - view: text, markup, annotated - select for diffs
Thu Nov 20 08:43:40 2025 UTC (11 months, 3 weeks ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2026Q3-base, pkgsrc-2026Q3, pkgsrc-2026Q2-base, pkgsrc-2026Q2, pkgsrc-2026Q1-base, pkgsrc-2026Q1, pkgsrc-2025Q4-base, pkgsrc-2025Q4, HEAD
Diff to: previous 1.12: preferred, colored
Changes since revision 1.12: +4 -2 lines
benchmarks/hyperfine: update to 1.20.0

Features
 - Add --reference-name option to give a meaningful name to the reference command, see #808 (@niklasdewally)
 - The --ignore-failure option now supports a comma-separated list of exit codes to ignore (e.g., --ignore-failure=1,2), see #836 (@sharkdp)
 - Python scripts: Add --time-unit option to advanced_statistics.py (@sharkdp)
 - Python scripts: Add new plot_benchmarks.py script for plotting collections of benchmarks, see #806 (@marxin)

Bugfixes
 - Fix bug where naming individual commands with parameter scan was not working correctly, see #794 (@teofr)

Revision 1.12: download - view: text, markup, annotated - select for diffs
Wed Apr 2 17:49:44 2025 UTC (19 months, 2 weeks ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2025Q3-base, pkgsrc-2025Q3, pkgsrc-2025Q2-base, pkgsrc-2025Q2
Diff to: previous 1.11: preferred, colored
Changes since revision 1.11: +2 -2 lines
benchmarks/hyperfine: reset maintainer

Revision 1.11: download - view: text, markup, annotated - select for diffs
Wed Nov 13 08:41:46 2024 UTC (2 years ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2025Q1-base, pkgsrc-2025Q1, pkgsrc-2024Q4-base, pkgsrc-2024Q4
Diff to: previous 1.10: preferred, colored
Changes since revision 1.10: +2 -2 lines
benchmarks/hyperfine: update to 0.19.0

Features

    Add a new --reference <cmd> option to specify a reference command for the relative speed comparison, see #579, #577 and #744 (@JanEricNitschke)
    Add --conclude argument (analog to --prepare), see #565 and #719 as well as the docs here (@jackoconnordev)
    Allow --output=… to appear once for each command, enabling use cases like hyperfine --output=null my-cmd --output=./file.log my-cmd, see #529 and #775 (@sharkdp)
    The environment variable $HYPERFINE_ITERATION will now contain the current iteration number for each benchmarked command, see #775 (@sharkdp)
    Add iteration information to failure error message, see #771 and #772 (@sharkdp)
    Python scripts:
        legend modification parameters and output DPI, see #758 (@Spreadcat)
        Nicer whiskers plot, see #727 (@serpent7776)

Bugfixes

    ETA not clearly visible on terminals with a block cursor, see #698 and #699 (@overclockworked64)
    Fix zsh completions, see #717 (@xzfc)

Other

    Build binaries for aarch64-apple-darwin, see #728 (@Phault)
    Various cleanups (@hamirmahal, @one230six)

Revision 1.10: download - view: text, markup, annotated - select for diffs
Thu Oct 5 20:13:36 2023 UTC (3 years, 1 month ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2024Q3-base, pkgsrc-2024Q3, pkgsrc-2024Q2-base, pkgsrc-2024Q2, pkgsrc-2024Q1-base, pkgsrc-2024Q1, pkgsrc-2023Q4-base, pkgsrc-2023Q4
Diff to: previous 1.9: preferred, colored
Changes since revision 1.9: +2 -2 lines
benchmarks/hyperfine: update to 1.18.0

Features
 - Add support for microseconds via --time-unit microsecond, see #684 (@sharkdp)

Bugfixes
 - Proper argument quoting on Windows CMD, see #296 and #678 (@PedroWitzel)

Revision 1.9: download - view: text, markup, annotated - select for diffs
Sun Jun 4 06:44:22 2023 UTC (3 years, 5 months ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2023Q3-base, pkgsrc-2023Q3, pkgsrc-2023Q2-base, pkgsrc-2023Q2
Diff to: previous 1.8: preferred, colored
Changes since revision 1.8: +4 -6 lines
benchmarks/hyperfine: update to 1.17.0

Features
 - Add new --sort option to control the order in the rel. speed comparison and
   in markup export formats, see #601, #614, #655 (@sharkdp)
 - Parameters which are unused in the command line are now displayed in
   parentheses, see #600 and #644 (@sharkdp).
 - Added --log-count option for histogram plots, see scripts/plot_histogram.py
   (@sharkdp)

Changes
 - Updated hyperfine to use windows-sys instead of the unmaintained winapi,
   see #624, #639, #636, #641 (@clemenswasser)
 - Silenced deprecation warning in Python scripts, see #633 (@nicovank)
 - Major update of the man page, see 0ce6578, #647 (@sharkdp)

Bugfixes
 - Do not export intermediate results to stdout when using - as a file name,
   see #640 and #643 (@sharkdp)
 - Markup exporting does not fail if benchmark results are zero, see #642
   (@sharkdp)

Revision 1.8: download - view: text, markup, annotated - select for diffs
Thu Mar 23 10:30:43 2023 UTC (3 years, 7 months ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2023Q1-base, pkgsrc-2023Q1
Diff to: previous 1.7: preferred, colored
Changes since revision 1.7: +2 -2 lines
benchmarks/hyperfine: update to 1.16.1

Bugfixes
 - Fix line-wrapping of --help text (@sharkdp)
 - Fix --input=null (@sharkdp)

Revision 1.7: download - view: text, markup, annotated - select for diffs
Wed Mar 15 14:38:00 2023 UTC (3 years, 8 months ago) by pin
Branches: MAIN
Diff to: previous 1.6: preferred, colored
Changes since revision 1.6: +2 -2 lines
benchmarks/hyperfine: update to 1.16.0

v1.16.0

Features
- Added new `--input` option, see #541 and #563 (@snease)
- Added possibility to specify `-` as the filename in the
  `--export-*` options, see #615 and #623 (@humblepenguinn)

Changes
- Improve hints for outlier warnings if `--warmup` or `--prepare` are in use
  already, see #570 (@sharkdp)

Bugfixes
- Fix uncolored output on Windows if `TERM` is not set, see #583
  (@nabijaczleweli)
- On Windows, only run `cmd.exe` with the `/C` option. Use `-c` for all other
  shells. See #568 and #582 (@FilipAndersson245)

Other
- Thanks to @berombau for working on dependency upgrades, see #584
- Fixed installationm on Windows, see #595 and #596 (@AntoniosBarotsis)

Revision 1.6: download - view: text, markup, annotated - select for diffs
Thu Sep 8 07:21:03 2022 UTC (4 years, 2 months ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2022Q4-base, pkgsrc-2022Q4, pkgsrc-2022Q3-base, pkgsrc-2022Q3
Diff to: previous 1.5: preferred, colored
Changes since revision 1.5: +2 -2 lines
benchmarks/hyperfine: update to 1.15.0

v1.15.0
Features
 - Disable colorized output in case of TERM=dumb or NO_COLOR=1, see #542 and
   #555 (@nabijaczleweli)
 - Add new (experimental) --min-benchmarking-time <secs> option, see #527
   (@sharkdp)

Bugfixes
 - Fix user and kernel times on Windows, see #368 and #538 (@clemenswasser)

Other
 - Improve --help texts of --export-* options, see #506 and #522
   (@Engineer-of-Efficiency)

Revision 1.5: download - view: text, markup, annotated - select for diffs
Wed May 18 12:05:27 2022 UTC (4 years, 6 months ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2022Q2-base, pkgsrc-2022Q2
Diff to: previous 1.4: preferred, colored
Changes since revision 1.4: +2 -2 lines
benchmarks/hyperfine: update to 1.14.0

-Add a new --output={null,pipe,inherit,<FILE>} option to control
 where the output of the benchmarked program is redirected (if at all),
 see #377 and #509 (@tavianator, originally suggested by @BurntSushi)
-Add Emacs org-mode as a new export format, see #491 (@ppaulweber)
-Relax glibc requirements, see #508 and #512 (@sharkdp)

Revision 1.4: download - view: text, markup, annotated - select for diffs
Sat Mar 5 21:22:16 2022 UTC (4 years, 8 months ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2022Q1-base, pkgsrc-2022Q1
Diff to: previous 1.3: preferred, colored
Changes since revision 1.3: +6 -4 lines
benchmarks/hyperfine: update to 1.13.0

Features:
-Added a new --shell=none/-N option to disable the intermediate shell for
 executing the benchmarked commands. Hyperfine normally measures and subtracts
 the shell spawning time, but the intermediate shell always introduces a
 certain level of measurement noise. Using --shell=none/-N allows users to
 benchmark very fast commands (with a runtime on the order of a few
 milliseconds). See #336, #429, and #487 (@cipriancraciun and @sharkdp)
-Added --setup/-s option that can be used to run make all or similar.
 It runs once per set of tests, like --cleanup/-c (@avar)
-Added new plot_progression.py script to debug background interference effects.

Changes:
-Breaking change: the -s short option for --style is now used for the new
 --setup option.
-The environment offset randomization is now also available on Windows, see #484

Other:
-Improved documentation and test coverage, cleaned up code base for future
 improvements.

Revision 1.3: download - view: text, markup, annotated - select for diffs
Mon Oct 18 09:15:58 2021 UTC (5 years ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2021Q4-base, pkgsrc-2021Q4
Diff to: previous 1.2: preferred, colored
Changes since revision 1.2: +2 -2 lines
benchmarks/hyperfine: update to 1.12.0

Features:
--command-name can now take parameter names from --parameter-* options, see #351
and #391 (@silathdiir)
-Exit codes (or signals) are now printed in cases of command failures, see #342
(@KaindlJulian)
-Exit codes are now part of the JSON output, see #371 (@JordiChauzi)
-Colorized output should now be enabled on Windows by default, see #427

Changes:
-When --export-* commands are used, result files are created before benchmark
execution
-to fail early in case of, e.g., wrong permissions. See #306 (@s1ck).
-When --export-* options are used, result files are written after each
individual
-benchmark command instead of writing after all benchmarks have finished. See
#306 (@s1ck).
-Reduce number of shell startup time measurements from 200 to 50, generally
speeding up benchmarks. See #378
-User and system time are now in consistent time units, see #408 and #409
(@film42)

Revision 1.2: download - view: text, markup, annotated - select for diffs
Thu Aug 5 08:50:35 2021 UTC (5 years, 3 months ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2021Q3-base, pkgsrc-2021Q3
Diff to: previous 1.1: preferred, colored
Changes since revision 1.1: +1 -3 lines
benchmarks/hyperfine: simplify Makefile

Revision 1.1: download - view: text, markup, annotated - select for diffs
Fri Jan 29 09:15:40 2021 UTC (5 years, 9 months ago) by pin
Branches: MAIN
CVS tags: pkgsrc-2021Q2-base, pkgsrc-2021Q2, pkgsrc-2021Q1-base, pkgsrc-2021Q1
benchmarks/hyperfine: import package

A command-line benchmarking tool.
Features:
-Statistical analysis across multiple runs.
-Support for arbitrary shell commands.
-Constant feedback about the benchmark progress and current estimates.
-Warmup runs can be executed before the actual benchmark.
-Cache-clearing commands can be set up before each timing run.
-Statistical outlier detection to detect interference from other programs and
caching effects.
-Export results to various formats: CSV, JSON, Markdown, AsciiDoc.
-Parameterized benchmarks (e.g. vary the number of threads).

Diff request

This form allows you to request diffs between any two revisions of a file. You may select a symbolic revision name using the selection box or you may type in a numeric name using the type-in text box.

Log view options

CVSweb <webmaster@jp.NetBSD.org>