Up to [cvs.NetBSD.org] / pkgsrc / benchmarks / hyperfine
Request diff between arbitrary revisions
Keyword substitution: kv
Default branch: MAIN
benchmarks/hyperfine: update to 1.20.0 Features - Add --reference-name option to give a meaningful name to the reference command, see #808 (@niklasdewally) - The --ignore-failure option now supports a comma-separated list of exit codes to ignore (e.g., --ignore-failure=1,2), see #836 (@sharkdp) - Python scripts: Add --time-unit option to advanced_statistics.py (@sharkdp) - Python scripts: Add new plot_benchmarks.py script for plotting collections of benchmarks, see #806 (@marxin) Bugfixes - Fix bug where naming individual commands with parameter scan was not working correctly, see #794 (@teofr)
benchmarks/hyperfine: reset maintainer
benchmarks/hyperfine: update to 0.19.0
Features
Add a new --reference <cmd> option to specify a reference command for the relative speed comparison, see #579, #577 and #744 (@JanEricNitschke)
Add --conclude argument (analog to --prepare), see #565 and #719 as well as the docs here (@jackoconnordev)
Allow --output=… to appear once for each command, enabling use cases like hyperfine --output=null my-cmd --output=./file.log my-cmd, see #529 and #775 (@sharkdp)
The environment variable $HYPERFINE_ITERATION will now contain the current iteration number for each benchmarked command, see #775 (@sharkdp)
Add iteration information to failure error message, see #771 and #772 (@sharkdp)
Python scripts:
legend modification parameters and output DPI, see #758 (@Spreadcat)
Nicer whiskers plot, see #727 (@serpent7776)
Bugfixes
ETA not clearly visible on terminals with a block cursor, see #698 and #699 (@overclockworked64)
Fix zsh completions, see #717 (@xzfc)
Other
Build binaries for aarch64-apple-darwin, see #728 (@Phault)
Various cleanups (@hamirmahal, @one230six)
benchmarks/hyperfine: update to 1.18.0 Features - Add support for microseconds via --time-unit microsecond, see #684 (@sharkdp) Bugfixes - Proper argument quoting on Windows CMD, see #296 and #678 (@PedroWitzel)
benchmarks/hyperfine: update to 1.17.0 Features - Add new --sort option to control the order in the rel. speed comparison and in markup export formats, see #601, #614, #655 (@sharkdp) - Parameters which are unused in the command line are now displayed in parentheses, see #600 and #644 (@sharkdp). - Added --log-count option for histogram plots, see scripts/plot_histogram.py (@sharkdp) Changes - Updated hyperfine to use windows-sys instead of the unmaintained winapi, see #624, #639, #636, #641 (@clemenswasser) - Silenced deprecation warning in Python scripts, see #633 (@nicovank) - Major update of the man page, see 0ce6578, #647 (@sharkdp) Bugfixes - Do not export intermediate results to stdout when using - as a file name, see #640 and #643 (@sharkdp) - Markup exporting does not fail if benchmark results are zero, see #642 (@sharkdp)
benchmarks/hyperfine: update to 1.16.1 Bugfixes - Fix line-wrapping of --help text (@sharkdp) - Fix --input=null (@sharkdp)
benchmarks/hyperfine: update to 1.16.0 v1.16.0 Features - Added new `--input` option, see #541 and #563 (@snease) - Added possibility to specify `-` as the filename in the `--export-*` options, see #615 and #623 (@humblepenguinn) Changes - Improve hints for outlier warnings if `--warmup` or `--prepare` are in use already, see #570 (@sharkdp) Bugfixes - Fix uncolored output on Windows if `TERM` is not set, see #583 (@nabijaczleweli) - On Windows, only run `cmd.exe` with the `/C` option. Use `-c` for all other shells. See #568 and #582 (@FilipAndersson245) Other - Thanks to @berombau for working on dependency upgrades, see #584 - Fixed installationm on Windows, see #595 and #596 (@AntoniosBarotsis)
benchmarks/hyperfine: update to 1.15.0 v1.15.0 Features - Disable colorized output in case of TERM=dumb or NO_COLOR=1, see #542 and #555 (@nabijaczleweli) - Add new (experimental) --min-benchmarking-time <secs> option, see #527 (@sharkdp) Bugfixes - Fix user and kernel times on Windows, see #368 and #538 (@clemenswasser) Other - Improve --help texts of --export-* options, see #506 and #522 (@Engineer-of-Efficiency)
benchmarks/hyperfine: update to 1.14.0
-Add a new --output={null,pipe,inherit,<FILE>} option to control
where the output of the benchmarked program is redirected (if at all),
see #377 and #509 (@tavianator, originally suggested by @BurntSushi)
-Add Emacs org-mode as a new export format, see #491 (@ppaulweber)
-Relax glibc requirements, see #508 and #512 (@sharkdp)
benchmarks/hyperfine: update to 1.13.0 Features: -Added a new --shell=none/-N option to disable the intermediate shell for executing the benchmarked commands. Hyperfine normally measures and subtracts the shell spawning time, but the intermediate shell always introduces a certain level of measurement noise. Using --shell=none/-N allows users to benchmark very fast commands (with a runtime on the order of a few milliseconds). See #336, #429, and #487 (@cipriancraciun and @sharkdp) -Added --setup/-s option that can be used to run make all or similar. It runs once per set of tests, like --cleanup/-c (@avar) -Added new plot_progression.py script to debug background interference effects. Changes: -Breaking change: the -s short option for --style is now used for the new --setup option. -The environment offset randomization is now also available on Windows, see #484 Other: -Improved documentation and test coverage, cleaned up code base for future improvements.
benchmarks/hyperfine: update to 1.12.0 Features: --command-name can now take parameter names from --parameter-* options, see #351 and #391 (@silathdiir) -Exit codes (or signals) are now printed in cases of command failures, see #342 (@KaindlJulian) -Exit codes are now part of the JSON output, see #371 (@JordiChauzi) -Colorized output should now be enabled on Windows by default, see #427 Changes: -When --export-* commands are used, result files are created before benchmark execution -to fail early in case of, e.g., wrong permissions. See #306 (@s1ck). -When --export-* options are used, result files are written after each individual -benchmark command instead of writing after all benchmarks have finished. See #306 (@s1ck). -Reduce number of shell startup time measurements from 200 to 50, generally speeding up benchmarks. See #378 -User and system time are now in consistent time units, see #408 and #409 (@film42)
benchmarks/hyperfine: simplify Makefile
benchmarks/hyperfine: import package A command-line benchmarking tool. Features: -Statistical analysis across multiple runs. -Support for arbitrary shell commands. -Constant feedback about the benchmark progress and current estimates. -Warmup runs can be executed before the actual benchmark. -Cache-clearing commands can be set up before each timing run. -Statistical outlier detection to detect interference from other programs and caching effects. -Export results to various formats: CSV, JSON, Markdown, AsciiDoc. -Parameterized benchmarks (e.g. vary the number of threads).