Up to [cvs.NetBSD.org] / pkgsrc / security / httpx
Request diff between arbitrary revisions
Keyword substitution: kv
Default branch: MAIN
httpx: Update to 1.12.0
pkgsrc changes:
- Drop MAINTAINERship
Changes:
v1.12.0
Maintenance
* Bump dependencies
Other Changes
* fix(cpe): substring fallback for vendor-prefix mismatches
* fix: stop reporting TLS-only ports as plain http
* chore: require tlsx v1.4.0
* chore(ci): update CodeQL actions to supported versions
* maint release
v1.11.0
New Features
* Added `-kb` flag to make page type classification opt-in
* Added chrome and JA3 strategies for -tls-impersonate
Bugs Fixes
* Fixed make binary body test use a local server
* Fixed pdcp data loss, pipeline conn leak, Close() race, FilterCustom error swallowing
Other Changes
* Added Common Recipes section for well-known files
* Added a method to populate CPE version when ASQ product names differ from wappalyzer
* Improved/Added parser for fqdn
* Updated group of external dependabot updates
v1.10.0
New Features
* Add support for duplicate custom request headers
Other Changes
* fix(httpx): keep retry fallback on HTTP/1.1 when -pr http11 is set
* fix(runner): add mutex to testAndSet to prevent race condition
* fix: prevent nil panic for unsafe HEAD requests
* adding ip aware dedup
* Fixed typos
* fixing output writing
* fix(db): persist CPE column in postgres and mysql writers
* feat: honor HTTP_PROXY/HTTPS_PROXY env vars when -proxy is unset
* fix: improve error handling and fix bugs
* fix: populate product version in CPE output
* fix: code quality improvements
* fix: avoid hanging on 101 switching protocol responses
* fix: reduce memory
* fix(runner): preserve case sensitivity for match-regex and filter-regex flags
v1.9.0
New Features
* Added page, form and form field classifier with dit
-fpt, -filter-page-type string[] filter response with specified page type (e.g. -fpt login,captcha,parked)
* Added database output support (MongoDB, PostgreSQL, MySQL) for storing scan results
* Added Markdown output support
Bug Fixes
* Fixed data loss on interrupt by implementing graceful shutdown
* Fixed resolver parsing
Deprecated
* Deprecate "-fep" ("-filter-error-page") option, use -fpt
httpx: Update to 1.8.1 Changes: v1.8.1 * Bug fixes v1.8.0 * Added Burp XML input mode support (-im flag) * Added secret file authentication support (-sf flag) * Added passive CPE and WordPress detection support * Bug Fixes
httpx: Update to 1.7.4 Changes: v1.7.4 * bump the modules group with 9 updates v1.7.3 * Added panic guard + Tests * Added error handling in htmlToText function * Updated `-ldp` option to show default ports in CLI output * Updated HTML parser panic protection with multiple fallback * Fixed `host` JSON field now returns hostname instead of IP * Added `host_ip` JSONL field that returns dialed / used IP v1.7.2 - JS injection support - Feat: Add auto-referer (HTTP header) option - Introduce dynamic filtering - Add custom fingerprint support - Add network logging - Feat: add shorthand flag for websocket option in command line - Strip ANSI color codes from output file while keeping console colors - Bug fixes - Performance Improvements
httpx: Update to 1.7.1 Changes: v1.7.1 * Bug fixes v1.7.0 * Added option -no-screenshot-full-page to disable full page screenshots * Bug fixes
httpx: Update to 1.6.10 Changes: 1.6.10 ------ - Bug fixes
httpx: Update to 1.6.9 Changes: v1.6.9 * Added support to filter out near duplicate responses via `-fd`, `-filter-duplicates` option * Added `team-id` input support for dashboard upload * Added option to provide ideal time taking screenshot with `-screenshot` option * Adding `-trace` option to log complete connection * Added initial support for automatic page type classifier v1.6.8 * Fixed missing favicon hash in few edge cases * Fixed `ztls` context deadline error for tls connection * Fixed stats calculation in case of path * Fixed issue with extra new lines in output file * Fixed multiple registration of metrics (SDK) * Added option disable stdout output (SDK) * Added `*Server.Stop` method (SDK) * Updated `ChainInStdout` option available to use as library (SDK) v1.6.7 * Added UI Dashboard for httpx * Added `-fep` option to configure error file * Fixed issue with missing `host` field in output in few edge cases * Updated `jarm` field to `jarm_hash` to avoid confusion v1.6.6 * Added md5 hash for favicon in jsonl output * Fixed issue with `-fs` filtering * Fixed issue with custom header input for screenshot * Fixed nil deref with store chain option * Fixed issue with path input * Fixed issue with `-esb` option not storing screenshot on disk v1.6.5 * Added `favicon_url` in output with `-favicon` option * Fixed issues with favicon detection + SDK update * Fixed panic issue with wappalyzer v1.6.4 * Added `-efqdn` option to extract subdomans from response header and body * Added support to exclude response body with `-sr` option v1.6.3 * Fixed issue with tech detection output in default run * Fixed issue with `-sr` option to respect filters/matchers v1.6.2 * Added resolvers information in output v1.6.1 * Added `-protocol` option for force http 1.1 connection
httpx: Update to 1.6.0
Changes:
v1.6.0
## What's Changed
* Fixed issue with `-csv` format including response header/body as default
* Fixed issue with `-exclude` option
* Updated default JSONL output fields
- Added `tech` and `cdn`, `cdn_name`, can be optionally disabled (`-tech-detect=false`)
- Removed `hash`, can be optionally enabled (`-hash md5,mmh3`)
> Caution
> Updated default JSONL output fields
v1.5.0
> Warning
> This release upgrades ASNMap to the latest 1.1.0 version that uses an
> authenticated API. If you utilize the `-asn` option of httpx, one time
> configuration is required to set up PDCP API Key.
> You can do this using the `-auth` option or through setting up an
> environment variable, such as `export PDCP_API_KEY=xxxxx`
## What's Changed
* Updated to authenticated ASNMap client
* Fixed issue with `-exclude` option
v1.4.0
## What's Changed
### Maintenance
* Updated useragent library
* Fixed exclude cdn option
* Added sdk stream test
v1.3.9
## What's Changed
### Maintenance
* Fixed multiple issues related high memory uses
v1.3.8
## What's Changed
* Removed `-ec` option in favor of newly added `-exclude` option
* Added customizable `-exclude` option:
-e, -exclude string[] exclude host matching specified filter
('cdn', 'private-ips', cidr, ip, regex)
* Added timeout option for screenshot
-st, -screenshot-timeout int set timeout for screenshot in
seconds (default 10)
* Added option to set custom headless options
-ho, -headless-options string[] start headless chrome with additional
options
* Fixed issue with use of system resolver with custom resolver input
* Fixed issue with existing response directory
* Fixed issue with `-websocket` and `-pipeline` detection
* Fixed issue with redirects with `-ports` option
* Fixed issue with `-tls-probe` option
v1.3.7
## What's Changed
### Bug Fixes
* Fixed new line break issue with `-title` option
* Fixed build error on `termux/android`
* Fixed path issue on windows
* Fixed chrome zombie process using leakless
* Fixed panic crash with `-asn` option
### Other Changes
* Added SNI to jsonl output
* Added optional flag (`-eph`) to skip private host / ips for probing
* Added hyperlink to host result
* Increased timeout for a page lifecycle event
v1.3.6
## What's Changed
### New Features
* Added phash calculation for screenshot
* Added visual recon clusters in jsonl output
### Other Changes
* Update redirect chain storage
httpx: Update to 1.3.5 Changes: 1.3.5 ----- * Add `-bp` (`-body-preview`) flag to preview N characters from the response * Add `-rhsts` (`-respect-hsts`) option to respect redirect with HSTS policy * Add `-irh` (`-include-response-header`) option to include response headers in JSONL output * Add `-ehb` (`-exclude-headless-body`) and `-esb` (`-exclude-screenshot-bytes`) options to exclude screenshot bytes and body in JSONL response * Several bug fixes
httpx: Update to 1.3.4 Changes: v1.3.4 ### Features * Added error page classifier with automatic filtering ```console -fep, -filter-error-page filter response with ML based error page detection ``` * Added support for multiple output format ```console -oa, -output-all filename to write output results in all formats ``` * Added html index (`screenshot.html`) file for screenshots * Added custom config input support ```console -config string path to the httpx configuration file (default $HOME/.config/httpx/config.yaml) ### Bugs * Fixed `-tls-grab` option issue in ztls mode * Fixed issue with `-sr` option when used with `-x` option ### Maintenance * Made output response fields public ### Other Changes * Fixed github.com/bxcodec/faker/v4 is deprecated v1.3.3 ### Features * Added Support for TLS ClientHello randomization (experimental) ```console -tlsi, -tls-impersonate enable experimental client hello (ja3) tls randomization ``` ### Bugs * Fixed issue with `rateLimiter` not stop * Fixed issue to skip body read with status code 304 * Fixed issue to remove duplicate `onresult` option v1.3.2 ### Bugs * Fixed issue ignoring http path with port option * Fixed issue to write missing screenshots to index file ### Other Changes * Added `-no-stdin` option
httpx: Update to 1.3.1 Changes: v1.3.1 ## What's Changed * Fixed issue with response body store with json option * Fixed issue with response body hash calculation * Fixed issue with fallbacks when `-nfs` is used * Fixed issue with certificate parsing * Added improvements to code for using as library v1.3.0 ## What's Changed * Added screenshot support (`-ss, -screenshot`), e.g.: ``` subfinder -d hackerone.com | httpx -screenshot ``` * Added support to skip decode (`-no-decode`) * Added `stale.yml` config file * Fixed issue with dsl based filtering * Fixed error with URLs having http / httpx as a prefix * Fixed (`-match-regex`) not working with http proxy * Fixed issue with filename on windows
httpx: Update to 1.2.9 Changes: 1.2.9 ----- * Fixed nil pointer dereference crash * Added self-update option + version check support
httpx: Import httpx-1.2.8 as security/httpx httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library. It is designed to maintain result reliability with an increased number of threads.