Up to [cvs.NetBSD.org] / pkgsrc / net / gallery-dl
Request diff between arbitrary revisions
Keyword substitution: kv
Default branch: MAIN
gallery-dl: Update to 1.27.6 Changes: 1.27.6 ====== - [ao3] add `subscriptions` extractor - [boosty] add support - [civitai] add `post` extractors - [pixiv] support unlisted artworks - Several bug fixes and improvements 1.27.5 ====== - [ao3] add support - [civitai] add support - [cohost] add support - Several bug fixes and improvements 1.27.4 ====== - [sexcom] add `likes` extractor - [wikimedia] add `wiki` extractor - Several bug fixes and improvements
gallery-dl: Update to 1.27.3 Changes: ## 1.27.3 - 2024-08-10 - [bunkr] support `bunkr.ci` and `bunkrrr.org` - [furaffinity] add `submissions` extractor - [hentaicosplays] support `hentai-cosplay-xxx.com` - Several bug fixes and improvements ## 1.27.2 - 2024-08-03 - [agnph] add `tag` and `post` extractors - [aryion] add `favorite` extractor - [cien] add support - [instagram] add `info` extractor - [koharu] add `gallery`, `search`, and `favorite` extractors - [twitter] add `info` extractor - Several bug fixes and improvements ## 1.27.1 - 2024-06-22 - [hentainexus] restore module - [shimmie2] support `vidya.pics` - [tcbscans] support other domains - Several bug fixes and improvements ## 1.27.0 - 2024-06-01 - [mastodon] add `favorite`, `list`, and `hashtag` extractors - [mastodon] add support for card images - [pixeldrain] add support for single-file album downloads - [reddit] support comment embeds - [seiga] re-implement login with username & password - [tapas] add `creator` extractor - [vsco] add `avatar` extractor - [wikimedia] support `wiki.gg` wikis - Several bug fixes and improvements ## 1.26.9 - 2024-03-23 - [artstation] support video clips - [artstation] support collections - [deviantart] recognize `deviantart.com/stash/…` URLs - [idolcomplex] support new pool URLs - [lensdump] recognize direct image links - [skeb] add extractor for followed users - [twitter] add `quotes` extractor - [wikimedia] support `azurlane.koumakan.jp` - [xvideos] support `/channels/` URLs - Several bug fixes and improvements ## 1.26.8 - 2024-02-17 ### Extractors #### Additions - [bluesky] add support - [bunkr] support new domains - [fanbox] add `home` and `supporting` extractors - [imagechest] add `user` extractor - [imagetwist] add `gallery` extractor - [kemonoparty] add `posts` extractor - [twitter] support communities - [vsco] support spaces - [weibo] add `gifs` option - [wikimedia] support `www.pidgi.net` - [wikimedia] support `bulbapedia.bulbagarden.net` - Several bug fixes and improvements ## 1.26.7 - 2024-01-21 - [2ch] add support - [deviantart:avatar] add `formats` option - [hatenablog] add support - [mangadex] add `list` extractor - [steamgriddb] add support - [wikimedia] add support - [wikimedia] support `fandom` wikis - Several bug fixes and improvements ## 1.26.6 - 2024-01-06 - [batoto] add `chapter` and `manga` extractors - [deviantart] add `avatar` and `background` extractors - [poringa] add support - [szurubooru] support `snootbooru.com` - [zzup] add `gallery` extractor - Several bug fixes and improvements ## 1.26.5 - 2023-12-23 - [deviantart] add `intermediary` option - [inkbunny] add `unread` extractor - [mastodon] support non-numeric status IDs - [myhentaigallery] recognize `/g/` URLs - [postmill] add support - [shimmie] support `rule34hentai.net` - Several bug fixes and improvements ## 1.26.4 - 2023-12-10 - [exhentai] add `fallback-retries` option - [urlgalleries] add `gallery` extractor - Several bug fixes and improvements ## 1.26.3 - 2023-11-27 - [behance] support `text` modules - [behance] add `modules` option - [blogger] support `www.micmicidol.club` - [erome] add `count` metadata - [exhentai] add `gp` option - [fapello] support `.su` TLD - [pixeldrain] add `file` and `album` extractors - [pixeldrain] add `api-key` option - [tmohentai] add `gallery` extractor - Several bug fixes and improvements ## 1.26.2 - 2023-11-04 - [4archive] add `thread` and `board` extractors - [hitomi] recognize `imageset` gallery URLs - [kemonoparty] add `revision_index` metadata field - [misskey] support `misskey.design` - [reddit] support Reddit Mobile share links - [sankaku] support `/posts/` tag search URLs - [twitter] recognize `fixupx.com` URLs - Several bug fixes and improvements ## 1.26.1 - 2023-10-21 - [bunkr] add extractor for media URLs - [chevereto] add generic extractors for `chevereto` sites - `deltaporno.com` - `img.kiwi` - `jpgfish` - `pixl.li` - [deviantart] implement `"group": "skip"` - [fantia] add `content_count` and `content_num` metadata fields - [imgbb] add `displayname` and `user_id` metadata - [kemonoparty] support post revisions; add `revisions` option - [kemonoparty] support searches - [kemonoparty] support discord URLs with channel IDs - [moebooru] add `metadata` option - [newgrounds] support multi-image posts - [sankaku] support `/posts/` URLs - [twitter] add `sensitive` metadata field - Several bug fixes and improvements ## 1.26.0 - 2023-10-03 - [behance] add `date` metadata field - [danbooru] support `booru.borvar.art` - [danbooru] support `donmai.moe` - [deviantart] add `is_original` metadata field - [e621] support `e6ai.net` - [exhentai] add `fav` option - [gelbooru_v02] support `xbooru.com` - [instagram] add `following` extractor - [pillowfort] support `/tagged/` URLs - [pornhub] add `gif` support - [reddit] add `previews` option - [redgifs] add `niches` extractor - [redgifs] support `order` parameter for user URLs - [twitter] add `user` extractor and `include` option - [twitter] add `tweet-endpoint` option - [twitter] add `date_original` metadata for retweets - [twitter] extract `source` metadata - [twitter] support `x.com` URLs - Several bug fixes and improvements
*: update for Python base package change Instead of depending on one of the removed packages (that are now included in the base Python packages), include batteries-included.mk to require a Python version that supplies them. Remove now included packages. Bump PKGREVISION.
gallery-dl: Update to 1.25.8 Changes: ## 1.25.8 - 2023-07-15 ### Changes - update default User-Agent header to Firefox 115 ESR ### Additions - [gfycat] support `@me` user - [gfycat] implement login support - [reddit] notify users about registering an OAuth application - [twitter] add `ratelimit` option - [twitter] use `TweetResultByRestId` endpoint that allows accessing single Tweets without login ### Removals - [bcy] remove module - [lineblog] remove module ## 1.25.7 - 2023-07-02 ### Additions - [flickr] add 'exif' option - [flickr] add 'metadata' option - [mangapark] add 'source' option - [twitter] extend 'conversations' option ## 1.25.6 - 2023-06-17 ### Additions - [blogger] download files from `lh*.googleusercontent.com` - [fantia] extract `plan` metadata - [fantia] emit warning for non-visible content sections - [furaffinity] extract `favorite_id` metadata - [jschan] add generic extractors for jschan image boards - [kemonoparty] support `.su` TLDs - [pixiv:novel] add `novel-bookmark` extractor - [pixiv:novel] add `full-series` option - [postimage] add gallery support, update image extractor - [redgifs] support galleries - [twitter] extract `conversation_id` metadata - [vipergirls] add login support - [vipergirls] use API endpoints - [formatter] implement `H` conversion ## 1.25.5 - 2023-05-27 ### Additions - [8muses] add `parts` metadata field - [danbooru] add `date` metadata field - [e621] add `date` metadata field - [gofile] add basic password support - [imagechest] implement API support - [instagram] add `order-files` option - [instagram] add `order-posts` option - [instagram] add `metadata` option - [jpgfish] add `jpg.fishing` extractors - [lensdump] add `lensdump.com` extractors - [mangaread] add `mangaread.org` extractors - [misskey] add `favorite` extractor - [pixiv] add `novel` support - [reddit] support cross-posted media - [postprocessor:exec] support tilde expansion for `command` - [formatter] support slicing strings as bytes ## 1.25.4 - 2023-05-07 ### Additions - [4chanarchives] add `thread` and `board` extractors - [foolfuuka] add `archive.palanq.win` - [imgur] add `favorite-folder` extractor - [mangadex] add `status` and `tags` metadata - allow selecting a domain with `--cookies-from-browser` - add `--cookies-export` command-line option - add `-C` as short option for `--cookies` - include exception type in config error messages ### Removals - [420chan] remove module - [foolfuuka] remove `archive.alice.al` and `tokyochronos.net` - [foolslide] remove `sensescans.com` - [nana] remove module ## 1.25.3 - 2023-04-30 ### Additions - [imagefap] extract `description` and `categories` metadata - [imxto] add `gallery` extractor - [itchio] add `game` extractor - [nitter] extract user IDs from encoded banner URLs - [pixiv] allow sorting search results by popularity - [reddit] match `preview.redd.it` URLs - [sankaku] support post URLs with MD5 hashes - [shimmie2] add generic extractors for Shimmie2 sites - [tumblr] add `day` extractor - [twitter] support `profile-conversation` entries - [vipergirls] add `thread` and `post` extractors - [downloader:http] add `consume-content` option ## 1.25.2 - 2023-04-15 ### Additions - [deviantart] add `public` option - [nitter] extract videos from `source` elements - [twitter] add `date_liked` and `date_bookmarked` metadata for liked and bookmarked Tweets - [urlshortener] add support for bit.ly & t.co - [downloader:http] add MIME type and signature for `.heic` files ## 1.25.1 - 2023-03-25 ### Additions - [nitter] support nitter.it - [twitter] add `hashtag` extractor - [twitter] support Tweet content with >280 characters - [formatter] support loading f-strings from template files - [formatter] support filesystem paths for `\fM` modules - [formatter] support putting keys in quotes (e.g. `user['name']`) - [postprocessor:metadata] add `skip` option
*: recursive bump for Python 3.11 as new default
gallery-dl: Update to 1.25.0 Changes: ## 1.25.0 - 2023-03-11 ### Changes - [e621] split `e621` extractors from `danbooru` module - [deviantart] remove mature scraps warning - [deviantart] use `/collections/all` endpoint for favorites - [newgrounds] update default image and audio archive IDs to prevent ID overlap - rename `--ignore-config` to `--config-ignore` ### Extractors - [catbox] add `file` extractor - [deviantart] add `search` extractor - [deviantart] add `gallery-search` extractor - [deviantart] support `fxdeviantart.com` URLs (##3740) - [e621] implement `notes` and `pools` metadata extraction - [gelbooru] add `favorite` extractor - [imagetwist] support `phun.imagetwist.com` and `imagehaha.com` domains - [instagram] add `user` metadata field - [manganelo] update and fix metadata extraction - [manganelo] support mobile-only chapters - [mangasee] extract `author` and `genre` metadata - [misskey] add `misskey` extractors - [pornpics] add `gallery` and `search` extractors - [redgifs] support v3 URLs - [redgifs] add `collection` extractors - [shopify] support ohpolly.com - [szurubooru] add `tag` and `post` extractors - [twitter] add `transform` option ### Options - [postprocessor:metadata] add `sort` and `separators` options - [postprocessor:exec] implement archive options - add `--config-create` command-line option - add `--config-toml` command-line option to load config files in TOML format - add `output.stdout`, `output.stdin`, and `output.stderr` options - add `hash_md5` and `hash_sha1` functions - implement `globals` option to enable defining custom functions for `eval` statements - implement `archive-pragma` option to use SQLite PRAGMA statements - implement `actions` to trigger events on logging messages - implement ability to load external extractor classes - `-X/--extractors` command-line options - `extractor.modules-sources` config option ### Fixes - [bunkr] fix extraction - [danbooru] send gallery-dl User-Agent - [deviantart] fix crash when handling deleted deviations in status updates - [fanbox] fix crash with missing images - [imagefap] update `gallery` URLs - [imagefap] fix infinite pagination loop - [imagefap] fix metadata extraction - [oauth] use default name for browsers without `name` attribute - [pinterest] unescape search terms - [pixiv] fix `--write-tags` for `"tags": "original"` - [poipiku] warn about incorrect passwords - [reddit] update `videos` option - [soundgasm] rewrite - [telegraph] fix extraction when images are not in `<figure>` elements - [tumblr] raise more detailed errors for dashboard-only blogs - [twitter] fix some `original` retweets not downloading - [ytdl] fix `--parse-metadata` - [downloader:ytdl] prevent exception on empty results ### Improvements - [downloader:http] use `time.monotonic()` - [downloader:http] update `_http_retry` to accept a Python function - [postprocessor:metadata] speed up JSON encoding - replace `json.loads/dumps` with direct calls to `JSONDecoder.decode/JSONEncoder.encode` - improve `option.Formatter` performance ### Removals - [nitter] remove `nitter.pussthecat.org` ## 1.24.5 - 2023-01-28 ### Additions - [booru] add `url` option - [danbooru] extend `metadata` option - [deviantart] add extractor for status updates - [deviantart] add support for `/deviation/` and `fav.me` URLs - [kemonoparty] extract `hash` metadata for discord files - [lexica] add `search` extractor - [mastodon] add `num` and `count` metadata fields - [nudecollect] add `image` and `album` extractors - [wikifeet] add `gallery` extractor - [downloader:http] add signature checks for `.blend`, `.obj`, and `.clip` files - add `extractor.retry-codes` option - add `-O/--postprocessor-option` command-line option - improve `write-pages` output ### Fixes - [bunkr] fix downloading `.mkv` and `.ts` files - [fantia] send `X-CSRF-Token` headers - [generic] fix regex for non-src image URLs - [hiperdex] update domain - [hotleak] fix video URLs - [instagram] always show `cursor` value after errors - [instagram] update API domain, headers, and csrf token handling - [oauth] show `client-id`/`api-key` values - [philomena] match URLs with www subdomain - [sankaku] update URL pattern - [twitter] refresh guest tokens - [twitter] fix search pagination - [twitter] use `"browser": "firefox"` by default ## 1.24.4 - 2023-01-11 ### Additions - [downloader:http] add `validate` option ### Fixes - [kemonoparty] fix regression from commit 473bd380 ## 1.24.3 - 2023-01-10 ### Additions - [danbooru] extract `uploader` metadata - [deviantart] initial implementation of username & password login for `scraps` - [fanleaks] add `post` and `model` extractors - [imagefap] add `folder` extractor - [lynxchan] support `bbw-chan.nl` - [pinterest] support `All Pins` boards - [pinterest] add `domain` option - [pixiv] implement `metadata-bookmark` option - [tcbscans] add `chapter` and `manga` extractors - [twitter] implement `syndication=extended` - implement slice notation for `range` options - allow `filter` options to be a list of expressions ### Fixes - [behance] use delay between requests - [bunkr] fix URLs returned by API - [fanbox] return `imageMap` files in order - [imagefap] use delay between requests - [imagefap] warn about redirects to `/human-verification` - [kemonoparty] reject invalid/empty files - [myhentaigallery] handle whitespace before title tag - [poipiku] fix extraction for a different warning button style - [poipiku] warn about login requirements - [telegraph] fix file URLs - [twitter] fix crash when using `expand` and `syndication` - [twitter] apply tweet type checks before uniqueness check - [twitter] force `https://` for TwitPic URLs - [ytdl] adapt to yt-dlp changes - update and improve documentation ## 1.24.2 - 2022-12-18 ### Additions - [2chen] support `.club` URLs - [deviantart] extract sta.sh URLs from `text_content` - [deviantart] add `/view` URL support - [e621] implement `threshold` option to control pagination - [fapello] add `post`, `user` and `path` extractors - [imgur] add support for imgur.io URLs - [lynxchan] add generic extractors for lynxchan imageboards - [mangafox] extract more metadata - [pixiv] extract `date_url` metadata - [soundgasm] add `audio` and `user` extractors - [webmshare] add `video` extractor - support Firefox containers for `--cookies-from-browser` ### Fixes - [2chen] fix file URLs - [bunkr] update domain - [exhentai] fix pagination - [imagetwist] fix extraction - [imgth] rewrite - [instagram] prevent post `date` overwriting file `date` - [khinsider] fix metadata extraction - [komikcast] update domain and fix extraction - [reddit] increase `id-max` default value - [seiga] raise error when redirected to login page - [sexcom] fix video URLs - [twitter] update `search` pagination - [warosu] fix and update - [zerochan] update for layout v3 - restore paths for archived files - use `util.NONE` as `keyword-default` default value ### Removals - [foolslide] remove `kireicake` - [kissgoddess] remove module ## 1.24.1 - 2022-12-04 ### Additions - [artstation] add `pro-first` option - [artstation] add `max-posts` option - [fapachi] add `post` and `user` extractors - [inkbunny] provide additional metadata - [nitter] add `retweets` option - [nitter] add `videos` option - [nitter] support `/i/web/` and `/i/user/` URLs - [pixhost] add `gallery` support - [weibo] add `count` metadata field - [downloader:http] add `retry-codes` option - [formatter] implement `S` format specifier to sort lists - implement `version-metadata` option ### Fixes - [2chen] fix extraction - [bcy] fix JSONDecodeError - [bunkr] fix video downloads - [bunkr] use `media-files` servers for more file types - [itaku] remove `Extreme` rating - [hitomi] apply format check for every image - [hotleak] fix UnboundLocalError - [nitter] sanitize filenames - [nitter] retry downloads on 404 - [nitter] set `hlsPlayback` cookie - [patreon] fix `403 Forbidden` errors - [patreon] improve `campaign_id` extraction - [patreon] update API query parameters - [pixiv] preserve `tags` order - [reddit] use `dash_url` for videos - [twitter] fix error when using user IDs for suspended accounts - [weibo] fix bug with empty `playback_list` - [downloader:http] fix potential `ZeroDivisionError` ### Removals - [lolisafe] remove `zz.ht` ## 1.24.0 - 2022-11-20 ### Additions - [exhentai] add metadata to search results - [gelbooru_v02] implement `notes` extraction - [instagram] add `guide` extractor - [lolisafe] add support for xbunkr - [mastodon] add `instance_remote` metadata field - [nitter] add extractors for Nitter instances - [pixiv] add support for new daily AI rankings category - [twitter] add `avatar` and `background` extractors - [uploadir] add support for `uploadir.com` - [wallhaven] add `user` extractor - [downloader:http] add `chunk-size` option - [downloader:http] add file signature check for `.mp4` files - [downloader:http] add file signature check and MIME type for `.avif` files - [postprocessor] implement `post-after` event - [postprocessor:metadata] implement `"mode": "jsonl"` - [postprocessor:metadata] add `open`, `encoding`, and `private` options - add `--chunk-size` command-line option - add `--user-agent` command-line option - implement `http-metadata` option - implement `"user-agent": "browser"` ### Changes - [deviantart] restore cookies warning for mature scraps - [instagram] use REST API for unauthenticated users by default - [downloader:http] increase default `chunk-size` to 32768 bytes - build Windows executables using py2exe's new `freeze()` API - build executables on GitHub Actions with Python 3.11 - reword error text for unsupported URLs ### Fixes - [exhentai] fix pagination - [khinsider] fix extraction - [realbooru] fix download URLs - [realbooru] fix `tags` extraction - [tumblr] fall back to `gifv` when possible - [twitter] fix login - [twitter] update URL for syndication API - [weibo] send `Referer` headers - [ytdl] update `parse_bytes` location ### Improvements - [imxto] extract additional metadata - [instagram] allow downloading avatars for private profiles - [pixiv] raise error for invalid search/ranking parameters - [twitter] update `bookmarks` pagination - [downloader:http] refactor file signature checks - [downloader:http] improve `-r/--limit-rate` accuracy - add loaded config files to debug output - improve `-K` output for lists ### Removals - [instagram] remove login support - [instagram] remove `channel` extractor - [ngomik] remove module ## 1.23.5 - 2022-10-30 ### Fixes - [instagram] fix AttributeError on user stories extraction ## 1.23.4 - 2022-10-29 ### Additions - [aibooru] add support for aibooru.online - [instagram] add 'avatar' extractor - [instagram] support 'instagram.com/s/' highlight URLs - [instagram] extract 'coauthors' metadata - [mangasee] add support for 'mangalife' - [mastodon] add 'bookmark' extractor - [mastodon] support cross-instance user references and '/web/' URLs - [moebooru] implement 'notes' extraction - [pixiv] extend 'metadata' option - [reactor] match 'best', 'new', 'all' URLs - [smugloli] add 'smugloli' extractors - [tumblr] add 'fallback-delay' and 'fallback-retries' options - [vichan] add generic extractors for vichan imageboards ### Fixes - [bcy] fix extraction - [gelbooru] support alternate parameter order in post URLs - [hentai2read] support minor versions in chapter URLs - [hentaihere] support minor versions in chapter URLs - [kemonoparty] fix 'dms' extraction - [kemonoparty] update pagination offset - [manganelo] update domain to 'chapmanganato.com' - [pixiv] use 'exact_match_for_tags' as default search mode - [redgifs] fix 'token' extraction - [skeb] fix extraction - improve compatibility of DownloadArchive ## 1.23.3 - 2022-10-15 ### Additions - [2chen] Add `2chen.moe` extractor - [8chan] add `thread` and `board` extractors - [deviantart] add `group` option - [fanbox] add `content` metadata field - [instagram] restore `cursor` functionality - [instagram] restore warnings for private profiles - [nana] add `nana` extractors - [nijie] add `feed` and `followed` extractors - [tumblr] support `https://www.tumblr.com/BLOGNAME` URLs - [tumblr] add `offset` option - [vk] add `tagged` extractor - add `path-extended` option - emit debug logging messages before calling time.sleep() ### Changes - [postprocessor:metadata] assume `"mode": "custom"` when `format` is given ### Fixes - [artstation] skip missing projects - [danbooru] fix ugoira metadata extraction - [deviantart] fix `deviation` extraction - [hitomi] fall back to `webp` when selected format is not available - [imagefap] fix and improve folder extraction and gallery pagination - [instagram] fix login - [nozomi] fix extraction - [redgifs] fix extraction - [tumblr] sleep between fallback retries - [vk] unescape error messages - fix duplicated metadata bug with `-j` - fix bug when processing input file comments ## 1.23.2 - 2022-10-01 ### Additions - [artstation] support search filters - [blogger] add `label` and `query` metadata fields - [exhentai] add a slash to the end of gallery URLs - [instagram] add `count` metadata field - [instagram] add `api` option - [kemonoparty] add `count` metadata field - [mastodon] warn about moved accounts - [newgrounds] add `games` extractor - [newgrounds] extract `type` metadata - [pixiv] add `series` extractor - [sankaku] implement `refresh` option - [skeb] add `search` extractor and `filters` option ### Fixes - [deviantart] fix extraction - [fappic] fix extraction - [instagram] extract higher-resolution photos - [instagram] fix `username` and `fullname` metadata for saved posts - [instagram] update API headers - [kemonoparty] send `Referer` headers - [kemonoparty] restore `favorites` API endpoints - [myportfolio] use fallback when no images are found - [plurk] fix extraction - [sankaku] detect expired links - [tumblr] retry extraction of failed higher-resolution images
gallery-dl: Update to 1.23.1 Changes: ## 1.23.1 - 2022-09-18 ### Additions - [flickr] add support for `secure.flickr.com` URLs - [hotleak] add hotleak extractors - [instagram] add `highlight_title` and `date` metadata for highlight downloads - [paheal] add support for videos - [twitter] add general support for unified cards - [twitter] implement `cards-blacklist` option - [tumblr] fetch high-quality inline images - [tumblr] implement `ratelimit` option - [zerochan] add `metadata` option - [postprocessor:zip] implement `files` option ### Fixes - [bunkr] fix extraction - [bunkr] use `media-files` servers for `m4v` and `mov` downloads - [exhentai] improve 509.gif detection - [exhentai] guess extension for original files - [poipiku] use `img-org.poipiku.com` as image domain - [reddit] prevent exception with empty submission URLs - [redgifs] fix download URLs - [smugmug] update default API credentials - [twitter] provide proper `date` for syndication results - [twitter] fix new-style `/card_img/` URLs - remove all whitespace before comments after input file URLs ## 1.23.0 - 2022-08-28 ### Changes - [twitter] update `user` and `author` metdata fields - for URLs with a single username or ID like `https://twitter.com/USER` or a search with a single `from:` statement, `user` will now always refer to the user referenced in the URL. - for all other URLs like `https://twitter.com/i/bookmarks`, `user` and `author` refer to the same user - `author` will always refer to the original Tweet author - [twitter] update `quote_id` and `quote_by` metadata fields - `quote_id` is now non-zero for quoted Tweets and contains the Tweet ID of the quotng Tweet (was the other way round before) - `quote_by` is only defined for quoted Tweets like before, but now contains the screen name of the user quoting this Tweet - [skeb] improve archive IDs for thumbnails and article images ### Additions - [artstation] add `num` and `count` metadata fields - [catbox] add `album` extractor - [blogger] emit metadata for posts without files - [foolfuuka] update supported domains - [gelbooru] add support for `api_key` and `user_id` - [gelbooru] implement pagination for `pool` results - [instagram] add support for a user's saved collections - [instagram] provide `date` for directory format strings - [kemonoparty] add `favorites` option - [oauth] add `host` config option - [rule34] implement pagination for `pool` results - [skeb] add option to download `article` images - [tumblr] download higher-quality images - [tumblr] add `count` metadata field - [wallhaven] implement `metadata` option - [zerochan] add `tag` and `image` extractors - [zerochan] implement login with username & password - [postprocessor:metadata] implement `mode: modify` and `mode: delete` - [formatter] add `g` conversion for slugifying a string - [formatter] apply `:J` only to lists - implement `path-metadata` option - allow comments after input file URLs - add global `warnings` option to control `urllib3` warning behavior ### Fixes - [bunkr] fix extraction - [deviantart] use public access token for journals - [e621] fix extraction of `popular` posts - [fanbox] download cover images in original size - [mastodon] allow downloading without access token - [hitomi] update cache expiry time - [hitomi] fix error when number of tag results is a multiple of 25 - [mangahere] fix `page-reverse` option - [poipiku] fix posts with more than one image - [poipiku] update filter for static images - [slideshare] fix metadata extraction - [twitter] unescape `+` in search queries - [twitter] fall back to unfiltered search - [twitter] ignore invalid user entries - [vk] prevent exceptions for broken/invalid photos - [vsco] fix `collection` extraction - [weibo] prevent exception for missing `playback_list` - [weibo] prevent errors when paginating over album entries
gallery-dl: Update to 1.22.4 Changes: ## 1.22.4 - 2022-07-15 ### Additions - [instagram] add `pinned` metadata field - [itaku] categorize sections by group - [khinsider] extract `platform` metadata - [tumblr] support `/blog/view` URLs - [twitter] implement `strategy` option - [twitter] add `count` metadata field - [formatter] implement `O` format specifier - [postprocessor:mtime] add `value` option - add `--no-postprocessors` command-line option - implement `format-separator` option ### Changes - [pinterest] handle section pins with separate extractors - [postprocessor:ugoira] enable `mtime` by default ### Fixes - [bunkr] fix extraction - [hentaifoundry] fix metadata extraction - [itaku] fix user caching - [itaku] fix `date` parsing - [kemonoparty] ensure all files have an `extension` - [komikcast] update domain - [mangakakalot] update domain - [newgrounds] only attempt to login if necessary - [newgrounds] prevent exception on empty results - [nozomi] reduce memory consumption during searches - [pixiv] fix default `background` filenames - [sankaku] rewrite file URLs to s.sankakucomplex.com - [slideshare] fix `description` extraction - [twitter] ignore previously seen Tweets - [twitter] unescape HTML entities in `content` - [weibo] handle invalid or broken status objects - [postprocessor:zip] ensure target directory exists - make `brotli` an *optional* dependency - limit path length for `--write-pages` output on Windows ### Removals - [foolfuuka] remove archive.wakarimasen.moe ## 1.22.3 - 2022-06-28 ### Changes - [twitter] revert strategy changes for user URLs - update default User-Agent headers ## 1.22.2 - 2022-06-27 ### Additions - [cyberdrop] add fallback URLs - [horne] add support for horne.red - [itaku] add `gallery` and `image` extractors - [poipiku] add `user` and `post` extractors - [skeb] add `following` extractor - [twitter] implement `expand` option - [twitter] implement `csrf` option - [unsplash] add `collection_title` and `collection_id` metadata fields - [weibo] support `tabtype=video` listings - [formatter] implement slice operator as format specifier - support cygwin/BSD/etc for `--cookies-from-browser` ### Fixes - [instagram] improve metadata generated by `_parse_post_api()` - [instagram] fix `tag` extractor - [instagram] automatically invalidate expired login sessions - [twitter] fix pagination for conversion tweets - [twitter] improve `"replies": "self"` - [twitter] improve strategy for user URLs - [vk] take URLs from `*_src` entries - [weibo] fix URLs generated by `user` extractor - [weibo] fix retweets - [downloader:ytdl] update `_set_outtmpl()` - [formatter] fix `!j` conversion for non-serializable types - [snap] Fix missing libslang dependency ## 1.22.1 - 2022-06-04 ### Additions - [gfycat] add support for collections - [instagram] support specifying users by ID - [paheal] extract more metadata - [reddit] add `home` extractor - [weibo] support usernames in URLs - [weibo] support `livephoto` and `gif` files - [weibo] add support for several different `tabtype` listings - [postprocessor:metadata] write to stdout by setting filename to "-" - implement `output.ansi` option - support user-defined `output.mode` settings ### Changes - [readcomiconline] remove default `browser` setting - [weibo] switch to desktop API - fix command-line argument name of `--cookies-from-browser` ### Fixes - [bunkr] change domain to `app.bunkr.is` - [deviantart] fix folder listings with `"pagination": "manual"` - [gofile] fix 401 Unauthorized errors - [hypnohub] move to gelbooru_v02 instances - [instagram] fix and update extractors - [nozomi] remove slashes from search terms - [pixiv] include `.gif` in background fallback URLs - [sankaku] extend URL patterns - [subscribestar] fix `date` metadata ## 1.22.0 - 2022-05-25 ### Additions - [gelbooru_v01] add `favorite` extractor - [instagram] add `tagged_users` to keywords for stories - [lolisafe] implement `domain` option - [naverwebtoon] support (best)challenge comics - [nijie] support /history_nuita.php listings - [pixiv] provide more data when `metadata` is enabled - [shopify] support several more sites by default - [twitter] extract alt texts as `description` - [twitter] recognize vxtwitter URLs - [weasyl] implement `metadata` option - implement `--cookies-from-browser` - implement `output.colors` options - implement string literals in replacement fields - support using extended format strings for archive keys ### Changes - [foolfuuka] match 4chan filenames - [pixiv] implement `include` option - provide `avatar`/`background` downloads as separate extractors - [twitter] use a better strategy for user URLs - [twitter] disable `cards` by default - delay directory creation - flush writes to stdout/stderr - build executables on GitHub Actions with Python 3.10 ### Fixes - [artstation] use `"browser": "firefox"` by default - [imgur] prevent exception with empty albums - [instagram] report redirects to captcha challenges - [khinsider] fix metadata extraction - [mangafox] send Referer headers - [mangahere] send Referer headers - [mangasee] use randomly generated PHPSESSID cookie - [pixiv] make retrieving ugoira metadata non-fatal - [readcomiconline] update deobfuscation code - [realbooru] fix extraction - [vk] handle photos without width/height info - [vk] fix user ID extraction - [webtoons] extract real episode numbers - create missing directories for archive files - detect circular references with `-K` - replace "\f" in `--filename` arguments with a form feed character ### Removals - [gelbooru_v01] remove tlb.booru.org from supported domains ## 1.21.2 - 2022-04-27 ### Additions - [deviantart] implement `pagination` option - [pixiv] implement `background` option - [postprocessor:ugoira] report ffmpeg/mkvmerge errors ### Fixes - [cyberdrop] match cyberdrop.to URLs - [e621] fix 403 errors - [issuu] fix extraction - [mangadex] download from available chapters despite `externalUrl` - [photovogue] update domain and api endpoint - [sexcom] add fallback for empty files - [twitter] improve syndication video selection - [twitter] fix various syndication issues - [vk] fix extraction - [weibo] fix infinite retries for deleted accounts - [postprocessor:ugoira] use compatible paths with mkvmerge - [postprocessor:ugoira] do not auto-select the `image2` demuxer ## 1.21.1 - 2022-04-08 ### Additions - [gofile] add gofile.io extractor - [instagram] add `previews` option - [kemonoparty] add `duplicates` option - [pinterest] add extractor for created pins - [pinterest] support multiple files per pin - [telegraph] Add telegra.ph extractor - [twitter] add `syndication` option - [twitter] accept fxtwitter.com URLs - [downloader:http] support using an arbitrary method and sending POST data - [postprocessor:metadata] implement archive options - [postprocessor:ugoira] add `mtime` option - [postprocessor:ugoira] support setting timecodes with `mkvmerge` - [formatter] support evaluating f-string literals - add `--ugoira-conv-copy` command-line option - implement a `contains()` function for filter statements ### Fixes - [aryion] provide correct `date` metadata independent of DST - [furaffinity] fix search result pagination - [hitomi] update and fix metadata extraction - [kissgoddess] extract all images - [mangasee] unescape manga names - [newgrounds] update and fix pagination - [newgrounds] warn about age-restricted posts - [pinterest] do not force `m3u8_native` for video downloads - [twibooru] fix posts without `name` - [unsplash] replace dash with space in search API queries - [postprocessor:mtime] fix timestamps from datetime objects - fix yet another bug in `_check_cookies()` - fix loading/storing cookies without domain ## 1.21.0 - 2022-03-14 ### Additions - [fantia] add `num` enumeration index - [fantia] support "Blog Post" content - [imagebam] add support for /view/ paths - [kemonoparty] match beta.kemono.party URLs - [kissgoddess] add `gallery` and `model` extractors - [mememuseum] add `tag` and `post` extractors - [newgrounds] add `post_url` metadata field - [patreon] add `image_large` file type - [toyhouse] support `art` listings - [twibooru] add extractors for searches, galleries, and posts - [postprocessor:metadata] implement `mtime` option - [postprocessor:mtime] add `event` option - add fish shell completion - add `timedelta` class to global namespace in filter expressions ### Changes - [seiga] require authentication with `user_session` cookie - remove username & password login due to 2FA - refactor proxy support - allow gallery-dl proxy settings to overwrite environment proxies - allow specifying different proxies for data extraction and download ### Fixes - [bunkr] fix mp4 downloads - [fanbox] fetch data for each individual post - [hentaicosplays] send `Referer` header - [imagebam] set `nsfw_inter` cookie - [kemonoparty] limit default filename length - [mangadex] fix chapters without `translatedLanguage` - [newgrounds] fix video descriptions - [skeb] add `sent-requests` option - [slideshare] fix extraction - [subscribestar] unescape attachment URLs - [twitter] fix handling of 429 Too Many Requests responses - [twitter] warn about age-restricted Tweets - [twitter] handle Tweets with "softIntervention" entries - [twitter] update query hashes - fix another bug in `_check_cookies()` ## 1.20.5 - 2022-02-14 ### Additions - [furaffinity] add `layout` option - [lightroom] add Lightroom gallery extractor - [reddit] support standalone submissions on personal user pages - [redgifs] support i.redgifs.com URLs - [wallpapercave] add extractor for images and search results - add `signals-ignore` option ### Changes - [danbooru] merge `danbooru` and `e621` extractors - support `atfbooru` - remove support for old e621 tag search URLs ### Fixes - [furaffinity] improve new/old layout detection - [imgbox] fix ImgboxExtractor - [inkbunny] rename search parameters to their API equivalents - [kemonoparty] handle files without names - [twitter] fix extraction - [vk] fix infinite pagination loops - [downloader:ytdl] make `ImportError`s non-fatal ## 1.20.4 - 2022-02-06 ### Additions - [e621] add `favorite` extractor - [hitomi] add `format` option - [kohlchan] add Kohlchan extractors - [sexcom] add `pins` extractor - [twitter] add `warnings` option - add ability to disable TLS 1.2 - add examples for custom gelbooru instances ### Fixes - [bunkr] fix mp4 downloads - [gelbooru] improve and fix pagination - [hitomi] "fix" 403 errors - [kemonoparty] fix downloading smaller text files - [patreon] disable TLS 1.2 by default - [twitter] restore errors for protected timelines etc - [twitter] restore `logout` functionality - [twitter] provide fallback URLs for card images - [weibo] update pagination code
*: Revbump packages that use Python at runtime without a PKGNAME prefix
gallery-dl: Update to 1.20.3 Changes: ## 1.20.3 - Fixes to kemonoparty and twitter extractors. ## 1.20.2 - Add event extractor for twitter - Add `--source-address` command-line option #2206 - Enable cards option on twitter extractor by default - Several fixes ## 1.20.1 - Add newgrounds search extractor - Restore `-d/--dest` functionality from before 1.20.0 - Change short option for `--directory` to `-D` - Several fixes ## 1.20.0 - Improve several extractors - Add a generic extractor - Add `-d/--directory` and `-f/--filename` command-line options - Add `--sleep-request` and `--sleep-extractor` command-line options - Prefer yt-dlp over youtube-dl - Rename `--write-infojson` to `--write-info-json` - Several fixes ## 1.19.3 - Improve several extractors - Several fixes - Remove seisoparty ## 1.19.2 - Improve several extractors - Several fixes ## 1.19.1 - 2021-10-24 - Improve several extractors - Several fixes ## 1.19.0 - 2021-10-01 - Improve several extractors - Implement a download progress indicator - Implement a `page-reverse` option - Implement a way to specify extended format strings - Add a `--write-infojson` command-line option - Several fixes
python: egg.mk: add USE_PKG_RESOURCES flag This flag should be set for packages that import pkg_resources and thus need setuptools after the build step. Set this flag for packages that need it and bump PKGREVISION.
*: bump PKGREVISION for egg.mk users They now have a tool dependency on py-setuptools instead of a DEPENDS
gallery-dl: Update to 1.18.4 Changes: 1.18.4 ------ ### Additions - [420chan] add `thread` and `board` extractors - [deviantart] add `tag` extractor - [deviantart] add `comments` option - [deviantart] implement a `auto-watch` option - [foolfuuka] add `gallery` extractor - [furaffinity] expand URL pattern for searches - [kemonoparty] automatically generate required DDoS-GUARD cookies - [nhentai] add `favorite` extractor - [shopify] support windsorstore.com - [twitter] add `url` to user objects - [twitter] expand t.co links in user descriptions - show a warning if an extractor doesn`t yield any results - add a `j` format string conversion - implement a `fallback` option - implement a `path-strip` option ### Changes - [shopify] use API for product listings - update default User-Agent headers ### Fixes - [deviantart] prevent exceptions for "empty" videos - [exhentai] improve image limits check - [inkbunny] fix extraction - [mangadex] prevent exceptions for manga without English title - [oauth] use defaults when config values are set to `null` - [pixiv] fix pixivision title extraction - [reddit] delay RedditAPI initialization - [twitter] improve error reporting - [twitter] fix issue when filtering quote tweets - [twitter] fix `logout` option ### Removals - [deviantart] remove the "you need session cookies to download mature scraps" warning - [foolslide] remove entry for kobato.hologfx.com
gallery-dl: Update to 1.18.3 Changes: Additions --------- [bbc] add width option (#1706) [danbooru] add external option (#1747) [furaffinity] add external option (#1492) [luscious] add gif option (#1701) [newgrounds] add format option (#1729) [reactor] add gif option (#1701) [twitter] warn about suspended accounts (#1759) [twitter] extend replies option (#1254) [twitter] add option to log out and retry when blocked (#1719) [wikieat] add thread and board extractors (#1699, #1607) Changes ------- [instagram] increase default delay between HTTP requests from 5s to 8s (#1732) Fixes ----- [bbc] improve image dimensions (#1706) [bbc] support multi-page gallery listings (#1730) [behance] fix collection extraction [deviantart] get original files for GIF previews (#1731) [furaffinity] fix errors when using category-transfer (#1274) [hitomi] fix image URLs (#1765) [instagram] use custom User-Agent header for video downloads (#1682, #1623, #1580) [kemonoparty] fix username extraction (#1750) [kemonoparty] update file server domain (#1764) [newgrounds] fix errors when using category-transfer (#1274) [nsfwalbum] retry backend requests when extracting image URLs (#1733, #1271) [vk] prevent exception for empty/private profiles (#1742)
gallery-dl: Update to 1.18.2 Changes: 1.18.2 ------ ### Additions - [bbc] add `gallery` and `programme` extractors - [comicvine] add extractor - [kemonoparty] add `max-posts` option - [kemonoparty] parse `o` query parameters - [mastodon] add `reblogs` and `replies` options - [pixiv] add extractor for `pixivision` articles - [ytdl] add experimental extractor for sites supported by youtube-dl - extend `parent-metadata` functionality - add `archive-prefix` option - add `url-metadata` option ### Changes - [kemonoparty] skip duplicated patreon files - [mangadex] use custom User-Agent header ### Fixes - [hitomi] fix image URLs - [imagevenue] fix extraction - [instagram] fix extraction of `/explore/tags/` posts - [moebooru] fix `tags` ending with a `+` when logged in - [naverwebtoon] fix comic extraction - [pururin] update domain and fix extraction - [vk] improve metadata extraction and URL pattern - [downloader:ytdl] fix `outtmpl` setting for yt-dlp
gallery-dl: Update to 1.18.1 Changes: ## 1.18.1 - 2021-07-04 ### Additions - [mangafox] add manga extractor (#1633) - [mangasee] add chapter and manga extractors - [mastodon] implement text-posts option (#1569, #1669) - [seisoparty] add user and post extractors (#1635) - implement conditional directories (#1394) - add T format string conversion (#1646) - document format string syntax ### Changes - [twitter] set retweet_id for original retweets (#1481) ### Fixes - [directlink] manually encode Referer URLs (#1647) - [hiperdex] use domain from input URL - [kemonoparty] fix username extraction (#1652) - [kemonoparty] warn about missing DDoS-GUARD cookies - [twitter] ensure guest tokens are returned as string (#1665) - [webtoons] match arbitrary language codes (#1643) - fix depth counter in UrlJob when specifying -g multiple times ## 1.18.0 - 2021-06-19 ### Additions - [foolfuuka] support `archive.wakarimasen.moe` (#1595) - [mangadex] implement login with username & password (#1535) - [mangadex] add extractor for a user's followed feed (#1535) - [pixiv] support fetching privately followed users (#1628) - implement conditional filenames (#1394) - implement `filter` option for post processors (#1460) - add `-T/--terminate` command-line option (#1399) - add `-P/--postprocessor` command-line option (#1583) ### Changes - [kemonoparty] update default filenames and archive IDs (#1514) - [twitter] update default settings - change `retweets` and `quoted` options from `true` to `false` - change directory format for search results to the same as other extractors - require an argument for `--clear-cache` ### Fixes - [500px] update GraphQL queries - [furaffinity] improve metadata extraction (#1630) - [hitomi] update image URL generation (#1637) - [idolcomplex] improve and fix pagination (#1594) - [instagram] fix login (#1631) - [instagram] update query hashes - [mangadex] update to API v5 (#1535) - [mangafox] improve URL pattern (#1608) - [oauth] prevent exceptions when reporting errors (#1603) - [philomena] fix tag escapes handling (#1629) - [redgifs] update API server address (#1632) - [sankaku] handle empty tags (#1617) - [subscribestar] improve attachment filenames (#1609) - [unsplash] update collections URL pattern (#1627) - [postprocessor:metadata] handle dicts in `mode:tags` (#1598) ## 1.17.5 - 2021-05-30 ### Additions - [kemonoparty] add `metadata` option (#1548) - [kemonoparty] add `type` metadata field (#1556) - [mangapark] recognize v2.mangapark URLs (#1578) - [patreon] extract user-defined `tags` (#1539) - [pillowfort] implement login with username & password (#846) - [pillowfort] add `inline` and `external` options (#846) - [pixiv] implement `max-posts` option (#1558) - [pixiv] add `metadata` option (#1551) - [twitter] add `text-tweets` option (#570) - [weibo] extend `retweets` option (#1542) - [postprocessor:ugoira] support using the `image2` demuxer (#1550) - [postprocessor:ugoira] add `repeat-last-frame` option (#1550) - support `XDG_CONFIG_HOME` (#1545) - implement `parent-skip` and `"skip": "terminate"` options (#1399) ### Changes - [twitter] resolve `t.co` URLs in `content` (#1532) ### Fixes - [500px] update query hashes (#1573) - [aryion] find text posts in `recursive=false` mode (#1568) - [imagebam] fix extraction of NSFW images (#1534) - [imgur] update URL patterns (#1561) - [manganelo] update domain to `manganato.com` - [reactor] skip deleted/empty posts - [twitter] add missing retweet media entities (#1555) - fix ISO 639-1 code for Japanese (`jp` -> `ja`)
gallery-dl: Update to 1.17.4 Changes: ## 1.17.4 - 2021-05-07 ### Additions - [gelbooru] add extractor for `/redirect.php` URLs #1530 - [inkbunny] add `favorite` extractor #1521 - add `output.skip` option - add an optional argument to `--clear-cache` to select which cache entries to remove #1230 ### Changes - [pixiv] update `translated-tags` option #1507 - rename to `tags` - accept `"japanese"`, `"translated"`, and `"original"` as values ### Fixes - [500px] update query hashes - [kemonoparty] fix download URLs #1514 - [imagebam] fix extraction - [instagram] update query hashes - [nozomi] update default archive-fmt for `tag` and `search` extractors (#1529) - [pixiv] remove duplicate translated tags (#1507) - [readcomiconline] change domain to `readcomiconline.li` (#1517) - [sankaku] update invalid-token detection (#1515) - fix crash when using `--no-download` with `--ugoira-conv` (#1507) ## 1.17.3 - 2021-04-25 ### Additions - [danbooru] add option for extended metadata extraction (#1458) - [fanbox] add extractors (#1459) - [fantia] add extractors (#1459) - [gelbooru] add an option to extract notes (#1457) - [hentaicosplays] add extractor (#907, #1473, #1483) - [instagram] add extractor for `tagged` posts (#1439) - [naverwebtoon] ignore non-comic images - [pixiv] also save untranslated tags when `translated-tags` is enabled (#1501) - [shopify] support omgmiamiswimwear.com (#1280) - implement `output.fallback` option - add archive format to InfoJob output (#875) - build executables with SOCKS proxy support (#1424) ### Fixes - [500px] update query hashes - [8muses] fix JSON deobfuscation - [artstation] download `/4k/` images (#1422) - [deviantart] fix pagination for Eclipse results (#1444) - [deviantart] improve folder name matching (#1451) - [erome] skip deleted albums (#1447) - [exhentai] fix image limit detection (#1437) - [exhentai] restore `limits` option (#1487) - [gelbooru] fix tag category extraction (#1455) - [instagram] update query hashes - [komikcast] fix extraction - [simplyhentai] fix extraction - [slideshare] fix extraction - [webtoons] update agegate/GDPR cookies (#1431) - fix `category-transfer` option ### Removals - [yuki] remove module for yuki.la
gallery-dl: Update to 1.17.2 Changes: 1.17.2 ------ ### Additions - [deviantart] add support for posts from watched users (#794) - [manganelo] add `chapter` and `manga` extractors (#1415) - [pinterest] add `search` extractor (#1411) - [sankaku] add `tag_string` metadata field (#1388) - [sankaku] add enumeration index for books (#1388) - [tapas] add `series` and `episode` extractors (#692) - [tapas] implement login with username & password (#692) - [twitter] allow specifying a custom format for user results (#1337) - [twitter] add extractor for direct image links (#1417) - [vk] add support for albums (#474) ### Fixes - [aryion] unescape paths (#1414) - [bcy] improve pagination - [deviantart] update `watch` URL pattern (#794) - [deviantart] fix arguments for search/popular results (#1408) - [deviantart] use fallback for `/intermediary/` URLs - [exhentai] improve and simplify image limit checks - [komikcast] fix extraction - [pixiv] fix `favorite` URL pattern (#1405) - [sankaku] simplify `pool` tags (#1388) - [twitter] improve error message when trying to log in with 2FA (#1409) - [twitter] don't use youtube-dl for cards when videos are disabled (#1416)
gallery-dl: Update to 1.17.1 Changes: 1.17.1 ------ ### Additions - [architizer] add `project` and `firm` extractors (#1369) - [deviantart] add `watch` extractor (#794) - [exhentai] support `/tag/` URLs (#1363) - [gelbooru_v01] support `drawfriends.booru.org`, `vidyart.booru.org`, and `tlb.booru.org` by default - [nozomi] support `/index-N.html` URLs (#1365) - [philomena] add generalized extractors for philomena sites (#1379) - [philomena] support post URLs without `/images/` - [twitter] implement `users` option (#1337) - implement `parent-metadata` option (#1364) ### Changes - [deviantart] revert previous changes to `extra` option (#1356, #1387) ### Fixes - [exhentai] improve favorites count extraction (#1360) - [gelbooru] update domain for video downloads (#1368) - [hentaifox] improve image and metadata extraction (#1366, #1378) - [imgur] fix and improve rate limit handling (#1386) - [weasyl] improve favorites URL pattern (#1374) - use type check before applying `browser` option (#1358) - ensure `-s/--simulate` always prints filenames (#1360) ### Removals - [hentaicafe] remove module - [hentainexus] remove module - [mangareader] remove module - [mangastream] remove module
gallery-dl: Update to 1.17.0 Changes: 1.17.0 ------ ### Additions - [cyberdrop] add support for `https://cyberdrop.me/` (#1328) - [exhentai] add `metadata` option; extract more metadata from gallery pages (#1325) - [hentaicafe] add `search` and `tag` extractors (#1345) - [hentainexus] add `original` option (#1322) - [instagram] support `/user/reels/` URLs (#1329) - [naverwebtoon] add support for `https://comic.naver.com/` (#1331) - [pixiv] add `translated-tags` option (#1354) - [tbib] add support for `https://tbib.org/` (#473, #1082) - [tumblrgallery] add support for `https://tumblrgallery.xyz/` (#1298) - [twitter] add extractor for followed users (#1337) - [twitter] add option to download all media from conversations (#1319) - [wallhaven] add `collections` extractor (#1351) - [snap] allow access to user's .netrc for site authentication (#1352) - add extractors for Gelbooru v0.1 sites (#234, #426, #473, #767, #1238) - add `-E/--extractor-info` command-line option (#875) - add GitHub Actions workflow for building standalone executables (#1312) - add `browser` and `headers` options (#1117) - add option to use different youtube-dl forks (#1330) - support using multiple input files at once (#1353) ### Changes - [deviantart] extend `extra` option to also download embedded DeviantArt posts. - [exhentai] rename metadata fields to match API results (#1325) - [mangadex] use `api.mangadex.org` as default API server - [mastodon] cache OAuth tokens (#616) - replace `wait-min` and `wait-max` with `sleep-request` ### Fixes - [500px] skip unavailable photos (#1335) - [komikcast] fix extraction - [readcomiconline] download high quality image versions (#1347) - [twitter] update GraphQL endpoints - fix crash when `base-directory` is an empty string (#1339) ### Removals - remove support for formerly deprecated options - remove `cloudflare` module
gallery-dl: Update to 1.16.5 Changes: 1.16.5 ------ ### Additions - [behance] support `video` modules (#1282) - [erome] add `album`, `user`, and `search` extractors (#409) - [hentaifox] support searching by group (#1294) - [imgclick] add `image` extractor (#1307) - [kemonoparty] extract inline images (#1286) - [kemonoparty] support URLs with non-numeric user and post IDs (#1303) - [pillowfort] add `user` and `post` extractors (#846) ### Changes - [kemonoparty] include `service` in directories and archive keys - [pixiv] require a `refresh-token` to login (#1304) - [snap] use `core18` as base ### Fixes - [500px] update query hashes - [deviantart] update parameters for `/browse/popular` (#1267) - [deviantart] provide filename extension for original file downloads (#1272) - [deviantart] fix `folders` option (#1302) - [inkbunny] add `sid` parameter to private file downloads (#1281) - [kemonoparty] fix absolute file URLs - [mangadex] revert to `https://mangadex.org/api/` and add `api-server` option (#1310) - [nsfwalbum] use fallback for deleted content (#1259) - [sankaku] update `invalid token` detection (#1309) - [slideshare] fix extraction - [postprocessor:metadata] fix crash with `extension-format` (#1285)
gallery-dl: Update to version 1.16.4 Changes: 1.16.4 ------ ### Additions - [furaffinity] add `descriptions` option (#1231) - [kemonoparty] add `user` and `post` extractors (#1216) - [nozomi] add `num` enumeration index (#1239) - [photovogue] added portfolio extractor (#1253) - [twitter] match `/i/user/ID` URLs - [unsplash] add extractors (#1197) - [vipr] add image extractor (#1258) ### Changes - [derpibooru] use "Everything" filter by default (#862) ### Fixes - [derpibooru] update `date` parsing - [foolfuuka] stop search when results are exhausted (#1174) - [instagram] fix regex for `/saved` URLs (#1251) - [mangadex] update API URLs - [mangakakalot] fix extraction - [newgrounds] fix flash file extraction (#1257) - [sankaku] simplify login process - [twitter] fix retries after hitting rate limit
gallery-dl: Update to version 1.16.3 Changes: 1.16.3 ------ ### Fixes - Fix crash when using a `dict` for `path-restrict` - [postprocessor:metadata] sanitize custom filenames
gallery-dl: Update to 1.16.2 Changes: 1.16.2 ------ ### Additions - [derpibooru] add `search` and `gallery` extractors (#862) - [foolfuuka] add `board` and `search` extractors (#1044, #1174) - [gfycat] add `date` metadata field (#1138) - [pinterest] add support for getting all boards of a user (#1205) - [sankaku] add support for book searches (#1204) - [twitter] fetch media from pinned tweets (#1203) - [wikiart] add extractor for single paintings (#1233) - [downloader:http] add MIME type and signature for `.ico` files (#1211) - add a `d` format string conversion for timestamp values - add `"ascii"` as a special `path-restrict` value ### Fixes - [hentainexus] fix extraction (#1234) - [instagram] categorize single highlight URLs as `highlights` (#1222) - [redgifs] fix search results - [twitter] fix login with username & password - [twitter] fetch tweets from `homeConversation` entries
gallery-dl: Update to 1.16.1 Changes: 1.16.1 ------ ### Additions - [instagram] add `include` option (#1180) - [pinterest] implement video support (#1189) - [sankaku] reimplement login support (#1176, #1182) - [sankaku] add support for sankaku.app URLs (#1193) ### Changes - [e621] return pool posts in order (#1195) - [hentaicafe] prefer title of `/hc.fyi/` pages (#1106) - [hentaicafe] simplify default filenames - [sankaku] normalize `created_at` metadata (#1190) - [postprocessor:exec] do not add missing `{}` to command (#1185) ### Fixes - [booru] improve error handling - [instagram] warn about private profiles (#1187) - [keenspot] improve redirect handling - [mangadex] respect `chapter-reverse` settings (#1194) - [pixiv] output debug message on failed login attempts (#1192) - increase SQLite connection timeouts (#1173) ### Removals - [mangapanda] remove module
gallery-dl: Update to 1.16.0 Changes: 1.16.0 ------ ### Additions - [booru] implement generalized extractors for `*booru` and `moebooru` sites - add support for sakugabooru.com (#1136) - add support for lolibooru.moe (#1050) - provide formattable `date` metadata fields (#1138) - [postprocessor:metadata] add `event` and `filename` options (#315, #866, #984) - [postprocessor:exec] add `event` option (#992) ### Changes - [flickr] update default directories and improve metadata consistency (#828) - [sankaku] use API endpoints from `beta.sankakucomplex.com` - [downloader:http] improve filename extension handling (#776) - replace all JPEG filename extensions with `jpg` by default ### Fixes - [hentainexus] fix extraction (#1166) - [instagram] rewrite (#1113, #1122, #1128, #1130, #1149) - [mangadex] handle external chapters (#1154) - [nozomi] handle empty `date` fields (#1163) - [paheal] create directory for each post (#1147) - [piczel] update API URLs - [twitter] update image URL format (#1145) - [twitter] improve `x-csrf-token` header handling (#1170) - [webtoons] update `ageGate` cookies ### Removals - [sankaku] remove login support
Revbump packages with a runtime Python dep but no version prefix. For the Python 3.8 default switch.
gallery-dl: Update to 1.15.4 Changes: 1.15.4 ------ ### Fixes - [2chan] skip external links - [hentainexus] fix extraction (#1125) - [mangadex] switch to API v2 (#1129) - [mangapanda] use http:// - [mangoxo] fix extraction - [reddit] skip invalid gallery items (#1127)
gallery-dl: Update to 1.15.3 Changes: 1.15.3 ------ ### Additions - [sankakucomplex] extract videos and embeds (#308) - [twitter] add support for lists (#1096) - [postprocessor:metadata] accept string-lists for `content-format` (#1080) - implement `modules` and `extension-map` options ### Fixes - [500px] update query hashes - [8kun] fix file URLs of older posts (#1101) - [exhentai] update image URL parsing (#1094) - [hentaifoundry] update `YII_CSRF_TOKEN` cookie handling (#1083) - [hentaifoundry] use scheme from input URLs (#1095) - [mangoxo] fix metadata extraction - [paheal] fix extraction (#1088) - collect post processors from `basecategory` entries (#1084)
gallery-dl: Update to 1.15.2 Changes: 1.15.2 ------ ### Additions - [pinterest] implement login support (#1055) - [reddit] add `date` metadata field (#1068) - [seiga] add metadata for single image downloads (#1063) - [twitter] support media from Cards (#937, #1005) - [weasyl] support api-key authentication (#1057) - add a `t` format string conversion for trimming whitespace (#1065) ### Fixes - [blogger] handle URLs with specified width/height (#1061) - [fallenangels] fix extraction of `.5` chapters - [gelbooru] rewrite mp4 video URLs (#1048) - [hitomi] fix image URLs and gallery URL pattern - [mangadex] unescape more metadata fields (#1066) - [mangahere] ensure download URLs have a scheme (#1070) - [mangakakalot] ignore "Go Home" buttons in chapter pages - [newgrounds] handle embeds without scheme (#1033) - [newgrounds] provide fallback URLs for video downloads (#1042) - [xhamster] fix user profile extraction
gallery-dl: Update to 1.15.1 Changes: 1.15.1 ------ ### Additions - [hentaicafe] add `manga_id` metadata field (#1036) - [hentaifoundry] add support for stories (#734) - [hentaifoundry] add `include` option - [newgrounds] extract image embeds (#1033) - [nijie] add `include` option (#1018) - [reactor] match URLs without subdomain (#1053) - [twitter] extend `retweets` option (#1026) - [weasyl] add extractors (#977) ### Fixes - [500px] update query hashes - [behance] fix `collection` extraction - [newgrounds] fix video extraction (#1042) - [twitter] improve twitpic extraction (#1019) - [weibo] handle posts with more than 9 images (#926) - [xvideos] fix `title` extraction - fix crash when using `--download-archive` with `--no-skip` (#1023) - fix issues with `blacklist`/`whitelist` defaults (#1051, #1056) ### Removals - [kissmanga] remove module
gallery-dl: Update to 1.15.0 Changes: 1.15.0 ------ ### Additions - [deviantart] support watchers-only/paid deviations (#995) - [myhentaigallery] add gallery extractor (#1001) - [twitter] support specifying users by ID (#980) - [twitter] support `/intent/user?user_id=…` URLs (#980) - add `--no-skip` command-line option (#986) - add `blacklist` and `whitelist` options (#492, #844) - add `filesize-min` and `filesize-max` options (#780) - add `sleep-extractor` and `sleep-request` options (#788) - write skipped files to archive (#550) ### Changes - [exhentai] update wait time before original image downloads (#978) - [imgur] use new API endpoints for image/album data - [tumblr] create directories for each post (#965) - support format string replacement fields in download archive paths (#985) - reduce wait time growth rate for HTTP retries from exponential to linear ### Fixes - [500px] update query hash - [aryion] improve post ID extraction (#981, #982) - [danbooru] handle posts without `id` (#1004) - [furaffinity] update download URL extraction (#988) - [imgur] fix image/album detection for galleries - [postprocessor:zip] defer zip file creation (#968) ### Removals - [jaiminisbox] remove extractors - [worldthree] remove extractors
gallery-dl: Update to 1.14.5 Changes: 1.14.5 ------ ### Additions - [aryion] add username/password support (#960) - [exhentai] add ability to specify a custom image limit (#940) - [furaffinity] add `search` extractor (#915) - [imgur] add `search` and `tag` extractors (#934) ### Fixes - [500px] fix extraction and update URL patterns (#956) - [aryion] update folder mime type list (#945) - [gelbooru] fix extraction without API - [hentaihand] update to new site layout - [hitomi] fix redirect processing - [reddit] handle deleted galleries (#953) - [reddit] improve gallery extraction (#955)
gallery-dl: Update to 1.14.4 Changes: 1.14.4 ------ ### Additions - [blogger] add `search` extractor (#925) - [blogger] support searching posts by labels (#925) - [inkbunny] add `user` and `post` extractors (#283) - [instagram] support `/reel/` URLs - [pinterest] support `pinterest.co.uk` URLs (#914) - [reddit] support gallery posts (#920) - [subscribestar] extract attached media files (#852) ### Fixes - [blogger] improve error messages for missing posts/blogs (#903) - [exhentai] adjust image limit costs (#940) - [gfycat] skip malformed gfycat responses (#902) - [imgur] handle 403 overcapacity responses (#910) - [instagram] wait before GraphQL requests (#901) - [mangareader] fix extraction - [mangoxo] fix login - [pixnet] detect password-protected albums (#177) - [simplyhentai] fix `gallery_id` extraction - [subscribestar] update `date` parsing - [vsco] handle missing `description` fields - [xhamster] fix extraction (#917) - allow `parent-directory` to work recursively (#905) - skip external OAuth tests (#908) ### Removals - [bobx] remove module
gallery-dl: Update to 1.14.3 Changes: 1.14.3 ------ ### Additions - [8muses] support `comics.8muses.com` URLs - [artstation] add `following` extractor (#888) - [exhentai] add `domain` option (#897) - [gfycat] add `user` and `search` extractors - [imgur] support all `/t/...` URLs (#880) - [khinsider] add `format` option (#840) - [mangakakalot] add `manga` and `chapter` extractors (#876) - [redgifs] support `gifsdeliverynetwork.com` URLs (#874) - [subscribestar] add `user` and `post` extractors (#852) - [twitter] add support for nitter.net URLs (#890) - add Zsh completion script (#150) ### Fixes - [gfycat] retry 404'ed videos on redgifs.com (#874) - [newgrounds] fix favorites extraction - [patreon] yield images and attachments before post files (#871) - [reddit] fix AttributeError when using `recursion` (#879) - [twitter] raise proper exception if a user doesn't exist (#891) - defer directory creation (#722) - set pseudo extension for Metadata messages (#865) - prevent exception on Cloudflare challenges (#868)
gallery-dl: Update to 1.14.2 Changes: 1.14.2 ------ ### Additions - [artstation] add `date` metadata field (#839) - [mastodon] add `date` metadata field (#839) - [pinterest] add support for board sections (#835) - [twitter] add extractor for liked tweets (#837) - [twitter] add option to filter media from quoted tweets (#854) - [weibo] add `date` metadata field to `status` objects (#829) ### Fixes - [aryion] fix user gallery extraction (#832) - [imgur] build directory paths for each file (#842) - [tumblr] prevent errors when using `reblogs=same-blog` (#851) - [twitter] always provide an `author` metadata field (#831, #833) - [twitter] don't download video previews (#833) - [twitter] improve handling of deleted tweets (#838) - [twitter] fix search results (#847) - [twitter] improve handling of quoted tweets (#854) - fix config lookups when multiple locations are involved (#843) - improve output of `-K/--list-keywords` for parent extractors (#825) - call `flush()` after writing JSON in `DataJob()` (#727)
gallery-dl: Update to 1.14.1 Changes: 1.14.1 ------ ### Additions - [furaffinity] add `artist_url` metadata field (#821) - [redgifs] add `user` and `search` extractors (#724) ### Changes - [deviantart] extend `extra` option; also search journals for sta.sh links (#712) - [twitter] rewrite; use new interface (#806, #740) ### Fixes - [kissmanga] work around CAPTCHAs (#818) - [nhentai] fix extraction (#819) - [webtoons] generalize comic extraction code (#820)
gallery-dl: Update to 1.14.0 Changes: 1.14.0 ------ ### Additions - [imagechest] add new extractor for imgchest.com (#750) - [instagram] add `post_url`, `tags`, `location`, `tagged_users` metadata (#743) - [redgifs] add image extractor (#724) - [webtoons] add new extractor for webtoons.com (#761) - implement `--write-pages` option (#736) - extend `path-restrict` option (#662) - implement `path-replace` option (#662, #755) - make `path` and `keywords` available in logging messages (#574, #575) ### Changes - [danbooru] change default value of `ugoira` to `false` - [downloader:ytdl] change default value of `forward-cookies` to `false` - [downloader:ytdl] fix file extensions when merging into `.mkv` (#720) - write OAuth tokens to cache (#616) - use `%APPDATA%\gallery-dl` for config files and cache on Windows - use `util.Formatter` for formatting logging messages - reuse HTTP connections from parent extractors ### Fixes - [deviantart] use private access tokens for Journals (#738) - [gelbooru] simplify and fix pool extraction - [imgur] fix extraction of animated images without `mp4` entry - [imgur] treat `/t/unmuted/` URLs as galleries - [instagram] fix login with username & password (#756, #771, #797, #803) - [reddit] don't send OAuth headers for file downloads (#729) - fix/improve Cloudflare bypass code (#728, #757) - reset filenames on empty file extensions (#733)
gallery-dl: Update to 1.13.6 Changes: 1.13.6 ------ ### Additions - [patreon] respect filters and sort order in query parameters (#711) - [speakerdeck] add a new extractor for speakerdeck.com (#726) - [twitter] add `replies` option (#705) - [weibo] add `videos` option - [downloader:http] add MIME types for `.psd` files (#714) ### Fixes - [artstation] improve embed extraction (#720) - [deviantart] limit API wait times (#721) - [newgrounds] fix URLs produced by the `following` extractor (#684) - [patreon] improve file hash extraction (#713) - [vsco] fix user gallery extraction - fix/improve Cloudflare bypass code (#728)
gallery-dl: Update to 1.13.5 Changes: 1.13.5 ------ ### Additions - [500px] recognize `web.500px.com` URLs - [aryion] support downloading from folders (#694) - [furaffinity] add extractor for followed users (#515) - [hitomi] add extractor for tag searches (#697) - [instagram] add `post_id` and `num` metadata fields (#698) - [newgrounds] add extractor for followed users (#684) - [patreon] recognize URLs with creator IDs (#711) - [twitter] add `reply` metadata field (#705) - [xhamster] recognize more URLs (#700) ### Fixes - [gelbooru] improve post ID extraction in pool listings - [hitomi] fix extraction of galleries without tags - [jaiminisbox] update metadata decoding procedure (#702) - [mastodon] fix pagination (#701) - [mastodon] improve account searches (#704) - [patreon] fix hash extraction from download URLs (#693) - improve parameter extraction when solving Cloudflare challenges
gallery-dl: Update to 1.13.4 Changes: 1.13.4 ------ ### Additions - [aryion] add `gallery` and `post` extractors (#390, #673) - [deviantart] detect and handle folders in sta.sh listings (#659) - [hentainexus] add `circle`, `event`, and `title_conventional` metadata fields (#661) - [hiperdex] add `artist` extractor (#606) - [mastodon] add access tokens for `mastodon.social` and `baraag.net` (#665) ### Changes - [deviantart] retrieve *all* download URLs through the OAuth API - automatically read config files in PyInstaller executable directories (#682) ### Fixes - [deviantart] handle "Request blocked" errors (#655) - [deviantart] improve JPEG quality replacement pattern - [hiperdex] fix extraction - [mastodon] handle API rate limits (#665) - [mastodon] update OAuth credentials for pawoo.net (#665) - [myportfolio] fix extraction of galleries without title - [piczel] fix extraction of single images - [vsco] fix collection extraction - [weibo] accept status URLs with non-numeric IDs (#664)
gallery-dl: Update to 1.13.3 Changes: 1.13.3 ------ ### Additions - [instagram] Add support for user's saved medias (#644) - [nozomi] support multiple images per post (#646) - [35photo] add `tag` extractor ### Changes - [mangadex] transform timestamps from `date` fields to datetime objects ### Fixes - [deviantart] handle decode errors for `extended_fetch` results (#655) - [e621] fix bug in API rate limiting and improve pagination (#651) - [instagram] update pattern for user profile URLs - [mangapark] fix metadata extraction - [nozomi] sort search results (#646) - [piczel] fix extraction - [twitter] fix typo in `x-twitter-auth-type` header (#625) - remove trailing dots from Windows directory names (#647) - fix crash due to missing `stdout`/`stderr`/`stdin` handles (#653)
gallery-dl: Update to 1.13.2 Changes: 1.13.2 ------ ### Additions - [furaffinity] extract more metadata - [instagram] add `post_shortcode` metadata field (#525) - [kabeuchi] add extractor (#561) - [newgrounds] add extractor for favorited posts (#394) - [pixiv] implement `avatar` option (#595, #623) - [twitter] add extractor for bookmarked Tweets (#625) ### Fixes - [bcy] reduce number of HTTP requests during data extraction - [e621] update to new interface (#635) - [exhentai] handle incomplete MIME types (#632) - [hitomi] improve metadata extraction - [mangoxo] fix login - [newgrounds] improve error handling when extracting post data
gallery-dl: Update to 1.13.1 Changes: 1.13.1 ------ ### Additions - [hentaihand] add extractors (#605) - [hiperdex] add chapter and manga extractors (#606) - [oauth] implement option to write DeviantArt refresh-tokens to cache (#616) - [downloader:http] add more MIME types for `.bmp` and `.rar` files (#621, #628) - warn about expired cookies ### Fixes - [bcy] fix partial image URLs (#613) - [danbooru] fix Ugoira downloads and metadata - [deviantart] check availability of `/intermediary/` URLs (#609) - [hitomi] follow multiple redirects & fix image URLs - [piczel] improve and update - [tumblr] replace `-` with ` ` in tag searches (#611) - [vsco] update gallery URL pattern - fix `--verbose` and `--quiet` command-line options
gallery-dl: Update to 1.13.0 Changes: 1.13.0 ====== Additions --------- - Support for - `furaffinity` (#284) - `8kun` (#582) - `bcy` (#592) - [blogger] implement video extraction (#587) - [oauth] add option to specify port number used by local server (#604) - [pixiv] add `rating` metadata field (#595) - [pixiv] recognize tags at the end of new bookmark URLs - [reddit] add `videos` option - [weibo] use youtube-dl to download from m3u8 manifests - implement `parent-directory` option (#551) - extend filename formatting capabilities: - implement field name alternatives (#525) - allow multiple "special" format specifiers per replacement field (#595) - allow for numeric list and string indices Changes ------- - [reddit] handle reddit-hosted images and videos natively (#551) - [twitter] change default value for `videos` to `true` Fixes ----- - [cloudflare] unescape challenge URLs - [deviantart] fix video extraction from `extended_fetch` results - [hitomi] implement workaround for "broken" redirects - [khinsider] fix and improve metadata extraction - [patreon] filter duplicate files per post (#590) - [piczel] fix extraction - [pixiv] fix user IDs for bookmarks API calls (#596) - [sexcom] fix image URLs - [twitter] force old login page layout (#584, #598) - [vsco] skip "invalid" entities - improve functions to load/save cookies.txt files (#586) Removals -------- - [yaplog] remove module
gallery-dl: Update to 1.12.3 1.12.3 ------ ### Additions - [hentaifoundry] extract more metadata (#565) - [twitter] add option to extract TwitPic embeds (#579) - implement a post-processor module to compare file versions (#530) ### Fixes - [hitomi] update image URL generation - [mangadex] revert domain to `mangadex.org` - [pinterest] improve detection of invalid pin.it links - [pixiv] update URL patterns for user profiles and bookmarks (#568) - [twitter] Fix stop before real end (#573) - remove temp files before downloading from fallback URLs ### Removals - [erolord] remove extractor
gallery-dl: Update to 1.12.2 Changes: 1.12.2 ------ ### Additions - [deviantart] match new search/popular URLs (#538) - [deviantart] match `/favourites/all` URLs (#555) - [deviantart] add extractor for followed users (#515) - [pixiv] support listing followed users (#515) - [imagefap] handle beta.imagefap.com URLs (#552) - [postprocessor:metadata] add `directory` option (#520) ### Fixes - [artstation] fix search result pagination (#537) - [directlink] send Referer headers (#536) - [exhentai] restrict default directory name length (#545) - [mangadex] change domain to mangadex.cc (#559) - [mangahere] send `isAdult` cookies (#556) - [newgrounds] fix tags metadata extraction - [pixiv] retry after rate limit errors (#535) - [twitter] handle quoted tweets (#526) - [twitter] handle API rate limits (#526) - [twitter] fix URLs forwarded to youtube-dl (#540) - prevent infinite recursion when spawning new extractors (#489) - improve output of `--list-keywords` for "parent" extractors (#548) - provide fallback for SQLite versions with missing `WITHOUT ROWID` support (#553)
gallery-dl: Update to 1.12.1 Changes: ### Additions - [4chan] add extractor for entire boards (#510) - [realbooru] add extractors for pools, posts, and tag searches (#514) - [instagram] implement a `videos` option (#521) - [vsco] implement a `videos` option - [postprocessor:metadata] implement a `bypost` option for downloading the metadata of an entire post (#511) ### Changes - [reddit] change the default value for `comments` to `0` - [vsco] improve image resolutions - make filesystem-related errors during file downloads non-fatal (#512) ### Fixes - [foolslide] add fallback for chapter data extraction - [instagram] ignore errors during post-page extraction - [patreon] avoid errors when fetching user info (#508) - [patreon] improve URL pattern for single posts - [reddit] fix errors with `t1` submissions - [vsco] fix user profile extraction … again - [weibo] handle unavailable/deleted statuses - [downloader:http] improve rate limit handling - retain trailing zeroes in Cloudflare challenge answers
gallery-dl: Update to 1.12.0 Changes: 1.12.0 ------ ### Additions - [flickr] support 3k, 4k, 5k, and 6k photo sizes (#472) - [imgur] add extractor for subreddit links (#500) - [newgrounds] add extractors for `audio` listings and general `media` files (#394) - [newgrounds] implement login support (#394) - [postprocessor:metadata] implement a `extension-format` option (#477) - `--exec-after` ### Changes - [deviantart] ensure consistent username capitalization (#455) - [directlink] split `{path}` into `{path}/{filename}.{extension}` - [twitter] update metadata fields with user/author information - [postprocessor:metadata] filter private entries & rename `format` to `content-format` - Enable `cookies-update` by default ### Fixes - [2chan] fix metadata extraction - [behance] get images from 'media_collection' modules - [bobx] fix image downloads by randomly generating session cookies (#482) - [deviantart] revert to getting download URLs from OAuth API calls (#488) - [deviantart] fix URL generation from '/extended_fetch' results (#505) - [flickr] adjust OAuth redirect URI (#503) - [hentaifox] fix extraction - [imagefap] adapt to new image URL format - [imgbb] fix error in galleries without user info (#471) - [instagram] prevent errors with missing 'video_url' fields (#479) - [nijie] fix `date` parsing - [pixiv] match new search URLs (#507) - [plurk] fix comment pagination - [sexcom] send specific Referer headers when downloading videos - [twitter] fix infinite loops (#499) - [vsco] fix user profile and collection extraction (#480) - Fix Cloudflare DDoS protection bypass ### Removals - `--abort-on-skip`
gallery-dl: Update to 1.11.1 Changes: 1.11.1 ====== ### Fixes - Fix inclusion of bash completion and man pages in source distributions 1.11.0 ====== ### Additions - Support for - `blogger` (#364) - `nozomi` (#388) - `issuu` (#413) - `naver` (#447) - Extractor for `twitter` search results (#448) - Extractor for `deviantart` user profiles with configurable targets (#377, #419) - `--ugoira-conv-lossless` (#432) - `cookies-update` option to allow updating cookies.txt files (#445) - Optional `cloudflare` and `video` installation targets (#460) - Allow executing commands with the `exec` post-processor after all files are downloaded (#413, #421) ### Changes - Rewrite `imgur` using its public API (#446) - Rewrite `luscious` using GraphQL queries (#457) - Adjust default `nijie` filenames to match `pixiv` - Change enumeration index for gallery extractors from `page` to `num` - Return non-zero exit status when errors occurred - Forward proxy settings to youtube-dl downloader - Install bash completion script into `share/bash-completion/completions` ### Fixes - Adapt to new `instagram` page layout when logged in (#391) - Support protected `twitter` videos (#452) - Extend `hitomi` URL pattern and fix gallery extraction - Restore OAuth2 authentication error messages - Miscellaneous fixes for `patreon` (#444), `deviantart` (#455), `sexcom` (#464), `imgur` (#467), `simplyhentai`
gallery-dl: Update to 1.10.6 Changes: 1.10.6 ------ # Additions - `--exec` command-line option to specify a command to run after each file download (#421) # Changes - Include titles in `gfycat` default filenames (#434) # Fixes - Fetch working download URLs for `deviantart` (#436) - Various fixes and improvements for `yaplog` blogs (#443) - Fix image URL generation for `hitomi` galleries - Miscellaneous fixes for `behance` and `xvideos`
gallery-dl: Update to 1.10.5 Changes: 1.10.5 ------ ### Additions - `instagram.highlights` option to include highlighted stories when downloading user profiles (#329) - Support for `/user/` URLs on `reddit` (#350) - Support for `imgur` user profiles and favorites (#420) - Additional metadata fields on `nijie`(#423) ### Fixes - Improve handling of private `deviantart` artworks (#414) and 429 status codes (#424) - Prevent fatal errors when trying to open download-archive files (#417) - Detect and ignore unavailable videos on `weibo` (#427) - Update the `scope` of new `reddit` refresh-tokens (#428) - Fix inconsistencies with the `reddit.comments` option (#429) - Extend URL patterns for `hentaicafe` manga and `pixiv` artworks - Improve detection of unavailable albums on `luscious` and `imgbb` - Miscellaneous fixes for `tsumino`
gallery-dl: Update to 1.10.4 Changes: 1.10.4 ------ ### Additions - Support for - `lineblog` (#404) - `fuskator` (#407) - `ugoira` option for `danbooru` to download pre-rendered ugoira animations (#406) ### Fixes - Download the correct files from `twitter` replies (#403) - Prevent crash when trying to use unavailable downloader modules (#405) - Fix `pixiv` authentication (#411) - Improve `exhentai` image limit checks - Miscellaneous fixes for `hentaicafe`, `simplyhentai`, `tumblr`
gallery-dl: Update to 1.10.3 Changes: 1.10.3 ------ ### Additions - Provide `filename` metadata for all `deviantart` files (#392, #400) - Implement a `ytdl.outtmpl` option to let youtube-dl handle filenames by itself (#395) - Support `seiga` mobile URLs (#401) ### Fixes - Extract more than the first 32 posts from `piczel` galleries (#396) - Fix filenames of archives created with `--zip` (#397) - Skip unavailable images and videos on `flickr` (#398) - Fix filesystem paths on Windows with Python 3.6 and lower (#402)
gallery-dl: Update to 1.10.2 Changes: 1.10.2 ====== ### Additions - Support for `instagram` stories and IGTV (#371, #373) - Support for individual `imgbb` images (#363) - `deviantart.quality` option to set the JPEG compression quality for newer images (#369) - `enumerate` option for `extractor.skip` (#306) - `adjust-extensions` option to control filename extension adjustments - `path-remove` option to remove control characters etc. from filesystem paths ### Changes - Rename `restrict-filenames` to `path-restrict` - Adjust `pixiv` metadata and default filename format (#366) - Set `filename` to `"{category}_{user[id]}_{id}{suffix}.{extension}"` to restore the old default - Improve and optimize directory and filename generation ### Fixes - Allow the `classify` post-processor to handle files with unknown filename extension (#138) - Fix rate limit handling for OAuth APIs (#368) - Fix artwork and scraps extraction on `deviantart` (#376, #392) - Distinguish between `imgur` album and gallery URLs (#380) - Prevent crash when using `--ugoira-conv` (#382) - Handle multi-image posts on `patreon` (#383) - Miscellaneous fixes for `*reactor`, `simplyhentai`
gallery-dl: Update to 1.10.1 Changes: 1.10.1 ------ ## Fixes - Restore functionality of both domains for `exhentai` extractors
gallery-dl: Update to 1.10.0 Changes: 1.10.0 ------ ### Warning - Prior to version 1.10.0 all cache files were created world readable (mode `644`) leading to possible sensitive information disclosure on multi-user systems. It is recommended to restrict access permissions of already existing files (`/tmp/.gallery-dl.cache`) with `chmod 600`. Windows users should not be affected. ### Additions - Support for - `vsco` (#331) - `imgbb` (#361) - `adultempire` (#340) - `restrict-filenames` option to create Windows-compatible filenames on any platform (#348) - `forward-cookies` option to control cookie forwarding to youtube-dl (#352) ### Changes - The default cache file location on non-Windows systems is now `$XDG_CACHE_HOME/gallery-dl/cache.sqlite3` or `~/.cache/gallery-dl/cache.sqlite3` - New cache files are created with mode `600` - `exhentai` extractors will always use `e-hentai.org` as domain ### Fixes - Logging into `exhentai` now collects more cookies than just `ipb_member_id` and `ipb_pass_hash` - Better handling of `exhentai` image limits and errors (#356, #360) - Try to prevent ZIP file corruption (#355) - Miscellaneous fixes for `behance`, `ngomik`
gallery-dl: Update to 1.9.0 Changes: 1.9.0 ----- ### Additions - Support for - `erolord` (#326) - Add login support for `instagram` (#195) - Add `--no-download` and `extractor.*.download` disable file downloads (#220) - Add `-A/--abort` to specify the number of consecutive download skips before aborting - Interpret `-1` as infinite retries (#300) - Implement custom log message formats per log-level (#304) - Implement an `mtime` post-processor that sets file modification times according to metadata fields (#332) - Implement a `twitter.content` option to enable tweet text extraction (#333, #338) - Enable `date-min/-max/-format` options for `tumblr` (#337) ### Changes - Set file modification times according to their `Last-Modified` header when downloading (#236, #277) - Use `--no-mtime` or `downloader.*.mtime` to disable this behavior - Duplicate download URLs are no longer silently ignored (controllable with `extractor.*.image-unique`) - Deprecate `--abort-on-skip` ### Fixes - Retry downloads on OpenSSL exceptions (#324) - Ignore unavailable pins on `sexcom` instead of raising an exception (#325) - Use Firefox's SSL/TLS ciphers to prevent Cloudflare CAPTCHAs (#342) - Improve folder name matching on `deviantart` (#343) - Forward cookies to `youtube-dl` to allow downloading private videos - Miscellaneous fixes for `35photo`, `500px`, `newgrounds`, `simplyhentai`
gallery-dl: Update to 1.8.7 Changes: 1.8.7 ----- Additions: - Support for - `vanillarock` (#254) - `nsfwalbum` (#287) - `artist` and `tags` metadata for `hentaicafe` (#238) - `description` metadata for `instagram` (#310) - Format string option to replace a substring with another - `R<old>/<new>/` (#318) Changes: - Delete empty archives created by the `zip` post-processor (#316) Fixes: - Handle `hitomi` Game CG galleries correctly (#321) - Miscellaneous fixes for `deviantart`, `hitomi`, `pururin`, `kissmanga`, `keenspot`, `mangoxo`, `imagefap`
gallery-dl: Update to 1.8.6 Changes: 1.8.6 ----- ### Additions - Support for - `slickpic` (#249) - `xhamster` (#281) - `pornhub` (#282) - `8muses` (#305) - `extra` option for `deviantart` to download Sta.sh content linked in description texts (#302) ### Changes - Detect `directlink` URLs with upper case filename extensions (#296) ### Fixes - Improved error handling for `tumblr` API calls (#297) - Fixed extraction of `livedoor` blogs (#301) - Fixed extraction of special `deviantart` Sta.sh items (#307) - Fixed pagination for specific `keenspot` comics
gallery-dl: Update to 1.8.5 Changes: 1.8.5 ----- ### Additions - Support for - `keenspot` (#223) - `sankakucomplex` (#258) - `folders` option for `deviantart` to add a list of containing folders to each file's metadata (#276) - `captcha` option for `kissmanga` and `readcomiconline` to control CAPTCHA handling (#279) - `filename` metadata for files downloaded with youtube-dl (#291) ### Changes - Adjust `wallhaven` extractors to new page layout: - use API and add `api-key` option - removed traditional login support - Provide original filenames for `patreon` downloads (#268) - Use e-hentai.org or exhentai.org depending on input URL (#278) ### Fixes - Fix pagination over `sankaku` popular listings (#265) - Fix folder and collection extraction on `deviantart` (#271) - Detect "AreYouHuman" redirects on `readcomiconline` (#279) - Miscellaneous fixes for `hentainexus`, `livedoor`, `ngomik`
gallery-dl: Update to 1.8.4 Changes: ### Additions - Support for - `patreon` (#226) - `hentainexus` (#256) - `date` metadata fields for `pixiv` (#248), `instagram` (#250), `exhentai`, and `newgrounds` ### Changes - Improved `flickr` metadata and video extraction (#246) ### Fixes - Download original GIF animations from `deviantart` (#242) - Ignore missing `edge_media_to_comment` fields on `instagram` (#250) - Fix serialization of `datetime` objects for `--write-metadata` (#251, #252) - Allow multiple post-processor command-line options at once (#253) - Prevent crash on `booru` sites when no tags are available (#259) - Fix extraction on `instagram` after `rhx_gis` field removal (#266) - Avoid Cloudflare CAPTCHAs for Python interpreters built against OpenSSL < 1.1.1 - Miscellaneous fixes for `luscious`
gallery-dl: Update to 1.8.3 Changes: 1.8.3 ----- ### Additions - Support for - `plurk` (#212) - `sexcom` (#147) - `--clear-cache` - `date` metadata fields for `deviantart`, `twitter`, and `tumblr` (#224, #232) ### Changes - Standalone executables are now built using PyInstaller: - uses the latest CPython interpreter (Python 3.7.3) - available on several platforms (Windows, Linux, macOS) - includes the `certifi` CA bundle, `youtube-dl`, and `pyOpenSSL` on Windows ### Fixes - Patch `urllib3`'s default list of SSL/TLS ciphers to prevent Cloudflare CAPTCHAs (#227) - Windows users need to install `pyOpenSSL` for this to take effect - Provide fallback URLs for `twitter` images (#237) - Send `Referer` headers when downloading from `hitomi` (#239) - Updated login procedure on `mangoxo`
PKGREVISION bump for anything using python without a PYPKGPREFIX. This is a semi-manual PKGREVISION bump.
gallery-dl: Update to 1.8.2 pkgsrc changes: - Configuration files and man pages were accidentally installed in etc/ and share/man. Add a SUBST_SED in order to avoid hard-coded paths and install bash completions in share/bash_completions.d. Changes: 1.8.2 ===== Additions --------- - Support for - `pixnet` (#177) - `wikiart` (#179) - `mangoxo` (#184) - `yaplog` (#190) - `livedoor` (#190) - Login support for `mangoxo` (#184) and `twitter` (#214) Changes ------- - Increased required `Requests` version to 2.11.0 Fixes ----- - Improved image quality on `reactor` sites (#210) - Support `imagebam` galleries with more than 100 images (#219) - Updated Cloudflare bypass code
gallery-dl: Update to 1.8.1 Changes: 1.8.1 ----- ### Added - Support for: - `35photo` (#162) - `500px` (#185) - `instagram` extractor for hashtags (#202) - Option to get more metadata on `deviantart` (#189) - Man pages and bash completion (#150) - Snap improvements (#197, #199, #207) ### Changed - Metadata for `luscious` albums - FFmpeg arguments for `--ugoira-conv` ### Fixed - `tumblr` avatar URLs when not using OAuth1.0 (#193) - `instagram` multi-image posts (#178, #201) - Miscellaneous issues on `exhentai`, `komikcast`
gallery-dl: Update to 1.8.0 Changes: 1.8.0 ----- ### Added - Support for: - `weibo` - `pururin` (#174) - `fashionnove` (#175) - `shopify` sites in general (#175) - Snap packaging (#169, #170, #187, #188) - Automatic Cloudflare DDoS protection bypass - Extractor and Job information for logging format strings - `dynastyscans` image and search extractors (#163) - `deviantart` scraps extractor (#168) - `artstation` extractor for artwork listings (#172) - `smugmug` video support and improved image format selection (#183) ### Changed - More metadata for `nhentai` galleries - Combined `myportfolio` extractors into one - Renamed `name` metadata field to `filename` and removed the original `filename` field - Simplified and improved internal data structures - Optimized creation of child extractors ### Fixed - Filter empty `tumblr` URLs (#165) - Filter ads and improve connection speed on `hentaifoundry` - Show proper error messages if `luscious` galleries are unavailable - Miscellaneous issues on `mangahere`, `ngomik`, `simplyhentai`, `imgspice` ### Removed - `seaotterscans`
gallery-dl: Update to 1.7.0 Changes: 1.7.0 ----- - Added support for: - `photobucket` (#117) - `hentaifox` (#160) - `tsumino` (#161) - Added the ability to dynamically generate extractors based on a user's config file for - `mastodon` instances (#144) - `foolslide` based sites - `foolfuuka` based archives - Added an extractor for `behance` collections (#157) - Added login support for `luscious` (#159) and `tsumino` (#161) - Added an option to stop downloading if the `exhentai` image limit is exceeded (#141) - Fixed extraction issues for `behance` and `mangapark`
gallery-dl: Update to 1.6.3 Changes: 1.6.3 ----- - Added `metadata` post-processor to write image metadata to an external file (#135) - Added option to reverse chapter order of manga extractors (#149) - Added authentication support for `danbooru` (#151) - Added tag metadata for `exhentai` and `hbrowse` galleries - Improved `*reactor` extractors (#148) - Fixed extraction issues for `nhentai` (#156), `pinterest`, `mangapark`
gallery-dl: Update to 1.6.2 Changes: 1.6.2 ----- - Added support for: - `instagram` - https://www.instagram.com (#134) - Added support for multiple items on sta.sh pages (#113) - Added option to download `tumblr` avatars (#137) - Changed defaults for visited post types and inline media on `tumblr` - Improved inline extraction of `tumblr` posts (#133, #137) - Improved error handling and retry behavior of all API calls - Improved handling of missing fields in format strings (#136) - Fixed hash extraction for unusual `tumblr` URLs (#129) - Fixed image subdomains for `hitomi` galleries (#142) - Fixed and improved miscellaneous issues for `kissmanga` (#20), `luscious`, `mangapark`, `readcomiconline`
gallery-dl: Update net/gallery-dl to 1.6.1 Changes: 1.6.1 ----- - Added support for: - `joyreactor` (#114) - `pornreactor` (#114) - `newgrounds` (#119) - Added extractor for search results on `luscious` (#127) - Fixed filenames of ZIP archives (#126) - Fixed extraction issues for `gfycat`, `hentaifoundry` (#125), `mangafox`
gallery-dl: Update net/gallery-dl to 1.6.0 Changes: 1.6.0 ----- - Add wallhaven extractor - Add yuki extractor - Add a ytdl (youtube-dl) downloader to download media via youtube-dl (Unfortunately at the moment youtube-dl package is not a multipackage (we do not have py{27,34,35,37}-youtube-dl so this will work only if youtube-dl was built with the same PYTHON_VERSION_DEFAULT of gallery-dl)) - Add '--no-check-certificate' command-line option - Misc bug fixes and improvements
gallery-dl: Add dependency to sqlite3
gallery-dl: Update net/gallery-dl to 1.5.3 Changes: 1.5.3 ----- - Added support for: + hentaicafe - https://hentai.cafe/ (#101) + bobx - http://www.bobx.com/dark/ - Added black-/whitelist options for post-processor modules - Added support for tumblr inline videos (#102) - Fixed extraction of smugmug albums without owner (#100) - Fixed issues when using default config values with reddit extractors (#104) - Fixed pagination for user favorites on sankaku (#106) • Fixed a crash when processing deviantart journals (#108)
gallery-dl: Update net/gallery-dl to 1.5.2 Changes: 1.5.2 ----- - Added support for `twitter` timelines - Added option to suppress FFmpeg output during ugoira conversions - Improved filename formatter performance - Improved inline image quality on `tumblr` - Fixed image URLs for newly released `mangadex` chapters - Fixed a smaller issue with `deviantart` journals - Replaced `subapics` with `ngomik`
gallery-dl: Update net/gallery-dl to 1.5.1 Changes: 1.5.1 ----- - Added support for: * `piczel` - https://piczel.tv/ - Added support for related pins on `pinterest` - Fixed accessing "offensive" galleries on `exhentai` (#97) - Fixed extraction issues for `mangadex`, `komikcast` and `behance` - Removed original-image functionality from `tumblr`, since "raw" images are no longer accessible
gallery-dl: Update net/gallery-dl to 1.5.0 Changes: 1.5.0 ----- - Added support for: - `behance` - https://www.behance.net/ - `myportfolio` - https://www.myportfolio.com/ (#95) - Added custom format string options to handle long strings (#92, #94) - Slicing: `"{field[10:40]}"` - Replacement: `"{field:L40/too long/}"` - Improved frame rate handling for ugoira conversions - Improved private access token usage on `deviantart` - Fixed metadata extraction for some images on `nijie` - Fixed chapter extraction on `mangahere` - Removed `whatisthisimnotgoodwithcomputers` - Removed support for Python 3.3
gallery-dl: Update net/gallery-dl to 1.4.2 Changes: 1.4.2 ----- - Added image-pool extractors for safebooru and rule34 - Added option for extended tag information on booru sites (#92) - Added support for DeviantArt's new URL format - Added support for mangapark mirrors - Changed imagefap extractors to use HTTPS - Fixed crash when skipping downloads for files without known extension
gallery-dl: Update net/gallery-dl to 1.4.1 Changes: 1.4.1 ----- - Added an ugoira post-processor to convert pixiv animations to WebM - Added --zip and --ugoira-conv command-line options - Changed how ugoira frame information is handled * instead of being written to a separate file, it is now made available as metadata field of the ZIP archive - Fixed manga and chapter titles for mangadex - Fixed file deletion by post-processors
gallery-dl: Update net/gallery-dl to 1.4.0 Changes: 1.4.0 ----- * Added support for: - `simplyhentai` (#89) * Added extractors for - `pixiv` search results and followed users - `deviantart` search results and popular listings * Added post-processors to perform actions on downloaded files * Added options to configure logging behavior * Added OAuth support for `smugmug` * Changed `pixiv` extractors to use the AppAPI, this breaks `favorite` archive IDs and changes some metadata fields * Changed the default filename format for `tumblr` and renamed `offset` to `num` * Fixed a possible UnicodeDecodeError during installation (#86) * Fixed extraction of `mangadex` manga with more than 100 chapters (#84) * Fixed miscellaneous issues for `imgur`, `reddit`, `komikcast`, `mangafox` and `imagebam`
gallery-dl: Update net/gallery-dl to 1.3.5 Changes: 1.3.5 ----- - Added support for: * smugmug - https://www.smugmug.com/ - Added title information for mangadex chapters - Improved the pinterest API implementation (#83) - Improved error handling for deviantart and tumblr - Removed gomanga and puremashiro
gallery-dl: Update net/gallery-dl to 1.3.4 Changes: 1.3.4 ----- * Added support for custom OAuth2 credentials for `pinterest` * Improved rate limit handling for `tumblr` extractors * Improved `hentaifoundry` extractors * Improved `imgur` URL patterns * Fixed miscellaneous extraction issues for `luscious` and `komikcast` * Removed `loveisover` and `spectrumnexus`
gallery-dl: Update net/gallery-dl to 1.3.3 Changes: ## 1.3.3 - 2018-04-06 - Added extractors for * `nhentai` search results * `exhentai` search results and favorites * `nijie` doujins and favorites - Improved metadata extraction for `exhentai` and `nijie` - Improved `tumblr` extractors by avoiding unnecessary API calls - Fixed Cloudflare DDoS protection bypass - Fixed errors when trying to print unencodable characters
gallery-dl: Update net/gallery-dl to 1.3.2 Changes: 1.3.2 ----- * Added extractors for `artstation` albums, challenges and search results * Improved URL and metadata extraction for `hitomi`and `nhentai` * Fixed page transitions for `danbooru` API results (#82)
gallery-dl: Update net/gallery-dl to 1.3.1 Changes: 1.3.1 ----- * Added support for: - `mangadex` - `artstation` * Added Cloudflare DDoS protection bypass to `komikcast` extractors * Changed archive ID formats for `deviantart` folders and collections * Improved error handling for `deviantart` API calls * Removed `imgchili` and various smaller image hosts
gallery-dl: Update net/gallery-dl to 1.3.0 Changes: 1.3.0 ----- * Added `--proxy` to explicitly specify a proxy server (#76) * Added options to customize archive ID formats and undefined replacement fields * Changed various archive ID formats to improve their behavior for favorites / bookmarks / etc. * Affected modules are `deviantart`, `flickr`, `tumblr`, `pixiv` and all ...boorus * Improved `sankaku` and `idolcomplex` support by * respecting `page` and `next` URL parameters (#79) * bypassing the page-limit for unauthenticated users * Improved `directlink` metadata by properly unquoting it * Fixed `pixiv` ugoira extraction (#78) * Fixed miscellaneous extraction issues for `mangastream` and `tumblr` * Removed `yeet`, `chronos`, `coreimg`, `hosturimage`, `imageontime`, `img4ever`, `imgmaid`, `imgupload`
gallery-dl: Update net/gallery-dl to 1.2.0 Changes: 1.2.0 ----- * Added support for: - `paheal` (#69) - `komikcast` (#70) - `subapics` (#70) * Added `--download-archive` to record downloaded files in an archive file * Added `--write-log` to write logging output to a file * Added a filetype check on download completion to fix incorrectly assigned filename extensions (#63) * Added the `tumblr:...` pseudo URI scheme to support custom domains for Tumblr blogs (#71) * Added fallback URLs for `tumblr` images (#64) * Added support for `reddit`-hosted images (#68) * Improved the input file format by allowing comments and per-URL options * Fixed OAuth 1.0 signature generation for Python 3.3 and 3.4 (#75) * Fixed smaller issues for `luscious`, `hentai2read`, `hentaihere` and `imgur` * Removed the `batoto` module
gallery-dl: Update net/gallery-dl to 1.1.2 Changes: 1.1.2 ----- * Added support for: * `puremashiro` (#66) * `idolcomplex` * Added an option to filter reblogs on `tumblr` (#61) * Added OAuth user authentication for `tumblr` (#65) * Added support for `slideshare` mobile URLs (#67) * Improved pagination for various ...booru sites to work around page limits * Fixed chapter information parsing for certain manga on `kissmanga` (#58) and `batoto` (#60)
gallery-dl: Update net/gallery-dl to 1.1.1 Changes: 1.1.1 ----- * Added support for: `slideshare` - <https://www.slideshare.net/> (#54) * Added pool- and post-extractors for `sankaku` * Added OAuth user authentication for `deviantart` * Updated `luscious` to support `members.luscious.net` URLs (#55) * Updated `mangahere` to use their new domain name (mangahere.cc) and mobile URLs * Updated `gelbooru` to not be restricted to the first 20,000 images (#56) * Fixed extraction issues for `nhentai` and `khinsider`
gallery-dl: Update net/gallery-dl to 1.1.0 Changes: 1.1.0 ----- * Added the `-r/--limit-rate` command-line option to set a maximum download rate * Added the `--sleep` command-line option to specify the number of seconds to sleep before each download * Updated `gelbooru` to no longer use their now disabled API * Fixed SWF extraction for `sankaku` (#52) * Fixed extraction issues for `hentai2read` and `khinsider` * Removed the deprecated `--images` and `--chapters` options * Removed the `mangazuki` module
gallery-dl: Update net/gallery-dl to 1.0.2 Changes: 1.0.2 ----- * Added an option to set a custom user-agent string * Improved retry behavior for failed HTTP requests * Improved `seiga` by providing better metadata and getting more than the latest 200 images * Improved `tumblr` by adding support for all post types, scanning for inline images and following external links] (#48) * Fixed extraction issues for `hbrowse`, `khinsider` and `senmanga`
gallery-dl: Update net/gallery-dl to 1.0.1 Changes: - Added support for: xvideos (#45) - Fixed exception handling during file downloads which could lead to a premature exit - Fixed an issue with tumblr where not all images would be downloaded when using tags (#48) - Fixed extraction issues for imgbox (#47), mangastream (#49), and mangahere
gallery-dl: Update net/gallery-dl to 1.0.0 Changes: 1.0.0 ----- - Add `--cookies' option to load further cookies from a file - Remove `kisscomic' module, image links on the site are dead - Remove `yonkouprod' module, every manga chapter on the site were removed - Add thread extractor to `warosu' module - Add extractor for ranking lists to `pixiv' module - Add extractors for "Popular" images to `booru' module - Add `--filter' option to allow image filtering via Python expressions - Rename `--images' and `--chapters' options to `--range' and `--chapter-range' - Misc bug fixes and improvements
Import gallery-dl-0.9.1 as net/gallery-dl gallery-dl is a command-line program to download image galleries and image collections from several image hosting sites. Originally packaged in pkgsrc-wip by myself.