kumi/yt-dlp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
21951 commits 1 branch 0 tags 49 MiB
Commit graph

279 commits

Author SHA1 Message Date
coletdjnz
d3a3d7f0cc
[extractor/JWPlatform] Fix extractor (#5112) 
Fix bitrate and filesize extraction and support embeds with unquoted urls.

Related: #5106 

Authored by: coletdjnz
 2022-10-03 19:37:48 +00:00
pukkandan
8b7fb8b60d
[extractor] Make search_json able to parse lists 
Now `contains_pattern` can be set to `\[.+\]`
 2022-10-03 16:56:19 +05:30
nixxo
81b6102d20
[downloader/ism] Support ec-3 codec (#5004) 
Closes #296
Authored by: nixxo
 2022-09-30 23:03:29 +05:30
pukkandan
0f60ba6e65
[extractor] Improve json+ld extraction 
Related #5035
 2022-09-27 02:36:57 +05:30
pukkandan
2fa669f759
[docs] Misc improvements 
Closes #4987, Closes #4906, Closes #4919, Closes #4977, Closes #4979
 2022-09-22 02:15:55 +05:30
pukkandan
8ca48a1a54
[extractor] Fix fatal=False in RetryManager 2022-09-22 02:14:31 +05:30
Simon Sawicki
8817a80d3a
[cookies] Parse cookies leniently (#4780) 
Closes #4776, #3778
Authored by: Grub4K
 2022-09-16 22:32:00 +05:30
pukkandan
2314b4d89f
Allow plugin extractors to replace the built-in ones 
This allows easier plugin chaining; e.g.
- https://gist.github.com/pukkandan/24f13ff1ed385c5a390c1d7bd130d8f7
- https://gist.github.com/pukkandan/fcf5ca1785c80f64e471f0ee14f990fb
 2022-09-16 17:02:52 +05:30
pukkandan
0cb0fdbbfe
[extractor/common] Escape % in representation_id of m3u8 
Closes #4877
 2022-09-10 03:42:14 +05:30
pukkandan
17ffed1842
[docs] Improvements 
* Move detailed installation instructions to https://github.com/yt-dlp/yt-dlp/wiki/Installation
* Link to wiki where applicable
* Fix some mistakes. Closes #4853, Closes #4855, Closes #4852
* Improve some error messages
 2022-09-07 17:38:05 +05:30
pukkandan
d2c8aadf79
[cleanup] Misc 
Closes #4710, Closes #4754, Closes #4723
Authored by: pukkandan, MrRawes, DavidH-2022
 2022-09-01 16:49:03 +05:30
pukkandan
f2e9fa3ef7
[FormatSort] Fix aext for --prefer-free-formats 
Closes #4735
 2022-09-01 16:46:31 +05:30
Lesmiscore
bfbecd1174
[extractor/newspicks] Add extractor (#4725) 
Authored by: Lesmiscore
 2022-08-31 02:07:55 +09:00
pukkandan
da4db748fa
[utils] Add deprecation_warning 
See https://github.com/yt-dlp/yt-dlp/pull/2173#issuecomment-1097021515
 2022-08-30 21:03:07 +05:30
pukkandan
fe7866d0ed
Add option --use-extractors 
Deprecates `--force-generic-extractor`

Closes #3234, Closes #2044

Related: #4307, #1791
 2022-08-24 07:47:51 +05:30
Lesmiscore
62b58c0936
[docs] Consistent use of e.g. (#4643) 
Authored by: Lesmiscore
 2022-08-14 17:34:13 +05:30
pukkandan
7e798d725e
[extractor] Fix format sorting of channels 2022-08-11 07:23:46 +05:30
pukkandan
b8ed0f15d4
[extractor] Add field audio_channels 2022-08-08 01:35:36 +05:30
pukkandan
0647d9251f
Minor bugfixes 2022-08-02 03:52:23 +05:30
pukkandan
be5c1ae862
Standardize retry mechanism (#1649) 
* [utils] Create `RetryManager`
* Migrate all retries to use the manager
* [extractor] Add wrapper methods for convenience
* Standardize console messages for retries
* Add `--retry-sleep` for extractors
 2022-08-02 01:43:18 +05:30
pukkandan
bfd973ece3 [extractors] Use new framework for existing embeds (#4307) 
`Brightcove` is difficult to migrate because it's subclasses may depend
on the signature of the current functions. So it is left as-is for now

Note: Tests have not been migrated
 2022-08-02 01:08:16 +05:30
pukkandan
1e8fe57e5c [extractor] Support multiple archive ids for one video (#4307) 
Closes #4352
 2022-08-02 01:08:16 +05:30
pukkandan
f2e8dbcc00 [extractor, test] Basic framework for embed tests (#4307) 
and split download tests so they can be more easily run in CI

Authored by: coletdjnz
 2022-08-02 01:08:16 +05:30
pukkandan
8f97a15d1c [extractor] Framework for embed detection (#4307) 2022-08-02 01:08:16 +05:30
lazypete365
e325a21a1f
[extractor/youtube] Add live_status=post_live (#4495) 
Related: https://github.com/yt-dlp/yt-dlp/issues/1564
Authored by: lazypete365
 2022-08-01 01:42:04 +05:30
pukkandan
b79f9e302d
--compat-option no-live-chat should disable danmaku 
Closes #4387
 2022-07-19 15:29:28 +05:30
pukkandan
6929b41a21
Remove Python 3.6 support 
Closes #3764
 2022-07-18 06:31:14 +05:30
pukkandan
c6e07cf1e1
[cleanup] Misc 2022-07-18 05:14:55 +05:30
pukkandan
6edf28081f
[extractor] Passthrough errnote=False to parsing 2022-07-15 16:10:47 +05:30
Tim Weber
eb2333bce1
[extractor/StarTrek] Add extractor (#4191) 
Authored by: scy
 2022-07-13 23:59:44 +05:30
ftk
45e8a04e48
[extractor/youtube] More metadata for storyboards (#4334) 
Authored by: ftk
 2022-07-12 20:46:45 +05:30
pukkandan
47046464fa
[extractor] Fix empty BaseURL in MPD 
Closes #4113
 2022-06-29 06:43:26 +05:30
crazymoose77756
962ffcf89c
[cleanup] Fix some typos (#4194) 
Authored by: crazymoose77756
 2022-06-26 17:50:06 -07:00
pukkandan
c043c24625
[extractor] Fix _create_request when headers is None 
Closes #4164
 2022-06-25 19:41:22 +05:30
pukkandan
14f25df2b6
[compat] Remove deprecated functions from core code 2022-06-25 00:14:12 +05:30
pukkandan
54007a45f1
[cleanup] Consistent style for file heads 2022-06-25 00:08:58 +05:30
pukkandan
ac66811112
[compat] Remove more functions 
Removing any more will require changes to a large number of extractors
 2022-06-25 00:08:55 +05:30
pukkandan
9809740ba5
[extractor, cleanup] Reduce direct use of _downloader 2022-06-23 09:57:26 +05:30
pukkandan
0c36dc00d7
[extractor/npr] Implement e50c3500b4 differently 
Closes #4141
 2022-06-23 01:46:49 +05:30
pukkandan
3975b4d2e8
Allow extractors to specify section_start/end for clips 2022-06-22 02:44:28 +05:30
pukkandan
612f2be5d3
Bugfix for 7b2c3f47c6 2022-06-20 12:03:35 +05:30
pukkandan
7b2c3f47c6
[cleanup] Misc 2022-06-20 11:44:55 +05:30
pukkandan
8072ef2bbd
[extractor/BiliIntl] Fix metadata extraction 
Closes #4116
 2022-06-20 03:05:46 +05:30
coletdev
f0bc6e2019
[extractor] Add default parameter to _search_json (#4057) 
Authored by: pukkandan, coletdjnz
 2022-06-18 17:55:18 -07:00
pukkandan
a70635b8a1
[cleanup, utils] Don't use kwargs for format_field 2022-06-18 08:13:22 +05:30
christoph-heinrich
e121e3cee7
[cleanup] Minor fixes (#4096) 
Authored by: christoph-heinrich
 2022-06-17 18:57:22 -07:00
Evan Spensley
145c5a83a8
[extractor/GoogleDrive] Add folder extractor (#4009) 
Closes #3388
Authored by: evansp, pukkandan
 2022-06-14 06:33:29 -07:00
pukkandan
f3c0c77304
[extractor] Handle json_ld with multiple @types 
Closes: #4022
 2022-06-13 19:12:34 +05:30
pukkandan
56ba69e4c9
[cleanup] Misc fixes 
Closes #4027
 2022-06-11 05:00:12 +05:30
Aurélien Grosdidier
d05460e5fe
[extractor/FranceCulture] Fix extractor (#3874) 
Closes #3742
Authored by: aurelg, pukkandan
 2022-06-10 16:22:34 -07:00
pukkandan
b7c47b7438
[extractor] Add _search_json 
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
 2022-06-06 19:46:45 +05:30
Lesmiscore
0bea4fd807
[extractor/0000studio] Add extractors (#3959) 
Authored by: Lesmiscore
 2022-06-05 14:37:05 +09:00
pukkandan
1890fc6389
[cleanup] Misc fixes 
Cherry-picks from: #3498, #3947
Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
 2022-06-03 21:45:35 +05:30
pukkandan
c4910024f3
[extractor] Fix bug in 617f658b7e 
While the function signature don't enforce it, some IEs that override
`_download_webpage_handle` assume all optional arguments to be keyword-only

Closes #3954
 2022-06-03 17:25:20 +05:30
siddharth ravikumar
e50c3500b4
[extractor/npr] Use stream url from json-ld (#3455) 
Closes #1934
Authored by: r5d
 2022-06-02 17:51:11 -07:00
pukkandan
09d02ea429
[extractor] Fix bug in f95b9dee45 
Closes #3951
 2022-06-03 06:16:01 +05:30
pukkandan
f95b9dee45
[extractor] Add dev option --load-pages 2022-06-01 02:03:22 +05:30
pukkandan
617f658b7e
[extractor, cleanup] Refactor _download_... methods 2022-06-01 01:57:16 +05:30
Lesmiscore
222a230871
[extractor/common] Recognize src attribute from HTML5 media elements (#3899) 
Authored by: Lesmiscore
 2022-05-29 22:48:04 +09:00
coletdjnz
ee27297f82
[extractor/youtube] Fix initial player response extraction 
Authored by: pukkandan, coletdjnz
 2022-05-29 19:54:22 +12:00
pukkandan
8a82af3511
[cleanup] Misc fixes and cleanup 
Closes #3780, Closes #3853, Closes #3850
 2022-05-27 04:43:43 +05:30
pukkandan
c487cf0010
[cleanup] Misc 2022-05-21 16:01:53 +05:30
pukkandan
2762dbb17e
[compat] Add functools.cached_property 2022-05-20 21:06:37 +05:30
pukkandan
21633673c3
[cleanup] Minor fixes 2022-05-18 09:04:30 +05:30
pukkandan
2414649192
[cleanup] Misc cleanup 2022-05-17 00:07:43 +05:30
pukkandan
82d020804d
[extractor] Use classmethod/property where possible 
and refactor lazy extractors accordingly.

This reduces the need to create extractor instances
 2022-05-13 00:23:26 +05:30
pukkandan
8dcce6a89c
[extractor] Document netrc machines 
Closes #3169
 2022-05-11 22:10:15 +05:30
pukkandan
d4736fdb43
Remove warning for videos with an empty title 2022-05-07 19:45:33 +05:30
pukkandan
3fe75fdc80
[cleanup] Misc fixes (see desc) 
* Do not warn when fixup is skipped for existing file
* [fragment] Fix `--skip-unavailable-fragments` for HTTP Errors
* [utils] write_string: Fix bug in 59f943cd50
* [utils] parse_codecs: Subtitle codec is generally referred to as `scodec`. https://github.com/yt-dlp/yt-dlp/pull/2174#discussion_r790156048
* [docs] Remove note about permissions. Closes #3597
 2022-05-01 04:58:38 +05:30
pukkandan
1d485a1a79
[cleanup] Misc fixes 
Closes #3565, https://github.com/yt-dlp/yt-dlp/issues/3514#issuecomment-1105944364
 2022-04-29 07:39:33 +05:30
pukkandan
0a5a191a2a
Improve --clean-infojson 
It should not removes fields that may be needed for `--load-infojson`.
Eg: `_ffmpeg_args`, `_has_drm`
 2022-04-28 20:04:40 +05:30
Elyse
a076c1f97a
[extractor] Update manifest_urls after redirect (#3575) 
Authored by: elyse0
 2022-04-27 15:50:01 -07:00
Elyse
779da8e31b
[extractor] Update dash manifest_url after redirects (#3563) 
Closes #2696 
Authored by: elyse0
 2022-04-27 11:01:35 -07:00
felix
77f9033095
[compat] Split into sub-modules (#2173) 
Authored by: fstirlitz, pukkandan
 2022-04-18 04:26:43 +05:30
pukkandan
f82711587c
[cleanup] Sort imports 
Using https://github.com/PyCQA/isort

    isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
 2022-04-12 05:32:52 +05:30
pukkandan
86e5f3ed2e
[cleanup] Upgrade syntax 
Using https://github.com/asottile/pyupgrade

1. `__future__` imports and `coding: utf-8` were removed
2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format`
3. f-strings were cherry-picked from `pyupgrade --py36-plus`

Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
 2022-04-12 05:32:51 +05:30
pukkandan
f9934b9614
[cleanup] Mark some compat variables for removal (#2173) 
Authored by fstirlitz, pukkandan
 2022-04-12 05:32:50 +05:30
felix
cfb0511d82
[cleanup] Remove unused code paths (#2173) 
Notes:

* `_windows_write_string`: Fixed in 3.6
  * https://bugs.python.org/issue1602
  * PEP: https://www.python.org/dev/peps/pep-0528

* Windows UTF-8 fix: Fixed in 3.3
  * https://bugs.python.org/issue13216

* `__loader__`: is always present in 3.3+
  * https://bugs.python.org/issue14646

* `workaround_optparse_bug9161`: Fixed in 2.7
  * https://bugs.python.org/issue9161

Authored by: fstirlitz
 2022-04-12 05:32:50 +05:30
coletdev
61d3665d9d
[youtube] Fix uploader for collaborative playlists (#3332) 
Authored by: coletdjnz
 2022-04-07 01:11:16 -07:00
pukkandan
a44ca5a470
[cleanup] Misc fixes 
Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117

Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, a825ffbffa (commitcomment-68538986), https://github.com/yt-dlp/yt-dlp/issues/2360, 5fa3c9a88f (r70393519), 5fa3c9a88f (r70393254)
 2022-04-05 18:12:18 +05:30
pukkandan
04f3fd2c89
[cleanup] Use _html_extract_title 2022-04-04 15:13:30 +05:30
Fam0r
fbfde1c3e6
[elonet] Rewrite extractor (#3277) 
Closes #2911
Authored by: Fam0r, pukkandan
 2022-04-03 08:11:50 -07:00
pukkandan
90137ca4be
[utils] Add filter_dict 2022-03-28 08:25:04 +05:30
pukkandan
ae6a1b9585
[docs] Minor improvements 
Closes #3127, Closes #3081, Closes #3177
 2022-03-24 07:30:25 +05:30
pukkandan
231025c463
Fix bug in 52efa4b312 
Closes #3173
 2022-03-24 07:28:10 +05:30
pukkandan
700ccbe3f1
[extractor] Allow control characters inside json 
Closes #3174
 2022-03-24 07:28:07 +05:30
pukkandan
52efa4b312
[extractor] Add _perform_login function (#2943) 
* Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API
* Adds `ie.supports_login` to the public API
 2022-03-18 13:53:33 -07:00
coletdjnz
a825ffbffa
[extractor] Support merging subtitles with data 
Authored-by: coletdjnz
 2022-03-12 11:22:28 +13:00
pukkandan
08d30158ec
[cleanup, docs] Misc cleanup 
Closes #2828, closes #2734, closes #2802, closes #2937
 2022-03-08 22:38:06 +05:30
pukkandan
497d2fab6c
[utils] Better traceback for ExtractorError 2022-03-08 12:04:49 +05:30
Zenon Mousmoulas
27231526ae
[ant1newsgr] Add extractor (#1982) 
Authored by: zmousm
 2022-03-04 13:52:48 -08:00
pukkandan
a10aa588b0
[FormatSort] Consider acodec=ogg as vorbis 2022-03-04 19:49:38 +05:30
pukkandan
7265a2190c
Fix doubling of video_id in ExtractorError 2022-03-04 19:37:43 +05:30
coletdev
ded9f32667
[extractor] Support --mark-watched without _NETRC_MACHINE (#2939) 
Authored by: coletdjnz
 2022-03-03 23:27:09 -08:00
Lesmiscore (Naoya Ozaki)
77cc7c6e60
[nhk] Add support for NHK for School (#2850) 
Authored by: Lesmiscore
 2022-02-23 01:15:08 +09:00
pukkandan
ffa89477ea
[extractor] Fix for manifests without period duration 
Closes #2705
Authored by: dirkf, pukkandan
 2022-02-17 19:07:23 +05:30
pukkandan
297e9952b6
[extractor] Allow http_headers to be specified for thumbnails 2022-02-11 23:31:12 +05:30
pukkandan
079a7cfc71
[downloader] Do not use aria2c for non-native m3u8 
Closes #2718
 2022-02-11 12:09:03 +05:30
pukkandan
455a15e2dc
[cleanup,docs] Minor fixes 
Closes #2541, #2484
 2022-02-03 21:00:39 +05:30
pukkandan
85553414ae
[generic] Allow further processing of json_ld URL 
Closes #2578
 2022-02-02 07:33:16 +05:30