Commit graph

18455 commits

Author SHA1 Message Date
lkho
1b8805f831 [duboku] add referer header 2020-09-07 21:03:39 +08:00
nixxo
d53fec697e
[mailru] fixed extraction
improved valid_url regex to match more urls like
>https://my.mail.ru/mail/7bw7/video/embed/_myvideo/6778
>https://videoapi.my.mail.ru/videos/embed/mail/7bw7/_myvideo/6778.html
previously not matched.

Fixed json extraction to download metadata and video url.
2020-09-07 14:21:21 +02:00
xarantolus
c4a1d0eef8 Merge branch 'fixYTSearch' of https://github.com/xarantolus/youtube-dl into fixYTSearch 2020-09-06 09:25:02 +02:00
xarantolus
bea9b00588 Fix regex for other variable declaration type
This now supports declarations like `window["ytInitialData"] = ...` and `var ytInitialData = ...`
2020-09-06 09:22:49 +02:00
xarantolus
f442082a50 [youtube] More general title extraction
Seems like this attribute is moved every few weeks, so we just extract both and use the one that is present.
2020-09-06 09:22:48 +02:00
xarantolus
1f93faf60b [youtube] Make ytcfg.set config extraction non-fatal
If the markup of the page changes in the future, it might be possible that _FEED_DATA still works, but the other regex does not. SInce it is not necessary for the first page of videos, we make sure the program doesn't exit before extracting them.

TL;DR: Extract the first video page even if there are problems
2020-09-06 09:22:47 +02:00
xarantolus
299056ad52 Fix python2 compatibility and title extraction 2020-09-06 09:22:47 +02:00
xarantolus
f536080701 Run formatter 2020-09-06 09:22:46 +02:00
xarantolus
5c430b67bd [youtube] Fix feed extraction
In order to extract videos from further pages, we need to get various variables that are in an argument to the `ytcfg.set` call in a script on the feed page.
2020-09-06 09:22:46 +02:00
xarantolus
e03b4f3e05 [youtube] Make search extraction less dependent on json schema.
If an object looks like a video (it has a `videoId` key), assume that it is.
2020-09-06 09:22:30 +02:00
xarantolus
19f671f88b [youtube] Move search URL extraction to appropriate extractor 2020-09-06 09:21:26 +02:00
xarantolus
b948643f9c [youtube] Fix extraction of search urls (closes ytdl-org/youtube-dl#25696) 2020-09-06 09:21:25 +02:00
Sergey M․
d51e23d9fc
release 2020.09.06 2020-09-06 13:00:41 +07:00
Sergey M․
6cd452acff
[ChangeLog] Actualize
[ci skip]
2020-09-06 12:57:56 +07:00
Sergey M․
50e9fcc1fd
[nrktv:episode] Improve video id extraction (closes #25594, closes #26369, closes #26409) 2020-09-06 12:43:50 +07:00
Unknown
2045de7c32 [skip travis] bump version 2020-09-06 07:36:49 +02:00
random-nick
16ee69c1b7
[youtube] Fix age gate content detection (#26100) (closes #26152, closes #26311, closes #26384) 2020-09-06 11:44:53 +07:00
Sergey M․
67171ed7e9
[youtube:user] Extend _VALID_URL (closes #26443) 2020-09-06 11:31:28 +07:00
Unknown
419da738f3 [skip travis] exe related 2020-09-06 06:20:23 +02:00
Sergey M․
1d9bf655e6
[utils] Recognize wav mimetype (closes #26463) 2020-09-06 11:19:53 +07:00
TheRealDude2
62ae19ff76
[xhamster] Improve initials regex (#26526) (closes #26353) 2020-09-06 11:10:27 +07:00
Sergey M․
5ed05f26ad
[svtplay] Fix svt id extraction (closes #26425, closes #26428, closes #26438) 2020-09-06 10:45:57 +07:00
Sergey M․
841b683804
[twitch] Rework extractors (closes #12297, closes #20414, closes #20604, closes #21811, closes #21812, closes #22979, closes #24263, closes #25010, closes #25553, closes #25606)
* Switch to GraphQL.
+ Add support for collections.
+ Add support for clips and collections playlists.
2020-09-06 10:45:34 +07:00
Tom-Oliver Heidel
81e7a77e59 Merge branch 'julien-hadleyjack-ondemandkorea' 2020-09-06 04:02:47 +02:00
Tom-Oliver Heidel
65f5a72266 Merge branch 'ondemandkorea' of https://github.com/julien-hadleyjack/youtube-dl into julien-hadleyjack-ondemandkorea 2020-09-06 04:02:43 +02:00
Unknown
bc842c27a7 flake8 fix + soundcloud tests 2020-09-06 02:57:08 +02:00
Tom-Oliver Heidel
ea40ffd1e1 Merge branch 'MrDoritos-mkvthumbnail' 2020-09-06 02:43:42 +02:00
Tom-Oliver Heidel
3c0c0b428d Merge branch 'mkvthumbnail' of https://github.com/MrDoritos/youtube-dl into MrDoritos-mkvthumbnail 2020-09-06 02:43:37 +02:00
Tom-Oliver Heidel
115c360536 Merge branch 'adrianheine-abc' 2020-09-06 02:39:08 +02:00
Tom-Oliver Heidel
a74727e93c Merge branch 'abc' of https://github.com/adrianheine/youtube-dl into adrianheine-abc 2020-09-06 02:39:04 +02:00
Unknown
b54d0e702a Merge remote-tracking branch 'origin/master' 2020-09-06 02:37:51 +02:00
Tom-Oliver Heidel
27e248cdcd
Merge pull request #48 from theincognito-inc/master
[hotstar] Move to API v1
2020-09-06 02:28:53 +02:00
Tom-Oliver Heidel
d788bb9724 Merge branch 'zubearc' 2020-09-06 01:52:42 +02:00
Tom-Oliver Heidel
9aa79d6460 Merge branch 'master' of https://github.com/zubearc/youtube-dl into zubearc 2020-09-06 01:52:20 +02:00
zubearc
8848f8083b [test/youtube] update subtitle tests 2020-09-05 17:56:28 -04:00
NotFound
7078ec64b3 [hotstar] Move to API v1 2020-09-06 03:04:08 +05:30
Tom-Oliver Heidel
b3b710e2a8 Merge branch 'LucBerge-deezer' 2020-09-05 19:40:03 +02:00
Tom-Oliver Heidel
51f8793699 Merge branch 'deezer' of https://github.com/LucBerge/youtube-dl into LucBerge-deezer 2020-09-05 19:40:01 +02:00
Tom-Oliver Heidel
45edec2fb3 Merge branch 'mrtnmtth-wdr-subtitles' 2020-09-05 19:37:47 +02:00
Tom-Oliver Heidel
47b9774231 Merge branch 'wdr-subtitles' of https://github.com/mrtnmtth/youtube-dl into mrtnmtth-wdr-subtitles 2020-09-05 19:37:36 +02:00
Tom-Oliver Heidel
42eceaac7d
Merge pull request #38 from blackjack4494/soundcloud-sets
[soundcloud] sets pattern and tests
2020-09-04 02:08:23 +02:00
zubearc
7e1cf1a48d support new json3 captions 2020-09-03 19:24:31 -04:00
Unknown
906f980a75 [soundcloud] sets pattern and tests
include tests (weekly + charts)
weekly with login worked before. but now also public weekly will work. charts and similar patterned sets as well
2020-09-04 00:57:37 +02:00
xarantolus
4c47858c05 Fix regex for other variable declaration type
This now supports declarations like `window["ytInitialData"] = ...` and `var ytInitialData = ...`
2020-09-03 20:41:45 +02:00
Tom-Oliver Heidel
c10f38f887 Merge branch 'TinyToweringTree-tvnow' 2020-09-03 18:19:57 +02:00
Tom-Oliver Heidel
e908c55c9f Merge branch 'tvnow' of https://github.com/TinyToweringTree/youtube-dl into TinyToweringTree-tvnow 2020-09-03 18:19:36 +02:00
Unknown
633c2852fb [skip travis] twitch release. 2020-09-03 17:11:38 +02:00
Tom-Oliver Heidel
5627160298 Merge branch 'lel-amri-twitch-fix' 2020-09-03 17:06:26 +02:00
Tom-Oliver Heidel
dac4ecf592 Merge branch 'twitch-fix' of https://github.com/lel-amri/youtube-dl into lel-amri-twitch-fix 2020-09-03 17:05:58 +02:00
Tom-Oliver Heidel
2028c6492a
[skip travis] quick fix readme 2020-09-03 06:06:48 +02:00