Commit graph

350 commits

Author SHA1 Message Date
Sergey M․
75027364ba
[ChangeLog] Actualize 2017-03-05 02:22:02 +07:00
Yen Chi Hsuan
6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
2017-03-04 23:23:18 +08:00
Sergey M․
250eea6821
release 2017.03.02 2017-03-02 22:33:22 +07:00
Sergey M․
28d15b73f8
[ChangeLog] Actualize 2017-03-02 22:29:56 +07:00
Yen Chi Hsuan
11bb6ad1a5
[facebook] Fix extraction (closes #12323)
Almost all videos now use the pagelet type 'permalink_video_pagelet'
2017-03-02 20:51:24 +08:00
Sergey M․
1dc24093f8
release 2017.02.28 2017-02-28 23:59:22 +07:00
Sergey M․
11bae9cdde
[ChangeLog] Actualize 2017-02-28 23:49:24 +07:00
Yen Chi Hsuan
9bd05b5a18 [daisuki] Add new extractor (closes #4738) 2017-02-28 22:19:26 +08:00
Yen Chi Hsuan
f4c68ba372
[douyu] Fix extraction and update _TESTS
They've switched from flv to hls

Closes #12301
2017-02-28 21:41:03 +08:00
Sergey M․
ef48a1175d
release 2017.02.27 2017-02-27 23:26:07 +07:00
Sergey M․
c6184bcf7b
[ChangeLog] Actualize 2017-02-27 23:24:03 +07:00
Yen Chi Hsuan
892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
2017-02-27 21:34:33 +08:00
Yen Chi Hsuan
a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
2017-02-26 17:24:54 +08:00
Yen Chi Hsuan
9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 2017-02-26 00:15:49 +08:00
Yen Chi Hsuan
db182c63fb
[njpwworld] Add new extractor (closes #11561) 2017-02-25 18:44:39 +08:00
Sergey M․
204efc8509
release 2017.02.24.1 2017-02-24 21:59:39 +07:00
Sergey M․
5d3a51e1b9
[ChangeLog] Actualize 2017-02-24 21:57:39 +07:00
Sergey M․
6b097cff27
release 2017.02.24 2017-02-24 06:09:15 +07:00
Sergey M․
f2f7961820
[ChangeLog] Actualize 2017-02-24 06:07:41 +07:00
Sergey M․
345b24538b
release 2017.02.22 2017-02-22 23:50:42 +07:00
Sergey M․
63a29b6118
[ChangeLog] Actualize 2017-02-22 23:45:01 +07:00
Yen Chi Hsuan
b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 2017-02-23 00:08:45 +08:00
Sergey M․
8c6c88c7da
release 2017.02.21 2017-02-21 23:48:24 +07:00
Sergey M․
159aaaa9d0
[ChangeLog] Actualize 2017-02-21 23:46:58 +07:00
Sergey M․
28e35f5070
release 2017.02.17 2017-02-17 23:59:56 +07:00
Sergey M․
cf3704c132
[ChangeLog] Actualize 2017-02-17 23:48:30 +07:00
Yen Chi Hsuan
fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Yen Chi Hsuan
a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Sergey M․
2480b056c1
release 2017.02.16 2017-02-16 00:10:04 +07:00
Sergey M․
3aa25395aa
[ChangeLog] Actualize 2017-02-16 00:08:56 +07:00
Sergey M․
58a65ba852
release 2017.02.14 2017-02-14 01:09:18 +07:00
Sergey M․
cedf08ff54
[ChangeLog] Actualize 2017-02-14 01:07:35 +07:00
Yen Chi Hsuan
f8514630db
[einthusan] Fix extraction (closes #11416)
The old test URLs are no longer valid, so I replace them with the one
from #11416
2017-02-12 20:53:55 +08:00
Yen Chi Hsuan
8d38dafbbf
ChangeLog: update after #12085 2017-02-12 00:45:37 +08:00
Sergey M․
9b92a5917b
release 2017.02.11 2017-02-11 03:24:00 +07:00
Sergey M․
3e2274c8b7
[ChangeLog] Actualize 2017-02-11 17:08:22 +07:00
Sergey M․
55d4de2283
release 2017.02.10 2017-02-10 01:27:33 +07:00
Sergey M․
61ee556aea
[ChangeLog] Actualize 2017-02-10 01:26:00 +07:00
Sergey M․
013877298d
release 2017.02.07 2017-02-07 02:04:50 +07:00
Sergey M․
c87f95f991
[ChangeLog] Actualize 2017-02-07 01:58:57 +07:00
Yen Chi Hsuan
9c14fe9681
[gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
Yen Chi Hsuan
019f4c0371
[bandcamp] Fix extraction for incomplete albums
Closes #11727
2017-02-05 22:47:04 +08:00
Yen Chi Hsuan
caf0f5f8b7
[iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00
Yen Chi Hsuan
e4e50f60b1
[googledrive] Fix extraction on Python 3.6
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
2017-02-05 21:41:08 +08:00
Sergey M․
a713a86755
release 2017.02.04.1 2017-02-04 23:26:39 +07:00
Sergey M․
7bccd5fc8a
[ChangeLog] Actualize 2017-02-04 23:23:38 +07:00
Sergey M․
3144eccf55
[ChangeLog] Actualize 2017-02-04 23:22:28 +07:00
Sergey M․
31487eb974
release 2017.02.04 2017-02-04 22:57:48 +07:00
Yen Chi Hsuan
daac118bf4
[ChangeLog] Update after #11901 2017-02-03 18:56:40 +08:00
Yen Chi Hsuan
d7f9242e30
[ChangeLog] Update after #11565 2017-02-03 12:13:24 +08:00
Yen Chi Hsuan
a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
2017-02-03 01:28:24 +08:00
Yen Chi Hsuan
bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845)
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
2017-02-02 21:51:31 +08:00
Jaime Marquínez Ferrándiz
020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 2017-02-01 23:48:34 +01:00
Sergey M․
5069594993
release 2017.02.01 2017-02-01 03:20:09 +07:00
Sergey M․
b996b88092
[ChangeLog] Actualize 2017-02-01 23:29:59 +07:00
Yen Chi Hsuan
000f207944
[prosiebensat1] Update ChangeLog 2017-02-01 23:16:35 +08:00
Sergey M․
d7e215b42d
release 2017.01.31 2017-01-31 22:24:45 +07:00
Sergey M․
3a528ffd89
[ChangeLog] Actualize 2017-01-31 22:22:42 +07:00
Sergey M․
4d2fdb07c4
release 2017.01.29 2017-01-29 13:21:42 +07:00
Sergey M․
fe323a4800
[ChangeLog] Actualize 2017-01-29 21:21:26 +07:00
Sergey M․
d41ed6d243
release 2017.01.28 2017-01-28 00:33:55 +07:00
Sergey M․
815d2a36d8
[ChangeLog] Actualize 2017-01-28 00:03:21 +07:00
Sergey M․
2417d41535
release 2017.01.25 2017-01-25 23:36:03 +07:00
Sergey M․
2c302cf66b
[ChangeLog] Actualize 2017-01-25 23:33:46 +07:00
Sergey M․
c3a65c3de0
release 2017.01.24 2017-01-24 02:58:37 +07:00
Sergey M․
ee4c091ce5
[ChangeLog] Actualize 2017-01-24 02:56:19 +07:00
Yen Chi Hsuan
bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 2017-01-23 23:38:31 +08:00
Sergey M․
9d5b29c881
release 2017.01.22 2017-01-22 18:59:04 +07:00
Sergey M․
6c031a35f3
[ChangeLog] Actualize 2017-01-22 18:57:15 +07:00
Yen Chi Hsuan
7c20b7484c
[nextmedia] Support redirected URLs 2017-01-22 02:06:34 +08:00
Yen Chi Hsuan
4447fb2332
[cspan] Support Ustream embedded videos
Closes #11547
2017-01-20 22:27:13 +08:00
Sergey M․
1560baacc6
release 2017.01.18 2017-01-18 23:10:00 +07:00
Sergey M․
460f61fac4
[ChangeLog] Actualize 2017-01-18 23:06:46 +07:00
Sergey M․
c1c2fe2045
release 2017.01.16 2017-01-16 23:44:04 +07:00
Sergey M․
ddd53c392e
[ChangeLog] Actualize 2017-01-16 23:42:04 +07:00
Yen Chi Hsuan
16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
2017-01-16 00:06:52 +08:00
Yen Chi Hsuan
dcae7b3fdc
[niconico] Allow login via cookies
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
2017-01-15 22:51:54 +08:00
Sergey M․
5d4c7daa49
release 2017.01.14 2017-01-14 07:31:07 +07:00
Sergey M․
0b94510cd0
[ChangeLog] Actualize 2017-01-14 07:30:32 +07:00
Sergey M․
31ea2ad89d
release 2017.01.10 2017-01-10 21:29:20 +07:00
Sergey M․
2184d44361
[ChangeLog] Actualize 2017-01-10 21:27:17 +07:00
Philipp Hagemeister
bfedb2cc5a small fix to Changelog format 2017-01-09 11:26:01 +01:00
Philipp Hagemeister
8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
2017-01-09 11:24:40 +01:00
Sergey M․
e7ea724cb9
release 2017.01.08 2017-01-08 20:58:43 +07:00
Sergey M․
e60166020b
[ChangeLog] Actualize 2017-01-08 20:56:38 +07:00
Yen Chi Hsuan
1219201143
[ChangeLog] Update after #11581
[ci skip]
2017-01-06 01:07:30 +08:00
Yen Chi Hsuan
24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
2017-01-05 18:50:34 +08:00
Sergey M․
7232bb299b
release 2017.01.05 2017-01-05 04:10:15 +07:00
Sergey M․
2b12e34076
[ChangeLog] Actualize 2017-01-05 04:07:32 +07:00
Sergey M․
2021b650dd
release 2017.01.02 2017-01-02 23:55:04 +07:00
Sergey M․
b890caaf21
[ChangeLog] Actualize 2017-01-02 23:54:29 +07:00
Sergey M․
dc48a35404
release 2016.12.31 2016-12-31 23:58:41 +07:00
Sergey M․
1ea0b727c4
[ChangeLog] Actualize 2016-12-31 23:53:30 +07:00
Sergey M․
5e77c0b58e
release 2016.12.22 2016-12-22 22:52:54 +07:00
Remita Amine
ab3091feda
[ChangeLog] Actualize 2016-12-22 22:51:51 +07:00
Sergey M․
90352a8041
release 2016.12.20 2016-12-20 22:39:39 +07:00
Sergey M․
1f6a79b0af
[ChangeLog] Actualize 2016-12-20 22:37:06 +07:00
Yen Chi Hsuan
8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 2016-12-20 18:45:52 +08:00
Sergey M․
f73d7d5074
release 2016.12.18 2016-12-18 19:50:33 +07:00
Sergey M․
52a1d48d9f
[ChangeLog] Actualize 2016-12-18 19:48:59 +07:00