mollusk/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
13,627 Commits 9 Branches 1,077 Tags
c452e69d3d3e6bbbec298a5d4b032cb502cef0ab
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yen Chi Hsuan c452e69d3d [footyroom] Fix extraction and update _TESTS (closes #10810) 2016-10-11 17:46:13 +08:00
Yen Chi Hsuan 555787d717 [streamable] Add helper for extracting embedded videos 2016-10-11 17:44:35 +08:00
Yen Chi Hsuan f165ca70eb [abc.net.au:iview] Fix for non-series videos (closes #10895) 2016-10-11 12:53:27 +08:00
Yen Chi Hsuan 27b8d2ee95 [hbo] Add display_id and another test (#10892) 2016-10-11 12:41:44 +08:00
Yen Chi Hsuan 71cdcb2331 [hbo] Support episode pages (closes #10892) 2016-10-11 12:30:35 +08:00
Yen Chi Hsuan 176006a120 [allocine] Fix for /video/ videos (closes #10860) 2016-10-09 19:42:42 +08:00
Yen Chi Hsuan 65f4c1de3d [allocine] Fix extraction (closes #10860) 
I change the URL of the third test case, because now the original URL
does not contain a video anymore, and there's no easy to get the real
URL from the /film/ one.
 2016-10-09 18:58:15 +08:00
Yen Chi Hsuan b0082629a9 [nextmedia] Support action news (動新聞) on Apple Daily 2016-10-09 18:42:15 +08:00
Yen Chi Hsuan 8204c73352 [Makefile] Fix for GNU make < 4 (closes #9387) 
Shell assignment operator in BSD make != is ported to GNU make in
version 4.0, so 3.x doesn't work. I choose to drop BSD make support as
installing GNU make on *BSD systems is easier than installing newer GNU
make.
 2016-10-09 18:24:45 +08:00
Yen Chi Hsuan 38588ab977 [facebook] Fix for new handleServerJS syntax (closes #10846) 
According to the dump file in #10846, handleServerJS() now accepts
an optional second argument. It's a string from available dump files.
 2016-10-07 20:04:49 +08:00
Yen Chi Hsuan 85bcdd081c [extractors] Add MmsIE 2016-10-07 19:31:26 +08:00
Yen Chi Hsuan 9dcd6fd3aa [generic,commonprotocols] Move mms suuport from GenericIE 
And use _generic_* helpers in those extractors
 2016-10-07 19:24:22 +08:00
Yen Chi Hsuan 98763ee354 [extractor/common] Add id and title helpers for generic IEs 2016-10-07 19:20:53 +08:00
Yen Chi Hsuan 3d83a1ae92 [generic] Support direct MMS links (closes #10838) 2016-10-07 17:50:45 +08:00
Yen Chi Hsuan c0a7b9b348 Revert "[Makefilea] Fix for GNU make < 4" 
This reverts commit 831a34caa2.

The reverted commit breaks lazy extractors.
 2016-10-07 16:03:34 +08:00
Yen Chi Hsuan 831a34caa2 [Makefilea] Fix for GNU make < 4 
Closes #9387

The shell assignment operator != was introduced in GNU make 4.0, or
specifically the commit in [1]. This fix removes such usages and
fallback to a more portable syntax. Tested with:

* GNU make 3.82 on CentOS 7.2
* bmake 20150910 on CentOS 7.2, source RPM from Fedora 24 [2]
* GNU make 4.2.1 on Arch Linux (Arch official package)
* bmake 20160926 on Arch Linux (Arch official package)
* GNU make 3.82 on Arch Linux (Compiled from source)
* Apple bsdmake-24 on macOS Sierra, binary package from Homebrew

Thanks @bdeyal for the feedback of the first tests

[1] http://git.savannah.gnu.org/cgit/make.git/commit/?id=b34438bee83ee906a23b881f257e684a0993b9b1
[2] http://koji.fedoraproject.org/koji/buildinfo?buildID=716769
 2016-10-07 03:28:41 +08:00
Yen Chi HsuanandGitHub 25291b979a Merge pull request #10829 from TRox1972/pornoxo_improve 
[pornoxo] Use JWPlatform to improve metadata extraction
 2016-10-02 20:19:34 +08:00
Yen Chi Hsuan 703b3afa93 [amcnetworks] Skip a restricted _TEST 2016-10-02 14:25:06 +08:00
Yen Chi Hsuan 99ed78c79e [jwplatform] Support DASH streams 2016-10-02 14:07:49 +08:00
Yen Chi Hsuan fd15264172 [jwplatform] Support old-style jwplayer playlists 2016-10-02 13:47:06 +08:00
Yen Chi Hsuan bd26441205 [utils] Fix xattr error handling 2016-10-02 03:03:41 +08:00
Yen Chi Hsuan b19e275d99 [__init__] Fix lost xattr if --embed-thumbnail used 
Reported at
https://github.com/rg3/youtube-dl/issues/9054#issuecomment-250451823
 2016-10-02 02:12:14 +08:00
Yen Chi Hsuan 53a7e3d287 [utils] Support xattr as well as pyxattr 
Closes #9054

There are two xattr packages in Python, pyxattr [1] and xattr [2]. They
have different APIs.

In old days pyxattr supports Linux only and xattr supports Linux, Mac,
FreeBSD and Solaris, and pyxattr supports Linux only. Recently pyxattr
adds support for Mac OS X. [3]

An old version of [2] is shipped with Mac OS X. However, some Linux
distributions have pyxattr only, for example PLD-Linux [4] and old Arch
Linux. [5] As a result, supporting both is the way to go.

[1] https://github.com/iustin/pyxattr
[2] https://github.com/xattr/xattr
[3] https://github.com/iustin/pyxattr/pull/9
[4] https://github.com/rg3/youtube-dl/issues/5498
[5] https://git.archlinux.org/svntogit/community.git/commit/?id=427c4c76401e386d865ccddea4fbfdc74df80492
    https://git.archlinux.org/svntogit/community.git/commit/?id=59b40da7b69622a6761d364a8b07909e9cccaa56
    python-xattr is added on 2016/06/29 while pyxattr is there for more
    than 6 years
 2016-10-01 20:13:04 +08:00
Yen Chi Hsuan d54739a2e6 [downloader/http] xattr values should be bytes 2016-10-01 19:58:13 +08:00
Yen Chi HsuanandGitHub 63e0fd5bcc Merge pull request #10818 from TRox1972/criterion_match_id 
[criterion] Rely on _match_id, improve regex and add thumbnail to test
 2016-10-01 19:49:18 +08:00
Yen Chi Hsuan 9bd7bd0b80 [twitch] Skip a 404 test 2016-10-01 16:38:47 +08:00
Yen Chi HsuanandGitHub 4a76b73c6c Merge pull request #10817 from TRox1972/clubic_match_id 
[clubic] Rely on _match_id and _parse_json
 2016-10-01 16:20:12 +08:00
Yen Chi Hsuan e295618f9e [dctp] Fix extraction (closes #10734) 2016-10-01 15:22:48 +08:00
Yen Chi Hsuan d7753d1948 [downloader/http] Use write_xattr function for --xattr-set-filesize 2016-10-01 14:47:20 +08:00
Yen Chi Hsuan efa97bdcf1 Move write_xattr to utils.py 
There are some other places that use xattr functions. It's better to
move it to a common place so that others can use it.
 2016-09-30 00:28:32 +08:00
Yen Chi HsuanandGitHub 0ce26ef228 Merge pull request #10788 from TRox1972/instagram_comments 
[Instagram] Extract comments
 2016-09-29 21:54:39 +08:00
Yen Chi Hsuan 0d72ff9c51 [leeco] Recognize more Le Sports URLs (#10794) 2016-09-29 21:39:35 +08:00
Yen Chi Hsuan d75d9e343e [einthusan] Fix extraction (closes #10714) 2016-09-27 14:38:41 +08:00
Yen Chi Hsuan d3c97bad61 Ignore and cleanup 3gp files 2016-09-26 14:14:37 +08:00
Yen Chi Hsuan f0bc5a8609 [twitter] Support Periscope embeds (closes #10737) 
Also update _TESTS
 2016-09-24 20:00:29 +08:00
Yen Chi Hsuan 0711995bca [openload] Support subtitles (closes #10625) 2016-09-24 14:27:08 +08:00
Yen Chi Hsuan 5968d7d2fe [extractor/common] Improved support for HTML5 subtitles 
Ref: #10625

In a strict sense, <track>s with kind=captions are not subtitles. [1]
openload misuses this attribute, and I guess there will be more
examples, so I add it to common.py.

Also allow extracting information for subtitles-only <video> or <audio>
tags, which is the case of openload.

[1] https://www.w3.org/TR/html5/embedded-content-0.html#attr-track-kind
 2016-09-24 14:20:42 +08:00
Yen Chi Hsuan 4ddcb5999d [openload] Fix extraction (closes #10408, closes #10727) 
Thanks to @daniel100097 for providing a working version
 2016-09-23 01:47:51 +08:00
Yen Chi Hsuan 628406db96 [Makefile] Cleanup files from fragment-based downloaders 2016-09-23 01:13:56 +08:00
Yen Chi Hsuan e3d6bdc8fc [ustream] Support HLS streams (closes #10698) 2016-09-23 01:11:13 +08:00
Yen Chi Hsuan d8dbf8707d [thisav] Improve title extraction (closes #10682) 
I didn't add a test case as the one in #10682 looks like a copyrighted
product.
 2016-09-18 18:35:38 +08:00
Yen Chi Hsuan 584d6f3457 [thisav] Recognize jwplayers (closes #10447) 2016-09-17 18:46:43 +08:00
Yen Chi Hsuan e14c82bd6b [jwplatform] Use js_to_json to detect more JWPlayers 2016-09-17 18:45:08 +08:00
Yen Chi Hsuan 961516bfd1 [kwuo:song] Improve error detection (closes #10650) 2016-09-15 00:56:15 +08:00
Yen Chi Hsuan 6db354a9f4 [kuwo] Update _TESTS 2016-09-15 00:53:04 +08:00
Yen Chi Hsuan 86d68f906e [bilibili] Fix extraction for videos without backup_url (#10647) 2016-09-14 22:11:49 +08:00
Yen Chi Hsuan 4875ff6847 [bilibili] Remove copyrighted test cases 
I can't find any English or Chinese material that claims BiliBili has
bought legal redistribution permissions for copyrighted products from
copyrighted holders.

References for removed test cases:
"刀语": https://en.wikipedia.org/wiki/Katanagatari, by White Fox
"哆啦A梦": https://en.wikipedia.org/wiki/Doraemon, by Shin-Ei Animation
"岳父岳母真难当": https://en.wikipedia.org/wiki/Serial_(Bad)_Weddings, by Les films du 24
"混沌武士": https://en.wikipedia.org/wiki/Samurai_Champloo, by Manglobe

I shouldn't have added them to _TESTS
 2016-09-14 22:09:43 +08:00
Yen Chi Hsuan be45730226 [nbc] Add new extractor for NBC Olympics (#10295, #10361) 2016-09-12 02:55:15 +08:00
Yen Chi Hsuan 6bb05b32a9 [pornhub] Extract categories and tags (closes #10499) 2016-09-11 19:22:51 +08:00
Yen Chi Hsuan fea74acad8 [foxnews] Revert to old extractor names 2016-09-11 18:54:24 +08:00
Yen Chi Hsuan f01115c933 [openload] Temporary fix (#10408) 2016-09-11 18:36:59 +08:00
Yen Chi Hsuan 2cdbc06a1f [foxnews] Support Fox News Articles (closes #10598) 2016-09-11 18:32:45 +08:00
Yen Chi Hsuan bfcda07a27 [abc:iview] Skip the test. They are removed soon 2016-09-11 04:06:00 +08:00
Yen Chi Hsuan 001a5fd3d7 [iwara] Fix extraction after relaunch 
Closes #10462, closes #3215
 2016-09-11 03:02:00 +08:00
Yen Chi Hsuan 6c3affcb18 [newgrounds] Fix uploader extraction 
Closes #10584

Also change test URLs to HTTPS, as proposed by
@stepshal in #10593.

Closes #10593
 2016-09-10 20:09:09 +08:00
Yen Chi HsuanandGitHub 02e552886f Merge pull request #10596 from stepshal/r_prefix 
Add missing r prefix for _VALID_URLs
 2016-09-08 18:31:09 +08:00
Yen Chi Hsuan 3f612f0767 Fix _VALID_URLs further (#10594) 2016-09-08 17:39:29 +08:00
Yen Chi HsuanandGitHub 17bf6e71cc Merge pull request #10594 from stepshal/https_support 
Add support for https for rest of the exctractors.
 2016-09-08 17:28:46 +08:00
Yen Chi Hsuan 881f35479d Credit @xyb for miaopai extractor (#10556) 2016-09-08 17:22:43 +08:00
Yen Chi Hsuan e78a5428b6 [foxgay] Fix extraction (closes #10480) 2016-09-08 02:01:09 +08:00
Yen Chi Hsuan 9c27188988 Merge branch 'xyb-miaopai' 2016-09-08 00:31:06 +08:00
Yen Chi Hsuan b84d311d53 [ChangeLog] Update for #10556 2016-09-08 00:29:55 +08:00
Yen Chi Hsuan f87feb4b68 [miaopai] Coding style (#10556) 2016-09-08 00:28:33 +08:00
Yen Chi Hsuan 2841bdcebb Merge branch 'miaopai' of https://github.com/xyb/youtube-dl into xyb-miaopai 2016-09-08 00:08:02 +08:00
Yen Chi Hsuan 84b91dd4e3 [gamestar] Fix metadata extraction (closes #10479) 2016-09-07 23:07:50 +08:00
Yen Chi Hsuan 92c9c2a88b [moevideo] Skip another removed test (#10474) 2016-09-07 22:21:59 +08:00
Yen Chi Hsuan bc22a79694 Credit @mcepl for #10524 2016-09-05 16:44:06 +08:00
Yen Chi Hsuan 340e31ca74 Merge branch 'PeterDing-bilibili' 2016-09-05 13:55:07 +08:00
Yen Chi Hsuan 973dee491f [ChangeLog] Update for #10190 2016-09-05 13:54:35 +08:00
Yen Chi Hsuan 1f85029d82 [bilibili] Simplify 2016-09-05 13:53:58 +08:00
Yen Chi Hsuan 95843da529 Merge branch 'bilibili' of https://github.com/PeterDing/youtube-dl into PeterDing-bilibili 2016-09-05 13:47:24 +08:00
Yen Chi Hsuan abf2c79f95 Merge branch 'mcepl-tvnoe' 2016-09-05 13:39:51 +08:00
Yen Chi Hsuan b49ad71ce1 [ChangeLog] Update for #10524 2016-09-05 13:38:55 +08:00
Yen Chi Hsuan 9127e1533d [tvnoe] PEP8 and coding style 2016-09-05 13:37:36 +08:00
Yen Chi Hsuan 919cf1a62f [downloader/dash] Abort if the first segment fails 
Closes #10497, Closes #10542
 2016-09-04 17:32:29 +08:00
Yen Chi Hsuan b29cd56591 [pornovoisines] Fix extraction (closes #10469) 2016-09-04 17:01:39 +08:00
Yen Chi Hsuan 622638512b [rottentomatoes] Fix extraction 
Closes #10467
 2016-09-04 16:25:59 +08:00
Yen Chi Hsuan 45aab4d30b [youjizz] Fix extraction. The site has moved to HTML5 
Closes #10437
 2016-09-03 18:37:36 +08:00
Yen Chi Hsuan ed2bfe93aa [fc2:embed] Add ie_key 2016-09-03 18:22:00 +08:00
Yen Chi Hsuan cdc783510b [foxnews:insider] Add new extractor 
Closes #10445
 2016-09-03 18:16:19 +08:00
Yen Chi Hsuan cf0efe9636 [fc2:embed] New extractor for Flash player URLs 
Closes #10512
 2016-09-03 17:25:03 +08:00
Yen Chi Hsuan 4c8ab6fd71 [thvideo] Remove extractor. Website down. 
Closes #10464

According to a screenshot in http://tieba.baidu.com/p/4691302183,
thvideo.tv is shut down "temporarily". I see no clues that it will be up
again, so I remove it here.
 2016-09-01 17:04:41 +08:00
Yen Chi Hsuan 05d4612947 [movingimage] Adapt to the new domain name and fix extraction 
Closes #10466
 2016-09-01 16:58:16 +08:00
Yen Chi Hsuan 746a695b36 [myvidster] Update _TESTS (closes #10473) 2016-09-01 16:42:35 +08:00
Yen Chi Hsuan 165c54e97d [southpark.cc.com:español] Skip geo-restricted _TESTS 
Breaks https://travis-ci.org/rg3/youtube-dl/jobs/156728175
 2016-09-01 16:28:03 +08:00
Yen Chi Hsuan 6c9b71bc08 [downloader/external] Recommend --hls-prefer-native for SOCKS users 
Related: #10490
 2016-08-29 19:05:38 +08:00
Yen Chi Hsuan 98908bcf7c [openload] Update algorithm again (#10408) 2016-08-28 22:49:46 +08:00
Yen Chi Hsuan 04b32c8f96 [bilibili] Fix extraction (closes #10375) 
Thanks @gdkchan for the algorithm
 2016-08-28 22:06:31 +08:00
Yen Chi Hsuan 40eec6b15c [openload] Fix extraction (closes #10408) 
Thanks to @yokrysty again!
 2016-08-28 20:27:52 +08:00
Yen Chi Hsuan 39efc6e3e0 [generic] Update some _TESTS 2016-08-28 15:46:11 +08:00
Yen Chi Hsuan d181cff685 Merge branch 'steven7851-patch-2' 2016-08-27 01:17:12 +08:00
Yen Chi Hsuan 3b4b82d4ce [douyutv] Simplify 2016-08-27 01:16:39 +08:00
Yen Chi Hsuan 545ef4f531 Merge branch 'patch-2' of https://github.com/steven7851/youtube-dl into steven7851-patch-2 2016-08-26 22:29:46 +08:00
Yen Chi Hsuan 906b87cf5f [crackle] Revert to template-based thumbnail extraction 
To reduce to number of HTTP requests
 2016-08-26 19:58:47 +08:00
Yen Chi Hsuan 20bad91d76 [downloader/external] Clarify that ffmpeg doesn't support SOCKS 
Ref: #10304
 2016-08-25 22:38:06 +08:00
Yen Chi Hsuan b54a2da433 [crackle] Fix extraction and update _TESTS (closes #10333) 2016-08-25 22:22:31 +08:00
Yen Chi Hsuan dc2c37f316 [spankbang] Fix description and uploader (closes #10339) 2016-08-25 20:47:35 +08:00
Yen Chi Hsuan 08773689f3 [kickstarter] Silent the warning for og:description 
Closes #10415
 2016-08-25 01:29:32 +08:00
Yen Chi Hsuan 0c75abbb7b [mtvservices:embedded] Use another endpoint to get feed URL 
Closes #10363

In the original mtvservices:embedded test case, config.xml is still used
to get the feed URL. Some other examples, including test_Generic_40
(http://www.vulture.com/2016/06/new-key-peele-sketches-released.html),
and the video mentioned in #10363, use another endpoint to get the feed
URL. The 'index.html' approach works for the original test case, too. So
I didn't keep the old approach.
 2016-08-24 23:58:22 +08:00
Yen Chi Hsuan 97653f81b2 [bilibili] Mark as broken 
Bilibili now uses emscripten, which is very difficult for reverse
engineering. I don't expect it to be fixed in near future, so I mark
it as broken.

Ref: #10375
 2016-08-24 21:28:00 +08:00