mollusk/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
13,575 Commits 9 Branches 1,077 Tags
d54739a2e6a8dc089e7530afda0a1cfe355a6fef
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yen Chi Hsuan d54739a2e6 [downloader/http] xattr values should be bytes 2016-10-01 19:58:13 +08:00
Yen Chi HsuanandGitHub 63e0fd5bcc Merge pull request #10818 from TRox1972/criterion_match_id 
[criterion] Rely on _match_id, improve regex and add thumbnail to test
 2016-10-01 19:49:18 +08:00
Yen Chi Hsuan 9bd7bd0b80 [twitch] Skip a 404 test 2016-10-01 16:38:47 +08:00
Yen Chi HsuanandGitHub 4a76b73c6c Merge pull request #10817 from TRox1972/clubic_match_id 
[clubic] Rely on _match_id and _parse_json
 2016-10-01 16:20:12 +08:00
Yen Chi Hsuan e295618f9e [dctp] Fix extraction (closes #10734) 2016-10-01 15:22:48 +08:00
Yen Chi Hsuan d7753d1948 [downloader/http] Use write_xattr function for --xattr-set-filesize 2016-10-01 14:47:20 +08:00
Yen Chi Hsuan efa97bdcf1 Move write_xattr to utils.py 
There are some other places that use xattr functions. It's better to
move it to a common place so that others can use it.
 2016-09-30 00:28:32 +08:00
Yen Chi HsuanandGitHub 0ce26ef228 Merge pull request #10788 from TRox1972/instagram_comments 
[Instagram] Extract comments
 2016-09-29 21:54:39 +08:00
Yen Chi Hsuan 0d72ff9c51 [leeco] Recognize more Le Sports URLs (#10794) 2016-09-29 21:39:35 +08:00
Yen Chi Hsuan d75d9e343e [einthusan] Fix extraction (closes #10714) 2016-09-27 14:38:41 +08:00
Yen Chi Hsuan d3c97bad61 Ignore and cleanup 3gp files 2016-09-26 14:14:37 +08:00
Yen Chi Hsuan f0bc5a8609 [twitter] Support Periscope embeds (closes #10737) 
Also update _TESTS
 2016-09-24 20:00:29 +08:00
Yen Chi Hsuan 0711995bca [openload] Support subtitles (closes #10625) 2016-09-24 14:27:08 +08:00
Yen Chi Hsuan 5968d7d2fe [extractor/common] Improved support for HTML5 subtitles 
Ref: #10625

In a strict sense, <track>s with kind=captions are not subtitles. [1]
openload misuses this attribute, and I guess there will be more
examples, so I add it to common.py.

Also allow extracting information for subtitles-only <video> or <audio>
tags, which is the case of openload.

[1] https://www.w3.org/TR/html5/embedded-content-0.html#attr-track-kind
 2016-09-24 14:20:42 +08:00
Yen Chi Hsuan 4ddcb5999d [openload] Fix extraction (closes #10408, closes #10727) 
Thanks to @daniel100097 for providing a working version
 2016-09-23 01:47:51 +08:00
Yen Chi Hsuan 628406db96 [Makefile] Cleanup files from fragment-based downloaders 2016-09-23 01:13:56 +08:00
Yen Chi Hsuan e3d6bdc8fc [ustream] Support HLS streams (closes #10698) 2016-09-23 01:11:13 +08:00
Yen Chi Hsuan d8dbf8707d [thisav] Improve title extraction (closes #10682) 
I didn't add a test case as the one in #10682 looks like a copyrighted
product.
 2016-09-18 18:35:38 +08:00
Yen Chi Hsuan 584d6f3457 [thisav] Recognize jwplayers (closes #10447) 2016-09-17 18:46:43 +08:00
Yen Chi Hsuan e14c82bd6b [jwplatform] Use js_to_json to detect more JWPlayers 2016-09-17 18:45:08 +08:00
Yen Chi Hsuan 961516bfd1 [kwuo:song] Improve error detection (closes #10650) 2016-09-15 00:56:15 +08:00
Yen Chi Hsuan 6db354a9f4 [kuwo] Update _TESTS 2016-09-15 00:53:04 +08:00
Yen Chi Hsuan 86d68f906e [bilibili] Fix extraction for videos without backup_url (#10647) 2016-09-14 22:11:49 +08:00
Yen Chi Hsuan 4875ff6847 [bilibili] Remove copyrighted test cases 
I can't find any English or Chinese material that claims BiliBili has
bought legal redistribution permissions for copyrighted products from
copyrighted holders.

References for removed test cases:
"刀语": https://en.wikipedia.org/wiki/Katanagatari, by White Fox
"哆啦A梦": https://en.wikipedia.org/wiki/Doraemon, by Shin-Ei Animation
"岳父岳母真难当": https://en.wikipedia.org/wiki/Serial_(Bad)_Weddings, by Les films du 24
"混沌武士": https://en.wikipedia.org/wiki/Samurai_Champloo, by Manglobe

I shouldn't have added them to _TESTS
 2016-09-14 22:09:43 +08:00
Yen Chi Hsuan be45730226 [nbc] Add new extractor for NBC Olympics (#10295, #10361) 2016-09-12 02:55:15 +08:00
Yen Chi Hsuan 6bb05b32a9 [pornhub] Extract categories and tags (closes #10499) 2016-09-11 19:22:51 +08:00
Yen Chi Hsuan fea74acad8 [foxnews] Revert to old extractor names 2016-09-11 18:54:24 +08:00
Yen Chi Hsuan f01115c933 [openload] Temporary fix (#10408) 2016-09-11 18:36:59 +08:00
Yen Chi Hsuan 2cdbc06a1f [foxnews] Support Fox News Articles (closes #10598) 2016-09-11 18:32:45 +08:00
Yen Chi Hsuan bfcda07a27 [abc:iview] Skip the test. They are removed soon 2016-09-11 04:06:00 +08:00
Yen Chi Hsuan 001a5fd3d7 [iwara] Fix extraction after relaunch 
Closes #10462, closes #3215
 2016-09-11 03:02:00 +08:00
Yen Chi Hsuan 6c3affcb18 [newgrounds] Fix uploader extraction 
Closes #10584

Also change test URLs to HTTPS, as proposed by
@stepshal in #10593.

Closes #10593
 2016-09-10 20:09:09 +08:00
Yen Chi HsuanandGitHub 02e552886f Merge pull request #10596 from stepshal/r_prefix 
Add missing r prefix for _VALID_URLs
 2016-09-08 18:31:09 +08:00
Yen Chi Hsuan 3f612f0767 Fix _VALID_URLs further (#10594) 2016-09-08 17:39:29 +08:00
Yen Chi HsuanandGitHub 17bf6e71cc Merge pull request #10594 from stepshal/https_support 
Add support for https for rest of the exctractors.
 2016-09-08 17:28:46 +08:00
Yen Chi Hsuan 881f35479d Credit @xyb for miaopai extractor (#10556) 2016-09-08 17:22:43 +08:00
Yen Chi Hsuan e78a5428b6 [foxgay] Fix extraction (closes #10480) 2016-09-08 02:01:09 +08:00
Yen Chi Hsuan 9c27188988 Merge branch 'xyb-miaopai' 2016-09-08 00:31:06 +08:00
Yen Chi Hsuan b84d311d53 [ChangeLog] Update for #10556 2016-09-08 00:29:55 +08:00
Yen Chi Hsuan f87feb4b68 [miaopai] Coding style (#10556) 2016-09-08 00:28:33 +08:00
Yen Chi Hsuan 2841bdcebb Merge branch 'miaopai' of https://github.com/xyb/youtube-dl into xyb-miaopai 2016-09-08 00:08:02 +08:00
Yen Chi Hsuan 84b91dd4e3 [gamestar] Fix metadata extraction (closes #10479) 2016-09-07 23:07:50 +08:00
Yen Chi Hsuan 92c9c2a88b [moevideo] Skip another removed test (#10474) 2016-09-07 22:21:59 +08:00
Yen Chi Hsuan bc22a79694 Credit @mcepl for #10524 2016-09-05 16:44:06 +08:00
Yen Chi Hsuan 340e31ca74 Merge branch 'PeterDing-bilibili' 2016-09-05 13:55:07 +08:00
Yen Chi Hsuan 973dee491f [ChangeLog] Update for #10190 2016-09-05 13:54:35 +08:00
Yen Chi Hsuan 1f85029d82 [bilibili] Simplify 2016-09-05 13:53:58 +08:00
Yen Chi Hsuan 95843da529 Merge branch 'bilibili' of https://github.com/PeterDing/youtube-dl into PeterDing-bilibili 2016-09-05 13:47:24 +08:00
Yen Chi Hsuan abf2c79f95 Merge branch 'mcepl-tvnoe' 2016-09-05 13:39:51 +08:00
Yen Chi Hsuan b49ad71ce1 [ChangeLog] Update for #10524 2016-09-05 13:38:55 +08:00
Yen Chi Hsuan 9127e1533d [tvnoe] PEP8 and coding style 2016-09-05 13:37:36 +08:00
Yen Chi Hsuan 919cf1a62f [downloader/dash] Abort if the first segment fails 
Closes #10497, Closes #10542
 2016-09-04 17:32:29 +08:00
Yen Chi Hsuan b29cd56591 [pornovoisines] Fix extraction (closes #10469) 2016-09-04 17:01:39 +08:00
Yen Chi Hsuan 622638512b [rottentomatoes] Fix extraction 
Closes #10467
 2016-09-04 16:25:59 +08:00
Yen Chi Hsuan 45aab4d30b [youjizz] Fix extraction. The site has moved to HTML5 
Closes #10437
 2016-09-03 18:37:36 +08:00
Yen Chi Hsuan ed2bfe93aa [fc2:embed] Add ie_key 2016-09-03 18:22:00 +08:00
Yen Chi Hsuan cdc783510b [foxnews:insider] Add new extractor 
Closes #10445
 2016-09-03 18:16:19 +08:00
Yen Chi Hsuan cf0efe9636 [fc2:embed] New extractor for Flash player URLs 
Closes #10512
 2016-09-03 17:25:03 +08:00
Yen Chi Hsuan 4c8ab6fd71 [thvideo] Remove extractor. Website down. 
Closes #10464

According to a screenshot in http://tieba.baidu.com/p/4691302183,
thvideo.tv is shut down "temporarily". I see no clues that it will be up
again, so I remove it here.
 2016-09-01 17:04:41 +08:00
Yen Chi Hsuan 05d4612947 [movingimage] Adapt to the new domain name and fix extraction 
Closes #10466
 2016-09-01 16:58:16 +08:00
Yen Chi Hsuan 746a695b36 [myvidster] Update _TESTS (closes #10473) 2016-09-01 16:42:35 +08:00
Yen Chi Hsuan 165c54e97d [southpark.cc.com:español] Skip geo-restricted _TESTS 
Breaks https://travis-ci.org/rg3/youtube-dl/jobs/156728175
 2016-09-01 16:28:03 +08:00
Yen Chi Hsuan 6c9b71bc08 [downloader/external] Recommend --hls-prefer-native for SOCKS users 
Related: #10490
 2016-08-29 19:05:38 +08:00
Yen Chi Hsuan 98908bcf7c [openload] Update algorithm again (#10408) 2016-08-28 22:49:46 +08:00
Yen Chi Hsuan 04b32c8f96 [bilibili] Fix extraction (closes #10375) 
Thanks @gdkchan for the algorithm
 2016-08-28 22:06:31 +08:00
Yen Chi Hsuan 40eec6b15c [openload] Fix extraction (closes #10408) 
Thanks to @yokrysty again!
 2016-08-28 20:27:52 +08:00
Yen Chi Hsuan 39efc6e3e0 [generic] Update some _TESTS 2016-08-28 15:46:11 +08:00
Yen Chi Hsuan d181cff685 Merge branch 'steven7851-patch-2' 2016-08-27 01:17:12 +08:00
Yen Chi Hsuan 3b4b82d4ce [douyutv] Simplify 2016-08-27 01:16:39 +08:00
Yen Chi Hsuan 545ef4f531 Merge branch 'patch-2' of https://github.com/steven7851/youtube-dl into steven7851-patch-2 2016-08-26 22:29:46 +08:00
Yen Chi Hsuan 906b87cf5f [crackle] Revert to template-based thumbnail extraction 
To reduce to number of HTTP requests
 2016-08-26 19:58:47 +08:00
Yen Chi Hsuan 20bad91d76 [downloader/external] Clarify that ffmpeg doesn't support SOCKS 
Ref: #10304
 2016-08-25 22:38:06 +08:00
Yen Chi Hsuan b54a2da433 [crackle] Fix extraction and update _TESTS (closes #10333) 2016-08-25 22:22:31 +08:00
Yen Chi Hsuan dc2c37f316 [spankbang] Fix description and uploader (closes #10339) 2016-08-25 20:47:35 +08:00
Yen Chi Hsuan 08773689f3 [kickstarter] Silent the warning for og:description 
Closes #10415
 2016-08-25 01:29:32 +08:00
Yen Chi Hsuan 0c75abbb7b [mtvservices:embedded] Use another endpoint to get feed URL 
Closes #10363

In the original mtvservices:embedded test case, config.xml is still used
to get the feed URL. Some other examples, including test_Generic_40
(http://www.vulture.com/2016/06/new-key-peele-sketches-released.html),
and the video mentioned in #10363, use another endpoint to get the feed
URL. The 'index.html' approach works for the original test case, too. So
I didn't keep the old approach.
 2016-08-24 23:58:22 +08:00
Yen Chi Hsuan 97653f81b2 [bilibili] Mark as broken 
Bilibili now uses emscripten, which is very difficult for reverse
engineering. I don't expect it to be fixed in near future, so I mark
it as broken.

Ref: #10375
 2016-08-24 21:28:00 +08:00
Yen Chi Hsuan 18b6216150 [openload] Fix extraction (closes #10408) 
Thanks @yokrysty for the algorithm
 2016-08-23 21:55:58 +08:00
Yen Chi Hsuan 96229e5f95 [mtvservices:embedded] Update config URL 
All starts from #10363. The test case in mtvservices:embedded uses
config.xml, while the video from #10363 and the test case in generic.py
is broken. Both uses index.html for fetching the feed URL.
 2016-08-22 13:56:09 +08:00
Yen Chi Hsuan ad120ae1c5 [extractor/common] Change the default m3u8 protocol in HTML5 
Helper functions should have consistent default values
 2016-08-22 02:26:07 +08:00
Yen Chi Hsuan f97f9f71e5 Merge branch 'TRox1972-charlierose' 2016-08-22 02:11:43 +08:00
Yen Chi Hsuan 526656726b [charlierose] Simplify and improve 2016-08-22 02:06:47 +08:00
Yen Chi Hsuan d13bfc07b7 Merge branch 'charlierose' of https://github.com/TRox1972/youtube-dl into TRox1972-charlierose 2016-08-22 00:48:35 +08:00
Yen Chi Hsuan d164a0d41b [README.md] Add a format selection example using comma 
Ref: #10399
 2016-08-21 20:00:48 +08:00
Yen Chi Hsuan 39e1c4f08c [litv] Support 'promo' URLs (closes #10385) 2016-08-20 00:52:37 +08:00
Yen Chi Hsuan 19f35402c5 [snotr] Fix extraction (closes #10338) 2016-08-20 00:18:22 +08:00
Yen Chi Hsuan 70852b47ca [utils] Recognize units with full names in parse_filename 
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
 2016-08-20 00:17:26 +08:00
Yen Chi Hsuan a9a3b4a081 [miomio] Adapt to the new API and update _TESTS 
The test case is from #9680
 2016-08-20 00:08:23 +08:00
Yen Chi Hsuan ecc90093f9 [vuclip] Adapt to the new API and update _TEST 2016-08-19 23:56:09 +08:00
Yen Chi Hsuan 520251c093 [extractor/common] Recognize m3u8 manifests in HTML5 multimedia tags 2016-08-19 23:53:47 +08:00
Yen Chi Hsuan 55af45fcab [radiobremen] Update _TEST (closes #10337) 2016-08-19 23:12:30 +08:00
Yen Chi Hsuan b82232036a [n-tv.de] Fix extraction (closes #10331) 2016-08-19 20:39:28 +08:00
Yen Chi Hsuan e4659b4547 [utils] Correct octal/hexadecimal number detection in js_to_json 2016-08-19 20:37:17 +08:00
Yen Chi Hsuan 69eb4d699f [cbsnews] Remove invalid tests. CBS Live videos gets deleted soon. 2016-08-15 20:29:22 +08:00
Yen Chi Hsuan 6d8ec8c3b7 [ChangeLog] Update for CBSLocal and related changes 2016-08-15 13:39:43 +08:00
Yen Chi Hsuan 760845ce99 [cbslocal] Adapt to SendtoNewsIE 2016-08-15 13:37:37 +08:00
Yen Chi Hsuan 5c2d087221 [sendtonews] Fix extraction 2016-08-15 13:31:08 +08:00
Yen Chi Hsuan b6c4e36728 [jwplatform] Parse video_id from JWPlayer data 
And remove a mysterious comma from 115c65793a
 2016-08-15 13:29:01 +08:00
Yen Chi Hsuan fafabc0712 Update ChangeLog for #10342 
[skip ci]
 2016-08-14 02:33:15 +08:00
Yen Chi HsuanandGitHub 409760a932 Merge pull request #10342 from muphil/patch-1 
[xiami] bug fix for extractor xiami.py
 2016-08-14 02:30:50 +08:00