Jaime Marquínez Ferrándiz
bb18d787b5
[aljazeera] Add extractor ( closes #4487 )
2014-12-16 15:48:01 +01:00
Jaime Marquínez Ferrándiz
4b7df0d30c
[youtube:playlist] Work around buggy playlists ( fixes #4449 )
...
They show a "Load more" button, but they don't have more videos.
The continuation url in the json file was a link to itself, so we ended up in an infinite loop.
2014-12-15 19:19:15 +01:00
Jaime Marquínez Ferrándiz
3013bbb27d
Remove unused imports
2014-12-15 08:24:50 +01:00
Jaime Marquínez Ferrándiz
1557ed153c
[test_unicode_literals] Import from test.helper
2014-12-13 12:45:09 +01:00
Jaime Marquínez Ferrándiz
293f0f39ce
[utils] make_HTTPS_handler: Remove try/except block that would always raise an exception
...
This code is only run for Python < 3.4, where context.load_default_certs doesn't exist
2014-12-12 23:43:25 +01:00
Jaime Marquínez Ferrándiz
0db261ba56
[utils] make_HTTPS_handler: Use ssl.create_default_context in Python 2.7.9
...
The new features in the ssl module have been backported from 3.4, see https://docs.python.org/dev/whatsnew/2.7.html#pep-466-network-security-enhancements-for-python-2-7
2014-12-12 23:35:17 +01:00
Jaime Marquínez Ferrándiz
26c06f0c51
[youtube:playlist] Remove unused property
2014-12-12 22:26:50 +01:00
Jaime Marquínez Ferrándiz
23d3608c6b
[youtube:channel] Fix extraction ( fixes #4435 )
...
It uses now the same pagination system as playlists
2014-12-12 22:23:54 +01:00
Jaime Marquínez Ferrándiz
9c1aa1d668
[mixcloud] Fix metadata extraction ( fixes #4443 )
2014-12-11 23:16:40 +01:00
Jaime Marquínez Ferrándiz
83e865a370
Fix PEP8 issue E713
2014-12-09 23:11:26 +01:00
Jaime Marquínez Ferrándiz
603c92080f
[nhl] Make sure we add '_sd' before the extension ( fixes #4397 )
...
'.replace' would find the first dot in the path.
2014-12-07 11:26:07 +01:00
Jaime Marquínez Ferrándiz
abe70fa044
[audiomack] Modernize test definition
2014-12-04 08:21:29 +01:00
Jaime Marquínez Ferrándiz
233d37fb6b
[brightcove] Make sure that the 'ext' variable is set ( fixes #4360 )
2014-12-03 13:25:49 +01:00
Jaime Marquínez Ferrándiz
163c8babaa
[nhl] Simplify
2014-12-03 00:08:26 +01:00
Jaime Marquínez Ferrándiz
6708542099
Merge branch 'master' of https://github.com/akretz/youtube-dl
2014-12-03 00:00:05 +01:00
Jaime Marquínez Ferrándiz
ea2ee40357
[nhl.com:videocenter] Don't match url with 'id=*' before 'catid' in the query
...
Since the order extractors are added is not defined, it would match instead of NHLIE.
2014-12-02 23:56:30 +01:00
Jaime Marquínez Ferrándiz
05177b34a6
[rutube] Extract m3u8 formats ( fixes #3984 )
2014-12-01 18:20:36 +01:00
Jaime Marquínez Ferrándiz
c41a9650c3
[youtube] Extract framerate from the dash manifest
...
Not all videos have 60 fps, for example they can have 48 fps.
2014-12-01 17:36:12 +01:00
Jaime Marquínez Ferrándiz
94aa25b995
Credit @Tithen-Firion for the myspace changes ( #4341 )
2014-12-01 16:15:09 +01:00
Jaime Marquínez Ferrándiz
954f36f890
[myspace] Cleanup
2014-12-01 00:10:12 +01:00
Jaime Marquínez Ferrándiz
19e92770c9
[myspace] Replace removed test video and fix the others
2014-12-01 00:10:12 +01:00
Jaime Marquínez Ferrándiz
c522adb1f0
[youtube] Add a normal age-gate test video
2014-11-30 21:45:49 +01:00
Jaime Marquínez Ferrándiz
7160532d41
[youtube] Simplify code for getting the dash manifest url
...
video_info contains now the 'ytplayer.config.args' dictionary
2014-11-30 21:07:50 +01:00
Jaime Marquínez Ferrándiz
4e62ebe250
[youtube] Try to extract the video_info from the webpage before requesting the 'get_video_info' pages
...
The YouTube player doesn't seem to use them except for embedded videos, so we can skip a network request.
But they still provide better error mesagges (for removed videos for example).
2014-11-30 20:56:32 +01:00
Jaime Marquínez Ferrándiz
4472f84f0c
[test/test_subtitles] Update checksum for vimeo subtitle file
2014-11-30 19:42:54 +01:00
Jaime Marquínez Ferrándiz
b766eb2707
[youtube] Update test
2014-11-30 19:18:39 +01:00
Jaime Marquínez Ferrándiz
10a404c335
[youtube] Add format 313 ( fixes #4339 )
2014-11-30 18:56:14 +01:00
Jaime Marquínez Ferrándiz
42939b6129
[youtube] Use a cookie for seeting the language
...
This way, we don't have to do an aditional request
2014-11-30 00:03:59 +01:00
Jaime Marquínez Ferrándiz
37ea8164d3
[youtube] Don't confirm age when initializing
...
It seems that all the videos with age restriction use now the age gate method, which doesn't require any confirmation.
2014-11-29 23:46:39 +01:00
Jaime Marquínez Ferrándiz
00e9d396ab
[francetv] Use the m3u8 manifest for georestricted videos ( closes #3963 )
...
Generating the correct urls for the f4m segments seems to require a lot of work.
Also raise an error if the video is not available from your location.
2014-11-24 19:49:43 +01:00
Jaime Marquínez Ferrándiz
4d46c1c68c
[brightcove] Improve error message detection ( #4256 )
2014-11-20 18:44:54 +01:00
Jaime Marquínez Ferrándiz
d6f714f321
[brightcove] Remove the namespace from the BrightcoveExperience html object
2014-11-20 18:37:08 +01:00
Jaime Marquínez Ferrándiz
f56875f271
[test/test_compat] Restore the old value of the HOME environment variable
...
If the test was run before the YoutubeIE tests (for example by running
"nosetests -v test/test_compat.py test/test_download.py -m 'Youtube_1|compat_expand'"),
it wrote the signatures cache to the 'C:\Documents and Settings\тест\Application Data' folder.
It failed due to a problem in the cache code and the write_json_file function (fixed in f03e33b89a622af13fa5275c46b63aaa4814c499)
2014-11-19 00:02:24 +01:00
Jaime Marquínez Ferrándiz
92120217eb
[cache] Fix writing to paths with unicode characters
...
* Use "compat_getenv"
* "write_json_file" now expects the filename to be a string
2014-11-19 00:02:24 +01:00
Jaime Marquínez Ferrándiz
ec5f601670
[utils] Fix "write_json_file" for unicode names in python 2.x ( fixes #4125 )
2014-11-15 22:00:32 +01:00
Jaime Marquínez Ferrándiz
71f8c7ce7a
[mtvservices:embedded] Improve config url ( fixes #4092 )
2014-11-14 19:02:18 +01:00
Jaime Marquínez Ferrándiz
5fee0eeac0
[ComedyCentralShows] Use the rtmp urls transform function from the MTV IE ( fixes #3364 )
...
It produces the right mp4 urls, so we stop prefering the rtmp urls.
2014-11-14 18:36:04 +01:00
Jaime Marquínez Ferrándiz
9e05d039e0
[dailymotion] Fix extraction of vevo videos ( fixes #4168 )
2014-11-12 23:32:27 +01:00
Jaime Marquínez Ferrándiz
c295490830
[YoutubeDL] Fix bug in the detection of formats that don't contain video ( fixes #4150 )
...
If the format requested was not available, we called the method '.get' in None.
2014-11-12 09:42:35 +01:00
Jaime Marquínez Ferrándiz
eb4cb42a02
[ted] Extract duration ( closes #4155 )
2014-11-12 09:30:57 +01:00
Jaime Marquínez Ferrándiz
a6dae6c09c
[ndr] Improve video url regex ( fixes #4140 )
2014-11-09 11:15:50 +01:00
Jaime Marquínez Ferrándiz
f866e474f3
[YoutubeDL] Don't dowload formats for merging if the first doesn't contain the video ( #4132 )
2014-11-09 10:59:56 +01:00
Jaime Marquínez Ferrándiz
c2b61af548
[options] Document the syntax for merging formats ( closes #3940 , closes #4132 )
2014-11-08 15:09:04 +01:00
Jaime Marquínez Ferrándiz
2fdbf27ad8
[niconico:playlist] Use the same video url the webpage uses ( closes #4133 )
2014-11-08 14:53:23 +01:00
Jaime Marquínez Ferrándiz
1fe8fb8c20
[vice] Re-add extractor ( fixes #4120 )
...
The generic extraction no longer works.
2014-11-06 21:44:07 +01:00
Jaime Marquínez Ferrándiz
6110bbbfdd
[niconico] Catch deleted videos ( closes #4064 )
2014-11-05 19:52:34 +01:00
Jaime Marquínez Ferrándiz
4f195f55f0
Do not override stdlib html parser 'locatestarttagend' regex ( fixes #4081 )
...
'<a href="foo" ><img src="bar" / ></a>' wouldn't be parsed right (the problem is '/ >', '/>' worked fine).
We need to change it in python 2.6 (for example the description of youtube videos wouldn't be extracted).
2014-11-02 19:31:06 +01:00
Jaime Marquínez Ferrándiz
ac35c26686
[tests] Don't auto init YoutubeDL
...
It would print the debug headers for each test.
And nose uses a StringIO object for stdout, which in python 2.x doesn't have the 'encoding' attribute.
2014-11-02 17:53:12 +01:00
Jaime Marquínez Ferrándiz
d65d628613
[crunchycroll] Fix building of ass subtitles (reported in #4019 )
...
Parse the xml document instead of using regexes, otherwise unicode characters are left unescaped.
2014-10-29 21:19:20 +01:00
Jaime Marquínez Ferrándiz
8abec2c8bb
[test_utils] Fix compat_getenv and compat_expanduser tests on python 3.x
2014-10-29 11:13:34 +01:00
Jaime Marquínez Ferrándiz
a9bad429b3
[niconico] Add extractor for playlists ( closes #4043 )
2014-10-29 11:04:48 +01:00
Jaime Marquínez Ferrándiz
579657ad87
[soundcloud] Set the 'webpage_url' field for each track
...
For playlists, YoutubeDL would set it to the playlist url.
2014-10-26 19:08:36 +01:00
Jaime Marquínez Ferrándiz
5f82b129e0
[ffmpeg] Also look into stderr for extracting the version
...
At least with avconv 11, it will print 'avconv version 11, ..' to stderr, not stdout.
2014-10-26 18:11:31 +01:00
Jaime Marquínez Ferrándiz
1bdeb7be2e
Set '--simulate' if any of the printing options is given ( fixes #3036 )
...
That's what the help messages say.
Previously it would only set '--skip-download', which would write thumbnail,
descriptions or subtitles if they were requested (for example you may have set
'--write-thumbnail' in the config file).
2014-10-26 13:01:57 +01:00
Jaime Marquínez Ferrándiz
681b9caa9c
[tumblr] Fix extraction ( fixes #4029 )
2014-10-25 22:42:56 +02:00
Jaime Marquínez Ferrándiz
0eb9fb9f24
[soundcloud] Modernize and fix tests
2014-10-25 22:32:01 +02:00
Jaime Marquínez Ferrándiz
2c63ccec78
[mitele] Fix on python 2.x
2014-10-23 21:26:48 +02:00
Jaime Marquínez Ferrándiz
ad5f53ac72
[telecinco] Add extractor ( closes #4005 )
...
It uses the same extraction process as mitele.es, but with a few small differences.
2014-10-23 20:08:55 +02:00
Jaime Marquínez Ferrándiz
cc98a3f096
[cnn] Fix for urls ending in '.cnn-ap' ( fixes #3985 )
2014-10-19 15:14:37 +02:00
Jaime Marquínez Ferrándiz
4698f0d858
[vimeo] Improve regex for the config js dict ( fixes #3955 , fixes #3974 )
...
The javascript code contains assignments of empty dicts with the same variable name
2014-10-17 15:55:58 +02:00
Jaime Marquínez Ferrándiz
a72cbfacf0
[ted] Add support for external videos ( fixes #3948 )
2014-10-15 12:24:11 +02:00
Jaime Marquínez Ferrándiz
bd4e40df1a
[brightcove] Add a test for playlists
2014-10-13 16:26:53 +02:00
Jaime Marquínez Ferrándiz
b4c3c8c172
[mixcloud] Fix metadata extraction ( fixes #3930 )
2014-10-12 13:06:31 +02:00
Jaime Marquínez Ferrándiz
3357110a4c
[vimeo] Make the protocol mandatory in the url ( fixes #3926 )
...
If it's missing, it will be correctly handled by the generic IE.
2014-10-11 22:26:26 +02:00
Jaime Marquínez Ferrándiz
18937a50a4
[dropbox] Fix the video url query ( fixes #3868 )
...
Previously it would convert urls without a query into 'something.mp4&dl=1'
2014-10-01 23:19:56 +02:00
Jaime Marquínez Ferrándiz
8e6f8051f0
[vbox7] Don't set the extension to 'flv' ( fixes #3836 )
2014-09-27 10:53:02 +02:00
Jaime Marquínez Ferrándiz
63cddb6477
[sbs] Recognize urls with format ' http://www.sbs.com.au/ondemand/video/ <id>' ( #3811 )
2014-09-22 14:11:08 +02:00
Jaime Marquínez Ferrándiz
d0df92928b
[npo] Add extractor for tegenlicht.vpro.nl ( closes #3778 )
2014-09-21 16:53:00 +02:00
Jaime Marquínez Ferrándiz
e35cb78c40
[theplatform] Correctly extract videos that don't use f4m or rtmp (reported in #3176 )
2014-09-21 16:08:38 +02:00
Jaime Marquínez Ferrándiz
224ce0d872
[nbc] Update test
2014-09-21 15:49:04 +02:00
Jaime Marquínez Ferrándiz
dd41e8c82b
[theplatform] Extract all formats for f4m videos
2014-09-21 15:47:58 +02:00
Jaime Marquínez Ferrándiz
b509a4b176
[downloader/f4m] If <pv-2.0> is in the manifest, add it to the fragments urls query ( fixes #3176 )
...
It's used in some akamai videos (for example for theplatform.com).
2014-09-21 15:43:09 +02:00
Jaime Marquínez Ferrándiz
7bd4b4229a
[dropbox] Recognize ' https://www.dropbox.com/sh/ *' urls ( fixes #3795 )
...
And extract the title from the url last path component.
2014-09-21 13:42:08 +02:00
Jaime Marquínez Ferrándiz
09b23c902b
[1up.com] Urls end now with '.html'
2014-09-18 17:02:53 +02:00
Jaime Marquínez Ferrándiz
109a540e7a
[ign] Fix extraction
2014-09-18 16:57:34 +02:00
Jaime Marquínez Ferrándiz
a04aa7a9e6
[generic] The url in the <meta redirect> doesn't need to be enclosed in single quotes ( fixes #3770 )
...
See the examples in https://en.wikipedia.org/wiki/Meta_refresh or the shortened urls from https://t.co/ .
2014-09-16 22:53:48 +02:00
Jaime Marquínez Ferrándiz
56d1912f1d
Add a completion script generator for the fish shell
2014-09-14 14:07:33 +02:00
Jaime Marquínez Ferrándiz
edb53e2dc3
[youtube] Don't make the url protocol optional
...
The generic extractor will add it.
2014-09-11 21:47:25 +02:00
Jaime Marquínez Ferrándiz
f401a4173b
[youjizz] Don't make the url protocol optional ( fixes #3722 )
...
It would fail to download the webpag if it's missing.
And the generic extractor will add it.
2014-09-11 21:44:02 +02:00
Jaime Marquínez Ferrándiz
9b330db7f0
Add age limit to anysex, beeg, eporner, hornbuny and sunporno
2014-09-01 22:38:40 +02:00
Jaime Marquínez Ferrándiz
9ea9b61448
Merge branch 'master' of github.com:rg3/youtube-dl
2014-08-31 23:47:26 +02:00
Jaime Marquínez Ferrándiz
1ed5b5c9c8
[youtube:subscriptions] Fix extraction ( fixes #2975 )
2014-08-31 23:44:43 +02:00
Jaime Marquínez Ferrándiz
f30a38be8b
[youtube] Fix extraction of like and dislike count ( fixes #3633 )
2014-08-31 12:38:00 +02:00
Jaime Marquínez Ferrándiz
7798fad535
[downloader/rtmp] Use check_exectuble
2014-08-27 15:56:27 +02:00
Jaime Marquínez Ferrándiz
baf2907501
[downloader/hls] Return False if ffmpeg or avconv couldn't be found
2014-08-27 15:50:47 +02:00
Jaime Marquínez Ferrándiz
3c765c68c4
[downloader/hls] Use check_executable
2014-08-27 15:49:07 +02:00
Jaime Marquínez Ferrándiz
29153f49b3
[downloader/hls] Use the correct program when reporting an error
2014-08-27 15:40:02 +02:00
Jaime Marquínez Ferrándiz
a204c85408
[ign] Fix extraction of video in articles
2014-08-26 15:38:29 +02:00
Jaime Marquínez Ferrándiz
dbc1366b50
[mixcloud] Use a HEAD request when checking if the url is valid
2014-08-26 14:55:15 +02:00
Jaime Marquínez Ferrándiz
bcc069a937
[generic] Remove debug statement
2014-08-25 17:21:58 +02:00
Jaime Marquínez Ferrándiz
34708e1bb6
[bliptv] Remove superfluous characters in _VALID_URL regex
2014-08-25 17:16:11 +02:00
Jaime Marquínez Ferrándiz
938dd254e5
[mitele] Add extractor for mitele.es
2014-08-18 22:43:35 +02:00
Jaime Marquínez Ferrándiz
6493f5d704
[rtlnl] Add extractor for rtlxl.nl ( closes #3523 )
2014-08-18 15:40:48 +02:00
Jaime Marquínez Ferrándiz
a6da7b6b96
[facebook] Allow '?' before '#!' ( fixes #3477 )
2014-08-10 11:57:15 +02:00
Jaime Marquínez Ferrándiz
173a7026d5
[test/test_utils] Fix typo in method name
2014-08-10 11:08:56 +02:00
Jaime Marquínez Ferrándiz
40a90862f4
[reverbnation] The 'uploader_id' field must be a string
2014-08-10 11:00:14 +02:00
Jaime Marquínez Ferrándiz
511c4325dc
[reverbnation] Simplify json download
...
We can directly get a json file instead of the jsonp.
2014-08-10 10:58:22 +02:00
Jaime Marquínez Ferrándiz
85a699246a
[reverbnation] Modernize test
2014-08-10 10:56:37 +02:00
Jaime Marquínez Ferrándiz
4dc5286e13
[reverbnation] Make sure that the thumbnail url contain the protocol
...
They are protocol relative.
2014-08-10 10:45:27 +02:00
Jaime Marquínez Ferrándiz
f036a6328e
[extractor/common] _extract_f4m_formats: Use more specific messages when downloading the manifest
2014-07-28 15:42:19 +02:00