Jaime Marquínez Ferrándiz
ecc6bd1341
YoutubeDL.post_process: simplify keep_video handling
...
Since keep_video started as None we always set it to keep_video_wish unless it was None, so in the end keep_video == keep_video_wish. This should have been changed in f3ff1a3696 , but I didn't notice it.
2015-04-17 22:38:14 +02:00
Jaime Marquínez Ferrándiz
ce81b1411d
FFmpegExtractAudioPP: Simplify handling of already existing files
2015-04-17 22:37:27 +02:00
Jaime Marquínez Ferrándiz
214e74bf6f
[soundcloud] Raise an error instead of calling 'report_error'
2015-04-17 19:24:30 +02:00
Jaime Marquínez Ferrándiz
c5826a491b
[mixcloud] Simplify url extraction
...
On the tracks I tested the server number in the url from the webpage is valid
for the mp3 or the m4a file and any other number is invalid, it's a
waste of time to check them.
2015-04-17 19:02:49 +02:00
Jaime Marquínez Ferrándiz
08f2a92c9c
InfoExtractor._search_regex: Suggest updating when the regex is not found (suggested in #5442 )
...
Reuse the same message from ExtractorError
2015-04-17 14:55:24 +02:00
Jaime Marquínez Ferrándiz
024ebb2706
[soundcloud] Handle 'secret_token' for 'w.soundcloud.com/player/?url=*' urls ( fixes #5453 )
2015-04-17 10:46:25 +02:00
Jaime Marquínez Ferrándiz
37b44fe7c1
[postprocessor/atomicparsley] Don't try to remove the temporary and original files if the format is unsupported ( fixes #5419 )
2015-04-13 22:50:40 +02:00
Jaime Marquínez Ferrándiz
ce73839fe4
[rtve] Detect videos that are no longer available
2015-04-09 14:01:33 +02:00
Jaime Marquínez Ferrándiz
8e4b83b96b
Remove check for ssl certs
...
When it uses a capath instead of a cafile, 'get_ca_certs' or 'cert_store_stats' only returns certificates already used in a connection.
(see #5364 )
2015-04-06 22:18:08 +02:00
Jaime Marquínez Ferrándiz
e9f65f8749
[rtve] Extract a better quality video
2015-04-04 13:11:55 +02:00
Jaime Marquínez Ferrándiz
cd341b6e06
[mixcloud] Fix extraction of like count (reported in #5231 )
2015-04-03 19:37:35 +02:00
Jaime Marquínez Ferrándiz
ff2be6e180
[bloomberg] Adapt to website changes ( fixes #5347 )
2015-04-03 15:01:17 +02:00
Jaime Marquínez Ferrándiz
3da4b31359
[postprocessor/ffmpeg] Fix crash when ffprobe/avprobe are not installed ( closes #5349 )
...
'self.probe_basename' was None, so 'probe_executable' raised a KeyError exception
2015-04-03 14:09:50 +02:00
Jaime Marquínez Ferrándiz
4bbeb19fc7
[miomio] pep8: remove whitespaces in empty line
2015-04-03 14:09:07 +02:00
Jaime Marquínez Ferrándiz
1a944d8a2a
Print a warning if no ssl certificates are loaded
2015-04-02 14:09:55 +02:00
Jaime Marquínez Ferrándiz
cb88671e37
[nbc] Recognize https urls ( fixes #5300 )
2015-03-28 14:18:11 +01:00
Jaime Marquínez Ferrándiz
8e678af4ba
Makefile: fix 'find' command
...
It worked with the GNU version, but not with the BSD version.
2015-03-27 14:21:53 +01:00
Jaime Marquínez Ferrándiz
70a1165b32
Don't use bare 'except:'
...
They catch any exception, including KeyboardInterrupt, we don't want to catch it.
2015-03-27 13:02:20 +01:00
Jaime Marquínez Ferrándiz
157e9e5aa5
[youtube:watchlater] Remove unused properties and fix tests
2015-03-26 20:03:31 +01:00
Jaime Marquínez Ferrándiz
c496ec0848
[vessel] Fix pep8 issue
2015-03-26 19:51:40 +01:00
Jaime Marquínez Ferrándiz
93f787070f
[twitch] Only match digits for the video id
...
Urls can also contain contain a query (for example a timestamp '?t=foo')
2015-03-22 15:39:35 +01:00
Jaime Marquínez Ferrándiz
f9544f6e8f
[test/aes] Test aes_decrypt_text with 256 bit
2015-03-22 12:09:58 +01:00
Jaime Marquínez Ferrándiz
336d19044c
[lybsyn] pep8: add space around operator
2015-03-22 11:03:52 +01:00
Jaime Marquínez Ferrándiz
5379a2d40d
[test/utils] Test xpath_text
2015-03-21 14:12:43 +01:00
Jaime Marquínez Ferrándiz
c9450c7ab1
[nrk:playlist] Restrict _VALID_URL
...
It would also match /videos/PS... urls
2015-03-21 14:00:37 +01:00
Jaime Marquínez Ferrándiz
179d6678b1
Remove the 'stitle' field
...
A warning has been printed for more than 2 years (since 97cd3afc75 )
2015-03-21 12:34:44 +01:00
Jaime Marquínez Ferrándiz
85698c5086
[crunchyroll] Remove unused class
2015-03-21 12:18:33 +01:00
Jaime Marquínez Ferrándiz
a7d9ded45d
[test] Add tests for aes
2015-03-21 12:07:23 +01:00
Jaime Marquínez Ferrándiz
531980d89c
[test/YoutubeDL] test match_filter
2015-03-20 17:05:28 +01:00
Jaime Marquínez Ferrándiz
f20bf146e2
[test/YoutubeDL] split in two classes
...
The name was misleading
2015-03-20 15:14:25 +01:00
Jaime Marquínez Ferrándiz
01218f919b
[test/http] Add test for proxy support
2015-03-20 14:59:38 +01:00
Jaime Marquínez Ferrándiz
7a757b7194
[mixcloud] Fix extraction of some metadata
...
The second test had some wrong info.
I couldn't find the timestamp, so I have removed it.
2015-03-18 17:08:19 +01:00
Jaime Marquínez Ferrándiz
90183a46d8
Credit @eferro for the rtve.es:infantil extractor ( #5214 )
2015-03-15 22:49:03 +01:00
Jaime Marquínez Ferrándiz
b68eedba23
[rtve.es:infantil] Minor fixes ( closes #5214 )
2015-03-15 22:18:41 +01:00
Jaime Marquínez Ferrándiz
7c42327e0e
tox.ini: Add python 3.4
2015-03-14 21:41:56 +01:00
Jaime Marquínez Ferrándiz
873383e9bd
tox.ini: Run the same command as 'make offlinetest' by default
2015-03-14 21:41:15 +01:00
Jaime Marquínez Ferrándiz
8508557e77
[test/YoutubeDL] Use valid urls
...
It failed on python 3.4 when building the http_headers field
2015-03-14 20:51:42 +01:00
Jaime Marquínez Ferrándiz
4d1652484f
[test/unicode_literals] Don't look into the .git and .tox directories
...
The .tox directory contains python code that we can't control
2015-03-14 20:25:37 +01:00
Jaime Marquínez Ferrándiz
88cf6fb368
[metadatafromtitle] Some improvements and cleanup
...
* Remove the 'songtitle' field, 'title' can be used instead.
* Remove newlines in the help text, for consistency with other options.
* Add 'from __future__ import unicode_literals'.
* Call '__init__' from the parent class.
* Add test for the format_to_regex method
2015-03-14 20:06:33 +01:00
Jaime Marquínez Ferrándiz
082b1155a3
[livestream] Extract all videos in events ( fixes #5198 )
...
The webpage only contains the most recent ones, but if you scroll down more will appear.
2015-03-14 12:06:01 +01:00
Jaime Marquínez Ferrándiz
9202b1b787
[eighttracks] Remove unused import
2015-03-14 12:04:49 +01:00
Jaime Marquínez Ferrándiz
054b99a330
[jeuxvideo] Fix extraction ( fixes #5190 )
2015-03-12 22:33:59 +01:00
Jaime Marquínez Ferrándiz
3946864c8a
[vimeo] Use https for all vimeo.com urls
...
Unfortunately vimeopro.com doesn't support it yet.
2015-03-12 19:08:16 +01:00
Jaime Marquínez Ferrándiz
b84037013e
[vimeo] Fix login ( #3886 )
2015-03-12 18:45:00 +01:00
Jaime Marquínez Ferrándiz
3a77719c5a
Don't accept '-1' as format, 'all' is clearer
2015-03-11 17:38:35 +01:00
Jaime Marquínez Ferrándiz
f5d8f58a17
[yandexmusic:album] Improve _VALID_URL to avoid matching tracks urls
2015-03-09 18:17:22 +01:00
Jaime Marquínez Ferrándiz
937daef4a7
[niconico] Use '_match_id'
2015-03-09 18:12:41 +01:00
Jaime Marquínez Ferrándiz
dd77f14c64
[yandexmusic] PEP8: remove blank line at the end of file
2015-03-09 18:07:31 +01:00
Jaime Marquínez Ferrándiz
43d6280d0a
[downloader/f4m] Fix use of base64 in python 3.2 ( fixes #5132 )
...
b64decode needs a byte string, but on 3.4 it also accepts strings.
2015-03-08 18:25:11 +01:00
Jaime Marquínez Ferrándiz
23ba76bc0e
[dailymotion] Replace test
...
It has been removed.
2015-03-06 22:45:05 +01:00
Jaime Marquínez Ferrándiz
61e00a9775
[vimeo] Use https for player.vimeo.com urls ( closes #5147 )
2015-03-06 22:39:05 +01:00
Jaime Marquínez Ferrándiz
d1508cd68d
[vimeo:album] Fix password protected videos
...
Since it only uses https now, don't recognize http urls.
2015-03-06 22:16:26 +01:00
Jaime Marquínez Ferrándiz
9c85b5376d
[vimeo] Fix and use '_verify_video_password' ( #5001 )
...
It only supports verifying the password over https now.
Use it instead of manually setting the 'password' cookie because it allows to check if the password is correct.
2015-03-06 19:08:27 +01:00
Jaime Marquínez Ferrándiz
3c6f245083
[vimeo] Fix upload date extraction
2015-03-06 18:16:56 +01:00
Jaime Marquínez Ferrándiz
f28fe66970
[downloader/http] Add missing fields for _hook_progress call
...
It would fail if you run 'youtube-dl --no-part URL' a second time when the file has already been downloaded.
(Reported in Fedora: https://bugzilla.redhat.com/show_bug.cgi?id=1195779 )
2015-03-04 12:14:38 +01:00
Jaime Marquínez Ferrándiz
123397317c
[downloader/http] Remove wrong '_hook_progress' call ( fixes #5117 )
2015-03-03 18:45:56 +01:00
Jaime Marquínez Ferrándiz
31bd39256b
--load-info: Use the fileinput module
...
It automatically handles the '-' filename as stdin
2015-03-01 11:54:48 +01:00
Jaime Marquínez Ferrándiz
003c69a84b
Use shutil.get_terminal_size for getting the terminal width if it's available (python >= 3.3)
2015-02-28 21:44:57 +01:00
Jaime Marquínez Ferrándiz
e9fade72f3
Add postprocessor for converting subtitles ( closes #4954 )
2015-02-28 14:43:24 +01:00
Jaime Marquínez Ferrándiz
0f2c0d335b
[YoutubeDL] Use the InfoExtractor._download_webpage method for getting the subtitles
...
It handles encodings better, for example for 'http://www.npo.nl/nos-journaal/14-02-2015/POW_00942207 '
2015-02-28 14:03:27 +01:00
Jaime Marquínez Ferrándiz
781a7ef60a
[lynda] Use 'lstrip' for the subtitles
...
The newlines at the end are important, they separate each piece of text.
2015-02-27 16:18:18 +01:00
Jaime Marquínez Ferrándiz
f3bff94cf9
[rtve] Extract duration
2015-02-27 12:24:51 +01:00
Jaime Marquínez Ferrándiz
c10ea454dc
[telecinco] Recognize more urls ( closes #5065 )
2015-02-25 23:52:54 +01:00
Jaime Marquínez Ferrándiz
13d8fbef30
[generic] Don't set the 'title' if it's not defined in the entry ( closes #5061 )
...
Some of them may be an 'url' result, which in general don't have the 'title' field.
2015-02-25 17:56:51 +01:00
Jaime Marquínez Ferrándiz
25ac63ed71
[rtve] Extract subtitles
2015-02-23 23:04:07 +01:00
Jaime Marquínez Ferrándiz
ffdf972b91
[facebook] Extract all the formats ( closes #5037 )
2015-02-23 18:54:15 +01:00
Jaime Marquínez Ferrándiz
bfc993cc91
Merge branch 'subtitles-rework'
...
(Closes PR #4964 )
2015-02-23 17:13:03 +01:00
Jaime Marquínez Ferrándiz
b531cfc019
[YoutubeDL] remove compatiblity with the old subtitles system
2015-02-23 16:12:35 +01:00
Jaime Marquínez Ferrándiz
80970e531b
[test/subtitles] Update checksum for Viki
2015-02-22 11:52:22 +01:00
Jaime Marquínez Ferrándiz
b7bb76df05
[test/subtitles] Remove some tests
...
Test only with 'allsubtitles', the language selection is already tested in test_YoutubeDL.py
2015-02-22 11:51:57 +01:00
Jaime Marquínez Ferrándiz
98c70d6fc7
[YoutubeDL] only add normal subtitles to the 'requested_subtitles' field if 'writesubtitles' is True
2015-02-22 11:37:27 +01:00
Jaime Marquínez Ferrándiz
ab84349b16
[test/YoutubeDL] Add test for subtitles
...
Updated the offlinetest make target to not skip it
2015-02-22 11:29:56 +01:00
Jaime Marquínez Ferrándiz
03091e372f
[ted] Always extract the subtitles
...
The required info is already in the webpage
2015-02-22 00:27:59 +01:00
Jaime Marquínez Ferrándiz
4d17184817
[YoutubeDL] don't set the 'requested_subtitles' without writesubtitles or writeautomaticsub
2015-02-22 00:27:49 +01:00
Jaime Marquínez Ferrándiz
93540ee10e
[rtve] Fix the video url
...
Changing mvod to mvod1 fixes the url, we don't need to add the query.
2015-02-21 19:31:39 +01:00
Jaime Marquínez Ferrándiz
fb7cb6823e
Remove the SubtitlesInfoExtractor class
...
No longer needed
2015-02-19 23:24:24 +01:00
Jaime Marquínez Ferrándiz
6140baf4e1
[nationalgeographic] Add extractor ( closes #4960 )
2015-02-19 18:17:31 +01:00
Jaime Marquínez Ferrándiz
f13b1e7d7f
[bbccouk] Convert to new subtitles system
...
I haven't found any video available outside the UK, so I haven't added tests.
I have updated how the srt file is build, because (at least for www.bbc.co.uk/programmes/p02j9b69) the subtitles is inside 'span' elements.
2015-02-19 16:46:41 +01:00
Jaime Marquínez Ferrándiz
5c8a3f862a
[nbc] Use a test video that works outside the US
2015-02-19 15:00:39 +01:00
Jaime Marquínez Ferrándiz
8807f1277f
[theplatform] Convert to new subtitles system
2015-02-19 14:54:50 +01:00
Jaime Marquínez Ferrándiz
a3b9157f49
[cbssports] Add extractor ( closes #4996 )
2015-02-19 13:06:53 +01:00
Jaime Marquínez Ferrándiz
93a16ba238
[vimeo] Raise the ExtractorError with expected=True when no video password is given
2015-02-18 22:00:12 +01:00
Jaime Marquínez Ferrándiz
4f7cea6c53
[viki] Convert to new subtitles system
2015-02-18 20:37:16 +01:00
Jaime Marquínez Ferrándiz
afbdd3acc3
[rai] Convert to new subtitles system
2015-02-18 20:14:42 +01:00
Jaime Marquínez Ferrándiz
01561da142
[nrk] Convert to new subtitles system
2015-02-18 18:57:01 +01:00
Jaime Marquínez Ferrándiz
0af25f784b
[mtv] Convert to new subtitles system
2015-02-18 18:27:45 +01:00
Jaime Marquínez Ferrándiz
b9b42f2ea0
[npo] Convert to new subtitles system
2015-02-18 17:57:10 +01:00
Jaime Marquínez Ferrándiz
311c393838
[lynda] Convert to new subtitles system
2015-02-18 17:46:33 +01:00
Jaime Marquínez Ferrándiz
18c1c42405
[drtv] Convert to new subtitles system
2015-02-18 17:20:22 +01:00
Jaime Marquínez Ferrándiz
37dd5d4629
[mit] Don't set the subtitles field
...
YouTube already provides them in more formats
2015-02-18 17:19:56 +01:00
Jaime Marquínez Ferrándiz
edab9dbf4d
[YoutubeDL] use the 'render_table' function for listing the subtitles
2015-02-17 22:59:19 +01:00
Jaime Marquínez Ferrándiz
9868ea4936
[extractor/common] Simplify subtitles handling methods
...
Initially I was going to use a single method for handling both subtitles and automatic captions, that's why I used the 'list_subtitles' and the 'subtitles' variables.
2015-02-17 22:16:29 +01:00
Jaime Marquínez Ferrándiz
85920dd01d
[bliptv] Convert to new subtitles system
2015-02-17 21:56:25 +01:00
Jaime Marquínez Ferrándiz
bd7fe0cf66
[walla] Convert to new subtitles system
2015-02-17 21:23:09 +01:00
Jaime Marquínez Ferrándiz
48246541da
[ceskatelevize] Convert to new subtitles system
2015-02-17 21:17:47 +01:00
Jaime Marquínez Ferrándiz
4cd95bcbc3
[twitch:stream] Prefer the 'source' format ( fixes #4972 )
2015-02-17 18:57:01 +01:00
Jaime Marquínez Ferrándiz
fbc503d696
[downloader/hls] Fix detection of ffmpeg/avconv (reported in #4966 )
2015-02-17 16:40:42 +01:00
Jaime Marquínez Ferrándiz
662435f728
[YoutubeDL] Use a Request object for getting the cookies ( fixes #4970 )
...
So that we don't have to implement all the methods used by the cookiejar.
2015-02-17 16:29:24 +01:00
Jaime Marquínez Ferrándiz
163d966707
[downloader/external] curl: Add the '--location' flag
...
curl doesn't follow redirections by default
2015-02-17 16:21:02 +01:00
Jaime Marquínez Ferrándiz
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
2015-02-16 22:47:39 +01:00