1
0
mirror of https://github.com/spaam/svtplay-dl.git synced 2024-11-28 06:04:17 +01:00
Commit Graph

947 Commits

Author SHA1 Message Date
Johan Andersson
64b2ac0240 utils.request: send chrome user-agent instead of the default one 2015-10-04 14:33:08 +02:00
Mikael Wikstrom
992d18c46d fix crach on empty error array cause by no streams 2015-10-02 10:40:11 +02:00
Johan Andersson
28581838b0 svtplay: show the right url when it can’t find the json page. 2015-10-02 10:21:11 +02:00
Johan Andersson
ebb7049e19 twitch: handle directories when we output to an directory 2015-09-30 13:52:17 +02:00
Jellyfrog
0be6bddf8c Make oppetarkiv work with --all-episodes again
seems they changed some css-classes
2015-09-30 00:47:49 +02:00
Mikael Johansson
e7d5dc1f6f Added command line option to skip download if there's no subtitles available 2015-09-20 20:30:27 +02:00
Johan Andersson
79c7f82881 subtitle: only convert when its unicode 2015-09-20 16:03:07 +02:00
Johan Andersson
3afb8aa490 subtitle: workaround a bug in requests in ubuntu 14.04 LTS
2.2.1 cant convert string from bytes to text right.

fixes #259
2015-09-20 15:15:50 +02:00
Johan Andersson
dc2cc0294c pip8. expected 2 lines found 1 2015-09-15 20:10:32 +02:00
Johan Andersson
0b280457a2 Prepare for release 0.20.2015.09.13 2015-09-13 23:37:10 +02:00
Johan Andersson
351206cd79 picsearch_test: di use picsearch nowdays 2015-09-13 23:03:59 +02:00
Johan Andersson
755cfe3825 raw: send url to hlsparse 2015-09-13 22:09:23 +02:00
Johan Andersson
8596e3bfb9 bigbrother: send url to hlsparse 2015-09-13 22:09:07 +02:00
Johan Andersson
29d00920ad utils: show an error message if requests is not found 2015-09-13 22:05:17 +02:00
Johan Andersson
80a55e2615 utils: unused import 2015-09-13 22:04:47 +02:00
Johan Andersson
58ac72ea70 ruv: hlsparse need the url to the playlist 2015-09-10 23:41:50 +02:00
Johan Andersson
82dabc602f support for solidtango
fixes #268
2015-09-10 23:40:48 +02:00
Johan Andersson
07d061d397 viaplay: adding support for juciplay.se 2015-09-10 21:57:55 +02:00
Johan Andersson
595f482a48 get_one_media: .message does not work with python3 2015-09-10 21:39:51 +02:00
Johan Andersson
f7323a0072 viaplay: f4m can be in the middle of the filename 2015-09-10 21:38:29 +02:00
Johan Andersson
1057f800b0 request: only show what request we are getting. 2015-09-07 20:13:36 +02:00
Johan Andersson
467e49b3ad sr: this should be text 2015-09-07 19:03:31 +02:00
Johan Andersson
5fcf3f71fd vimeo: this should be text 2015-09-07 19:02:43 +02:00
Johan Andersson
990cf491d5 twitch: this should be text 2015-09-07 19:00:40 +02:00
Johan Andersson
1e6de72d64 Better excluding message
fixing #198
2015-09-06 23:04:48 +02:00
Johan Andersson
b02b293919 output: walkaround for titles with .XXX at the in the end. 2015-09-06 22:51:39 +02:00
Johan Andersson
028a6fe061 urplay: dont include dupes 2015-09-06 22:41:49 +02:00
Johan Andersson
00335a06b5 urplay: import log 2015-09-06 22:41:29 +02:00
Johan Andersson
e0618e9fb0 generic: handle it as a regular service 2015-09-06 16:03:57 +02:00
Johan Andersson
411381a653 get_media: handle generic as a regular service. 2015-09-06 16:03:26 +02:00
Johan Andersson
8507219bf0 aftonbladet: use text instead of content 2015-09-06 16:02:54 +02:00
Johan Andersson
56bef49edf Catch all the Exceptions when the script is crashing 2015-09-06 14:56:54 +02:00
Johan Andersson
8408375356 twitch: better error handling 2015-09-06 14:37:40 +02:00
Johan Andersson
acf526c54a Show only one error message instead of two 2015-09-06 14:19:10 +02:00
Johan Andersson
7c811e38f8 kanal5: dont add dupes in the all season list
fixes #263
2015-09-03 22:09:30 +02:00
Johan Andersson
01a265427f get_media: add http:// if the user forgot to add it 2015-09-03 22:05:48 +02:00
Johan Andersson
45a5c0ee38 mtvnn: dont urlparse the path 2015-09-02 19:46:55 +02:00
Johan Andersson
bb47a5d1fa urplay: we need to send the url to hlsparse
fixes #260
2015-09-02 18:51:07 +02:00
Johan Andersson
086ae79482 svtplay: this need to be text 2015-09-01 23:53:13 +02:00
Johan Andersson
83fecfb6be tv4play: json need to be text 2015-09-01 23:52:16 +02:00
Johan Andersson
b3cd0ad586 viaplay: json need to be text 2015-09-01 23:52:00 +02:00
Johan Andersson
469e243361 kanal5: adding support for all episodes
this fixes #81
2015-09-01 23:44:57 +02:00
Johan Andersson
614c9b8ae5 subtitle_wsrt: decode html entities
fixes #255
2015-09-01 22:54:32 +02:00
Johan Andersson
028754606b qbrick: di dont use qbrick anymore 2015-09-01 00:37:32 +02:00
Johan Andersson
f01d97df9d dr: use text for json and send the url to the playlist 2015-09-01 00:37:06 +02:00
Johan Andersson
421057194e efn: send the url to the playlist 2015-09-01 00:36:27 +02:00
Johan Andersson
96d2bfd529 expressen: send the url to the playlist 2015-09-01 00:36:01 +02:00
Johan Andersson
21817c58f2 nrk: support for third kind of video 2015-09-01 00:23:19 +02:00
Johan Andersson
729374c94c nrk: support for p3.no 2015-09-01 00:22:51 +02:00
Johan Andersson
b55e5fbb27 picsearch: di.se switched provider 2015-08-31 23:46:17 +02:00
Johan Andersson
b1be0b5d0c picsearch: support for screen9 videos 2015-08-31 23:45:54 +02:00
Johan Andersson
4361254f0c vg: use text instead of bytes 2015-08-31 23:45:28 +02:00
Johan Andersson
6883f31550 subtitle: python3 fixes 2015-08-31 23:19:01 +02:00
Johan Andersson
08f47dcbd5 viaplay: should be text and not binary 2015-08-31 23:18:37 +02:00
Johan Andersson
665104bec8 urldata: should be text instead of binary 2015-08-31 23:18:18 +02:00
Johan Andersson
270506082d urplay: send the url to the playlist 2015-08-31 23:17:51 +02:00
Johan Andersson
b61b4cdac3 kanal5: open it as text not binary 2015-08-31 22:47:11 +02:00
Johan Andersson
724af70f49 subtitle: open as text and save it 2015-08-31 22:46:45 +02:00
Johan Andersson
c4cb752401 init: requests fixes 2015-08-31 22:26:19 +02:00
Johan Andersson
f30a782739 init: remove unused import 2015-08-31 22:26:04 +02:00
Johan Andersson
285b01a3b7 mtvnn: import urlparse from the right module 2015-08-31 22:25:37 +02:00
Johan Andersson
6cd4e335de viaplay: remove debug print 2015-08-31 22:25:14 +02:00
Johan Andersson
082f167245 more requests fixes for get_urldata.
dont check the first byte
2015-08-31 22:04:59 +02:00
Johan Andersson
812097b95b tv4play: remove unused imports 2015-08-31 21:54:10 +02:00
Johan Andersson
dc76094369 hls: remove unused imports 2015-08-31 20:35:37 +02:00
Johan Andersson
06472b5012 utils: remove unused imports 2015-08-31 20:35:23 +02:00
Johan Andersson
ea70ec30bf urllib: remove unused imports 2015-08-31 20:35:05 +02:00
Johan Andersson
7922966aff sr: dont look for aria-label when getting the audio info
fixes #258
2015-08-31 20:18:18 +02:00
Johan Andersson
331de0a70f replace self.http.get with our own function with debug info 2015-08-31 19:45:15 +02:00
Johan Andersson
abf29827fb oppetarkiv: request fixes 2015-08-31 17:14:31 +02:00
Johan Andersson
63a59707fe tv4play: request fixes 2015-08-31 17:14:19 +02:00
Johan Andersson
57842a3895 viaplay: request fixes 2015-08-31 17:14:08 +02:00
Johan Andersson
c2ae9e99e7 aftonbladet: request fixes 2015-08-31 17:13:48 +02:00
Johan Andersson
1bd7410cc2 dbtv: send hls url to hlsparse 2015-08-31 16:53:23 +02:00
Johan Andersson
c691aa6ea1 disney: request fixes 2015-08-31 16:51:09 +02:00
Johan Andersson
9394f03251 http: remove unused imports 2015-08-30 14:42:29 +02:00
Johan Andersson
a0f0b192e2 http: use requests 2015-08-30 14:41:59 +02:00
Johan Andersson
fb7d4dd1b9 vimeo: we need the content to look at it 2015-08-30 14:41:19 +02:00
Johan Andersson
a1e987348d download_thumbernail: use request instead 2015-08-30 12:04:49 +02:00
Johan Andersson
7115c57e4c generic: request fixes 2015-08-30 12:04:16 +02:00
Johan Andersson
12e85b00ee picsearch: unused import 2015-08-30 12:03:56 +02:00
Johan Andersson
4daf49f84b twitch: more requests fixes 2015-08-30 11:57:45 +02:00
Johan Andersson
d51e513c17 More request fixes 2015-08-30 11:27:31 +02:00
Johan Andersson
1d51ad71f1 kanal5: requests fixes 2015-08-30 10:33:38 +02:00
Johan Andersson
daec9178d8 tv4play: requests fixes 2015-08-30 10:20:47 +02:00
Johan Andersson
f416a17572 ensure_unicode: remove extra space 2015-08-30 00:08:24 +02:00
Johan Andersson
84ee181f5b adding request support.
still need some more work
2015-08-30 00:06:20 +02:00
Johan Andersson
b47f3f8601 Prepare for release 0.10.2015.08.24 2015-08-24 23:06:41 +02:00
Johan Andersson
5a54105ccc output: use the right slash for the right platform
fixes #251
2015-08-24 23:02:28 +02:00
Johan Andersson
ea014f27d2 svtplay: seperate format and output json. 2015-08-24 23:02:28 +02:00
Olof Johansson
495dc1fcaa twitch: Don't include description in filename
This can easily lead to "IOError: [Errno 36] File name too long"
exceptions.
2015-08-24 18:44:46 +02:00
Olof Johansson
f7b26a5745 Rename Justin to Twitch
Justin has been disbanded for a while.
2015-08-24 18:42:58 +02:00
Olof Johansson
56274ec64e build: Avoid using non-portable install -D
The following error was reported when trying to build on OSX:

 install: illegal option -- D

We now instead create the directories in a first, and copy in a second
step.
2015-07-26 12:48:23 +02:00
Johan Andersson
7ea335ec10 service.exclude: don’t crash when using åäö
fixes #245
2015-07-13 19:26:51 +02:00
Johan Andersson
1beebb7bea mtvnn: they changed how the id is present in the text.
fixes #243
2015-07-05 21:51:58 +02:00
Johan Andersson
f3f748dde2 efn: adding support
fixed #242
2015-07-05 21:08:11 +02:00
Johan Andersson
5b015b95c1 oppetarkiv: they changed the links for the videos.
this fixes #238
2015-06-28 16:45:43 +02:00
Johan Andersson
86d17b5d20 Merge pull request #239 from olof/topic/reproducibility
Two reproducible build issues
2015-06-14 20:25:39 +02:00
Johan Andersson
63eee40e49 subtitle_wrst: check against int instead of str
this fixes #240
2015-06-07 20:10:36 +02:00
Olof Johansson
352fd90e51 build: Truncate timestamps in zip archive
Even though zip's -X flag suggests that it removes timestamps, that's not
quite true. There's still modification times per file, and that introduces
non-determinism that are hard to notice, since the mtimes are unlikely to
change without changes to the files. Only when doing a new clone/unpacking
a tar ball under some circumstances or similar action that resets/discards
the mtimes, we would notice.

So, the -X is not enough, and from what I can tell, there's no way of
telling zip to not include timestamps (or truncate them). With this
change, we stage all files in a temporary .build directory, and set the
mtime manually to the beginning of time (as is the case for zip files:
1980-01-01T00:00). These timestamps should not be important to anyone,
since they are all presented to the user as a blob.

The rationale for this change is that this makes it possible to build
svtplay-dl reproducibly. And it also removes the pesky svtplay-dl diffs
just from regenerating the executable.
2015-05-30 13:58:30 +02:00
Johan Andersson
0006eeea58 Prepare for release 0.10.2015.05.24 2015-05-24 17:31:34 +02:00
Johan Andersson
0259643fbe __init__: unused import 2015-05-24 14:55:45 +02:00
Johan Andersson
0ee4ef7ce9 justin: unused variable 2015-05-24 14:51:37 +02:00
Johan Andersson
89cf3cad76 tv4play: they changed the order on name and type key.
this fixes #237
2015-05-24 14:27:07 +02:00
Johan Andersson
b0dbe63345 justin: better filenames 2015-05-24 13:59:11 +02:00
Johan Andersson
6f228284cf justin: refactor get function 2015-05-24 12:37:16 +02:00
Johan Andersson
e1100fa7d4 justin: support for the new vod system 2015-05-23 19:18:04 +02:00
Johan Andersson
617edb4d21 urplay: better path for rtmp streams 2015-05-06 10:42:03 +02:00
Johan Andersson
620cbf9b43 urplay: Check how many items we have in subtitles
This fixes #235
2015-05-06 10:33:24 +02:00
Johan Andersson
7950e06e0d smi: check if data is empty 2015-05-01 22:34:02 +02:00
Johan Andersson
4d634dc323 unused import 2015-04-30 11:42:21 +02:00
Johan Andersson
072e4d50c7 filename: it should be latin1 not lain1. 2015-04-30 11:03:52 +02:00
Johan Andersson
5c135d24a4 Move automagic filename thing to output.py 2015-04-30 11:02:18 +02:00
Johan Andersson
07038caa2a get_one_media: don’t try to decode utf8 on filenames on windows
more fixes #233
2015-04-30 10:51:43 +02:00
Johan Andersson
67ad23a8b3 get_one_media: handle international character in output
this fixes #233
2015-04-29 15:06:18 +02:00
Johan Andersson
acb3349591 qbrick: unused import unquote_plus 2015-04-28 23:20:34 +02:00
Johan Andersson
01fee67b88 vg, vimeo: missing newline at the end of file 2015-04-28 23:19:35 +02:00
Johan Andersson
c95c51fa5d subtitle: missing r-prefix 2015-04-28 23:16:44 +02:00
Johan Andersson
7ed21ae16b smi: Handle subtitle that starts direct after the previous one.
this fixes #225
2015-04-28 23:00:24 +02:00
Johan Andersson
26a5db7a6e wrst: don’t encode the data to utf8 on python3 2015-04-28 22:59:07 +02:00
Johan Andersson
679f40cf35 io: use StringIO instead of BytesIO 2015-04-28 22:58:02 +02:00
Johan Andersson
29612f4f11 get_one_media: fixes issues with filenames with “, ‘ and \ in windows
this fixes #230
2015-04-27 22:25:56 +02:00
Johan Andersson
749d00ac82 svtplay: use context instead of statistics for filename 2015-04-16 21:58:48 +02:00
Johan Andersson
bdeea1e130 facebook: better error message 2015-03-31 20:51:13 +02:00
Johan Andersson
6f20126ff7 facebook: support for downloading public videos. 2015-03-31 20:49:08 +02:00
Johan Andersson
1d3f3ac96f Prepare for release 0.10.2015.03.25 2015-03-25 00:17:30 +01:00
Jimmy Axenhus
ae8e768b51 Add a new command line switch --get-url that prints the URL instead. 2015-03-24 21:10:01 +01:00
Olof Johansson
2265d544b9 Synchronize manual with --help text 2015-03-21 18:36:31 +01:00
Johan Andersson
d58ce64ec8 urplay: they updated their site a bit.
this fixes #213
2015-03-21 17:36:15 +01:00
Johan Andersson
e449d8c471 subtitle: py3 fixes 2015-03-12 21:39:36 +01:00
Johan Andersson
abd38b55ea subtitle: smi py3 fixes 2015-03-12 21:33:55 +01:00
Johan Andersson
cd2ef6b403 ruv: leftover debugstuff.. 2015-03-12 19:35:33 +01:00
Johan Andersson
5c6859fdf3 ruv: some files is .mp4 files instead of .m3u8
this fixes #218
2015-03-08 14:56:04 +01:00
Johan Andersson
70ef4a30a5 qbrick: sydsvenskan is not supported anymore
fixes #216
2015-03-08 14:46:27 +01:00
Johan Andersson
fce27d5736 svtplay: Grab all episodes from the new program page.
fixes #216
2015-03-08 00:44:26 +01:00
Anders Waldenborg
371e06f6cf ur.se: Add scraping for all episodes if rss doesn't exist
Example: http://www.ur.se/Produkter/178229-Vilda-djur-Trana
2015-03-07 10:46:01 +01:00
Anders Waldenborg
101354ed7e Add urljoin to svtplay_dl.utils.urllib 2015-03-07 10:42:48 +01:00
Johan Andersson
c5d21de673 dr: subtitle support
this fixes #214
2015-03-01 21:46:22 +01:00
Johan Andersson
ec7356aeea subtitle: rewrite wrst function 2015-03-01 21:44:55 +01:00
Johan Andersson
3821481322 aftonbladet: support for the new design 2015-02-17 13:41:26 -08:00
Johan Andersson
1e501bc7b9 aftonbladet: check if we got any streams or not 2015-02-17 13:41:25 -08:00
Olof Johansson
87ae56caca Make build reproducible
This change makes zip drop any additional metadata about the file, like access
time. Without this change, you'd get different md5sums every time you build
svtplay-dl --- even though you use the exact same sources.

Credit to the people behind http://reproducible.debian.net/ for inspiration! :)
2015-02-13 23:33:52 +01:00
Johan Andersson
72f04e3b47 svtplay: don’t crash when we can’t get any HLS streams 2015-02-01 09:09:37 +01:00
Johan Andersson
bcccfd3e86 New version 0.10.2015.01.28 2015-01-28 22:34:42 +01:00
Johan Andersson
91a94f5b6e generic: return None stream when http error. 2015-01-28 21:57:54 +01:00
Johan Andersson
ff3971edec outout: remove a superfluous-parens 2015-01-28 21:02:27 +01:00
Johan Andersson
a1fdefa0ca raw: refactor filename part 2015-01-28 20:57:37 +01:00
Johan Andersson
68854fc53a get_media: they to the same thing so better have fewer lines 2015-01-28 20:50:10 +01:00
Johan Andersson
cc72aa341a Handle raw .m3u8 and .f4m links better. 2015-01-28 19:00:31 +01:00
Johan Andersson
15b3909035 raw: handle directories better 2015-01-28 18:58:38 +01:00