|
|
aeffeabc33
|
added some first MinGW compatibility code
|
2014-08-28 17:54:20 +02:00 |
|
|
|
7f131b0ef5
|
added -k/--convert-links and -K/--backup-converted
|
2014-07-17 17:12:44 +02:00 |
|
|
|
d2813a0dc6
|
use libpsl for cookie checking against Public Suffix List
|
2014-07-11 17:05:36 +02:00 |
|
|
|
67f49bab9d
|
added --accept, --reject, --ignore-case
|
2014-07-03 13:29:50 +02:00 |
|
|
|
4e667ae853
|
fix some clang warnings
|
2014-04-04 15:36:10 +02:00 |
|
|
|
a51fe2fe98
|
fixed up cookie code
|
2014-03-19 17:15:24 +01:00 |
|
|
|
79aeb3fd27
|
fix sigfault in cookie functions
|
2014-03-08 22:24:42 +01:00 |
|
|
|
abe1c04d82
|
added --gnutls-otpions to directly set a GnuTLS priority string
|
2014-03-02 14:21:56 +01:00 |
|
|
|
e01a60da70
|
improved cookie API
|
2014-02-26 21:25:30 +01:00 |
|
|
|
583e7eebd6
|
tuned HSTS API
|
2014-02-20 16:57:48 +01:00 |
|
|
|
5223f349d3
|
added support for RFC 6266 Content-Disposition
|
2014-02-19 17:53:04 +01:00 |
|
|
|
3e66d70ffc
|
fixed HTTPS testing to succeed distcheck
|
2014-02-14 16:56:38 +01:00 |
|
|
|
c52a20c716
|
added HTTPS server code for the test suite
|
2014-02-12 17:12:50 +01:00 |
|
|
|
e1e9bfad6a
|
fixed generating man pages, added some documentation
|
2014-02-06 12:46:37 +01:00 |
|
|
|
73f89e6f2a
|
fix type naming to mget type naming convention
|
2014-02-05 12:39:36 +01:00 |
|
|
|
1ee622d986
|
added test routine for HSTS feature
|
2014-02-02 16:35:20 +01:00 |
|
|
|
b013655705
|
working on RFC 6797 HSTS (HTTP Strict Transport Security)
|
2014-01-31 17:51:54 +01:00 |
|
|
|
d1be9223de
|
use libnettle for checksumming if libgnutls not available or too old
|
2014-01-24 16:09:27 +01:00 |
|
|
|
9c8f45d38d
|
fixed some clang 3.4 warnings
|
2014-01-11 14:21:05 +01:00 |
|
|
|
a5f21a0ac9
|
added example print_html_url.c (scanning and printing URLs from HTML files)
|
2014-01-03 17:28:50 +01:00 |
|
|
|
dd0c23f447
|
added support for bzip2 Content-Encoding / Accept-Encoding type
|
2014-01-02 17:06:53 +01:00 |
|
|
|
f42166fd29
|
added support for XZ Content-Encoding / Accept-Encoding type
|
2013-12-31 13:01:40 +01:00 |
|
|
|
e2df3472ef
|
added --waitretry, new function mget_millisleep()
|
2013-12-30 16:21:12 +01:00 |
|
|
|
3845d792cc
|
added parsing RSS 2.0 feeds
|
2013-12-21 19:02:47 +01:00 |
|
|
|
2101e8ace4
|
added parsing Atom 1.0 feeds
|
2013-12-15 21:50:30 +01:00 |
|
|
|
1d6acb0e25
|
refactored basic sitemap parsing into libmget
|
2013-12-14 17:48:24 +01:00 |
|
|
|
742ff0ebdf
|
new option --force-sitemap to scan URLs from a local Sitemap XML file
|
2013-11-30 20:36:21 +01:00 |
|
|
|
8dc27042c2
|
fix some compiler warnings
|
2013-11-03 22:39:53 +01:00 |
|
|
|
26681f10da
|
added --chunk-size to allow multithreaded downloads of single files
|
2013-10-31 22:02:55 +01:00 |
|
|
|
a140195018
|
added --(no-)check-hostname to disable certificate hostname checking only
|
2013-10-27 21:34:19 +01:00 |
|
|
|
5d8a9a6fe2
|
fixed clang 3.4 analyzer issues
|
2013-10-04 13:00:16 +02:00 |
|
|
|
b0bf64a6d5
|
Use Etag in spider mode to prevent double downloading
|
2013-10-02 17:16:17 +02:00 |
|
|
|
417b8f9446
|
added support for IDNA2008 using Libidn2
|
2013-10-02 12:17:08 +02:00 |
|
|
|
0786185131
|
check if url needs utf-8 encoding
|
2013-10-01 12:34:33 +02:00 |
|
|
|
e01110eaf8
|
added --restrict-file-names
|
2013-09-30 17:15:10 +02:00 |
|
|
|
2113dafde1
|
moved robots routines to new file robots.c
|
2013-09-28 15:04:26 +02:00 |
|
|
|
e62901faae
|
fixed up ROBOTS/META
|
2013-09-27 17:14:41 +02:00 |
|
|
|
f93a03830d
|
fine tuning on some library functions
|
2013-09-25 17:12:03 +02:00 |
|
|
|
e65965d901
|
preparing for utf-16 support
|
2013-09-24 17:15:10 +02:00 |
|
|
|
f5aaebc759
|
added support for robots.txt Robots Exclusion Standard
|
2013-09-22 22:01:11 +02:00 |
|
|
|
c19fdc197b
|
added option --(no-)parent
|
2013-09-20 12:58:55 +02:00 |
|
|
|
68f6865964
|
more work on the test suite
|
2013-09-19 17:11:48 +02:00 |
|
|
|
6ce710db1f
|
some tweaks on encoding
|
2013-09-16 13:28:50 +02:00 |
|
|
|
1547a93271
|
better handling of non-ASCII URLs and filenames
|
2013-09-15 21:42:18 +02:00 |
|
|
|
64325fae3a
|
more work done
|
2013-09-12 17:53:53 +02:00 |
|
|
|
d5d18ea067
|
moved metalink stuff to library code
|
2013-09-10 17:14:30 +02:00 |
|
|
|
00249e0a5c
|
threading model reimplemented to put more load onto the workers
|
2013-09-09 21:39:11 +02:00 |
|
|
|
6aa639f762
|
xml parser rewritten to output len and pos of values
|
2013-08-16 17:10:01 +02:00 |
|
|
|
3cf32c4828
|
more tests
|
2013-07-27 13:03:12 +02:00 |
|
|
|
e0ba710ec9
|
highlevel improvement
|
2013-04-24 21:26:39 +02:00 |
|
