Commit Graph

206 Commits

Author SHA1 Message Date
679d9ad43c * docs/wget2_md2man.sh.in: Remove set -o pipefail (incompatible) 2018-01-13 11:49:41 +01:00
8850689e62 * docs/wget2.md: Add text for plugin options 2018-01-13 11:25:11 +01:00
a73a78b660 * docs/wget2.md: Add text for --local-db, --input-encoding=encoding 2018-01-12 21:45:53 +01:00
7e271c1239 * docs/wget2.md: Amend text for --secure-protocol 2018-01-12 21:35:49 +01:00
e1ea1b0096 * docs/wget2.md: Add text for --gnutls-options 2018-01-12 21:18:42 +01:00
3e45820d01 * docs/wget2.md: Add text for --fsync-policy, --hpkp, --hpkp-file 2018-01-12 21:14:45 +01:00
4f262e1e0e * docs/wget2.md: Add text for --dns-caching, --http2, --metalink 2018-01-12 20:56:04 +01:00
0e8fbce301 * docs/wget2.md: Add text for --cookie-suffixes 2018-01-12 19:21:45 +01:00
c0cad5ae06 * docs/wget2.md: Add text for --robots 2018-01-12 19:21:45 +01:00
da0733e2f7 * docs/wget2.md: Fix syntax of --private-key 2018-01-12 19:21:45 +01:00
e080a7a521 * docs/wget2.md: Fix --inet*, Add text for --tcp-fastopen 2018-01-12 19:21:45 +01:00
4ffe73f3db Remove --config-file in favor of --config
* docs/wget2.md: Amend docs
* src/options.c: Remove option --config-file
2018-01-12 19:21:45 +01:00
c7666497ad * docs/wget2.md: Fix option syntax 2018-01-12 19:21:45 +01:00
5077082a12 * docs/wget2.md: Add text for --ocsp, --ocsp-stapling and --ocsp-file 2018-01-12 19:21:45 +01:00
266a508843 * docs/wget2.md: Add text for --tls-session-file and --tls-false-start 2018-01-12 19:21:45 +01:00
bdb0c2142b * docs/wget2.md: Add text for --http-proxy and --https-proxy 2018-01-12 19:21:45 +01:00
0ba7554f24 * docs/wget2.md: Add space before --tries and --output-document 2018-01-12 19:21:45 +01:00
47307939c9 * docs/wget2.md: Add text for --check-hostname 2018-01-12 19:21:45 +01:00
a457cf101b * docs/wget2_md2man.sh.in: Add bash error flags to script 2018-01-12 19:21:45 +01:00
d69f967297 * docs/wget2.md: Add documentation for --signature-extension 2018-01-12 19:21:45 +01:00
dd0bdac7f1 Delete signature file, and delete files that fail signature validation.
* docs/wget2.md: Added documentation for new '--verify-save-failed'
* src/gpgme.c: Exposed function to determine base downloaded file from
  signature JOB.
* src/options.c: Added '--verify-save-failed' to allow users to keep downloaded
  files that fail validation.
* src/wget.c: Logic for unlinking signatures, and files failing validation.
* src/wget_gpgme.c: Declaration for new function that determine base downloaded
  files.
* tests/Makefile.am: Added New test code, fixed missing SOURCES.
* tests/gpg-test-util.h: Conditionally expect a saved base file if exit
  code == 0, never expect a saved signature file.
* tests/test-gpg-save-failed.c: A test that tests the '--verify-save-failed'
  flag.
* tests/test-gpg-style.s: Remove signature file from expected output.

Added flag '--verify-save-failed' to disable the "fail delete" behavior.
2018-01-12 18:53:11 +01:00
9688bcc517 * docs/wget2.md: Add text for --xattr 2018-01-11 11:57:46 +01:00
3257dceca3 Add man pages to tarball 2018-01-11 11:57:22 +01:00
2f24a81c70 Fix building docs
* Makefile.am: Add README.md to EXTRA_DIST
* configure.ac: Generate conditionals WITH_DOXYGEN and WITH_PANDOC
* docs/Makefile.am: Use conditionals for building
2018-01-11 11:57:17 +01:00
f11ceec812 Check for pandoc in ./configure
* configure.ac: Check for pandoc
* docs/Makefile.am: Use $(PANDOC)
* docs/wget2_md2man.sh.in: Use $PANDOC shell variable
2018-01-11 11:57:14 +01:00
f206a6d004 Generate .texi and .info from markdown manual
* Makefile.am: Convert .md to .texi and .info
* mainpage.md: Rename wget2_manual.md to wget2.md
* wget2_manual.md: Renamed to wget2.md
2018-01-11 11:57:10 +01:00
582c4bcbab Add a space after section header string in md manual 2018-01-11 11:57:06 +01:00
4324cd1196 Generate wget2 man page
* .gitignore: Add auto-generated docs/wget2_md2man
* README.md: Add pandoc
* configure.ac: Generate docs/wget2_md2man
* docs/Makefile.am: Build wget2.1
* docs/wget2_manual.md: Fix things for a better man page experience
* docs/wget2_md2man.sh.in: Template file for docs/wget2_md2man
2018-01-11 11:56:58 +01:00
7285154243 Refactor DNS chaching code out of net.c
* include/wget/wget.h: Add missing wget_dns_cache declarations
* libwget/Makefile.am: Add dns_cache.c
* libwget/dns_cache.c: New file
* libwget/net.c: Remove DNS chaching code
2018-01-09 09:40:06 +01:00
60c1bfef30 Add --filter-mime-type option
* src/wget.c: Add mime type check before downloading a file
* src/options.c: Add --filter-mime-type option
* src/wget_options.h: Add mime_types to the config structure
* docs/wget2_manual.md: Add documentation related to the new option
2018-01-02 14:13:32 +00:00
39dfeec1ae Fixed problems pointed out in MR. Added tests and doxygen documentation.
* bootstrap.conf: Add canonicalize module.
* cfg.mk: Added exclusions to no new line at EOF for binary files used in tests.
* configure.ac: Check for libgpgme
* docs/wget2_manual.md: Added manual entries for --verify-sig, --gnupg-homedir, and new exit codes.
* fuzz/Makefile.am: Amend linker options
* include/wget/wget.h: Add error codes for GPG signature verification.
* po/POTFILES.in: Add new files.
* src/Makefile.am: Add src/gpgme.c and src/wget_gpgme.h
* src/gpgme.c: Using new error codes, and better signature verification failure detection.
* src/job.c (job_free): Free sig_filename
* src/options.c: Add new options --gnupg-homedir and --verify-sig
* src/wget.c: Verify the signature if possible, exit with the proper status code,
  print error messages
* src/wget_gpgme.h: Add documentation.
* src/wget_job.h: Extend struct JOB
* src/wget_options.h: Add new status codes, add new members to struct config
* tests/Makefile.am: Added new tests.
* tests/gpg-test-util.h: Common GPG testing functionality (tries to verify a signature, expects exit code ... etc).
* tests/gpg/helloworld.txt: Text that has been signed in the .sig files.
* tests/gpg/helloworld.txt.{invalid,no-pub,missing,trusted}.sig: Signatures on helloworld.txt with properties described by their names.
* tests/gpg/openpgp-revocs.d/*: Revocation certs for the fake "homedir"
* tests/gpg/private-keys-v1.d/*: The not-so-private private keys used to sign the test file.
* tests/gpg/pubring.kbx: Fake gnupg homedir public key ring.
* tests/gpg/test-gpg-*.c: Tests.
* tests/valgrind-supressions: Supress failures due to oddness with GPGME.
* unit-tests/Makefile.am: Add src/gpgme.o to BASE_OBJS
2018-01-01 13:28:43 +01:00
d1847fb518 Add docs for thread functions
* docs/Makefile.am: Add man page
* libwget/thread.c: Add documentation
2017-12-31 18:47:19 +01:00
beda523b9f * docs/wget2_manual.md: Remove duplicate documentation on the --report-speed option and change it a bit 2017-12-30 13:49:36 +00:00
c198801ae8 Implement speed reporting in the progress bar and the --report-speed switch
* docs/wget2_manual.md: Add documentation for the --report-speed switch
* include/wget/wget.h: Define the report speed types, add reference to wget_bar_set_speed_type()
* libwget/bar.c: Modify the wget2 progress bar to print speed information
* src/bar.c: Add code to set the type of speed reporting
* src/options.c: Add the --report-speed switch and a function to parse the legal types
* src/wget_options.h: Add 'report_speed' in the config structure
* src/wget.c: Print speed reports at the end of a download thread
2017-12-06 16:20:10 +01:00
d95336f829 * docs/wget2_manual.md: Add documentation for --max-threads and --chunk-size switches 2017-12-01 19:09:36 +01:00
90ea11ca38 Disable TLS Session Resumption by default
* src/options.c: Set config.tls_resume to false/zero by default

* docs/wget2_manual.md: Add docs for --tls-resume
2017-11-12 20:17:36 +00:00
e8ad27f631 Implementation of --use-askpass switch
* bootstrap.conf: Add 'posix_spawn' and 'spawn-pipe' gnulib modules
* docs/wget2_manual.md: Add docs for --use-askpass
* src/options.c: Add implementation of --use-askpass
* src/wget_options.h (struct config): Add 'use_askpass_bin' member
2017-11-12 00:24:49 +01:00
2cae33c8ed Implement --ask-password switch to enable a password prompt
* bootstrap.conf: Add 'getpass' gnulib module
* docs/wget2_manual.md: Amend docs for --ask-password
* src/options.c: Add implementation of --ask-password
* src/wget_options.h (struct config): Add 'password' member
2017-11-02 21:08:23 +01:00
01a08e2f3f Add support for RFC 7616 HTTP Digest Access Authentication
* docs/Makefile.am: Remove libwget-md5.3
* include/wget/wget.h: Remove wget_md5_printf_hex(),
  add wget_hash_printf_hex()
* libwget/Makefile.am: Rename md5.c to hash_printf.c
* libwget/hash_printf.c: New file with wget_hash_printf_hex()
* libwget/http.c (wget_http_add_credentials): Remove hardcoded MD5 algo
* tests/test-metalink.c: Use wget_hash_printf_hex()

RFC 7616 adds/replaces the MD5 digest algorithm with SHA-256.
2017-10-29 18:32:29 +01:00
b31538f5cb Added new setting --filter-urls
* docs/wget2_manual.md: Added doc for new setting
* src/options.c: Added new setting
* src/wget.c: Added code for new setting.
* src/wget_options.h: Added new setting

This commit hasn't been copyright-assigned to the FSF.
2017-10-29 11:46:24 +01:00
54b470f969 * doc/wget2_manual.md: Add docs for --stats-* options 2017-09-19 14:40:40 +02:00
46dfcc6764 * docs/wget2_manual.md: Fix several small things 2017-09-06 12:34:19 +02:00
b0e1def6fe Add docs for xml parsing functions.
* libwget/xml.c: Rename XML_CONTEXT to _xml_context,
  document wget_* functions
* docs/Makefile.am: Sort order of man page files,
  add building of libwget-xml.3
2017-08-04 11:26:24 +02:00
e606417a4a Fix doxygen warnings
* README.md: Mark options
* docs/wget2_manual.md: Mark URLs
* libwget/bar.c: Fix doc for bar_init(),
  add doxygen close tag at end of file
* libwget/buffer.c: Fix doc for wget_buffer_reset()
* libwget/console.c: Move unused tag to front of param
* libwget/hpkp.c: Fix documented params for wget_hpkp_new()
* libwget/iri.c: Fix doc for wget_iri_supported()
* libwget/net.c: Fix doc for wget_tcp_printf()
* libwget/utils.c: Move unused tag to front of param
2017-07-21 11:12:23 +02:00
8dc65908ce New options --http-proxy-user and --http-proxy-passord
* docs/wget2_manual.md: Amend description of user/password options
* docs/wget2_manual.md: Add new param to wget_http_add_credentials()
* libwget/http.c (wget_http_parse_response_header): Add Proxy-Authenticate
  HTTP header,
  (wget_http_add_credentials): Add Proxy-Authorization HTTP header,
  (_on_header_callback): Add Proxy-Authenticate HTTP header
* libwget/http_highlevel.c: Amend call to wget_http_add_credentials()
* src/job.c (job_free): Free proxy_challenges
* src/options.c: Add --http-proxy-password and --http-proxy-user
* src/wget.c (process_response_header): Add status code 407,
  (_add_authorize_header): New function,
  (http_create_request): Use _add_authorize_header()
* src/wget_job.h: Add JOB.proxy_challenges
* src/wget_options.h: Add config.http_proxy_username and config.http_proxy_password
* unit-tests/test.c: Amend call to wget_http_add_credentials()
2017-06-13 15:49:26 +02:00
56efdab1a7 Remove trailing whitespaces (syntax-check) 2017-04-29 20:51:32 +02:00
c1dee14c72 Spell filesystem 'file system' (syntax-check)
* docs/wget2_manual.md: filesystem -> file system
* tests/libtest.c: Likewise
* tests/libtest.h: Likewise
* tests/test-wget-1.c: Likewise
2017-04-29 19:41:15 +02:00
f56c167a61 Added settings --cut-url-get-vars and --cut-file-get-vars and fixed --backups
* docs/wget2_manual.md: Added doc for the new settings
* src/options.c: Fixed --backups and added --cut-url-get-vars and --cut-file-get-vars
* src/wget.c: Added --cut-url-get-vars and --cut-file-get-vars
* src/wget_options.h: Added --cut-url-get-vars and --cut-file-get-vars
* tests/Makefile.am: Added test-cut-get-vars
* test-cut-get-vars.c: New file
2017-04-13 21:41:53 +02:00
ade8c82f27 * docs/libwget.doxy: Fix path to libwget header file for documentation 2017-04-08 15:44:47 +02:00
c545263d54 Support tilde expansion of filenames from wgetrc
* src/options.c (_shell_expand): New function to perform tilde
expansion on a given string
(parse_filename): Parse the input string and perform shell expansion on
it using _shell_expand
(parse_string): Set the parser functions for various options that may be
set from a config file to use parse_filename
(wget_strnglob): Run glob() on only the specified part of the string
2017-02-22 16:28:10 +01:00