36 Commits

Author SHA1 Message Date
b22e6b8b07 * examples/Makefile.am: Remove linking of libgnu.la 2022-06-25 13:38:31 +02:00
0f624b16b5 Update Makefile.am for latest gnulib
* examples/Makefile.am: Amend LDADD assignment
* fuzz/Makefile.am: Likewise
* libwget/Makefile.am: Likewise
* src/Makefile.am: Likewise
* tests/Makefile.am: Likewise
* unit-tests/Makefile.am: Likwise
2020-01-07 15:46:12 +01:00
a6e38ee2ec * examples/Makefile.am: Add -DMALLOC_RETURNS_NONNULL to AM_CFLAGS and AM_CPPFLAGS 2019-08-17 18:34:45 +02:00
837ab09eb5 Add examples/relative_to_absolute_url.c 2019-08-08 15:49:51 +02:00
f04b8eef66 Add example batch_loader
* examples/Makefile.am: Add batch_loader.c
* examples/batch_loader.c: New example code

This example uses 500 threads to process domains / URLS from
stdin. It downloads the URL and creates a stats entry in out.csv.
Check the source for details.
2018-08-04 21:56:55 +02:00
b3aede0e57 Remove gnulib dependencies from examples and wget.h
* cfg.mk: Add examples as excludes for config.h
* examples/Makefile.am: Remove -I to srcdir and builddir
* examples/*.c: Remove #include <config.h>
* include/wget/wget.h: Remove gettext include and defines
* libwget/private.h: Add gettext include and defines
* src/wget_main.h: Likewise
* tests/libtest.h: Likewise
* src/log.c: Add #include <string.h>
2017-04-30 21:37:39 +02:00
4ad6d68305 Fix libraries to use libtool variables
* examples/Makefile.am: Use $(LTLIBICONV) $(LTLIBINTL) $(LTLIBTHREAD)
* src/Makefile.am: Likewise
* tests/Makefile.am: Likewise
2017-04-06 12:25:07 +02:00
4d7238e282 Fix vpath builds
* examples/Makefile.am: Add -DWGETVER_FILE to AM_CPPFLAGS
* libwget/Makefile.am: Likewise
* src/Makefile.am: Likewise
* tests/Makefile.am: Likewise
* include/wget/wget.h: Include WGETVER_FILE if defined
2017-03-25 20:49:41 +01:00
e07854949e Add examples/check_url_types.c
* examples/Makefile.am: Add rule for examples/check_url_types
* examples/check_url_types.c: New file

This adds a Alexa top-X scanner to find out the numbers of
http:// links in landing pages retrieved via https://.
It follows and counts redirections separated by secure and insecure
ones, flags if the landing page was completely secure, counts links
in the landing HTML page (same-page, external, http, https).
2017-03-03 17:07:42 +01:00
9568b0c87e Rename include/libwget.h to include/wget/wget.h+wgetver.h 2016-09-30 09:47:32 +02:00
06c5f8911e API changes for HTTP/2 parallel/async requests
* .gitignore: New entry examples/http_multi_get
* Makefile.am: Move subdir 'examples' before 'src'
* examples/Makefile.am: Add http_multi_get
* examples/http_get2.c (main): Adapt code to API changes
* examples/http_multi_get.c: New example to show async/parallel
  requests
* examples/websequencediagram.c (main): Adapt code to API changes
* include/libwget.h.in: New functions wget_http_request_set_header_cb,
    wget_http_request_set_body_cb, wget_http_request_set_int.
  Changed params of wget_http_get_response.
  Removed wget_http_get_response_func, wget_http_get_response_stream,
    wget_http_get_response_fd.
  Changed params of wget_http_get_response_cb.
  Add members pending_requests, received_http2_responses,
    pending_http2_requests to wget_http_connection_t.
  Add member req to wget_http_response_t.
  Add members header_callback, body_callback, header_user_data,
    body_user_data, response_keepheader to wget_http_request_t.
  New function types wget_http_header_callback_t and
    wget_http_body_callback_t.
* libwget/http.c: Implementation of the changes in include/libwget.h.in.
* libwget/http_highlevel.c: Adapt code to API changes
* libwget/ssl_gnutls.c: Fixed defaults for SNI, OCSP and
  ALPN.
  Adapt code to API changes.
* src/options.c: Reflect changes in libwget/ssl_gnutls.c
* src/wget.c: Adapt code to API changes
2016-06-22 09:17:57 +02:00
a8d99227e8 Add gnulib module 'manywarnings'
* autogen.sh: Add module manywarnings
* configure.ac: Add ./configure option --enable-gcc-warnings to enable
 many warnings
* examples/Makefile.am: Add WERROR_CFLAGS and WARN_CFLAGS to AM_CFLAGS
* libwget/Makefile.am: Likewise
* src/Makefile.am: Likewise
* tests/Makefile.am: Likewise
2016-06-14 12:22:03 +02:00
4aedab2d6d Adjust LDFLAGS for MinGW
* examples/Makefile.am: Add -no-install to AM_LDFLAGS
* libwget/Makefile.am: Add -no-undefined to libwget_la_LDFLAGS
2016-05-08 23:06:58 +02:00
fb734476c6 Add new examples websequencediagram[_highlevel]
* examples/websequencediagram.c: New file
* examples/websequencediagram_high.c: New file
* examples/Makefile.am: Add websequencediagram[_highlevel]

These examples show how to do two requests on one connection,
a POST and a GET, saving the downloaded body to disk.
websequencediagram uses the low-level API.
websequencediagram_highlevel uses the high-level API.
2016-03-14 17:34:56 +01:00
fb840427d2 Add $(LIB_PTHREAD) to makefiles
* examples/Makefile.am, libwget/Makefile.am, src/Makefile.am,
  tests/Makefile.am: Add $(LIB_PTHREAD)
2016-01-23 22:51:43 +01:00
7250e6ccb9 Add symbol visibility control to libwget
* autogen.sh: Add gnulib module lib-symbol-visibility,
  add --libtool to gnulib-tool invokation
* examples/Makefile.am: Remove -static from AM_LDFLAGS,
  remove ../lib/libgnu.a from LDADD
* include/libwget.h.in: Define LIBWGET_EXPORT,
  add LIBWGET_EXPORT to all visible symbols
* libwget/Makefile.am: Remove AM_CPPFLAGS and LDADD,
  add libwget_la_CPPFLAGS and libwget_la_LIBADD,
  add test_linking_CPPFLAGS, fix test_linking_LDADD
* libwget/iri.c: Add LIBWGET_EXPORT to wget_iri_schemes and iri_ports
* src/Makefile.am: Remove wget2_LDFLAGS, fix wget2_LDADD
* tests/Makefile.am: Fix LDADD, fix test_LDADD, fix test_parse_html_LDADD,
  fix libtest_la_CPPFLAGS and libtest_la_LIBADD
* tests/libtest.h: Add LIBWGET_EXPORT to symbols
2016-01-15 11:21:35 +01:00
69d1b3392c Add gnulib module setlocale
* autogen.sh: Add gnulib module setlocale
* configure.ac: Remove searching for setlocale, locale.h, sys/time.h
* src/wget.c: Move #include <locale.h> (cosmetics)
* examples/Makefile.am: Add $(LIBTHREAD), @INTL_MACOSX_LIBS@ to LDADD
* libwget/Makefile.am: Add to $(LTLIBTHREAD), @INTL_MACOSX_LIBS@ LDADD
* src/Makefile.am: Add $(LIBTHREAD), @INTL_MACOSX_LIBS@ to LDADD
* tests/Makefile.am: Add $(LIBTHREAD), @INTL_MACOSX_LIBS@ to LDADD
2016-01-12 17:08:29 +01:00
c6e0ba1dce Add gnulib module iconv
* autogen.sh: Add gnulib module iconv
* configure.ac: Remove AM_ICONV
* examples/Makefile.am: Add $(LIBICONV) to LDADD
* libwget/Makefile.am: Add $(LIBICONV) to LDADD
* src/Makefile.am: Add $(LIBICONV) to LDADD
* tests/Makefile.am: Add $(LIBICONV) to LDADD
2016-01-12 15:58:40 +01:00
dd9cb25fcc Cover network functions with gnulib modules
* autogen.sh: Add accept, bind, close, connect, getaddrinfo, getsockname,
  listen, netdb, netinet_in, open, read, send, sendto, servent, setsockopt,
  socket, sys_socket, write to modules
* configure.ac: Remove searching for ws2_32, libsocket, libnsl, netdb.h,
  netinet/in.h, sys/socket.h, socket.
  Add searching for netinet/tcp.h.
* examples/Makefile.am: Add additional libs.
* libwget/Makefile.am: Add additional libs.
* src/Makefile.am: Add additional libs.
* tests/Makefile.am: Add additional libs.
* libwget/http.c: Remove conditional code.
* libwget/net.c: Remove conditional code. Use c_isdgit().
* libwget/net.h: Remove conditional code.
2016-01-12 15:08:14 +01:00
e8fafdeb9f Add header file gnulib modules
* autogen.sh: Add gettext-h, inttypes, stdarg, stddef, stdint
* configure.ac: Remove check for inttypes.h, libintl.h, stddef.h
  Remove AC_TYPE_* checks
* include/libwget.h.in: Include gnulib gettext.h
* examples/Makefile.am: Fix AM_CPPFLAGS, add $(LIBINTL) to LDADD
* libwget/Makefile.am: Fix LDADD and test_linking_LDADD
* src/Makefile.am: Add $(LIBINTL) to wget2_LDADD
* tests/Makefile.am: Fix AM_CPPFLAGS and libtest_la_CPPFLAGS,
  add $(LIBINTL) to LDADD, test_LDADD and test_parse_html_LDADD
2016-01-12 10:18:09 +01:00
b770fc7197 Add $(LIB_POLL) to *_LDADD
* examples/Makefile.am, src/Makefile.am, tests/Makefile.am:
  Add $(LIB_POLL) to *_LDADD
2016-01-11 22:22:29 +01:00
11c102fada Use nanosleep gnulib fallback
* autogen.sh: Add nanosleep to gnulib modules
* configure.ac: Remove searching for nanosleep
* examples/Makefile.am: Add $(LIBSOCKET) $(LIB_NANOSLEEP) $(LIB_SELECT)
* src/Makefile.am: Add $(LIBSOCKET) $(LIB_NANOSLEEP) $(LIB_SELECT)
* tests/Makefile.am: Add $(LIBSOCKET) $(LIB_NANOSLEEP) $(LIB_SELECT)
* libwget/utils.c: Remove conditional code
2016-01-11 11:36:34 +01:00
ad691f1f3f Remove API version from library file names
* .gitignore, Makefile.am, configure.ac, examples/Makefile.am,
  libwget.pc.in, libwget/Makefile.am, src/Makefile.am, tests/Makefile.am:
  Remove API version from library file names
2016-01-09 17:56:32 +01:00
e3b89db8c7 Hook gnulib into project 2016-01-09 16:04:25 +01:00
1cbb8ae9f7 Rename LIBWGET_API_VERSION to LIBWGET_VERSION 2016-01-06 16:25:27 +01:00
c6b0e461a1 Transform Mget into Wget 2015-09-19 22:54:38 +02:00
52e9586f78 add LTLIBICONV and LTLIBINTL to LDADD for Solaris 2015-02-06 17:08:56 +01:00
b4604f2f16 added plg-config, brushed up configure.ac and Makefiles 2014-02-05 17:10:08 +01:00
b755144959 fixed 'make distcheck' 2014-01-12 22:14:31 +01:00
a5f21a0ac9 added example print_html_url.c (scanning and printing URLs from HTML files) 2014-01-03 17:28:50 +01:00
bb386e8bf8 add -fPIC to CFLAGS, remove private path from tests 2013-07-30 10:42:38 +02:00
27bc5a3e3f converted more tests from Perl to C III 2013-03-21 20:20:30 +01:00
f79d9029e1 new example getting a stream from a .m3u URL 2013-02-03 21:57:09 +01:00
1fdab9d1ec moved http.c and md5.c into library 2013-01-18 17:11:26 +01:00
84e0e7b3b6 fix more stuff 2013-01-17 17:16:51 +01:00
c049bb0655 new examples folder 2013-01-15 17:11:01 +01:00