Commit Graph

550 Commits

Author SHA1 Message Date
df9be038a6 Add a munin graph to display the time spent rendering in each queue
This is useful to determine how many resources are used to render missing tiles
and how many to keep things up-to-date
2013-08-04 08:51:26 -06:00
6203668b37 Keep track of how much time is spent with rendering tiles from each queue 2013-08-04 08:48:21 -06:00
b44d992fc9 Make munin graphs support Z19 and Z20 2013-08-04 08:46:40 -06:00
81a0f52dab Improve diff-importing and tile expiry script 2013-08-04 08:38:57 -06:00
86d71d50b6 Don't install the unit test program into bin directory 2013-07-12 14:45:16 -06:00
eae2eaec1c Merge pull request #32 from tomhughes/master
Allow render_old to take a unix timestamp
2013-06-19 10:40:30 -07:00
965f77a31e Allow timestamp to be specified to render_old as a unix timestamp 2013-06-19 18:24:39 +01:00
6e1f6afdad The test suit was not generating unique items to add to the queue
The de-dupplication of the queue then resulted in unexpected behaviour.

This should fix the test suite
2013-06-15 11:09:27 -06:00
dd75339f8d Free memory when the request queues get closed. 2013-06-14 12:16:58 -06:00
54ea7a4375 Fix some minor memory leaks in the testing frame work.
There are still a number of memory leaks in the queueing tests
2013-06-14 12:11:11 -06:00
4e9b24daa8 Set mapniks max_size parameter in renderd if configured to use more than 10 threads.
The default postgresql connection pool size of mapnik is 10, which can get exhausted
on modern multi-core servers.

This sets the max_size parameter to 2 larger than the thread count unless it is
explicitly set in the loaded stylesheet.
2013-06-12 01:55:03 -06:00
7145be95ea Changed the default supported max zoom of rendrd to 20
While mod_tile could handle much higher zoom levels already, renderd was stuck with z18,
unless one changed the compile time setting.

This changes the maximum supported zoom level to z20 out of the box. Furthermore,
it is now possible to set max and min zoom level per style in renderd.conf (as long
as they are within the range.)

Zoom levels higher than z20 are currently not supported out of the box, especially with
the file based storage backend. The directory hash function only supports 40 bit (20 bit for each X and Y).
2013-05-30 23:53:21 -06:00
1db2d4158c Warn if maxzoom in renderd.conf is set higher than the
compile time specified variable in renderd

Currently renderd doesn't actually respect the maxzoom variable in renderd.conf. (only mod_tile does)
2013-05-30 23:52:23 -06:00
91a2e1d716 Add some tests for the default file storage backend 2013-05-30 20:32:18 -06:00
299ac3bdd3 Refactor some functionality out of gen_tile.cpp
Move metatile handling and tile cache expiry out of gen_tile.cpp into
seperate files for reuse and cleaner structure.
2013-05-30 20:31:23 -06:00
4cf301b06b Only set buffer_size if it hasn't already been set via the style-sheet
It assumes that one doesn't set an explicity buffer_size of 0 and thus
all buffer_sizes are the default for which renderd then overwrites it to
buffer_size 128.

Addresses issue #17
2013-05-22 21:29:00 -06:00
2c538916be [Bug fix] mod_tile was not correctly thread-safe in Apache 2.2 and could segfault.
Apache's memory pool operations aren't thread-safe. In get_storage_backend
multiple threads could try to allocate memory on the process pool concurrently
leading to segfaults. To prevent this, wrap that code into a mutex.

Benchmarking seems to indicate, that even though each request has to acquire the lock
this does not appear to have a performance impact.

The issue was reported by Sven Geggus, and diagnosed by Tom Hughes. Thanks.
2013-05-22 20:36:47 -06:00
a401159d4b Partially revert previous commit for logging and fix it.
The previous patch did not take different storage backends into account,
or different tile path locations.
2013-05-22 00:59:44 -06:00
1daf09a693 Merge pull request #26 from plepe/log-start-tile
Log start tile
2013-05-21 23:17:08 -07:00
8b8745e424 Merge pull request #24 from plepe/bugfix
Daemon: fix typo in #define
2013-05-21 23:15:34 -07:00
7028bde54f Add time of old metatile to item structure, print age when starting rendering
- struct item got value 'old_mtime', holding the time of the old metatile (or 0
  for new tiles)
2013-05-22 06:28:07 +02:00
911670bc23 gen_tile: Instead of two DONE messages write START and DONE messages 2013-05-22 06:28:07 +02:00
015f799860 Daemon: fix typo in #define 2013-05-22 06:15:58 +02:00
cc4003c1b4 Don't ignore all .m4 files, only autogenerated ones 2013-05-16 22:47:34 -06:00
7290a4cde1 Merge pull request #20 from ramunasd/master
fix issue #18, ignore compilation files
2013-05-16 21:33:22 -07:00
3463f441e2 Merge pull request #23 from pnorman/patch-1
Change absolute URL in slippymap.html to a relative one
2013-05-16 18:51:51 -07:00
7e57144dad Change absolute URL in slippymap.html to a relative one
If we're browsing from a different machine localhost is the wrong hostname.
2013-05-16 16:28:03 -06:00
b7cb20df4b Merge pull request #22 from zerebubuth/master
Fix null storage missing symbol
2013-05-14 08:41:12 -07:00
798763820f Added missing null storage source file for APXS build. 2013-05-14 13:05:23 +01:00
fef2c0ac6f add git ignores 2013-05-13 22:35:21 +03:00
acb33187d0 Set same default renderd socket, fixes #18 2013-05-13 22:34:32 +03:00
7ed57d956c Merge pull request #19 from zerebubuth/master
Add 'null' storage
2013-05-13 11:40:57 -07:00
c07adeebf8 Added simple 'null' storage, which might be useful for benchmarking or testing. 2013-05-13 19:35:01 +01:00
01d70ff43d Merge pull request #14 from pnorman/patch-1
Fix typos in render_list man page
2013-05-09 13:23:20 -07:00
5a37766c2d Fix typos in render_list man page 2013-04-25 16:31:46 -07:00
1341e129e5 Merge pull request #12 from rusvdw/master
Fixed render_old exit crash
2013-04-22 11:35:35 -07:00
babf30f1a1 Implemented verbose output for zoom level progress 2013-04-22 15:07:32 +02:00
226335e901 Fixed crash on exit when no map style file is specified 2013-04-22 14:46:24 +02:00
b7fe90c887 Add man page for openstreetmap-tiles-update-expire 2013-04-20 20:49:11 -06:00
f84a981ff6 Rename openstreetmap-tiles-update-expire.sh to without .sh to keep debian linthian more happy 2013-04-20 20:06:37 -06:00
d319002e5f change file permission of mod_tile_latency to be in accordance with other munin plugins 2013-04-20 20:00:53 -06:00
f53545e7dc Add some per zoom level timing information to render_list
This should allow render_list to be used more easily for benchmarking with a
well known list of tiles as reference.
2013-04-14 19:21:19 -06:00
cd30714ed4 Add tests for the refactored queueing code 2013-04-14 03:17:29 -06:00
707e125e35 Refactor queueing code out of daemon.c into a separate file
Also make a slightly cleaner extraction.

This hopefully has a couple of advantages:

1) The code should now be a bit cleaner
2) It makes testing the queueing code easier
3) In future it might be possible to have a separate queue per style
   allowing e.g. to perform fair queueing between styles.
2013-04-14 03:17:29 -06:00
adf6e2fc1a Cleanup .slo and some other autogenerated files in make clean 2013-04-11 23:25:20 -06:00
03192f5b61 Fixup test cases, by correctly handling the return value of system 2013-04-11 23:25:20 -06:00
cf68607407 Merge pull request #11 from springmeyer/test-framework
add test framework that can be run with 'make test' - refs #10

This still needs some more cleanup to get it working, but as it doesn't effect anything existing, I'll do that post merge.
2013-04-11 21:11:22 -07:00
2238a5f1a1 Fix compile where cairo is installed in a non standard location
Also work around a bug in cairomm flags in Mapnik 2.0 (#787) that has been fixed upstream
a long time ago, but is still present in the ubuntu mapnik packages.
2013-04-10 17:37:41 -06:00
b635598ad0 add test framework that can be run with 'make test' - refs #10 2013-04-10 12:45:49 -07:00
5d6b6caefa renderd could segfault if map was not loaded 2013-04-08 19:32:49 -06:00