Commit Graph

1126 Commits

Author SHA1 Message Date
Eric Fischer
732a51d684 Fix the option for testing radix sort
Add a check to make sure I don't make the same mistake again
2016-04-14 10:06:01 -07:00
Eric Fischer
222735004d Add a sanity check to make sure I remember to close all open files 2016-04-13 20:33:01 -07:00
Eric Fischer
137bb46db5 Clean up the maximum-files-open check a little 2016-04-13 20:20:25 -07:00
Eric Fischer
cae20bb5e6 Speculatively open files to avoid overrunning the system limits 2016-04-13 18:05:24 -07:00
Eric Fischer
7c9bd5da2f Merge pull request #210 from mapbox/block-input
Don't let the input buffer for parallel streaming input get too big.
2016-04-13 13:31:51 -07:00
Eric Fischer
fbcb00fee9 Add an option to set the tileset's attribution 2016-04-13 12:49:41 -07:00
Eric Fischer
4dba8b3f70 Update clipper to 381c817fd13e8 2016-04-13 10:18:32 -07:00
Eric Fischer
cb4a83776e Fix log formatting 2016-04-12 16:52:46 -07:00
Eric Fischer
e5461b1863 Additional debug output from polygon checking 2016-04-12 16:40:03 -07:00
Eric Fischer
3a46c05b46 Fix the progress indicator 2016-04-12 10:59:06 -07:00
Eric Fischer
968c94a409 Quiet warning about potentially uninitialized variable. 2016-04-11 16:43:46 -07:00
Eric Fischer
efe66dcafe Use stdio instead of mmap for geometry while tiling to reduce thrashing 2016-04-11 15:59:02 -07:00
Eric Fischer
c6d2988485 Logic may be clearer this way 2016-04-11 14:51:04 -07:00
Eric Fischer
e846b11ce7 Don't let the input buffer for parallel streaming input get too big. 2016-04-11 13:51:28 -07:00
Eric Fischer
9d48d6a93d Merge pull request #208 from mapbox/simplify-crash
Fix a line simplification crash when a segment degenerates to a single point
2016-04-07 16:50:01 -07:00
Eric Fischer
acb97361a0 Fix a line simplification crash when a segment degenerates to a single point 2016-04-07 16:45:45 -07:00
Eric Fischer
64faa1d79e Upgrade Clipper to 68c49e9a9a 2016-04-07 13:52:39 -07:00
Eric Fischer
1e6332bae8 Merge branch 'master' into earcut-polygon
Conflicts:
	geojson.c
	tile.h
2016-04-07 13:50:04 -07:00
Eric Fischer
1792a13e1a Merge pull request #207 from mapbox/checkspace
Keep an eye on free disk space and warn if tippecanoe is using it all
2016-04-07 12:23:05 -07:00
Eric Fischer
41ae22164c Mention the default location for temporary files 2016-04-07 11:39:32 -07:00
Eric Fischer
73fcdba02b Linux and Mac want different headers for file system stats 2016-04-07 11:23:33 -07:00
Eric Fischer
1eb0537302 Warn if temporary directory doesn't begin with / 2016-04-07 10:47:46 -07:00
Eric Fischer
39285c8102 Keep an eye on free disk space and warn if tippecanoe is using it all 2016-04-07 10:35:36 -07:00
Eric Fischer
22ede9ac8c Merge pull request #206 from mapbox/chatty-polygon
Add an option to drop a fraction of polygons by zoom.
2016-04-06 14:33:48 -07:00
Eric Fischer
574a2b79c8 Add an option to drop a fraction of polygons by zoom.
Only warn once about polygon cleaning failures.
2016-04-06 14:17:44 -07:00
Eric Fischer
1e31edbfb3 Merge branch 'master' into earcut-polygon
Conflicts:
	geojson.c
	tile.h
2016-04-05 15:22:43 -07:00
Eric Fischer
d1456c0f66 Merge pull request #202 from mapbox/radix
Restructure geometry reordering to try to reduce virtual memory thrashing
2016-04-05 15:13:44 -07:00
Eric Fischer
4a572b810b Close some file descriptors that were left dangling before 2016-04-05 14:07:24 -07:00
Eric Fischer
b10b436ac9 Add a way to test recursive radix sorting. Bump version number. 2016-04-05 13:32:44 -07:00
Eric Fischer
e394501faa Check for errors when closing files 2016-04-05 11:13:31 -07:00
Eric Fischer
c0a0aef060 Use large sort chunks, since that part can be parallelized 2016-04-05 10:08:46 -07:00
Eric Fischer
2a4be4f6d4 Parallel reading is effectively random order, not sequential 2016-04-04 17:00:11 -07:00
Eric Fischer
c62762078a Can't tell Linux to free pages, so just say we don't need them 2016-04-04 16:18:55 -07:00
Eric Fischer
72e485f285 Also advise when unmapping pages 2016-04-04 16:14:26 -07:00
Eric Fischer
b1d3849889 Sprinkle madvise calls to hint about how files should be paged in 2016-04-04 16:03:13 -07:00
Eric Fischer
2b0ac890c5 Fix the status message about how much geometry there is 2016-04-04 15:33:25 -07:00
Eric Fischer
d4b9f79d3c Fix the progress indicator when there is an inner radix sort 2016-04-04 14:49:41 -07:00
Eric Fischer
31c4d4850c Remove dead code 2016-04-04 13:22:23 -07:00
Eric Fischer
2fe841c6dc Remove extra newline output from old progress format 2016-04-04 11:42:40 -07:00
Eric Fischer
7b6cd2d0f4 Fix the any-valid-geometries check again 2016-04-04 11:25:21 -07:00
Eric Fischer
c9e542e688 Keep meta count inline to avoid thrash if no attributes 2016-04-04 11:18:37 -07:00
Eric Fischer
986719f2ff Rework sorting/merging progress indicator 2016-04-04 10:53:53 -07:00
Eric Fischer
e2b36a8ee9 Restore mergesort for the intermediate sort. Tests pass. 2016-04-01 18:15:31 -07:00
Eric Fischer
55f93963be Stop recursing when the indices are exactly the same 2016-04-01 17:41:53 -07:00
Eric Fischer
cf806baca2 Slow, but works for some cases now 2016-04-01 17:36:09 -07:00
Eric Fischer
60139532c8 Provide top-level output files for geometry and index 2016-04-01 17:01:10 -07:00
Eric Fischer
9793be1517 Split indices and geometries up by radix 2016-04-01 16:25:10 -07:00
Eric Fischer
851d7b576b Merge branch 'master' into radix 2016-04-01 15:32:15 -07:00
Eric Fischer
1e8c030b03 Make indent 2016-04-01 15:31:59 -07:00
Eric Fischer
560add2ccd More calculation about how many fds are available 2016-04-01 15:31:34 -07:00