Commit Graph

390 Commits

Author SHA1 Message Date
Eric Fischer
2957f16b4b Assign tasks (reading temporary files) to threads 2015-07-09 16:09:40 -07:00
Eric Fischer
2bdb51e995 Calculate how many threads should be run 2015-07-09 15:24:47 -07:00
Eric Fischer
5d4ab6df1b Merge branch 'master' into multithread 2015-07-08 16:36:58 -07:00
Eric Fischer
3452ee92ab Fix formatting 2015-07-08 16:35:02 -07:00
Eric Fischer
e5a6f981b7 Work out the sharding math for multhreading 2015-07-08 16:33:22 -07:00
Eric Fischer
9abf09eb7e Merge pull request #66 from mapbox/quiet
Add option to quiet the chatty progress indicators
2015-07-08 15:07:15 -07:00
Eric Fischer
138699d243 Add option to quiet the chatty progress indicators 2015-07-08 15:06:21 -07:00
Eric Fischer
3bc5a07e5b Merge pull request #65 from mapbox/skip
Skipping over zoom levels when there is a minzoom, and other performance improvements
2015-07-08 14:44:55 -07:00
Eric Fischer
e7b4443838 Enforce code style 2015-07-08 14:42:12 -07:00
Eric Fischer
0ff6819efb Merge branch 'skip' of https://github.com/mapbox/tippecanoe into skip 2015-07-08 12:26:01 -07:00
Eric Fischer
6fd72d4518 Remove vacuum step, which doesn't seem to make .mbtiles smaller in practice
yet takes time and temporary disk space to perform
2015-07-08 12:25:09 -07:00
Eric Fischer
c19c913bf9 Fix confusing error messages from sloppy copying and pasting of code 2015-07-08 11:52:22 -07:00
Eric Fischer
65f3737325 Use a hash table of binary trees for string pooling, not just a binary tree 2015-07-02 17:07:11 -07:00
Eric Fischer
1b72804358 Precalculate which child tiles a feature can overlap
instead of looping over them all
2015-07-01 15:17:35 -07:00
Eric Fischer
18cdcb0732 Drop linetos smaller than tile resolution before doing normal simplification
Since simplification is rather expensive
2015-07-01 12:16:50 -07:00
Eric Fischer
af13a95dc1 Shard the child tiles as widely as possible even if not skipping levels
to help future parallelization
2015-07-01 12:04:45 -07:00
Eric Fischer
b2fdcba6b0 Don't shrink string buffers before returning them as JSON objects.
It takes a little bit of time, and it's already not shrinking them
for number objects.
2015-06-30 17:21:48 -07:00
Eric Fischer
767a581874 Inline the I/O in the long long serialization loop 2015-06-30 16:47:25 -07:00
Eric Fischer
0d3192b863 Break rewriting the geometry for the next zoom out into its own function 2015-06-30 16:36:26 -07:00
Eric Fischer
530852ae00 Maximum zoom increment of 3 seems to give the best performance 2015-06-29 17:18:48 -07:00
Eric Fischer
4bb88e228a Fix buffer overflow. This is a bounding box, not sub-tiles. 2015-06-29 17:05:33 -07:00
Eric Fischer
7724e2c329 Skip over some intermediate zooms below minzoom 2015-06-29 16:42:26 -07:00
Eric Fischer
efe3c62bb1 Start breaking the assumption that the next zoom is exactly 1 deeper 2015-06-29 16:16:38 -07:00
Eric Fischer
6951c1b72d Merge pull request #62 from mapbox/signedchars
Fix sign-extension bug with signed chars in attribute names
2015-06-21 11:20:23 -07:00
Eric Fischer
59faead7fa Fix sign-extension bug with signed chars in attribute names 2015-06-21 11:18:14 -07:00
Eric Fischer
a42dbd7968 Merge pull request #60 from mapbox/cpp
Move zoom traversal into C++
2015-06-19 17:46:31 -07:00
Eric Fischer
62052cafab Move zoom traversal into C++ 2015-06-19 17:29:56 -07:00
Eric Fischer
265b6866db Merge pull request #59 from mapbox/smaller
Optimizations to reduce memory footprint
2015-06-19 17:08:00 -07:00
Eric Fischer
e6c5aa9bfe Oops. Make sure that 0 stays 0 even when swizzling 2015-06-19 15:53:09 -07:00
Eric Fischer
e6997b00ff Swizzle the string comparison so it's not pathological if input is presorted 2015-06-19 15:49:51 -07:00
Eric Fischer
498e723563 Yet another temp file, for the tree of pointers into the string pool 2015-06-18 16:30:51 -07:00
Eric Fischer
dc3021656e Build the string pool in an appendable memory map, not the normal heap 2015-06-18 16:13:37 -07:00
Eric Fischer
d96dee8dad Fix formatting again 2015-06-18 14:47:29 -07:00
Eric Fischer
a185073f0a Shrink the geometry by shaving off bits below the maxzoom tile resolution 2015-06-18 14:16:16 -07:00
Eric Fischer
86a341c344 Merge pull request #57 from anandthakker/master
Update README to include buffer size units.
2015-06-18 12:39:00 -07:00
Eric Fischer
a1d3ecf9bb Save another byte per attribute by moving the type to the string pool 2015-06-18 12:12:20 -07:00
Eric Fischer
1a44538bdf Use the first coordinates of the first feature as the origin for deltas 2015-06-18 10:52:01 -07:00
Eric Fischer
46626e4f08 Delta encoding for motion within features 2015-06-17 17:48:29 -07:00
Eric Fischer
725ea71e57 Fix formatting 2015-06-17 17:30:17 -07:00
Eric Fischer
cde1e60603 Use a string pool to avoid duplicating keys and values 2015-06-17 17:18:08 -07:00
Eric Fischer
55e93a5d37 Use variable-length zigzag for ints and long longs 2015-06-17 16:46:36 -07:00
Anand Thakker
fbe4416fba Update README to include buffer size units. 2015-06-17 15:18:46 -04:00
Eric Fischer
9b34f7e6e3 Merge pull request #54 from mapbox/badproj
Clearer message about projections
2015-06-05 10:35:02 -07:00
Eric Fischer
d5d322f36a Clearer message about projections 2015-06-05 10:34:19 -07:00
Eric Fischer
448617e0a7 Merge pull request #53 from mapbox/badproj
Add a warning when data appears to be in the wrong projection
2015-06-05 10:24:13 -07:00
Eric Fischer
263ae94e75 Add a warning when data appears to be in the wrong projection 2015-06-05 10:23:25 -07:00
Eric Fischer
1a95504390 No need to write a loop to reindent the source files 2015-06-03 12:47:56 -07:00
Eric Fischer
b70d19288e Get back in sync with json-pull 2015-06-03 11:31:41 -07:00
Eric Fischer
fd60cc6600 Merge pull request #52 from mapbox/indentstyle
Consistent indent style with clang-format
2015-06-03 11:26:25 -07:00
Eric Fischer
8a1f0d83e1 Consistent indent style with clang-format 2015-06-03 11:22:13 -07:00