Skip to content

Commit

Permalink
Merge pull request #56 from lonvia/batch-worker-queues
Browse files Browse the repository at this point in the history
Increase chunk-size for sending data to generator workers
  • Loading branch information
pnorman authored Nov 25, 2024
2 parents 2e55b4b + 3f8df7e commit 4cff53e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tilekiln/generator.py
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,6 @@ def generate(config: Config, source_kwargs, storage_kwargs, # type: ignore[no-u
return

with mp.Pool(num_processes, setup, (config, source_kwargs, storage_kwargs)) as pool:
pool.imap_unordered(worker, tiles)
pool.imap_unordered(worker, tiles, 100)
pool.close()
pool.join()

0 comments on commit 4cff53e

Please sign in to comment.