[GIS] Downloading large data sets on overpass-turbo

overpass-api

I'm trying to download historical data from overpass-turbo and I keep getting this error. 

Error: runtime error: open64: 0 Success /osm3s_v0.7.54_osm_base Dispatcher_Client::request_read_and_idx::timeout. The server is probably too busy to handle your request.

This is after trying to increase the timeout and maxsize on the query and using the "raw data directly from Overpass API" export function. I need to do this for all of US and Canada. Breaking it up by state and province is fine or one big download will work as well. Am I exceeding the limits and need to find another way of doing this? The files don't seem to be too big. California is about 10MB and Ohio is about 2MB. Here are my basic queries.

 [adiff:"2016-10-23T15:00:00Z","2017-10-22T15:00:00Z"];

{{geocodeArea:california}}->.searchArea;
(
  way["highway"="motorway_link"](area.searchArea);
);
out body;
>;
out skel qt;



[adiff:"2016-10-23T15:00:00Z","2017-10-22T15:00:00Z"][timeout:99999][maxsize:10737418240];

{{geocodeArea:california}}->.searchArea;
(
  way["highway"="motorway_link"](area.searchArea);
);
out body;
>;
out skel qt;

Best Answer

Am I exceeding the limits

Given that quoted error includes

Dispatcher_Client::request_read_and_idx::timeout. The server is probably too busy to handle your request.

Yes, you requested more than server is able to provide. Try splitting queries into smaller.

Also, from comments:

Besides, both timeout and maxsize values are both ridiculously large: 99999 seconds is more than 1 day (!), maxsize is >10GB

It is possible that server rejects queries with outrageous maxsize and timeout values.

Related Question