get
: new command for getting tabular data from various sources
#2263
Labels
CKAN
interoperability with CKAN Data Management System
datapusher+
for Datapusher+
enhancement
New feature or request. Once marked with this label, its in the backlog.
Now that qsv has a separate lookup module (#2262), create a
get
command that can retrieve tabular data from various sources:dathere://
is a special scheme that autoresolves to either a datHere-provisioned CKAN or a datHere host, based on the datHere URLIt will be backed by a diskcache using https://crates.io/crates/cached (already heavily used by
fetch
andgeocode
commands) and will use https://docs.rs/http-cache-reqwest/latest/http_cache_reqwest/ as well to make it even more efficient in fetching remote data (using http caching semantics, e.g. etag, cache keywords in response header, etc.)The command can be used to efficiently retrieve reference data; to seed the caches for
luau
(lookup tables),validate
JSONschemadynamicEnum
validation; and to have a more efficient resource fetcher for DataPusher+ (should greatly improve harvesting throughput).cc @tino097
The text was updated successfully, but these errors were encountered: