Package: ecospgr 0.5.2

ecospgr: Shared Loader Utilities for ecospg

Extracts duplicated R code from ecospg data loaders into a reusable package. Provides database connection, catalog registration, partitioned table management, staging/ingest, S3 upload, and CLI argument parsing utilities.

Authors:Lars Dalby [aut, cre]

ecospgr_0.5.2.tar.gz
ecospgr_0.5.2.zip(r-4.7-any)ecospgr_0.5.2.zip(r-4.6-any)ecospgr_0.5.2.zip(r-4.5-any)
ecospgr_0.5.2.tgz(r-4.6-any)ecospgr_0.5.2.tgz(r-4.5-any)
ecospgr_0.5.2.tar.gz(r-4.7-any)ecospgr_0.5.2.tar.gz(r-4.6-any)
ecospgr_0.5.2.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION
card.svg |card.png
ecospgr/json (API)

# Install 'ecospgr' in R:
install.packages('ecospgr', repos = c('https://ldalby.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://gitlab.au.dk/ecos/tools/r-pkgs/ecospgr

On CRAN:

Conda:

2.48 score 30 exports 29 dependencies

Last updated from:d6e124c097. Checks:9 OK. Indexed: no.

TargetResultTimeFilesSyslog
linux-develOK120
source / vignettesOK176
linux-releaseOK102
macos-releaseOK112
macos-oldrelOK109
windows-develOK133
windows-releaseOK138
windows-oldrelOK136
wasm-releaseOK119

Exports:epg_build_source_metaepg_check_feature_countepg_collect_source_meta_overridesepg_create_partitionepg_detect_xsd_for_gmlepg_dfd_auth_paramsepg_dfd_auth_qsepg_drop_versionepg_ensure_datasetepg_ensure_topicepg_finalize_versionepg_fix_encodingepg_insert_normalizedepg_parse_argepg_parse_json_argepg_parse_json_payloadepg_persist_source_metaepg_pg_connectepg_promote_latestepg_read_json_fileepg_redact_urlepg_register_versionepg_resolve_s3_configepg_run_pipelineepg_sanitize_nameepg_set_raw_file_urlepg_shapefile_encoding_optsepg_upload_raw_filesepg_url_without_queryepg_write_staging

Dependencies:bitbit64blobclassclassIntclicpp11DBIe1071fsgenericsgluehmsjsonliteKernSmoothlifecyclelubridatepkgconfigproxyRcpprlangRPostgress2sftimechangeunitsvctrswithrwk

Readme and manuals

Help Manual

Help pageTopics
Build base source metadataepg_build_source_meta
Check a loaded feature count against what the source reportedepg_check_feature_count
Collect source metadata overrides from file and/or inline JSONepg_collect_source_meta_overrides
Create a partition table and indexes for a dataset versionepg_create_partition
Detect a companion XSD file for a GML fileepg_detect_xsd_for_gml
Datafordeler authentication query parametersepg_dfd_auth_params
Datafordeler authentication query stringepg_dfd_auth_qs
Remove a dataset version and its dataepg_drop_version
Ensure a dataset row exists in meta.datasetepg_ensure_dataset
Ensure a topic row exists in meta.topicepg_ensure_topic
Finalize a dataset version: mark latest and drop stagingepg_finalize_version
Repair text that was decoded as UTF-8 but is actually Latin-1epg_fix_encoding
Insert normalized geometries from staging into a vector partitionepg_insert_normalized
Parse a command-line flag argumentepg_parse_arg
Parse a JSON value from a string or @file referenceepg_parse_json_arg
Parse a JSON stringepg_parse_json_payload
Persist source metadata on a dataset versionepg_persist_source_meta
Connect to PostgreSQL using PG* environment variablesepg_pg_connect
Promote the newest eligible year-vintage version to latestepg_promote_latest
Read and parse a JSON fileepg_read_json_file
Redact credentials from a URLepg_redact_url
Register a new dataset versionepg_register_version
Resolve S3-compatible object storage configuration from environmentepg_resolve_s3_config
Run the full ingest pipeline in a single transactionepg_run_pipeline
Sanitize a string into a valid SQL/table nameepg_sanitize_name
Set the raw file URL on a dataset versionepg_set_raw_file_url
GDAL open options for reading a shapefile's attributes correctlyepg_shapefile_encoding_opts
Upload raw files to S3-compatible object storageepg_upload_raw_files
Strip the query string from a URLepg_url_without_query
Write an sf object to a staging tableepg_write_staging