Package: ecospgr 0.3.0

ecospgr: Shared Loader Utilities for ecospg

Extracts duplicated R code from ecospg data loaders into a reusable package. Provides database connection, catalog registration, partitioned table management, staging/ingest, S3 upload, and CLI argument parsing utilities.

Authors:Lars Dalby [aut, cre]

ecospgr_0.3.0.tar.gz
ecospgr_0.3.0.zip(r-4.7)ecospgr_0.3.0.zip(r-4.6)ecospgr_0.3.0.zip(r-4.5)
ecospgr_0.3.0.tgz(r-4.6-any)ecospgr_0.3.0.tgz(r-4.5-any)
ecospgr_0.3.0.tar.gz(r-4.7-any)ecospgr_0.3.0.tar.gz(r-4.6-any)
ecospgr_0.3.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
card.svg |card.png
ecospgr/json (API)

# Install 'ecospgr' in R:
install.packages('ecospgr', repos = c('https://ldalby.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://gitlab.au.dk/ecos/tools/r-pkgs/ecospgr

On CRAN:

Conda:

2.18 score 23 exports 30 dependencies

Last updated from:365a1accfd. Checks:9 OK. Indexed: no.

TargetResultTimeFilesSyslog
linux-devel-x86_64OK121
source / vignettesOK187
linux-release-x86_64OK121
macos-release-arm64OK76
macos-oldrel-arm64OK106
windows-develOK70
windows-releaseOK79
windows-oldrelOK69
wasm-releaseOK113

Exports:epg_build_source_metaepg_collect_source_meta_overridesepg_create_partitionepg_detect_xsd_for_gmlepg_dfd_auth_paramsepg_dfd_auth_qsepg_ensure_datasetepg_ensure_topicepg_finalize_versionepg_insert_normalizedepg_parse_argepg_parse_json_argepg_parse_json_payloadepg_persist_source_metaepg_pg_connectepg_read_json_fileepg_register_versionepg_resolve_s3_configepg_run_pipelineepg_sanitize_nameepg_set_raw_file_urlepg_upload_raw_filesepg_write_staging

Dependencies:bitbit64blobclassclassIntclicpp11DBIe1071fsgenericsgluehmsjsonliteKernSmoothlifecyclelubridateMASSpkgconfigproxyRcpprlangRPostgress2sftimechangeunitsvctrswithrwk

Readme and manuals

Help Manual

Help pageTopics
Build base source metadataepg_build_source_meta
Collect source metadata overrides from file and/or inline JSONepg_collect_source_meta_overrides
Create a partition table and indexes for a dataset versionepg_create_partition
Detect a companion XSD file for a GML fileepg_detect_xsd_for_gml
Datafordeler authentication query parametersepg_dfd_auth_params
Datafordeler authentication query stringepg_dfd_auth_qs
Ensure a dataset row exists in meta.datasetepg_ensure_dataset
Ensure a topic row exists in meta.topicepg_ensure_topic
Finalize a dataset version: mark latest and drop stagingepg_finalize_version
Insert normalized geometries from staging into a vector partitionepg_insert_normalized
Parse a command-line flag argumentepg_parse_arg
Parse a JSON value from a string or @file referenceepg_parse_json_arg
Parse a JSON stringepg_parse_json_payload
Persist source metadata on a dataset versionepg_persist_source_meta
Connect to PostgreSQL using PG* environment variablesepg_pg_connect
Read and parse a JSON fileepg_read_json_file
Register a new dataset versionepg_register_version
Resolve S3-compatible object storage configuration from environmentepg_resolve_s3_config
Run the full ingest pipeline in a single transactionepg_run_pipeline
Sanitize a string into a valid SQL/table nameepg_sanitize_name
Set the raw file URL on a dataset versionepg_set_raw_file_url
Upload raw files to S3-compatible object storageepg_upload_raw_files
Write an sf object to a staging tableepg_write_staging