srcnet-tools-ingest

usage: ../bin/srcnet-tools-ingest [-h] [-d D] [--frequency FREQUENCY]
                                  [--debug] [--batch-size BATCH_SIZE]
                                  [--metadata-schema-path METADATA_SCHEMA_PATH]
                                  [--metadata-suffix METADATA_SUFFIX]
                                  [--n-processes N_PROCESSES]
                                  [--ingestion-backend-name INGESTION_BACKEND_NAME]
                                  [--rucio-ingest-rse-name RUCIO_INGEST_RSE_NAME]
                                  [--rucio-pfn-basepath RUCIO_PFN_BASEPATH]

Named Arguments

-d

base directory for service

Default: “/tmp/ingest”

--frequency

frequency at which to run (s)

Default: 5

--debug

debug mode?

Default: False

--batch-size

number of files to batch per iteration

Default: 50

--metadata-schema-path

The schema for metadata files.

Default: “/usr/local/etc/schemas/metadata.json”

--metadata-suffix

the expected metadata suffix

Default: “meta”

--n-processes

number of processes to pool

Default: 2

--ingestion-backend-name

the backend to ingest into (supported: rucio, rucio-non-det)

Default: “rucio”

--rucio-ingest-rse-name

the RSE name into which to ingest the data (Rucio and Rucio Non-Det only)

--rucio-pfn-basepath

the basepath of the physical filename (Rucio Non-Det only)