Install dependent libraries with pip install -r requirements.txt.
The gen_new_list.py generates a list of new product IDs in the DHuS database added since the last run of this script and saves them. Otherwise, generates list of IDs from the last 30 days. The list of IDs is then stored in a file.
Authentication: Basic auth is resolved automatically by the Requests library by reading a ~/.netrc file. Make sure to set up the correct entry (DHuS URL) there.
Configuration file: The sentinel_config.yml contains the URL to the Sentinel data hub host.
Command line arguments: The command line options supersede the configuration file settings. Run help to list all
configurable parameters: ./gen_new_list.py -h
The register_stack.py script fetches Sentinel 1, 2, 3 and 5P metadata from a data hub and transforms it into a STAC format. It can publish the results to a STAC catalogue. The transformation is done by imported stactools modules.
check_new_register_stac.py calls previous scripts to fetch new products, transform them to STAC metadata and push them to the catalogue.
There are several ways to configure the script's behaviour:
Preconfigured mappings: The stac_collections.py file contains general constants that should be updated by developers if necessary. You can modify the options if needed.
Configuration file: The sentinel_config.yml contains the URLs to the Sentinel data hub host and the STAC catalogue host, log file prefixes and path to a location to save the data.
Command line arguments: The command line options supersede the configuration file settings. Run help to list all
configurable parameters: ./register_stack.py -h
Authentication: Basic auth is resolved automatically by the Requests library by reading a ~/.netrc file. Make sure to set up the correct entries (Sentinel and STAC host URL) there.
Automation of the COPE-SRCO-PL-2400437 GSS user test activity v1.1. Perform Odata queries: Odata filters, queries by attributes and nodes inspection for some products per each product type in a random way.
virtualenv .
source bin/activate
pip install -r requirements.txt
Example:
python user-test-activity3.py -b
Use with -b for basic auth file .netrc which contains machine, login, password records. See man curl.
Use with -t for basic auth file .token which contains single token line.
Use with -k for keycloak authentication. Credentials are read from the .netrc.
Use -d to increase verbosity. Specify multiple times to increase more.
Custom filters could be defined in filters.txt file.