Install dependent libraries with pip install -r requirements.txt.
The gen_new_list.py generates a list of new product IDs in the DHuS database added since the last run of this script and saves them. Otherwise, generates list of IDs from the last 30 days. The list of IDs is then stored in a file.
Authentication: Basic auth is resolved automatically by the Requests library by reading a ~/.netrc file. Make sure to set up the correct entry (DHuS URL) there.
Configuration file: The sentinel_config.yml contains the URL to the Sentinel data hub host.
Command line arguments: The command line options supersede the configuration file settings. Run help to list all
configurable parameters: ./gen_new_list.py -h
The register_stack.py script fetches Sentinel 1, 2, 3 and 5P metadata from a data hub and transforms it into a STAC format. It can publish the results to a STAC catalogue. The transformation is done by imported stactools modules.
There are several ways to configure the script's behaviour:
Preconfigured mappings: The stac_collections.py file contains general constants that should be updated by developers if necessary. You can modify the options if needed.
Configuration file: The sentinel_config.yml contains the URLs to the Sentinel data hub host and the STAC catalogue host, log file prefixes and path to a location to save the data.
Command line arguments: The command line options supersede the configuration file settings. Run help to list all
configurable parameters: ./register_stack.py -h
Authentication: Basic auth is resolved automatically by the Requests library by reading a ~/.netrc file. Make sure to set up the correct entries (Sentinel and STAC host URL) there.
Sometimes, data get removed in the odata catalogue (either expire, or were found invalid). Upon their deletion in the odata catalogue, we need to remove their STAC entry from a STAC catalogue. This script takes the product title (including prefix which was set on creation of the entry) and removes it from the STAC catalogue.
Configuration file is again in the sentinel_config.yml, where STAC host and possible prefix needs to be set.
Authentication: Basic auth is resolved automatically by the Requests library by reading a ~/.netrc file. Make sure to set up the correct entry (STAC host URL) there.
Command line arguments: The command line options supersede the configuration file settings. Run help to list all
configurable parameters: ./remove_stac.py -h