Configuration#
This section auto-documents the repository application configuration.
- pydantic settings app.core.config.Settings[source]#
Settings model for API.
- Config:
extra: str = ignore
env_file: str = .env
env_file_encoding: str = utf-8
- Fields:
- field default_download_file_chunk_size: Literal[1] = 1[source]#
Number of records to process in a single file chunk when downloading.Not configurable or used, just representing that we stream line-by-line at this point.
- field default_es_indexing_chunk_size: int = 1000[source]#
Number of records to process in a single chunk when indexing to Elasticsearch.
- field default_es_percolation_chunk_size: int = 1000[source]#
Number of records to process in a single chunk when percolating to Elasticsearch.
- field default_upload_file_chunk_size: int = 1[source]#
Number of records to process in a single file chunk when uploading.
- field es_indexing_chunk_size_override: dict[ESIndexingOperation, int] [Optional][source]#
Override the default Elasticsearch indexing chunk size.
- field es_percolation_chunk_size_override: dict[ESPercolationOperation, int] [Optional][source]#
Override the default Elasticsearch percolation chunk size.
- field import_batch_retry_count: int = 3[source]#
Number of times to retry processing an import batch before marking it as failed. We only retry on errors we are confident can be resolved - eg network issues or inconsistent database state being loaded in parallel.
- field message_lock_renewal_duration: int = 10800[source]#
Duration in seconds to keep renewing message locks. Should be longer than expected processing time.
- field presigned_url_expiry_seconds: int = 3600[source]#
The number of seconds a signed URL is valid for.
- field project_root: Path = PosixPath('/home/runner/work/destiny-repository/destiny-repository')[source]#