981ac700d4
Implement MinIO Offload and Retention Features - Added configuration options for MinIO retention hours and offload threshold in README. - Introduced MinIO payload offloading for large DataFrame-derived payloads, storing them as parquet files. - Updated activities to utilize MinIO for data loading and cleanup, including new methods for offloading and retention management. - Refactored existing activities to integrate MinIO functionality, ensuring compatibility with previous workflows. - Removed the legacy MinioRepository class, consolidating MinIO operations under a new manager structure. - Updated requirements to use the latest version of the sientia-dataops-library.
16 lines
260 B
Plaintext
16 lines
260 B
Plaintext
temporalio
|
|
psycopg2-binary
|
|
sqlalchemy
|
|
asyncua
|
|
redis
|
|
git+ssh://git@github.com/Aignosi/sientia-dataops-library.git@1.10.2
|
|
git+ssh://git@github.com/Aignosi/sientia-mlops-library.git@0.40.7
|
|
prometheus-client
|
|
botocore
|
|
boto3
|
|
s3fs
|
|
pyarrow
|
|
kaleido
|
|
hyperopt
|
|
shap
|
|
pycurl |