SIENTIAPDE-1231

Enhance MinIO integration and update environment configurations

- Added MinIO configuration parameters to .env.example and values.yaml for improved storage management.
- Updated requirements.txt to include necessary libraries for MinIO support.
- Refactored Activities class to utilize Storage for MinIO interactions.
- Enhanced MLFlow class to integrate MinIO for data retrieval during model retraining.
- Introduced build_minio_config function to streamline MinIO configuration setup.
- Updated minimal_retrain workflow to support data storage in MinIO.

laborious/worker/worker.py

@@ -44,6 +44,7 @@ with workflow.unsafe.imports_passed_through():
     from laborious.utils.connectors_config import (
         build_postgres_config,
         build_mlflow_config,
+        build_minio_config,
         build_opc_config,
         build_mongodb_config
     )
@@ -152,6 +153,7 @@ async def main():
     activities = Activities(
         postgres_config=build_postgres_config(),
         mlflow_config=build_mlflow_config(),
+        minio_config=build_minio_config(),
         opc_config=build_opc_config(),
         logger=logger,
         notification_handler=notification_handler
@@ -190,6 +192,7 @@ async def main():
             workflows=[MinimalRetrain],
             activities=[
                 activities.load_custom_query,
+                activities.query_to_minio,
                 activities.retrain_model,
                 activities.update_production_model,
                 activities.format_retrain_report,
@@ -211,6 +214,7 @@ async def main():
                 # MLFlow
                 activities.request_predict,
                 activities.request_transform,
+                activities.query_to_minio,
                 # Gates
                 activities.input_gate,
                 activities.mlflow_response_gate,