758ffb10b6
SIENTIAPDE-1241: Fix: Correctly handle feature normalization and denormalization, and add scaler parameters to metadata
Bruno Domingues
2025-10-22 21:26:11 -03:00
5789a13023
SIENTIAPDE-1241: refactor train_model workflow due to I/O errors.
Bruno Domingues
2025-10-22 15:37:56 -03:00
f2a1c88ff3
Merge pull request #8 from Aignosi/feature/SIENTIAPDE-1255
Bruno Domingues
2025-10-21 09:42:17 -03:00
ab7c93480b
SIENTIAPDE-1255: Refactor: Move extra pip requirements to environment variable and use constants for preprocessor steps.
Bruno Domingues
2025-10-21 09:20:23 -03:00
4686b438db
SIENTIAPDE-1255: Update quality gate workflow: Remove redundant repository and disk space cleanup, update cache key.
Bruno Domingues
2025-10-20 22:35:20 -03:00
3e52253a98
SIENTIAPDE-1255: Add tests to ensure get_required_columns removes columns from self_operations and cross_operations.
Bruno Domingues
2025-10-20 22:27:58 -03:00
614eb0cb7f
SIENTIAPDE-1255: Add unit tests for utils.split_train_test function
Bruno Domingues
2025-10-20 22:22:38 -03:00
089f312575
SIENTIAPDE-1255: Add unit tests for the reports module
Bruno Domingues
2025-10-20 22:20:26 -03:00
0de2ece063
SIENTIAPDE-1255: Add unit tests for sientia models (DataPreprocessor and LinearRegressionModel)
Bruno Domingues
2025-10-20 20:59:55 -03:00
3c09e59f6a
SIENTIAPDE-1255: Add unit tests for the ModelServing class.
Bruno Domingues
2025-10-20 20:24:50 -03:00
b1fe62f68b
SIENTIAPDE-1255: Add unit tests for sientia metrics module (MAE, MSE, R2)
Bruno Domingues
2025-10-20 20:13:08 -03:00
b3e4bb8660
SIENTIAPDE-1255: Add comprehensive tests for __del__ methods in Activities and ExperimentTracking to ensure proper resource cleanup and exception handling.
Bruno Domingues
2025-10-20 20:09:49 -03:00
4a32d712ba
SIENTIAPDE-1255: Implement object destructors for Activities and ExperimentTracking to prevent AttributeError during garbage collection, and mock workflow logger in tests to avoid RuntimeWarning.
Bruno Domingues
2025-10-20 17:53:49 -03:00
52be5c4e8e
SIENTIAPDE-1255: Improve documentation for split_train_test function in utils.py
Bruno Domingues
2025-10-20 17:41:05 -03:00
0dbe179367
SIENTIAPDE-1255: Add thread-safety documentation and I/O notes to Reports class, improve save_all_sections documentation and error handling.
Bruno Domingues
2025-10-20 17:38:44 -03:00
2292ae57cc
SIENTIAPDE-1255: Add thread-safety documentation and in-place modification warnings to LinearRegressionModel and DataPreprocessor classes.
Bruno Domingues
2025-10-20 17:27:58 -03:00
56f3db350c
SIENTIAPDE-1255: Refactor ModelServing class to improve thread safety, resource management, and documentation. Adds context manager for experiment saving and clarifies thread-safety concerns.
Bruno Domingues
2025-10-20 17:16:45 -03:00
56a21a16da
SIENTIAPDE-1255: Integrate sientia-mlops-library into model-manager, adding model serving, reporting, and updated model definitions.
Bruno Domingues
2025-10-20 16:55:52 -03:00
9e31ab679b
SIENTIAPDE-1255: Implement MLFlow artifact management and model persistence
Bruno Domingues
2025-10-17 09:11:54 -03:00
a66b996cc1
SIENTIAPDE-1255: Refactor MLFlow activities for training operations and update metrics
Bruno Domingues
2025-10-17 00:51:29 -03:00
85a8ba1e68
SIENTIAPDE-1255: Refactor data quality gates to training focused metrics and repositories. This commit removes the data quality gates and filters, focusing on training-specific metrics and data repositories. It also updates the README to reflect these changes, including new training metrics and a streamlined data services section.
Bruno Domingues
2025-10-17 00:39:06 -03:00
e191e7849f
SIENTIAPDE-1255: Refactor Model Manager to focus on ML model training pipeline and simplify architecture. This includes removing prediction workflows, updating core functionality, and improving parameter validation and resource management. README.md | 411 deletions(-) 117 insertions(+) 1 file changed, 117 insertions(+), 411 deletions(-)
Bruno Domingues
2025-10-16 18:26:56 -03:00
7abd951806
SIENTIAPDE-1255: Refactor worker to support only the train_model-queue and remove prediction workflows.
Bruno Domingues
2025-10-16 18:15:52 -03:00
8f1cc21bb1
SIENTIAPDE-1255: Add port forwarding setup script and documentation to README.md
Bruno Domingues
2025-10-16 18:00:28 -03:00
9ee12373b4
Merge pull request #7 from Aignosi/feature/SIENTIAPDE-1253
Bruno Domingues
2025-10-15 17:04:49 -03:00
4ff796a56f
SIENTIAPDE-1253: Update README.md to include documentation for the Train Model workflow and renumber the Minimal Retrain workflow. (+101, -1)
Bruno Domingues
2025-10-15 16:35:13 -03:00
98c216733b
SIENTIAPDE-1253: Enhance error logging in train_model workflow with rich context for debugging.
Bruno Domingues
2025-10-15 16:19:15 -03:00
305a39b44c
SIENTIAPDE-1253: Implement business rule validation for training parameters. Adds a validate_business_rules method to the TrainModelParams class to enforce constraints on training parameters, improving data integrity and preventing errors. Also updates tests to include target variable in variable columns and adds tests for business rule validations.
Bruno Domingues
2025-10-15 16:16:09 -03:00
4b28d5f1c8
SIENTIAPDE-1253: Implement granular retry policies for activities in train_model workflow.
Bruno Domingues
2025-10-15 16:06:13 -03:00
780184769d
SIENTIAPDE-1253: Expose workflow activity timeouts as environment variables and document them.
Bruno Domingues
2025-10-15 16:03:01 -03:00
1ec40bfb2a
SIENTIAPDE-1253: Implement activity for cleaning up temporary run directory and integrate into train model workflow. This change introduces a new activity for idempotent cleanup of the run directory after model training, replacing the direct directory removal in the workflow. This improves determinism and error handling. Also includes unit tests for the new activity.
Bruno Domingues
2025-10-15 15:49:05 -03:00
8ea98360c3
SIENTIAPDE-1253: Refactor training workflow and activities to raise exceptions on failure
Bruno Domingues
2025-10-15 15:19:29 -03:00
61267ec49d
SIENTIAPDE-1253: Enforce TrainModelParams object in Training activity and tests, removing dict conversion.
Bruno Domingues
2025-10-14 10:03:34 -03:00
014e1cd910
Merge pull request #6 from Aignosi/feature/SIENTIAPDE-1252
Bruno Domingues
2025-10-13 14:44:39 -03:00
9d4ec19586
SIENTIAPDE-1252: Improve caching in quality gate, add alt text to logo, and change exception type in MLflow repository.
Bruno Domingues
2025-10-13 10:54:38 -03:00
b3c749872c
SIENTIAPDE-1252: Implement save_model activity to save trained models to MLflow with comprehensive error handling and add corresponding unit tests.
Bruno Domingues
2025-10-13 10:18:45 -03:00
3fd5ab79fe
SIENTIAPDE-1252: Implement artifact generation and MLflow logging for model training results
Bruno Domingues
2025-10-10 17:56:09 -03:00
52b7b23261
SIENTIAPDE-1252: Update Python setup action and simplify dependency caching in quality gate workflow
Bruno Domingues
2025-10-09 17:52:35 -03:00
94e11df803
SIENTIAPDE-1252: Remove experiment_description from TrainModelParams and related tests.
Bruno Domingues
2025-10-09 17:48:43 -03:00
5b0cd92dfe
Merge pull request #5 from Aignosi/feature/SIENTIAPDE-1251
Bruno Domingues
2025-10-09 17:09:56 -03:00
bee6036205
SIENTIAPDE-1251: Implement ML model training activity and repository
Bruno Domingues
2025-10-09 15:07:27 -03:00
c970754e1b
Merge pull request #4 from Aignosi/feature/SIENTIAPDE-1250
Bruno Domingues
2025-10-07 14:51:14 -03:00
97f5ee08f1
SIENTIAPDE-1250: Fix: Update pip cache key and replace pytz with datetime.UTC in experiment tracking.
Bruno Domingues
2025-10-07 14:12:35 -03:00
7e1eace77f
SIENTIAPDE-1250: Implement experiment tracking activity with status updates, error handling, and model registration. This includes a unified update method, error message truncation, and integration into the main activities orchestrator. (236+, 2-)
Bruno Domingues
2025-10-07 11:27:23 -03:00
2628dc92d2
SIENTIAPDE-1250: Refactor: Remove 'laborious' directory from test structure and update README.md accordingly.
Bruno Domingues
2025-10-07 10:02:38 -03:00
851f34c80e
Merge pull request #3 from Aignosi/feature/SIENTIAPDE-1249
Bruno Domingues
2025-10-06 19:53:28 -03:00
04c94efd98
SIENTIAPDE-1249: Refactor TrainModelParams to use dataclass and add from_dict method for validation, remove no-cache-dir from pip install in quality gate workflow, and rename X_train/X_test to x_train/x_test in TrainModelResult.
Bruno Domingues
2025-10-06 19:11:02 -03:00
d8583cdae7
SIENTIAPDE-1249: Implement data models for Model Manager and add unit tests. This commit introduces data transfer objects (DTOs) and model classes for experiment status, training parameters, and training results, along with corresponding unit tests to ensure their correct behavior.
Bruno Domingues
2025-10-06 16:49:18 -03:00
18ccfed78a
Merge pull request #2 from Aignosi/feature/SIENTIAPDE-1248
Bruno Domingues
2025-10-06 11:27:19 -03:00
520975e7aa
SIENTIAPDE-1248: Refactor MinIO activity to raise specific exception types for better error handling
Bruno Domingues
2025-10-06 10:58:48 -03:00
ec5b9df125
SIENTIAPDE-1248: Refactor README.md to include detailed documentation on features, architecture, workflows, installation, code quality, testing, monitoring, configuration, development, troubleshooting, performance tuning, contributing, license, and support.
Bruno Domingues
2025-10-04 14:45:42 -03:00
0db7f7462a
SIENTIAPDE-1248: Add worker tests, including Prometheus server startup, main function execution, exception handling, worker creation, activity initialization, and environment variable usage.
Bruno Domingues
2025-10-04 13:02:24 -03:00
9afe711075
SIENTIAPDE-1248: Integrate MinIO for object storage and add related configurations
Bruno Domingues
2025-10-03 21:04:27 -03:00
11c25d126c
Merge pull request #1 from Aignosi/release/SIENTIAPDE-1243
Bruno Domingues
2025-10-02 14:59:16 -03:00
2f84d7ac20
SIENTIAPDE-1243: Update SonarQube Scan Action to v6 in quality-gate workflow.
Bruno Domingues
2025-10-02 12:37:55 -03:00
4285ddb59d
SIENTIAPDE-1243: Improve versioning logic in quality gate and optimize workflow
Bruno Domingues
2025-10-02 12:18:52 -03:00
9a1355fe9b
SIENTIAPDE-1243: Add Temporal namespace setup guide to README and improve validation script.
Bruno Domingues
2025-10-02 10:08:02 -03:00
8f4ac3284e
SIENTIAPDE-1243: Remove Redis dependency and related configurations.
Bruno Domingues
2025-10-01 18:16:21 -03:00
c12973410c
SIENTIAPDE-1243: Add .bandit/ and validate.txt to .gitignore to exclude code quality tool cache files.
Bruno Domingues
2025-10-01 18:02:39 -03:00
07e699aae2
SIENTIAPDE-1243: Fix: Corrected dataframe inference and mlflow repository tests, and updated activity method calls in format and export prediction tests.
Bruno Domingues
2025-10-01 17:54:02 -03:00
ef3c2a0c8a
SIENTIAPDE-1243: Add type ignores and fix datetime index formatting in gates and model repository.
Bruno Domingues
2025-10-01 17:44:45 -03:00
8bcee4c6a0
SIENTIAPDE-1243: Fix: Resolved mypy errors and added pandas stubs. Addressed type hinting issues and suppressed mypy warnings to improve code quality and maintainability.
Bruno Domingues
2025-10-01 17:36:47 -03:00
dfc190c818
SIENTIAPDE-1243: Refactor and enhance model manager activities and workflows
Bruno Domingues
2025-10-01 17:28:57 -03:00
b102f79087
SIENTIAPDE-1243: Remove OPC server integration and add code quality tools.
Bruno Domingues
2025-10-01 16:25:08 -03:00
bc4d98f78d
SIENTIAPDE-1243: Rename project from 'laborious' to 'model-manager' across codebase and configuration. This includes updating project names in environment variables, Makefiles, README, metrics, and Helm chart values.
Bruno Domingues
2025-10-01 14:41:24 -03:00
aba4a3f1a5
SIENTIAPDE-1243: Refactor: Rename 'laborious' package to 'model_manager'
Bruno Domingues
2025-10-01 14:29:24 -03:00
e318b91c63
SIENTIAPDE-1243: Update README with correct repository name and installation instructions.
Bruno Domingues
2025-10-01 14:11:36 -03:00
e83dd9d3c2
SIENTIAPDE-1243: Implement automatic version calculation and branch validation in quality gate workflow, and update SonarQube project properties. (+190 -10 lines)
Bruno Domingues
2025-10-01 11:41:24 -03:00
93d0849c80
SIENTIAPDE-1243: Initial commit of the model manager project, adding core files and configurations.
Bruno Domingues
2025-09-30 14:55:38 -03:00
e79b35a1fb
Initial commit
Bruno Domingues
2025-09-30 13:38:26 -03:00
Bruno Domingues