Commit Graph

216 Commits

Author SHA1 Message Date
Bruno Domingues
005c33151c Merge pull request #12 from Aignosi/feature/SIENTIAPDE-1308
SIENTIAPDE-1308: Dockerize project, update documentation, and improve dependency management
2025-11-04 15:42:06 -03:00
Bruno Domingues
d9d3df5723 SIENTIAPDE-1308: Initial Docker setup, improved .dockerignore, updated README, and minor fixes. 2025-11-04 14:07:37 -03:00
Bruno Domingues
9f56a128e6 SIENTIAPDE-1308: Update documentation, remove install_dependencies.sh script from README, correct Training class initialization, and update sientia-dataops-library version in requirements.txt. 2025-11-03 17:35:33 -03:00
Bruno Domingues
6ff2d9857d feat: update todo list
This commit updates the todo list with new tasks and removes outdated ones.

The changes include:

- Adding tasks related to Grafana dashboard creation, library updates, and workflow improvements.
- Removing outdated tasks about test refactoring and readme updates.
2025-11-03 15:36:35 -03:00
Bruno Domingues
12f8b21625 Merge pull request #11 from Aignosi/feature/SIENTIAPDE-1307
SIENTIAPDE-1307: Implement and Integrate Metrics Tracking for Training Activities and Workflows
2025-11-03 15:26:58 -03:00
Bruno Domingues
f32d647d1c SIENTIAPDE-1307: Implement metrics for training activities and workflow executions, tracking success/failure status. 2025-11-03 14:41:37 -03:00
Bruno Domingues
d8e8d3c481 SIENTIAPDE-1307: Fix PytestUnraisableExceptionWarning in activity and experiment tracking tests by controlling exception raising in __del__ mocks. 2025-10-31 17:21:27 -03:00
Bruno Domingues
a258036397 SIENTIAPDE-1307: Refactor: Remove redundant patching of SientiaMonitoring and Postgres init in tests, and add shutdown mock to metrics controller. 2025-10-31 17:15:59 -03:00
Bruno Domingues
db581f60f9 SIENTIAPDE-1307: Integrate metrics controller and update sientia-dataops-library to 1.5.1. This change adds metrics collection capabilities to activities and updates the dataops library dependency. (18 files changed, 143 insertions(+), 16 deletions(-)) 2025-10-31 17:06:26 -03:00
Bruno Domingues
326f9f9dc6 Merge pull request #10 from Aignosi/feature/SIENTIAPDE-1241
Feature/SIENTIAPDE-1241: Corrigir bug ao treinar modelos com a flag de normalizar dados ativa
2025-10-30 17:04:51 -03:00
Bruno Domingues
5b14f1016b SIENTIAPDE-1241: Suppress PytestUnraisableExceptionWarning and update test data in training repository tests. 2025-10-30 15:22:59 -03:00
Bruno Domingues
bb25a19d8c SIENTIAPDE-1241: Simplify worker shutdown logic by removing conditional checks. 2025-10-30 15:14:43 -03:00
Bruno Domingues
f5c1ac3615 SIENTIAPDE-1241: Remove model equation implementation documentation and add test coverage for _generate_artifacts in ModelRepository. 2025-10-30 14:56:10 -03:00
Kou-Kinoshita
a5c0cb6e47 SIENTIAPDE-1241: Fixed formatting and linted code 2025-10-30 10:38:29 -03:00
Kou-Kinoshita
17a551d6f9 SIENTIAPDE-1241: Added remaining training repository tests 2025-10-30 10:29:51 -03:00
Kou-Kinoshita
7e9d6683e4 SIENTIAPDE-1241: Added worker test 2025-10-30 10:21:39 -03:00
Kou-Kinoshita
c63389620a SIENTIAPDE-1241: Train_model tests 2025-10-30 10:11:07 -03:00
Kou-Kinoshita
928c679223 SIENTIAPDE-1241: Added remaining model repository tests 2025-10-30 09:58:46 -03:00
Kou-Kinoshita
c699a47261 SIENTIAPDE-1241: worker tests 2025-10-30 09:52:34 -03:00
Kou-Kinoshita
94a407f1b8 SIENTIAPDE-1241: Storage repository tests 2025-10-30 09:49:10 -03:00
Kou-Kinoshita
87c64eac2e SIENTIAPDE-1241: Metrics test 2025-10-30 09:47:23 -03:00
Kou-Kinoshita
16fba46520 SIENTIAPDE-1241: Deleted accidental .md 2025-10-29 16:47:42 -03:00
Kou-Kinoshita
26fca36d82 SIENTIAPDE-1241: Refactored method into smaller ones 2025-10-29 16:45:30 -03:00
Kou-Kinoshita
63fa264ec4 SIENTIAPDE-1241: Updated readme (removed port foward script)) 2025-10-29 16:27:56 -03:00
Kou-Kinoshita
1f6765dc86 SIENTIAPDE-1241: Linted files 2025-10-29 11:57:40 -03:00
Kou-Kinoshita
5e763a8a64 SIENTIAPDE-1241: Formatted files 2025-10-29 11:55:03 -03:00
Kou-Kinoshita
e8250d8dd7 SIENTIAPDE-1241: fixed test 2025-10-29 11:49:08 -03:00
Kou-Kinoshita
64590032f3 SIENTIAPDE-1241: Added remaining model repository tests 2025-10-29 11:46:29 -03:00
Kou-Kinoshita
61364671db SIENTIAPDE-1241: Added remaining trainig_repository tests and some model_repository tests 2025-10-29 11:41:36 -03:00
Kou-Kinoshita
4fdefd8263 SIENTIAPDE-1241: Added training repository tests 2025-10-29 11:32:24 -03:00
Lucas Kou Kinoshita
8103f530e2 Merge pull request #9 from Aignosi/feature/SIENTIAPDE-1321
Feature/SIENTIAPDE-1321: A equação do modelo deve ficar disponível como artefato logo após o treinamento.
2025-10-29 11:21:25 -03:00
Kou-Kinoshita
63a5de5938 SIENTIAPDE-1321: Fixed tests 2025-10-29 10:29:43 -03:00
Kou-Kinoshita
25ad4729f7 SIENTIAPDE-1321: Formatted files 2025-10-29 10:24:25 -03:00
Kou-Kinoshita
734221e32d SIENTIAPDE-1321: Updated tests 2025-10-27 19:45:47 -03:00
Kou-Kinoshita
a80d65d7ba SIENTIAPDE-1321: Added equation related methods 2025-10-24 08:03:27 -03:00
Bruno Domingues
7826e68954 SIENTIAPDE-1241: Add unit tests for ModelRepository with 100% coverage. 2025-10-23 15:09:40 -03:00
Bruno Domingues
0a33bb86ed SIENTIAPDE-1241: Add unit tests for TrainModelParams model with 100% coverage. 2025-10-23 11:18:19 -03:00
Bruno Domingues
2262dcf4a0 SIENTIAPDE-1241: Add unit tests for logger_helper module. 2025-10-23 09:15:09 -03:00
Bruno Domingues
a66c5abdfd SIENTIAPDE-1241: Add unit tests for custom exceptions in tests/utils/test_exceptions.py 2025-10-23 00:30:48 -03:00
Bruno Domingues
3fe139763a SIENTIAPDE-1241: Add unit tests for the Training activity with 100% coverage. 2025-10-23 00:25:25 -03:00
Bruno Domingues
a6f1563036 SIENTIAPDE-1241: Add unit tests for ExperimentTracking class with 100% coverage.
This commit introduces a new test file tests/activities/test_experiment_tracking.py containing comprehensive unit tests for the ExperimentTracking class, achieving 100% test coverage. The tests cover initialization, deletion, execution of updates, and various scenarios for updating experiment run status, including error handling and edge cases.
2025-10-23 00:18:14 -03:00
Bruno Domingues
fc2fe33b59 SIENTIAPDE-1241: Add unit tests for Activities class and enhance validation script with fix and test options
This commit introduces a new test suite for the Activities class, achieving 100% coverage. Additionally, the validation script (validate.sh) is enhanced with new options:

- --fix: Automatically fixes code formatting and linting issues using Ruff.
- --only-tests: Runs only the unit tests, skipping other validation steps.

The validation script now also supports skipping tests and provides more informative output.
2025-10-22 23:38:01 -03:00
Bruno Domingues
f07bc8ff30 SIENTIAPDE-1241: Refactor: Remove redundant logging and fix duplicate logs
This commit removes redundant logging statements from training and experiment tracking activities, preventing duplicate log entries. It also introduces a logger helper to disable log propagation, further addressing the duplicate logs issue. Additionally, the Makefile, run_coverage.sh, setup_port_forwards.sh, and simulator/Dockerfile files were removed as they are no longer needed.
2025-10-22 22:39:26 -03:00
Bruno Domingues
ac97092ebf SIENTIAPDE-1241: Remove unused metadata fields and update todo list. 2025-10-22 21:51:29 -03:00
Bruno Domingues
94697215aa SIENTIAPDE-1241: Refactor: Improve documentation, exception handling, and configuration in model manager. This commit enhances clarity and robustness by adding detailed docstrings to methods, standardizing exception handling with custom types, and simplifying MLflow configuration. 2025-10-22 21:48:12 -03:00
Bruno Domingues
758ffb10b6 SIENTIAPDE-1241: Fix: Correctly handle feature normalization and denormalization, and add scaler parameters to metadata 2025-10-22 21:26:11 -03:00
Bruno Domingues
42a7e82c82 SIENTIAPDE-1241: Suppress sklearn FutureWarning regarding 'squared' deprecation. 2025-10-22 18:28:13 -03:00
Bruno Domingues
5789a13023 SIENTIAPDE-1241: refactor train_model workflow due to I/O errors. 2025-10-22 15:37:56 -03:00
Bruno Domingues
f2a1c88ff3 Merge pull request #8 from Aignosi/feature/SIENTIAPDE-1255
SIENTIAPDE-1255: Refactor Model Manager for Training Pipeline, Integrate Sientia MLOps Library, and Add Unit Tests
2025-10-21 09:42:17 -03:00
Bruno Domingues
ab7c93480b SIENTIAPDE-1255: Refactor: Move extra pip requirements to environment variable and use constants for preprocessor steps. 2025-10-21 09:20:23 -03:00