Commit Graph

  • 6ae83d90be SIENTIAPDE-1273 Update conftest.py to add a blank line for improved readability and code style consistency. vitor-aignosi 2025-11-18 08:59:43 -03:00
  • ffb829e0cb SIENTIAPDE-1273 Refactor data handling in Laborious workflows to enhance clarity and compatibility vitor-aignosi 2025-11-18 08:49:40 -03:00
  • 24da0c7b61 Merge branch 'main' into feature/SIENTIAPDE-1273 vitor-aignosi 2025-11-18 08:34:57 -03:00
  • 07dc612116 SIENTIAPDE-1273 Enhance data handling and export processes in Laborious workflows vitor-aignosi 2025-11-17 16:52:33 -03:00
  • a88a15c60a SIENTIAPDE-1273 SIENTIAPDE-1273 Enhance security analysis and SQL injection handling vitor-aignosi 2025-11-17 16:04:54 -03:00
  • 1014c33dd9 SIENTIAPDE-1273 Fix data size calculation in ModelMetrics class to use target_data.shape[0] for improved accuracy in metrics processing. vitor-aignosi 2025-11-17 11:03:27 -03:00
  • 59d3c26c71 SIENTIAPDE-1273 Update execution count in tests notebook and add data shape output for improved clarity in data handling. vitor-aignosi 2025-11-17 10:57:55 -03:00
  • 019b46009a SIENTIAPDE-1273 Refactor data size calculation in ModelMetrics class to use shape method for improved accuracy. Changed from using len(target_data) to data.shape[0] for better clarity in data handling. vitor-aignosi 2025-11-17 10:56:58 -03:00
  • 4563ffecac SIENTIAPDE-1273 Update sientia-dataops-library dependency version to 1.6.1 and refactor return types in Gates class methods for improved type clarity. Changed return types from dict[str, Any] to dict for better compatibility with downstream systems. vitor-aignosi 2025-11-17 10:45:13 -03:00
  • c9b1ddfd15 SIENTIAPDE-1273 Refactor data export in Drift, SimpleMetrics, and FormatAndExportPrediction workflows to improve data handling. Changed the export format from a list of dictionaries to direct objects for enhanced clarity and compatibility with downstream systems. vitor-aignosi 2025-11-17 10:38:44 -03:00
  • 08f9522695 SIENTIAPDE-1273 Refactor data export in MinimalRetrain workflow to improve structure. Changed the export format from a list of dictionaries to a direct report object for enhanced clarity and compatibility with downstream systems. vitor-aignosi 2025-11-17 10:36:17 -03:00
  • 91580f8255 SIENTIAPDE-1273 Refactor return type of get_reference_data method in MLFlow class to improve type specificity. Changed from a list of dictionaries with Hashable keys to a generic list of dictionaries for enhanced clarity in data handling. vitor-aignosi 2025-11-17 10:25:30 -03:00
  • 46fe88f69e SIENTIAPDE-1273 Refactor return types in ModelMetrics class methods to enhance type clarity. Updated calculate_drift and calculate_simple_metrics methods to return lists of dictionaries instead of generic lists, improving type specificity for better data handling. vitor-aignosi 2025-11-17 10:14:47 -03:00
  • a7ab8ffe49 SIENTIAPDE-1273 Refactor return type of calculate_drift method in ModelMetrics class to improve compatibility. Changed from a list of dictionaries to a generic list for enhanced flexibility in data handling. vitor-aignosi 2025-11-17 10:05:57 -03:00
  • c8b809f189 SIENTIAPDE-1273 Update dependencies and refactor data handling in various modules vitor-aignosi 2025-11-17 09:58:55 -03:00
  • d2b365a34d SIENTIAPDE-1273 Refactor data handling in various modules to ensure DataFrame consistency vitor-aignosi 2025-11-14 16:55:00 -03:00
  • 4191f68d3b SIENTIAPDE-1273 Refactor ModelMetrics return format and correct import name in worker module vitor-aignosi 2025-11-14 16:06:51 -03:00
  • 64f0747e8e SIENTIAPDE-1273 Update version and enhance metrics calculation in Laborious system vitor-aignosi 2025-11-14 15:43:28 -03:00
  • 66193cea15 SIENTIAPDE-1273 Refactor Drift class to improve target name handling vitor-aignosi 2025-11-14 08:47:39 -03:00
  • b68674fe64 SIENTIAPDE-1273 Enhance MLFlowRepository and Activities classes with new methods and metrics vitor-aignosi 2025-11-13 16:40:23 -03:00
  • 6ac0f38d59 SIENTIAPDE-1273 Update requirements and enhance metrics and data handling vitor-aignosi 2025-11-11 16:50:22 -03:00
  • ee854ffcfe Merge pull request #29 from Aignosi/feature/SIENTIAPDE-1325-adicionar-metricas-especificas-de-operacoes-externas vitor-aignosi 2025-11-10 10:11:44 -03:00
  • 0c59a7def8 SIENTIAPDE-1325 Refactor OPC data handling in opc_repository.py to improve code clarity. Updated commented-out code for SourceTimestamp to include NOSONAR annotations, ensuring better code quality checks. vitor-aignosi 2025-11-10 09:53:06 -03:00
  • 0de30d85a8 SIENTIAPDE-1325 Update logging in MLFlowRepository and OpcRepository to use unified logging methods vitor-aignosi 2025-11-10 09:40:12 -03:00
  • 03dc0978b8 SIENTIAPDE-1325 Enhance OPC connection metrics by emitting total connections metric upon connection attempt. This change ensures accurate tracking of connection attempts in the OpcRepository class. vitor-aignosi 2025-11-07 09:57:43 -03:00
  • c41c11b46f SIENTIAPDE-1325 Update OPC metric emissions to include server URL in total connections metric vitor-aignosi 2025-11-07 09:47:27 -03:00
  • b7a15999ab SIENTIAPDE-1325 Refactor OPC class to remove unused opc_servers attribute and streamline initialization. Update OpcRepository to consolidate server name tags for metric emissions. vitor-aignosi 2025-11-07 09:44:01 -03:00
  • fe82e52f70 SIENTIAPDE-1325 Update OPC connection logging to include server name in connection message vitor-aignosi 2025-11-07 09:26:03 -03:00
  • d2f73658c9 SIENTIAPDE-1325 Update OPC connection logging to include server name in success message vitor-aignosi 2025-11-07 09:25:34 -03:00
  • 8d402fb156 SIENTIAPDE-1325 SIENTIAPDE-1325 Add OPC server name configuration and update repository handling vitor-aignosi 2025-11-07 09:20:48 -03:00
  • 2245baae62 SIENTIAPDE-1325 Update OPC metric emission to include server URL in opc_repository.py vitor-aignosi 2025-11-07 08:46:11 -03:00
  • 4136c116da SIENTIAPDE-1325 Refactor OPC metrics in metrics.py and opc_repository.py vitor-aignosi 2025-11-07 08:37:08 -03:00
  • 507aded950 SIENTIAPDE-1325 Update image tag and enhance OPC metrics tracking vitor-aignosi 2025-11-06 16:59:02 -03:00
  • 1695df70ae SIENTIAPDE-1325 Enhance metrics handling in Gates and MLFlow classes vitor-aignosi 2025-11-05 16:30:51 -03:00
  • a3da800cab SIENTIAPDE-1325 Refactor monitoring and metrics integration across various components vitor-aignosi 2025-11-04 16:49:10 -03:00
  • 77550d49a6 Merge pull request #28 from Aignosi/fix/SIENTIAPDE-1314-ajustes-nas-camadas-de-monitoramento-do-sientia Matheus Demoner 2025-10-27 15:35:42 -03:00
  • 67af03ee94 SIENTIAPDE-1314 Enhance thread safety in MLFlowRepository model caching vitor-aignosi 2025-10-27 13:29:01 -03:00
  • 1cbf356d0c SIENTIAPDE-1314 Refactor model cache deletion in MLFlowRepository vitor-aignosi 2025-10-27 12:28:17 -03:00
  • 22eee9dfba SIENTIAPDE-1314 Refactor workflow names to include 'subworkflow' prefix vitor-aignosi 2025-10-27 10:14:33 -03:00
  • be06e0a1b6 SIENTIAPDE-1314 Refactor OPC Test for Output Management vitor-aignosi 2025-10-27 08:21:47 -03:00
  • 56122efefa SIENTIAPDE-1314 Enhance OPC Testing for Output Management vitor-aignosi 2025-10-27 08:17:57 -03:00
  • 1b93eb19cb SIENTIAPDE-1314 Refactor OPC Class and Enhance Testing for Output Management vitor-aignosi 2025-10-27 08:10:19 -03:00
  • 80c987b2dc SIENTIAPDE-1314 Refactor OPC Write Method and Comment Out Error Handling Logic vitor-aignosi 2025-10-27 07:47:11 -03:00
  • aec5839b5e SIENTIAPDE-1314 Refactor OPC Write Test to Separate Output Data and Metrics vitor-aignosi 2025-10-24 10:59:48 -03:00
  • 4b9da16aa6 SIENTIAPDE-1314 SIENTIAPDE-1314 Refactor OPC Write Operation in FormatAndExportPrediction Workflow vitor-aignosi 2025-10-24 10:22:48 -03:00
  • 723b30b1d6 SIENTIAPDE-1314 Update GITHUB_BRANCH in values.yaml to reflect new monitoring layer adjustments for SIENTIAPDE-1314 vitor-aignosi 2025-10-24 10:14:46 -03:00
  • fe48b480cf SIENTIAPDE-1314 Increase start-to-close timeout in FormatAndExportPrediction workflow from 60 to 180 seconds for improved execution reliability. vitor-aignosi 2025-10-24 10:09:46 -03:00
  • c1a5ab3d3b SIENTIAPDE-1314 Update test_format_and_export_prediction.py to use prediction_data for workflow execution vitor-aignosi 2025-10-23 17:55:35 -03:00
  • 0324e2e143 SIENTIAPDE-1314 Enhance OPC Metrics Handling and Refactor Write Operations vitor-aignosi 2025-10-23 17:48:43 -03:00
  • 32a76b35ea Merge pull request #27 from Aignosi/feature/SIENTIAPDE-1327-controle-de-releases Bruno Domingues 2025-10-23 10:44:39 -03:00
  • f0276b0cf4 SIENTIAPDE-1327 SIENTIAPDE-1327: Add requirements file to quality gate workflow vitor-aignosi 2025-10-23 09:51:41 -03:00
  • a398e2ea38 SIENTIAPDE-1327 Update requirements and simplify CI workflow for quality checks vitor-aignosi 2025-10-23 09:33:10 -03:00
  • 2cecd8eefb Merge pull request #26 from Aignosi/SIENTIAPDE-1312-melhorias-e-correcoes-nas-pipelines-de-dados Matheus Demoner 2025-10-21 17:24:35 -03:00
  • c5fb921654 SIENTIAPDE-1312 Refactor error handling in MLFlowRepository and update tests vitor-aignosi 2025-10-21 15:58:28 -03:00
  • 197a25ebf7 SIENTIAPDE-1312 Ensure model_temp_path directory exists before saving retrain data in MLFlowRepository vitor-aignosi 2025-10-21 14:40:52 -03:00
  • 4c1e9008ab SIENTIAPDE-1312 Update tests notebook execution count and bump image tag in values.yaml vitor-aignosi 2025-10-21 14:32:35 -03:00
  • 461a885eeb SIENTIAPDE-1312 Refactor OPC handling by removing pod_id from initialization and updating logging format vitor-aignosi 2025-10-20 16:48:21 -03:00
  • c2315a9455 SIENTIAPDE-1312 Enhance OpcRepository client initialization and error handling vitor-aignosi 2025-10-20 16:26:01 -03:00
  • f046d079b5 SIENTIAPDE-1312 Update dependencies and enhance OpcRepository functionality vitor-aignosi 2025-10-20 15:55:51 -03:00
  • 8b5fbfe0ab Merge pull request #25 from Aignosi/SIENTIAPDE-1318-adicionar-pipeline-de-qualidade Matheus Demoner 2025-10-20 08:36:01 -03:00
  • 04cbce259f SIENTIAPDE-1318 Enhance CI workflow for comprehensive code quality checks vitor-aignosi 2025-10-17 12:34:52 -03:00
  • 3326a7da00 SIENTIAPDE-1318 Remove Pytest test execution from CI workflow and add a blank line in MinioRepository class for improved readability. vitor-aignosi 2025-10-17 12:14:57 -03:00
  • 50741de2b0 Merge branch 'main' into SIENTIAPDE-1318-adicionar-pipeline-de-qualidade vitor-aignosi 2025-10-17 12:08:27 -03:00
  • da8706cf78 SIENTIAPDE-1318 Enhance validation script and CI workflow for improved code quality checks vitor-aignosi 2025-10-17 07:55:52 -03:00
  • 1ae268d3f4 Merge pull request #24 from Aignosi/SIENTIAPDE-1231-ajustar-o-retreino-do-courier-no-laborious Bruno Domingues 2025-10-16 12:44:49 -03:00
  • a7cc917760 SIENTIAPDE-1231 Enhance README with code quality and validation guidelines vitor-aignosi 2025-10-16 11:04:37 -03:00
  • 644a43093a SIENTIAPDE-1231 Enhance README and repository utilities for clarity and functionality vitor-aignosi 2025-10-16 11:01:36 -03:00
  • de47820c4a SIENTIAPDE-1231 Refactor tests and update model_repository.py for clarity and consistency vitor-aignosi 2025-10-16 10:15:53 -03:00
  • d59833a5e5 SIENTIAPDE-1231 Update .gitignore to include mlruns and remove Dockerfile for project simplification vitor-aignosi 2025-10-16 10:08:34 -03:00
  • 13644d5ebf SIENTIAPDE-1231 Remove obsolete job and MLflow metadata files to streamline project structure and eliminate unused configurations. vitor-aignosi 2025-10-16 10:08:04 -03:00
  • f8397582d4 SIENTIAPDE-1231 Refactor MinioRepository and MLFlowRepository for improved functionality and error handling vitor-aignosi 2025-10-16 10:06:42 -03:00
  • d8f4006488 SIENTIAPDE-1231 SIENTIAPDE-1231 Add mlflow to requirements-light.txt for enhanced model tracking capabilities vitor-aignosi 2025-10-16 09:49:56 -03:00
  • 358ad8b871 SIENTIAPDE-1231 vitor-aignosi 2025-10-16 09:32:53 -03:00
  • 3caa52d8b8 SIENTIAPDE-1231 Update .gitignore and remove values.yaml for project cleanup vitor-aignosi 2025-10-16 09:31:23 -03:00
  • 8ba646bb55 Merge branch 'main' into SIENTIAPDE-1231-ajustar-o-retreino-do-courier-no-laborious vitor-aignosi 2025-10-16 09:05:58 -03:00
  • f0fb9b854e SIENTIAPDE-1231 Enhance validation script and refactor code in various modules vitor-aignosi 2025-10-15 16:50:38 -03:00
  • ac795c7c53 SIENTIAPDE-1231 Update .gitignore and refactor metrics.py for improved logging and consistency vitor-aignosi 2025-10-15 16:00:18 -03:00
  • a5d2b0d3fd SIENTIAPDE-1231 Refactor force_memory_release function in model_repository.py to improve logging vitor-aignosi 2025-10-13 15:59:10 -03:00
  • a3989b84af SIENTIAPDE-1231 Refactor memory management in MLFlowRepository to use force_memory_release function vitor-aignosi 2025-10-13 15:57:23 -03:00
  • 143dd7759e SIENTIAPDE-1231 Add memory management function to model_repository.py vitor-aignosi 2025-10-13 15:50:37 -03:00
  • 331df2dd18 SIENTIAPDE-1231 Enhance MLFlowRepository memory management by adding garbage collection and logging for model deletion vitor-aignosi 2025-10-13 15:31:04 -03:00
  • fdaf48ddc9 SIENTIAPDE-1231 Update values.yaml and model_repository.py for configuration and error handling improvements vitor-aignosi 2025-10-13 15:12:20 -03:00
  • ac9b2e0ec6 SIENTIAPDE-1231 Comment out CSV export lines in MLFlowRepository to prevent temporary file creation during model operations. This change enhances data handling by avoiding unnecessary file writes while maintaining logging functionality. vitor-aignosi 2025-10-13 11:35:18 -03:00
  • 49b6e504ae SIENTIAPDE-1231 Enhance Gates and MLFlowRepository with new functionalities and improvements vitor-aignosi 2025-10-13 10:36:11 -03:00
  • 7512963e19 SIENTIAPDE-1231 Enhance MinIO integration and update environment configurations vitor-aignosi 2025-10-07 16:56:16 -03:00
  • 16a3aa7022 SIENTIAPDE-1231 Update .gitignore, values.yaml, and model_repository.py for improved data handling and logging vitor-aignosi 2025-10-06 16:35:53 -03:00
  • 36af84f056 SIENTIAPDE-1231 Enhance MLFlow and MLFlowRepository with improved data handling and logging vitor-aignosi 2025-10-06 13:32:36 -03:00
  • 9b71ad7556 SIENTIAPDE-1231 Update model retraining and logging enhancements vitor-aignosi 2025-10-02 16:36:18 -03:00
  • c6f004d20d SIENTIAPDE-1231 Update model retraining and reporting functionality vitor-aignosi 2025-09-29 17:34:47 -03:00
  • 1aede51dc1 SIENTIAPDE-1231 SIENTIAPDE-1222 Enhance MLFlow and MLFlowRepository with model configuration support vitor-aignosi 2025-09-24 17:04:40 -03:00
  • 24ca22b752 SIENTIAPDE-1222 Update .gitignore to include 'tmp/' directory and ensure '.env' is listed vitor-aignosi 2025-09-24 10:33:18 -03:00
  • 8b2218e56a SIENTIAPDE-1222 Remove deprecated files and configurations from transformer_pyfunc module vitor-aignosi 2025-09-24 10:32:56 -03:00
  • bb13c9a539 Update tests/laborious/activities/test_mlflow.py vitor-aignosi 2025-09-24 10:30:23 -03:00
  • bbae728e42 SIENTIAPDE-1222 Add placeholder class 'Any' in test_model_repository.py and update invalid_cases to use it vitor-aignosi 2025-09-24 09:59:26 -03:00
  • 673fc79df3 SIENTIAPDE-1222 Refactor model configuration handling in MLFlow and workflows vitor-aignosi 2025-09-17 16:02:54 -03:00
  • b279244160 SIENTIAPDE-1222 Enhance MLFlow data handling by adding timestamp column and improving debug logging vitor-aignosi 2025-09-17 11:15:05 -03:00
  • 295cab9f73 SIENTIAPDE-1222 Update MLFlow class to pass logger instance directly to MLFlowRepository vitor-aignosi 2025-09-17 10:27:02 -03:00
  • 03ac6a8f8d SIENTIAPDE-1222 SIENTIAPDE-1222 Update MLFlow methods to include metadata parameter vitor-aignosi 2025-09-17 10:11:54 -03:00
  • 73c8593993 SIENTIAPDE-1222 Update test cases in model repository and prediction process vitor-aignosi 2025-09-17 10:07:32 -03:00
  • 20fc938cc0 SIENTIAPDE-1222 Refactor datetime index handling in MLFlow and MLFlowRepository vitor-aignosi 2025-09-17 08:59:12 -03:00