7d59fd7c8c
SIENTIAPDE-1811 Update values.yaml to rename worker references and adjust GitHub branch for SIENTIAPDE-1811. Changed nameOverride, fullnameOverride, and service account name to "sientia-laborious-legacy-worker" and updated the GITHUB_BRANCH value to "fix/SIENTIAPDE-1811".
vitor-aignosi2026-05-18 10:17:52 -03:00
e3636d4b88
SIENTIAPDE-1811 Enhance OPC UA testing framework and documentation
vitor-aignosi2026-05-15 15:46:39 -03:00
638d5b70b4
SIENTIAPDE-1811 Enhance OPC UA communication and metrics tracking
vitor-aignosi2026-05-15 15:28:28 -03:00
00cf8a2ad6
SIENTIAPDE-1646 Refactor OPC and OpcRepository classes to remove logger dependency and streamline logging calls
vitor-aignosi2026-05-13 10:36:35 -03:00
84e6501063
SIENTIAPDE-1646 Implement new scheduling configurations for model retraining and drift analysis in input_sample.json
vitor-aignosi2026-05-12 08:31:50 -03:00
4989cfcb3c
SIENTIAPDE-1646 SIENTIAPDE-1646 Add new scheduling configurations and remove outdated documentation
vitor-aignosi2026-05-11 17:02:08 -03:00
16ea436e45
SIENTIAPDE-1646 Refactor MLflow configuration to use environment variable for tracking URL
vitor-aignosi2026-05-11 13:28:37 -03:00
02913e341d
SIENTIAPDE-1646 Update sientia_model dependency in requirements.txt to allow for any version greater than or equal to 0.8.2
vitor-aignosi2026-05-11 12:49:13 -03:00
d26e89aa98
SIENTIAPDE-1646 Update sientia_do dependency to version 1.12.1 in requirements.txt
vitor-aignosi2026-05-11 12:44:13 -03:00
473bd0b03f
Merge pull request #38 from Aignosi/feature/SIENTIAPDE-1712
vitor-aignosi2026-04-02 16:20:48 -03:00
25430b5b26
SIENTIAPDE-1712 Update scipy version constraint in requirements.txt to allow versions below 1.14.0 for compatibility with existing dependencies.
vitor-aignosi2026-04-02 10:07:05 -03:00
5e883d4530
SIENTIAPDE-1712 Add scipy version 1.13.0 to requirements.txt for enhanced scientific computing capabilities.
vitor-aignosi2026-04-02 10:06:39 -03:00
5398ac6bc2
SIENTIAPDE-1712 Update sientia-mlops-library dependency to version 0.41.0 in requirements.txt for improved functionality and features.
vitor-aignosi2026-04-01 16:53:12 -03:00
381856f5ca
SIENTIAPDE-1712 SIENTIAPDE-1712 Enhance logging across various classes by adding logger parameters and improving debug statements. This update includes adjustments in Gates, MLFlow, ModelMetrics, and MLFlowRepository classes for better traceability and observability during operations.
vitor-aignosi2026-04-01 13:53:23 -03:00
b9fe4604f7
SIENTIAPDE-1712 SIENTIAPDE-1712 Convert confidence_value to float in API class to ensure consistent data type for value assignment in activity monitoring.
vitor-aignosi2026-04-01 09:30:55 -03:00
59dd6078b0
SIENTIAPDE-1712 Update values.yaml to adjust workflow and activity poller configurations for improved performance, increasing minimum, initial, and maximum values. Additionally, add new minimal retrain parameters to enhance retraining capabilities.
vitor-aignosi2026-03-31 16:21:32 -03:00
e6fee73cce
SIENTIAPDE-1712 SIENTIAPDE-1712 Enhance logging in MLFlowRepository class by introducing a dedicated _debug_dataframe method for conditional logging of DataFrame content. This update improves observability during model transformation, prediction, and retraining processes while managing log output effectively.
vitor-aignosi2026-03-31 15:13:05 -03:00
a3775279e1
SIENTIAPDE-1712 SIENTIAPDE-1712 Refactor logging in MLFlowRepository class by removing the debug_dataframe method and replacing it with direct debug statements for improved clarity. This change enhances the logging of DataFrame content during model transformation, prediction, and retraining processes, ensuring better observability without excessive log output.
vitor-aignosi2026-03-31 15:05:40 -03:00
d9ec7fc496
SIENTIAPDE-1712 Update values.yaml to rename SIE_MINIO_OFFLOAD_THRESHOLD_MEGABYTES to SIENTIA_MINIO_OFFLOAD_THRESHOLD_MEGABYTES and adjust its value to 0.5 for improved configuration clarity.
vitor-aignosi2026-03-31 09:10:56 -03:00
7c32424cf1
SIENTIAPDE-1712 SIENTIAPDE-1712 Refactor logging in MinioDataFramePayload class to utilize custom_debug method for improved clarity and consistency. Enhanced DataFrame size logging by integrating a dedicated debug method, streamlining the logging process.
vitor-aignosi2026-03-30 09:32:51 -03:00
fa88572126
SIENTIAPDE-1712 SIENTIAPDE-1712 Enhance logging in Gates, MLFlow, and Storage classes by integrating logger parameter for improved traceability. This update allows for better monitoring of operations and data handling across these components.
vitor-aignosi2026-03-30 09:24:52 -03:00
00ac77a091
SIENTIAPDE-1712 SIENTIAPDE-1712 Implement debug logging in MinioDataFramePayload class for enhanced traceability. Added a static method for conditional logging and integrated debug statements throughout methods to capture DataFrame size estimates, upload actions, and retrieval processes, improving overall observability.
vitor-aignosi2026-03-30 09:12:27 -03:00
a8259d716a
SIENTIAPDE-1712 SIENTIAPDE-1712 Refactor debug logging for DataFrames across multiple classes. Introduced a new method to log DataFrame content conditionally based on row count in Gates, MLFlow, ModelMetrics, and MLFlowRepository classes, improving debugging capabilities while managing log output effectively.
vitor-aignosi2026-03-30 08:54:56 -03:00
f84d38a837
SIENTIAPDE-1712 SIENTIAPDE-1712 Implement debug logging for DataFrames in MLFlow and MLFlowRepository classes. Added a method to log DataFrame content conditionally based on row count, enhancing debugging capabilities while preventing excessive log output.
vitor-aignosi2026-03-30 08:51:41 -03:00
d71c45e61d
SIENTIAPDE-1712 SIENTIAPDE-1712 Add 'on_conflict' parameter to PredictionsBatch and PredictionProcess classes for improved conflict handling during predictions.
vitor-aignosi2026-03-27 14:28:13 -03:00
aec75cd336
SIENTIAPDE-1712 Log worker runtime configuration in prepare_worker function for improved debugging and monitoring.
vitor-aignosi2026-03-26 14:59:54 -03:00
8a0bb70fc8
SIENTIAPDE-1712 Refactor prediction process to use execute_activity_method for MLFlow model transformation and prediction requests, enhancing consistency in workflow execution.
vitor-aignosi2026-03-26 14:56:50 -03:00
ff2999dc14
SIENTIAPDE-1712 Update on_conflict parameter in FormatAndExportPrediction class to 'error' for stricter conflict handling during prediction export.
vitor-aignosi2026-03-26 14:40:58 -03:00
830dfe464e
SIENTIAPDE-1712 Update Gates and FormatAndExportPrediction classes to standardize timestamp usage
vitor-aignosi2026-03-25 12:45:44 -03:00
5b4903fffa
SIENTIAPDE-1712 Update Gates and FormatAndExportPrediction classes to use 'last_timestamp' for improved data handling
vitor-aignosi2026-03-25 12:18:27 -03:00
1f5a14be3f
SIENTIAPDE-1712 Add debug logging for non-DataFrame prediction data in MLFlowRepository
vitor-aignosi2026-03-25 11:18:21 -03:00
367b00f00a
SIENTIAPDE-1712 Enhance prediction export functionality by adding 'on_conflict' and 'unique_columns' parameters to the payload initialization in FormatAndExportPrediction class.
vitor-aignosi2026-03-25 09:41:12 -03:00
1f0441c7d7
SIENTIAPDE-1712 Update requirements.txt to add scikit-learn version 1.5.2 and ensure pycurl is included
vitor-aignosi2026-03-24 14:45:22 -03:00
a3dfb1ffc6
SIENTIAPDE-1712 Update pyproject.toml to add specific test file to exclusion list for linting
vitor-aignosi2026-03-24 10:37:15 -03:00
d3f8bf7196
SIENTIAPDE-1712 Update pyproject.toml to remove specific test file from exclusion list and bump sientia-dataops-library dependency version to 1.10.4 in requirements-light.txt
vitor-aignosi2026-03-24 10:34:46 -03:00
9fa8a6bf50
SIENTIAPDE-1712 Update pyproject.toml to exclude specific test file from linting
vitor-aignosi2026-03-24 10:29:26 -03:00
39f3a08e93
SIENTIAPDE-1712 Update README.md to add newline at the end of the note section for consistency
vitor-aignosi2026-03-24 10:18:03 -03:00
0e3ec6463f
SIENTIAPDE-1712 Enhance E2E testing with MinIO support and update documentation
vitor-aignosi2026-03-24 09:44:35 -03:00
503d9aa485
SIENTIAPDE-1712 Update dependencies and refactor input filter handling for consistency
vitor-aignosi2026-03-23 14:45:21 -03:00
69cbd08913
SIENTIAPDE-1712 Update payload initialization in Gates class to use from_dict method for improved clarity and consistency
vitor-aignosi2026-03-23 10:47:57 -03:00
ccbed58234
SIENTIAPDE-1712 Update MinioDataFramePayload to reflect changes from training to prediction datasets
vitor-aignosi2026-03-23 10:24:58 -03:00
e17824eb85
SIENTIAPDE-1712 Refactor metrics and API handling for improved consistency and clarity
vitor-aignosi2026-03-23 10:17:57 -03:00
44558b4415
SIENTIAPDE-1712 Add status parameter to MinioDataFramePayload for improved data tracking
vitor-aignosi2026-03-23 09:53:34 -03:00
3c45cbbc8a
SIENTIAPDE-1712 SIENTIAPDE-1712 Add status parameter to MinioDataFramePayload for enhanced data tracking
vitor-aignosi2026-03-23 09:42:24 -03:00
62b885afae
SIENTIAPDE-1712 SIENTIAPDE-1712 Add last_timestamp parameter to MLFlow and Gates activities for enhanced tracking
vitor-aignosi2026-03-23 09:26:49 -03:00
2fa7506075
SIENTIAPDE-1712 SIENTIAPDE-1712 Add timestamp column to processed data in MLFlow and improve dataframe validation in MinioDataFramePayload
vitor-aignosi2026-03-23 08:35:28 -03:00
e1d1e3d43d
SIENTIAPDE-1712 Refactor imports in gates.py and mlflow.py for improved organization
vitor-aignosi2026-03-23 08:06:01 -03:00
2979f2dd5a
SIENTIAPDE-1712 Update environment variables in values.yaml and enhance metric labels in metrics.py
vitor-aignosi2026-03-20 16:59:04 -03:00
e35e27bfb2
SIENTIAPDE-1712 SIENTIAPDE-1712 Update type hints in PredictionProcess to improve clarity and enforce data structure consistency. Changed data parameter to a dictionary type and updated the way last_timestamp is accessed.
vitor-aignosi2026-03-20 16:00:11 -03:00
52bca3f09d
SIENTIAPDE-1712 Fix type hint in from_dict method of MinioDataFramePayload class for improved clarity and compatibility with type checking.
vitor-aignosi2026-03-20 15:53:54 -03:00
67942c45e0
SIENTIAPDE-1712 Refactor MinioDataFramePayload usage across activities
vitor-aignosi2026-03-20 15:52:04 -03:00
8789e6693f
SIENTIAPDE-1712 Remove query_to_minio method from Storage class and update worker activities to eliminate its usage. This change streamlines the codebase by removing unused functionality related to MinIO queries.
vitor-aignosi2026-03-20 15:27:55 -03:00
57b0005c94
SIENTIAPDE-1712 Update MinIO configuration by changing access key in values.yaml and removing region_name references in multiple files to streamline configuration.
vitor-aignosi2026-03-20 15:06:23 -03:00
18718418fc
SIENTIAPDE-1712 Update MinIO configuration in values.yaml and activities.py; add secure option in connectors_config.py
vitor-aignosi2026-03-20 14:59:47 -03:00
add3629272
SIENTIAPDE-1712 Update liveness and readiness probe initial delays in values.yaml; change GITHUB_BRANCH to feature/SIENTIAPDE-1712; refactor MinioRepository initialization in activities.py
vitor-aignosi2026-03-20 14:37:26 -03:00
d43f08d272
SIENTIAPDE-1712 Enhance README and Implement Drift Detection and Metrics Workflows
vitor-aignosi2026-03-20 09:22:08 -03:00
5d0d049082
SIENTIAPDE-1712 Remove code validation script and refactor imports in activities and workflows
vitor-aignosi2026-03-20 09:14:16 -03:00
981ac700d4
SIENTIAPDE-1712 Implement MinIO Offload and Retention Features
vitor-aignosi2026-03-19 17:29:43 -03:00
9dc3cb3ba0
Merge pull request #37 from Aignosi/fix/SIENTIAPDE-1478
vitor-aignosi2026-02-11 11:04:25 -03:00
3a15ed8058
SIENTIAPDE-1478 Rename get_core_labels method to get_pi_web_api_core_labels in API class for clarity and consistency with PI Web API integration.
vitor-aignosi2026-02-11 10:29:56 -03:00
d770094a28
Merge branch 'main' into fix/SIENTIAPDE-1478
vitor-aignosi2026-02-11 10:12:33 -03:00
c2864d3806
SIENTIAPDE-1478 Enhance API class with optional operation_type in get_core_labels method
vitor-aignosi2026-02-11 10:11:28 -03:00
ce7632ba95
Merge branch 'main' into fix/SIENTIAPDE-1478
vitor-aignosi2026-01-29 10:04:03 -03:00
33db5fcb69
SIENTIAPDE-1478 SIENTIAPDE-1478 Update tests.ipynb to adjust execution counts and enhance plotting limits
vitor-aignosi2026-01-29 10:00:34 -03:00
9549179d93
SIENTIAPDE-1478 SIENTIAPDE-1478 Update GITHUB_BRANCH in values.yaml to reflect the fix for the issue
vitor-aignosi2026-01-27 13:06:22 -03:00
cf0478d9a5
SIENTIAPDE-1478 Enhance API class with default headers for JSON requests
vitor-aignosi2026-01-27 13:04:18 -03:00
49481253ca
SIENTIAPDE-1478 SIENTIAPDE-1478 Update tests.ipynb to enhance data loading and visualization
vitor-aignosi2026-01-27 13:03:31 -03:00
bda479af5f
Merge pull request #35 from Aignosi/feature/SIENTIAPDE-1478
vitor-aignosi2026-01-23 13:48:03 -03:00
24859eeeb4
SIENTIAPDE-1478 Fix missing newline at end of file in api.py
vitor-aignosi2026-01-23 10:01:23 -03:00
0ba43aa955
SIENTIAPDE-1478 SIENTIAPDE-1478 Update tests.ipynb with new execution counts, modify output values and timestamps, and enhance plotting functionality
vitor-aignosi2026-01-23 09:46:07 -03:00
1478680825
SIENTIAPDE-1478 Update release.yml to rename version input to release_version for clarity
vitor-aignosi2026-01-22 13:56:32 -03:00
ecbcd67597
SIENTIAPDE-1478 Refactor PI Web API response handling in tests
vitor-aignosi2026-01-22 13:48:05 -03:00
0739f7e2b3
SIENTIAPDE-1478 Update sientia-dataops-library dependency version from 1.8.1 to 1.8.2 in requirements.txt and modify API class to accept a list of response data for PI Web API integration.
vitor-aignosi2026-01-22 13:41:02 -03:00
fdb866adcf
SIENTIAPDE-1478 Update sientia-dataops-library dependency version from 1.8.0 to 1.8.1 in requirements.txt
vitor-aignosi2026-01-22 10:52:04 -03:00
53213bf7f1
SIENTIAPDE-1478 Fix spelling errors in poller behavior parameters in prepare_worker.py and remove redundant endpoint references in test_api.py
vitor-aignosi2026-01-21 15:42:59 -03:00
276fe6f623
SIENTIAPDE-1478 SIENTIAPDE-1478 Update tests.ipynb execution counts, modify timestamps, and enhance API class for PI Web API integration
vitor-aignosi2026-01-21 15:34:58 -03:00
9d7268aa0e
SIENTIAPDE-1478 Add write_pi_web_api_data activity to main workflow in worker.py
vitor-aignosi2026-01-20 16:32:00 -03:00
98fdb83341
SIENTIAPDE-1478 Update image tag in values.yaml from "1.1.1" to "1.1.2" for version increment.
vitor-aignosi2026-01-19 12:27:23 -03:00
23e41ac097
SIENTIAPDE-1478 Add a blank line before invalid_cases in test_model_repository.py for improved readability
vitor-aignosi2026-01-19 09:58:38 -03:00
33ee1e02cf
SIENTIAPDE-1478 Update sonar-project.properties to exclude all worker files from coverage and modify execution counts and timestamps in tests.ipynb. Add a new test for empty DataFrame handling in test_model_repository.py.
vitor-aignosi2026-01-19 09:55:44 -03:00
179716d770
Merge branch 'main' into feature/SIENTIAPDE-1478
vitor-aignosi2026-01-19 08:22:47 -03:00
69b2f93ab2
SIENTIAPDE-1478 Refactor validation script and improve logging in API and model repository
vitor-aignosi2026-01-16 16:47:33 -03:00
0032f88397
Enhance release workflow to support manual triggers and version input. The release job now activates on both merged pull requests and manual dispatch, allowing for version specification during releases.
vitor-aignosi2026-01-15 16:53:22 -03:00
vitor-aignosi
Matheus Demoner