a8259d716a
SIENTIAPDE-1712 SIENTIAPDE-1712 Refactor debug logging for DataFrames across multiple classes. Introduced a new method to log DataFrame content conditionally based on row count in Gates, MLFlow, ModelMetrics, and MLFlowRepository classes, improving debugging capabilities while managing log output effectively.
vitor-aignosi
2026-03-30 08:54:56 -03:00
f84d38a837
SIENTIAPDE-1712 SIENTIAPDE-1712 Implement debug logging for DataFrames in MLFlow and MLFlowRepository classes. Added a method to log DataFrame content conditionally based on row count, enhancing debugging capabilities while preventing excessive log output.
vitor-aignosi
2026-03-30 08:51:41 -03:00
d71c45e61d
SIENTIAPDE-1712 SIENTIAPDE-1712 Add 'on_conflict' parameter to PredictionsBatch and PredictionProcess classes for improved conflict handling during predictions.
vitor-aignosi
2026-03-27 14:28:13 -03:00
aec75cd336
SIENTIAPDE-1712 Log worker runtime configuration in prepare_worker function for improved debugging and monitoring.
vitor-aignosi
2026-03-26 14:59:54 -03:00
8a0bb70fc8
SIENTIAPDE-1712 Refactor prediction process to use execute_activity_method for MLFlow model transformation and prediction requests, enhancing consistency in workflow execution.
vitor-aignosi
2026-03-26 14:56:50 -03:00
ff2999dc14
SIENTIAPDE-1712 Update on_conflict parameter in FormatAndExportPrediction class to 'error' for stricter conflict handling during prediction export.
vitor-aignosi
2026-03-26 14:40:58 -03:00
830dfe464e
SIENTIAPDE-1712 Update Gates and FormatAndExportPrediction classes to standardize timestamp usage
vitor-aignosi
2026-03-25 12:45:44 -03:00
5b4903fffa
SIENTIAPDE-1712 Update Gates and FormatAndExportPrediction classes to use 'last_timestamp' for improved data handling
vitor-aignosi
2026-03-25 12:18:27 -03:00
1f5a14be3f
SIENTIAPDE-1712 Add debug logging for non-DataFrame prediction data in MLFlowRepository
vitor-aignosi
2026-03-25 11:18:21 -03:00
367b00f00a
SIENTIAPDE-1712 Enhance prediction export functionality by adding 'on_conflict' and 'unique_columns' parameters to the payload initialization in FormatAndExportPrediction class.
vitor-aignosi
2026-03-25 09:41:12 -03:00
1f0441c7d7
SIENTIAPDE-1712 Update requirements.txt to add scikit-learn version 1.5.2 and ensure pycurl is included
vitor-aignosi
2026-03-24 14:45:22 -03:00
a3dfb1ffc6
SIENTIAPDE-1712 Update pyproject.toml to add specific test file to exclusion list for linting
vitor-aignosi
2026-03-24 10:37:15 -03:00
d3f8bf7196
SIENTIAPDE-1712 Update pyproject.toml to remove specific test file from exclusion list and bump sientia-dataops-library dependency version to 1.10.4 in requirements-light.txt
vitor-aignosi
2026-03-24 10:34:46 -03:00
9fa8a6bf50
SIENTIAPDE-1712 Update pyproject.toml to exclude specific test file from linting
vitor-aignosi
2026-03-24 10:29:26 -03:00
39f3a08e93
SIENTIAPDE-1712 Update README.md to add newline at the end of the note section for consistency
vitor-aignosi
2026-03-24 10:18:03 -03:00
0e3ec6463f
SIENTIAPDE-1712 Enhance E2E testing with MinIO support and update documentation
vitor-aignosi
2026-03-24 09:44:35 -03:00
503d9aa485
SIENTIAPDE-1712 Update dependencies and refactor input filter handling for consistency
vitor-aignosi
2026-03-23 14:45:21 -03:00
69cbd08913
SIENTIAPDE-1712 Update payload initialization in Gates class to use from_dict method for improved clarity and consistency
vitor-aignosi
2026-03-23 10:47:57 -03:00
ccbed58234
SIENTIAPDE-1712 Update MinioDataFramePayload to reflect changes from training to prediction datasets
vitor-aignosi
2026-03-23 10:24:58 -03:00
e17824eb85
SIENTIAPDE-1712 Refactor metrics and API handling for improved consistency and clarity
vitor-aignosi
2026-03-23 10:17:57 -03:00
44558b4415
SIENTIAPDE-1712 Add status parameter to MinioDataFramePayload for improved data tracking
vitor-aignosi
2026-03-23 09:53:34 -03:00
3c45cbbc8a
SIENTIAPDE-1712 SIENTIAPDE-1712 Add status parameter to MinioDataFramePayload for enhanced data tracking
vitor-aignosi
2026-03-23 09:42:24 -03:00
62b885afae
SIENTIAPDE-1712 SIENTIAPDE-1712 Add last_timestamp parameter to MLFlow and Gates activities for enhanced tracking
vitor-aignosi
2026-03-23 09:26:49 -03:00
2fa7506075
SIENTIAPDE-1712 SIENTIAPDE-1712 Add timestamp column to processed data in MLFlow and improve dataframe validation in MinioDataFramePayload
vitor-aignosi
2026-03-23 08:35:28 -03:00
e1d1e3d43d
SIENTIAPDE-1712 Refactor imports in gates.py and mlflow.py for improved organization
vitor-aignosi
2026-03-23 08:06:01 -03:00
2979f2dd5a
SIENTIAPDE-1712 Update environment variables in values.yaml and enhance metric labels in metrics.py
vitor-aignosi
2026-03-20 16:59:04 -03:00
e35e27bfb2
SIENTIAPDE-1712 SIENTIAPDE-1712 Update type hints in PredictionProcess to improve clarity and enforce data structure consistency. Changed data parameter to a dictionary type and updated the way last_timestamp is accessed.
vitor-aignosi
2026-03-20 16:00:11 -03:00
52bca3f09d
SIENTIAPDE-1712 Fix type hint in from_dict method of MinioDataFramePayload class for improved clarity and compatibility with type checking.
vitor-aignosi
2026-03-20 15:53:54 -03:00
8789e6693f
SIENTIAPDE-1712 Remove query_to_minio method from Storage class and update worker activities to eliminate its usage. This change streamlines the codebase by removing unused functionality related to MinIO queries.
vitor-aignosi
2026-03-20 15:27:55 -03:00
57b0005c94
SIENTIAPDE-1712 Update MinIO configuration by changing access key in values.yaml and removing region_name references in multiple files to streamline configuration.
vitor-aignosi
2026-03-20 15:06:23 -03:00
18718418fc
SIENTIAPDE-1712 Update MinIO configuration in values.yaml and activities.py; add secure option in connectors_config.py
vitor-aignosi
2026-03-20 14:59:47 -03:00
add3629272
SIENTIAPDE-1712 Update liveness and readiness probe initial delays in values.yaml; change GITHUB_BRANCH to feature/SIENTIAPDE-1712; refactor MinioRepository initialization in activities.py
vitor-aignosi
2026-03-20 14:37:26 -03:00
d43f08d272
SIENTIAPDE-1712 Enhance README and Implement Drift Detection and Metrics Workflows
vitor-aignosi
2026-03-20 09:22:08 -03:00
5d0d049082
SIENTIAPDE-1712 Remove code validation script and refactor imports in activities and workflows
vitor-aignosi
2026-03-20 09:14:16 -03:00
981ac700d4
SIENTIAPDE-1712 Implement MinIO Offload and Retention Features
vitor-aignosi
2026-03-19 17:29:43 -03:00
3a15ed8058
SIENTIAPDE-1478 Rename get_core_labels method to get_pi_web_api_core_labels in API class for clarity and consistency with PI Web API integration.
vitor-aignosi
2026-02-11 10:29:56 -03:00
d770094a28
Merge branch 'main' into fix/SIENTIAPDE-1478
vitor-aignosi
2026-02-11 10:12:33 -03:00
c2864d3806
SIENTIAPDE-1478 Enhance API class with optional operation_type in get_core_labels method
vitor-aignosi
2026-02-11 10:11:28 -03:00
ce7632ba95
Merge branch 'main' into fix/SIENTIAPDE-1478
vitor-aignosi
2026-01-29 10:04:03 -03:00
33db5fcb69
SIENTIAPDE-1478 SIENTIAPDE-1478 Update tests.ipynb to adjust execution counts and enhance plotting limits
vitor-aignosi
2026-01-29 10:00:34 -03:00
9549179d93
SIENTIAPDE-1478 SIENTIAPDE-1478 Update GITHUB_BRANCH in values.yaml to reflect the fix for the issue
vitor-aignosi
2026-01-27 13:06:22 -03:00
cf0478d9a5
SIENTIAPDE-1478 Enhance API class with default headers for JSON requests
vitor-aignosi
2026-01-27 13:04:18 -03:00
49481253ca
SIENTIAPDE-1478 SIENTIAPDE-1478 Update tests.ipynb to enhance data loading and visualization
vitor-aignosi
2026-01-27 13:03:31 -03:00
24859eeeb4
SIENTIAPDE-1478 Fix missing newline at end of file in api.py
vitor-aignosi
2026-01-23 10:01:23 -03:00
0ba43aa955
SIENTIAPDE-1478 SIENTIAPDE-1478 Update tests.ipynb with new execution counts, modify output values and timestamps, and enhance plotting functionality
vitor-aignosi
2026-01-23 09:46:07 -03:00
1478680825
SIENTIAPDE-1478 Update release.yml to rename version input to release_version for clarity
vitor-aignosi
2026-01-22 13:56:32 -03:00
ecbcd67597
SIENTIAPDE-1478 Refactor PI Web API response handling in tests
vitor-aignosi
2026-01-22 13:48:05 -03:00
0739f7e2b3
SIENTIAPDE-1478 Update sientia-dataops-library dependency version from 1.8.1 to 1.8.2 in requirements.txt and modify API class to accept a list of response data for PI Web API integration.
vitor-aignosi
2026-01-22 13:41:02 -03:00
fdb866adcf
SIENTIAPDE-1478 Update sientia-dataops-library dependency version from 1.8.0 to 1.8.1 in requirements.txt
vitor-aignosi
2026-01-22 10:52:04 -03:00
53213bf7f1
SIENTIAPDE-1478 Fix spelling errors in poller behavior parameters in prepare_worker.py and remove redundant endpoint references in test_api.py
vitor-aignosi
2026-01-21 15:42:59 -03:00
276fe6f623
SIENTIAPDE-1478 SIENTIAPDE-1478 Update tests.ipynb execution counts, modify timestamps, and enhance API class for PI Web API integration
vitor-aignosi
2026-01-21 15:34:58 -03:00
9d7268aa0e
SIENTIAPDE-1478 Add write_pi_web_api_data activity to main workflow in worker.py
vitor-aignosi
2026-01-20 16:32:00 -03:00
98fdb83341
SIENTIAPDE-1478 Update image tag in values.yaml from "1.1.1" to "1.1.2" for version increment.
vitor-aignosi
2026-01-19 12:27:23 -03:00
23e41ac097
SIENTIAPDE-1478 Add a blank line before invalid_cases in test_model_repository.py for improved readability
vitor-aignosi
2026-01-19 09:58:38 -03:00
33ee1e02cf
SIENTIAPDE-1478 Update sonar-project.properties to exclude all worker files from coverage and modify execution counts and timestamps in tests.ipynb. Add a new test for empty DataFrame handling in test_model_repository.py.
vitor-aignosi
2026-01-19 09:55:44 -03:00
179716d770
Merge branch 'main' into feature/SIENTIAPDE-1478
vitor-aignosi
2026-01-19 08:22:47 -03:00
69b2f93ab2
SIENTIAPDE-1478 Refactor validation script and improve logging in API and model repository
vitor-aignosi
2026-01-16 16:47:33 -03:00
0032f88397
Enhance release workflow to support manual triggers and version input. The release job now activates on both merged pull requests and manual dispatch, allowing for version specification during releases.
vitor-aignosi
2026-01-15 16:53:22 -03:00
85e69a09e0
SIENTIAPDE-1478 Update replicaCount in values.yaml from 2 to 1 to adjust deployment scaling.
vitor-aignosi
2026-01-15 11:23:41 -03:00
6a69687fd5
SIENTIAPDE-1478 Enhance MLFlow logging and add skip_transform option in MLFlowRepository
vitor-aignosi
2026-01-15 10:55:48 -03:00
966d4f8193
SIENTIAPDE-1478 Update Python version in tests.ipynb to 3.11.14 and increment image tag in values.yaml to 1.1.1 for consistency with deployment requirements.
vitor-aignosi
2026-01-15 10:38:07 -03:00
63017754a8
SIENTIAPDE-1478 Update coverage source in pyproject.toml, add testcontainers for PostgreSQL in requirements-dev.txt, increment image tag and adjust probe delays in values.yaml, and refine condition checks in format_and_export_prediction.py and mlflow.py. Additionally, enhance test coverage in test_gates.py.
vitor-aignosi
2026-01-14 16:01:03 -03:00
34e8cce282
SIENTIAPDE-1478 Refactor import paths for create_sample_dict in gates.py and mlflow.py to improve module organization
vitor-aignosi
2026-01-13 13:09:07 -03:00
1a2a3b3d91
SIENTIAPDE-1478 Update sientia-dataops-library dependency to version 1.8.0 and adjust import path in worker.py for improved module organization
vitor-aignosi
2026-01-13 12:55:39 -03:00
7b6c96d8ac
SIENTIAPDE-1478 Update liveness and readiness probe initial delays in values.yaml for improved application startup timing
vitor-aignosi
2026-01-13 09:56:34 -03:00
9adda00605
SIENTIAPDE-1478 Update requirements.txt to remove specific versions for botocore and boto3 dependencies, allowing for more flexible version management.
vitor-aignosi
2026-01-12 10:52:45 -03:00
62aa14d8ff
SIENTIAPDE-1478 Update botocore and boto3 dependencies to specific versions in requirements.txt for improved compatibility
vitor-aignosi
2026-01-12 09:58:12 -03:00
0ccbb4b8d3
SIENTIAPDE-1478 Update sientia-mlops-library dependency to version 0.40.7 and modify liveness/readiness probes in values.yaml for improved health checks
vitor-aignosi
2026-01-12 09:29:54 -03:00
6b5283f48e
SIENTIAPDE-1478 Update image repository in values.yaml for consistency with module naming
vitor-aignosi
2026-01-09 16:02:42 -03:00
c62c30cc68
SIENTIAPDE-1478 Update requirements.txt and values.yaml for dependency and image tag adjustments
vitor-aignosi
2026-01-09 16:00:14 -03:00
8b55c07b48
Merge branch 'main' into feature/SIENTIAPDE-1478
vitor-aignosi
2026-01-09 15:05:43 -03:00
894d39faa4
SIENTIAPDE-1273 Refactor import statements in worker.py for improved organization
vitor-aignosi
2025-11-24 09:06:00 -03:00
2a451da976
SIENTIAPDE-1273 Refactor imports in opc.py to improve code clarity
vitor-aignosi
2025-11-19 18:31:52 -03:00
3311409885
SIENTIAPDE-1273 Update sientia-mlops-library dependency to version 0.40.6 and refactor get_prediction_data method calls for improved readability in model_repository.py and test_model_repository.py.
vitor-aignosi
2025-11-19 14:54:50 -03:00
684bc9fb31
SIENTIAPDE-1273 Enhance prediction data retrieval in MLFlowRepository by adding predict_flavor parameter
vitor-aignosi
2025-11-19 13:26:08 -03:00
8f6a3cd93d
SIENTIAPDE-1273 Enhance resource management and configuration in Laborious worker
vitor-aignosi
2025-11-19 11:53:50 -03:00
7e4e048ca3
SIENTIAPDE-1273 Update sientia-mlops-library dependency to version 0.40.5 and fix SQL interval formatting in Drift and SimpleMetrics workflows for improved query accuracy.
vitor-aignosi
2025-11-19 08:47:48 -03:00
388685df6e
SIENTIAPDE-1273 Update image tag to 1.1.2 in values.yaml and refactor prediction data sorting in model_repository.py for improved clarity and consistency.
vitor-aignosi
2025-11-18 09:16:42 -03:00
vitor-aignosi