935a9e9279
SIENTIAPDE-1199 Enhance logging in OpcRepository to include metadata for all log messages
vitor-aignosi
2025-08-20 11:35:42 -03:00
40870b021a
SIENTIAPDE-1199 Refactor logging in worker module to include metadata in custom info and error messages
vitor-aignosi
2025-08-20 10:51:38 -03:00
8b9bb8d720
SIENTIAPDE-1199 Refactor logging in Gates and MLFlow activities to use info level for key operations
vitor-aignosi
2025-08-20 10:38:08 -03:00
89384d7783
SIENTIAPDE-1199 Update test for validate_connection method in OpcRepository to include detailed response structure
vitor-aignosi
2025-08-19 16:42:48 -03:00
ef32167f57
SIENTIAPDE-1199 Update dependencies in requirements.txt and increment image tag in values.yaml
vitor-aignosi
2025-08-19 16:05:13 -03:00
46e21c7538
SIENTIAPDE-1199 Enhance logging in MLFlow activity to include formatted JSON response data
vitor-aignosi
2025-08-19 12:12:15 -03:00
8012ff778c
SIENTIAPDE-1199 Refactor logging in OpcRepository to include full metadata in error and info messages
vitor-aignosi
2025-08-19 11:52:42 -03:00
3a06f0ca39
SIENTIAPDE-1199 Update dependencies and refactor logging imports for observability
vitor-aignosi
2025-08-19 10:42:27 -03:00
3ee076214c
SIENTIAPDE-1169 Implement server validation and output tag management in OPC class
vitor-aignosi
2025-08-19 09:07:05 -03:00
fc6c95c264
SIENTIAPDE-1169 Refactor OPC data writing and repository initialization
vitor-aignosi
2025-08-19 08:31:58 -03:00
cc7efba887
SIENTIAPDE-1169 Refactor OPC data writing to improve success tracking
vitor-aignosi
2025-08-18 16:30:33 -03:00
37a31a51a4
SIENTIAPDE-1169 Refactor OPC metrics to use unpacking for CORE_LABELS in metrics.py
vitor-aignosi
2025-08-18 14:17:43 -03:00
e567b8d0a7
SIENTIAPDE-1169 Update OPC metrics to include opc_server_id for enhanced tracking
vitor-aignosi
2025-08-18 14:15:22 -03:00
366d406689
SIENTIAPDE-1169 Enhance OpcRepository initialization to include pod_id for improved tracking
vitor-aignosi
2025-08-18 14:08:00 -03:00
e35eb300cb
SIENTIAPDE-1169 Implement OPC writing metrics and enhance OPC class initialization
vitor-aignosi
2025-08-18 13:58:43 -03:00
6eb71739db
SIENTIAPDE-1169 Update helm chart version in values.yaml to 0.5.0
vitor-aignosi
2025-08-18 13:47:50 -03:00
e82b25582c
SIENTIAPDE-1169 Update helm chart version in values.yaml and modify logging in worker.py
vitor-aignosi
2025-08-18 09:45:54 -03:00
a2a9f95aa5
SIENTIAPDE-1169 SIENTIAPDE-1174 Add SDK metrics configuration and update worker for telemetry
vitor-aignosi
2025-08-18 09:41:17 -03:00
7f3457e318
SIENTIAPDE-1169 Enhance BaseActivity initialization across multiple activities to include error counter
vitor-aignosi
2025-08-14 15:41:03 -03:00
da10f900a8
SIENTIAPDE-1169 Update dependencies and configuration for improved functionality
vitor-aignosi
2025-08-14 15:25:04 -03:00
f195b5116e
Merge pull request #14 from Aignosi/SIENTIAPDE-1174-mapear-e-implementar-metricas-a-serem-criadas
Bruno Domingues
2025-08-13 16:35:04 -03:00
dd513ddfaf
SIENTIAPDE-1174 Add async test for write_metrics method in gates_activity
vitor-aignosi
2025-08-05 14:39:02 -03:00
fbdf9c3c6c
SIENTIAPDE-1174 SIENTIAPDE-1174 Update tests to enhance MLFlow and workflow activity assertions
vitor-aignosi
2025-08-05 14:19:53 -03:00
3d7de2ef5e
Merge branch 'main' into SIENTIAPDE-1174-mapear-e-implementar-metricas-a-serem-criadas
vitor-aignosi
2025-08-05 14:05:09 -03:00
c92e2f41c3
SIENTIAPDE-1174 pdate metrics tracking to include response time histogram
vitor-aignosi
2025-08-04 16:09:26 -03:00
3cf7b4ec16
SIENTIAPDE-1174 SIENTIAPDE-1174 Update replica count and image tag in values.yaml
vitor-aignosi
2025-08-04 15:24:20 -03:00
663b286ad7
SIENTIAPDE-1174 SIENTIAPDE-1174 Update tests.ipynb to normalize counter and rollout values, and fix MLFlowRepository initialization error
vitor-aignosi
2025-08-04 10:03:15 -03:00
28743eb720
Merge pull request #13 from Aignosi/SIENTIAPDE-1172-criar-pipeline-de-alertas-orquestrador
Bruno Domingues
2025-08-04 10:02:56 -03:00
47df5ebc60
SIENTIAPDE-1174 SIENTIAPDE-1174 Update MLFlowRepository initialization to include logger for enhanced logging capabilities
vitor-aignosi
2025-08-01 17:15:49 -03:00
669494c90b
SIENTIAPDE-1174 Mark application as DOWN in metrics on shutdown to improve failure reporting
vitor-aignosi
2025-08-01 12:01:29 -03:00
963f089c7b
SIENTIAPDE-1174 SIENTIAPDE-1174 Update replica count and enhance logging in MLFlow
vitor-aignosi
2025-08-01 10:32:06 -03:00
4f6f4d1fa9
SIENTIAPDE-1174 Enable data index reset in MLFlow by uncommenting data.reset_index, improving data processing consistency.
vitor-aignosi
2025-08-01 10:20:42 -03:00
4fb89b3862
SIENTIAPDE-1174 Comment out data.reset_index in MLFlow to prevent index reset during data processing, improving data handling without altering existing functionality.
vitor-aignosi
2025-08-01 10:16:41 -03:00
d2952654b4
SIENTIAPDE-1174 SIENTIAPDE-1174 Add write_metrics activity to main workflow for enhanced metrics tracking
vitor-aignosi
2025-08-01 10:03:19 -03:00
a34bdcd839
SIENTIAPDE-1171 Refactor data merging in MLFlowRepository to simplify merge operation in fit method. Removed unnecessary parameters for improved readability and maintainability.
vitor-aignosi
2025-07-24 11:24:21 -03:00
1261e4a8aa
SIENTIAPDE-1171 Enhance data merging in MLFlowRepository by specifying the 'on' parameter for improved join accuracy. This change ensures that the merge operation correctly aligns data based on the 'id' field.
vitor-aignosi
2025-07-24 10:56:05 -03:00
a2492e244d
SIENTIAPDE-1171 Enhance data merging in MLFlowRepository by specifying merge parameters
vitor-aignosi
2025-07-24 10:30:20 -03:00
c738e8b0df
SIENTIAPDE-1171 Refactor model_repository and enhance test coverage for MLFlow functionalities
vitor-aignosi
2025-07-24 10:24:08 -03:00
4283730e7a
SIENTIAPDE-1171 Update GITHUB_BRANCH in values.yaml and refactor MLFlowRepository for model retraining
vitor-aignosi
2025-07-23 16:51:33 -03:00
89b9892a5b
SIENTIAPDE-1171 Update dependencies and enhance ML model retraining functionality
vitor-aignosi
2025-07-23 12:02:16 -03:00
9410de5f82
Merge pull request #11 from Aignosi/SIENTIAPDE-1151-criar-testes-de-stress
Bruno Domingues
2025-07-22 12:22:46 -03:00
4f315a1506
Merge branch 'main' into SIENTIAPDE-1151-criar-testes-de-stress
vitor-aignosi
2025-07-22 11:34:16 -03:00
1844118091
Merge pull request #10 from Aignosi/SIENTIAPDE-1163-alterar-dinamica-de-notificacoes-para-usar-o-mongodb-ao-inves-do-kafka
Bruno Domingues
2025-07-22 10:14:23 -03:00
40cf93d500
SIENTIAPDE-1151 Update GITHUB_BRANCH in values.yaml to reflect new stress testing branch and modify OPC error handling to set success flag instead of continuing on error.
vitor-aignosi
2025-07-18 14:42:22 -03:00
71d256d192
SIENTIAPDE-1151 Enhance OPC error handling by adding detailed notifications for missing servers during write operations. The notification includes the list of available OPC servers for better debugging.
vitor-aignosi
2025-07-18 14:33:07 -03:00
b440c7d547
SIENTIAPDE-1163 SIENTIAPDE-1163 Enhance OPC tests to improve error handling and notifications. Added tests for MongoDB configuration and refined connection error handling in OPC repository.
vitor-aignosi
2025-07-17 15:21:10 -03:00
488674c7e1
SIENTIAPDE-1163 Update requirements.txt to replace local dataops library path with git repository link for version 1.3.3.
vitor-aignosi
2025-07-17 12:45:29 -03:00
9bcf882d00
SIENTIAPDE-1163 Update .gitignore to include git_log and enhance README.md with instructions for generating a git log summary.
vitor-aignosi
2025-07-17 12:37:54 -03:00
515881b404
SIENTIAPDE-1163 Add MongoDB configuration to values.yaml for integration
vitor-aignosi
2025-07-17 12:31:24 -03:00
694ad265c8
SIENTIAPDE-1163 Refactor OPC connection handling to improve error notifications and update GITHUB_BRANCH in values.yaml for MongoDB integration. Change requirements.txt to point to local dataops library path.
vitor-aignosi
2025-07-17 11:02:41 -03:00
c17792020e
SIENTIAPDE-1163 Update sientia-dataops-library dependency version to 1.3.0 in requirements.txt for improved functionality.
vitor-aignosi
2025-07-16 09:23:11 -03:00
b6b0dba735
SIENTIAPDE-1163 Update notification handler references to use CoreNotificationHandler and add MongoDB configuration to connectors. Update GITHUB_BRANCH in values.yaml for optimization tasks.
vitor-aignosi
2025-07-16 09:19:40 -03:00
5787d9f7a0
SIENTIAPDE-1148 Refactor Gates activity to correctly sort data by timestamp and update exception handling in worker to include NOSONAR comment for clarity.
vitor-aignosi
2025-07-11 12:09:24 -03:00
ceb82354ea
SIENTIAPDE-1141 SIENTIAPDE-1141 Update worker.py to configure concurrency limits for workflow tasks and activities, enhancing performance and resource management.
vitor-aignosi
2025-07-10 16:28:15 -03:00
20a624b26d
SIENTIAPDE-1141 Update values.yaml to increase replicaCount to 5, change GITHUB_BRANCH to SIENTIAPDE-1141-criar-testes-de-carga, and adjust POSTGRES_MAX_CONNECTIONS to 30 for improved performance and testing.
vitor-aignosi
2025-07-10 15:35:29 -03:00
f4610fec5b
SIENTIAPDE-1110 Update dependencies in requirements.txt and bump image tag in values.yaml to version 0.2.4 for consistency and improvements.
vitor-aignosi
2025-07-07 16:34:34 -03:00
50e6479c49
SIENTIAPDE-1110 Refactor notification handling in Gates and OPC activities to use send_notification method with metadata integration, enhancing error reporting and traceability.
vitor-aignosi
2025-07-04 15:19:14 -03:00
58216a91ce
SIENTIAPDE-1110 Enhance OpcRepository write_data method to set SourceTimestamp using individual datetime components, improving precision in timestamping.
vitor-aignosi
2025-06-27 17:07:33 -03:00
d2e4561dfd
SIENTIAPDE-1110 Enhance OpcRepository write_data method to include SourceTimestamp using DateTime, improving data accuracy and traceability.
vitor-aignosi
2025-06-27 17:03:59 -03:00
80ad2d54ad
SIENTIAPDE-1110 Refactor Gates and OpcRepository for improved logging and error handling. Removed debug statement in Gates and enhanced disconnect method in OpcRepository to log disconnection status and handle exceptions.
vitor-aignosi
2025-06-27 15:52:33 -03:00
90c6beb673
SIENTIAPDE-1110 Refactor logging in OpcRepository to consistently use 'schedule_name' from metadata for improved error reporting and traceability.
vitor-aignosi
2025-06-27 12:31:23 -03:00
fd9d933931
SIENTIAPDE-1110 Update OPC activity to utilize custom logger in write_data method, improving error handling and traceability.
vitor-aignosi
2025-06-27 12:27:40 -03:00
566818b308
SIENTIAPDE-1110 Refactor logging in OPC and OpcRepository to utilize custom logging methods, enhancing error handling and traceability with metadata integration.
vitor-aignosi
2025-06-27 12:24:15 -03:00
119decac16
SIENTIAPDE-1110 Refactor OPC activity and OpcRepository to include metadata parameter in write_data methods, improving error handling and logging capabilities for better traceability.
vitor-aignosi
2025-06-27 11:05:47 -03:00
f692e23a28
SIENTIAPDE-1110 Update connectors_config to use dynamic OPC_ID as key for configuration, enhancing flexibility in OPC setup.
vitor-aignosi
2025-06-27 10:49:49 -03:00
a1b7d8e024
SIENTIAPDE-1110 Enhance logging in OPC activity by adding debug statements for output configuration and server details to improve traceability.
vitor-aignosi
2025-06-27 10:45:39 -03:00
ce69b0839f
SIENTIAPDE-1110 SIENTIAPDE-1110 Refactor OPC activity to use server IDs instead of names, update values.yaml for OPC_ID, and enhance OpcRepository initialization for improved clarity and consistency.
vitor-aignosi
2025-06-27 10:37:06 -03:00
82356ca3b0
SIENTIAPDE-1110 Update process_confidence method in OPC activity to include metadata parameter for improved data handling.
vitor-aignosi
2025-06-27 10:23:52 -03:00
f1eba071aa
SIENTIAPDE-1110 Refactor metadata handling in PredictionProcess to improve clarity by explicitly naming the metadata key in the workflow execution parameters.
vitor-aignosi
2025-06-27 10:20:28 -03:00
f76ae839a9
SIENTIAPDE-1110 Refactor metadata handling in PredictionsBatch and PredictionProcess to improve clarity in input preparation.
vitor-aignosi
2025-06-27 10:06:38 -03:00
73a5ac1e38
SIENTIAPDE-1110 Add metadata logging in PredictionProcess for enhanced traceability.
vitor-aignosi
2025-06-27 10:03:19 -03:00
1325e7b7e3
SIENTIAPDE-1110 Update OPC_URL in values.yaml and enhance input data logging in PredictionProcess for improved traceability.
vitor-aignosi
2025-06-27 10:00:34 -03:00
b1e14aa8fe
SIENTIAPDE-1110 Enhance logging in Gates activity by adding input data debug statement for improved traceability.
vitor-aignosi
2025-06-27 09:47:52 -03:00
98ea2a7f75
SIENTIAPDE-1110 Update dependencies and enhance logging in activities; bump version in requirements and values.yaml
vitor-aignosi
2025-06-27 09:17:24 -03:00
cefef0b1e9
SIENTIAPDE-1110 Enhance MLFlow activity to sort data by created_at and remove duplicates; update tests to reflect changes
vitor-aignosi
2025-06-25 15:33:31 -03:00
2be78b1aea
SIENTIAPDE-1111: refactor sonarqube pipeline.
Bruno Domingues
2025-06-23 12:21:55 -03:00
7c4f3936e8
SIENTIAPDE-1100 Add test for handling invalid data type in write_data method
vitor-aignosi
2025-06-12 09:14:15 -03:00
1057db1d73
SIENTIAPDE-1100 Improve error handling in OPC activities; raise exceptions instead of logging errors and add data type validation in OpcRepository
vitor-aignosi
2025-06-12 09:06:31 -03:00
e8afa2673e
SIENTIAPDE-1100 Refactor error handling in Gates and OPC activities; replace raise statements with logging for better traceability
vitor-aignosi
2025-06-12 08:56:10 -03:00
ba576636a0
SIENTIAPDE-1100 Fix formatting in values.yaml by adding a newline at the end of the SSH secret creation comment
vitor-aignosi
2025-06-11 18:00:38 -03:00
72876e3598
[SIENTIAPDE-1100] Fix formatting in values.yaml by ensuring consistent comment style for SSH secret creation
vitor-aignosi
2025-06-11 17:59:38 -03:00
vitor-aignosi