Commit Graph

237 Commits

Author SHA1 Message Date
vitor-aignosi
545929c618 SIENTIAPDE-1141
feat: add asynchronous sleep in temporal_manager to improve schedule processing
2025-07-09 12:33:12 -03:00
vitor-aignosi
9d63647cf1 SIENTIAPDE-1141
Update GITHUB_BRANCH in values.yaml and enhance debug logging in temporal_manager.py
2025-07-09 12:24:27 -03:00
vitor-aignosi
a173f4d451 SIENTIAPDE-1141
Update GITHUB_BRANCH in values.yaml and add debug logging for schedule ID in temporal_manager.py
2025-07-09 12:18:57 -03:00
Matheus Demoner
ecda4befed Merge pull request #4 from Aignosi/SIENTIAPDE-1110-criar-testes-e-2-e
Sientiapde 1110 criar testes e 2 e
2025-07-08 19:13:10 -03:00
vitor-aignosi
e1f1d3e3f4 SIENTIAPDE-1110
refactor: remove unused test_prepare_activity function from test_activities.py
2025-07-08 16:39:35 -03:00
vitor-aignosi
5d4faab557 SIENTIAPDE-1110
chore: update sientia-dataops-library version to 1.2.1 and add debug_data_package option in test_scouter
2025-07-08 16:34:47 -03:00
vitor-aignosi
a848f20c6b SIENTIAPDE-1110
fix: handle missing input filters in predictions_batch function
2025-07-07 15:56:33 -03:00
vitor-aignosi
f7f95d3148 SIENTIAPDE-1110
Update GITHUB_BRANCH and helm version in values.yaml for SIENTIAPDE-1110
2025-07-07 15:50:19 -03:00
vitor-aignosi
0aa58ba1da SIENTIAPDE-1110
SIENTIAPDE-1110 add debug_data_package configuration option to scouter function
2025-07-07 11:03:48 -03:00
Bruno Domingues
c16b9caa44 SIENTIAPDE-1111: refactor sonarqube pipeline. 2025-06-23 14:35:12 -03:00
vitor-aignosi
486c6214ac Merge pull request #3 from Aignosi/SIENTIAPDE-1107-testar-o-uso-do-mongo-db-no-lugar-do-couchbase
Sientiapde 1107 testar o uso do mongo db no lugar do couchbase
2025-06-17 11:15:01 -03:00
vitor-aignosi
a3bc22c055 SIENTIAPDE-1107
TEst fix
2025-06-17 07:51:06 -03:00
vitor-aignosi
f7b73618d8 SIENTIAPDE-1107
feat: implement MongoDB integration with clear_mongo_id function and related tests
2025-06-16 16:01:20 -03:00
vitor-aignosi
7984cb29f4 SIENTIAPDE-1107
fix: remove unused imports from connectors_config.py
2025-06-16 12:39:37 -03:00
vitor-aignosi
3445c7cdf9 SIENTIAPDE-1107
fix: update image tag and environment variables for MongoDB integration
2025-06-16 12:36:05 -03:00
vitor-aignosi
a4e4d3b085 SIENTIAPDE-1107
feat: add MongoDB integration and update configuration for activities
2025-06-16 12:05:56 -03:00
Matheus Demoner
2db8435a42 Merge pull request #2 from Aignosi/SIENTIAPDE-1095-realizar-testes-basicos-no-cluster-suse-linux
Sientiapde 1095 realizar testes basicos no cluster suse linux
2025-06-12 08:58:31 -03:00
vitor-aignosi
0a612f6a5b fix: update server_name to server_id in predictions batch test 2025-06-10 13:06:13 -03:00
vitor-aignosi
5e2634f062 fix: update key casing for VARIABLES to variables in filter configuration 2025-06-10 11:38:35 -03:00
vitor-aignosi
89ac81e5e5 SIENTIAPDE-1095
Fix read_tags access in gather_read_tags function and update samples.json to use write_tags
2025-06-10 08:32:16 -03:00
vitor-aignosi
caa7b125f9 SIENTIAPDE-1095
Refactor predictions_batch to use server_id instead of server_name; update values.yaml to set GITHUB_BRANCH to main; add new laborious pipeline configuration in samples.json
2025-06-10 08:25:50 -03:00
vitor-aignosi
a0d8f96a99 SIENTIAPDE-1095
Fix decoding of active ingestors to handle both bytes and string types
2025-06-09 17:19:53 -03:00
Matheus Demoner
3bb0c45af8 Merge pull request #1 from Aignosi/SIENTIAPDE-1030-implementar-os-workflows-mapeados-utilizando-as-workers-e-activities-apropriadas
Sientiapde 1030 implementar os workflows mapeados utilizando as workers e activities apropriadas
2025-06-09 13:08:59 -03:00
vitor-aignosi
15f1cd92cb SIENTIAPDE-1030
Add tests for loading OPC slots without decoding and connector configurations
2025-06-09 12:00:54 -03:00
vitor-aignosi
e81bd61f5a Init files 2025-06-09 11:46:42 -03:00
vitor-aignosi
a5c5187664 workflow fix 2025-06-09 11:21:13 -03:00
vitor-aignosi
1fd8bdc2e3 SIENTIAPDE-1030
some fixes in workflow
2025-06-09 08:06:02 -03:00
vitor-aignosi
24ae3bfb9f SIENTIAPDE-1030
Adding Sonarqube workflow
2025-06-09 07:38:45 -03:00
vitor-aignosi
13fac6da3b SIENTIAPDE-1051
Lib version update
2025-06-06 14:48:44 -03:00
vitor-aignosi
9a18edb0e3 samples and kube updates 2025-06-05 16:17:49 -03:00
vitor-aignosi
c950cb6138 SIENTIAPDE-1030
fix: update image tag and refactor worker names in values.yaml
2025-06-05 09:29:45 -03:00
vitor-aignosi
dcbcc70651 fix: update search attribute keys and improve schedule handling
- Changed search attribute key from "Orchestrated" to "orchestrated" in temporal_manager.py and test cases.
- Enhanced logging for schedule creation and updates in temporal_manager.py.
- Updated schedule creation to use workflow_type directly instead of a hardcoded string.
- Modified gather_read_tags function to use server_id instead of server_name for tag identification.
- Adjusted test cases to reflect changes in server_id usage and ensure consistency across tests.
- Fixed model_name retrieval in common_config to access nested models dictionary.
- Updated test cases to align with new data structures and ensure accurate assertions.
2025-06-04 15:06:54 -03:00
vitor-aignosi
5dc49b476a SIENTIAPDE-1030
Add comprehensive tests and utility functions for orchestrator activities

- Introduced tests for the new Formatters class, covering methods for processing schedules and slots.
- Enhanced SlotManager tests with update and delete slot functionalities.
- Added TemporalManager tests for creating, updating, and deleting schedules, including frequency parsing.
- Implemented utility functions for orchestrator operations, including frequency parsing and tag configuration building.
- Created tests for utility functions to ensure correct behavior and integration with orchestrator activities.
- Established a new converters module for parsing frequency strings into seconds.
2025-06-03 17:29:00 -03:00
vitor-aignosi
43e9695849 SIENTIAPDE-1030
Refactor path priority handling in predictions_batch function
2025-05-30 16:26:33 -03:00
vitor-aignosi
4f37b2be02 SIENTIAPDE-1030
Add unit tests for orchestrator activities and workflows

- Implement tests for Activities class, covering initialization and prepare_activity method.
- Create tests for Couchbase class, including successful and failed query loading.
- Add tests for SlotManager class, verifying OPC slot loading and active ingestor retrieval.
- Develop tests for TemporalManager class, focusing on schedule loading functionality.
- Introduce tests for Orchestrator class, ensuring proper execution of workflow activities.
- Establish a new test suite for orchestrator activities and workflows in the tests directory.
2025-05-30 16:24:52 -03:00
vitor-aignosi
f6584314b2 SIENTIAPDE-1030
Add unit tests for connectors configuration, logger, workflows, and predictions batch

- Implement tests for MLflow, OPC, and Postgres configuration builders to validate environment variable handling and default values.
- Create tests for the logger to ensure default settings and handler configurations are correct.
- Add comprehensive tests for the FormatAndExportPrediction and PredictionProcess workflows, covering various scenarios including path flags and activity execution.
- Introduce tests for the PredictionsBatch workflow to verify the execution of local activities and child workflows.
- Include a values.yaml file for Kubernetes deployment configuration, specifying image details, service account settings, environment variables, and resource limits.
2025-05-28 13:32:42 -03:00
vitor-aignosi
8bb8bea54d Initial commit 2025-05-28 11:21:12 -03:00