gitea_admin/sientia-dataops-orchestrator_temporal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
252 Commits 3 Branches 0 Tags
4a672745c500fbfe6fe08db5b06cf2412a04928e
Commit Graph

252 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
vitor-aignosi
7279192343 SIENTIAPDE-1148 
refactor: streamline Temporal connection logic in temporal_manager.py and remove redundant logging in worker.py
 2025-07-11 10:42:28 -03:00
vitor-aignosi
96af810755 SIENTIAPDE-1148 
feat: add logging for Temporal namespace connection in temporal_manager.py
 2025-07-11 10:39:08 -03:00
vitor-aignosi
71f0db1c60 SIENTIAPDE-1148 
feat: add logging for Temporal namespace connection in worker.py
 2025-07-11 10:38:13 -03:00
vitor-aignosi
7f9efa579a SIENTIAPDE-1148 
refactor: update temporal configuration and refactor Activities class to support multiple namespaces for improved orchestration
 2025-07-11 10:34:40 -03:00
vitor-aignosi
d84b721798 Merge pull request #5 from Aignosi/SIENTIAPDE-1141-criar-testes-de-carga 
Sientiapde 1141 criar testes de carga
 2025-07-11 09:24:42 -03:00
vitor-aignosi
fae942136b SIENTIAPDE-1141 
fix: remove outdated assertions in test_orchestrator.py to streamline workflow testing
 2025-07-11 08:16:28 -03:00
vitor-aignosi
f43e962392 SIENTIAPDE-1141 
fix: update execution counts and add schedule deletion logic in test.ipynb for improved error handling
 2025-07-11 08:08:08 -03:00
vitor-aignosi
dfd77c1768 SIENTIAPDE-1141 
fix: set RPC timeout to 60 seconds in temporal_manager.py for improved schedule description handling
 2025-07-10 16:32:58 -03:00
vitor-aignosi
351fce905a SIENTIAPDE-1141 
fix: increase sleep duration in temporal_manager.py to improve schedule processing efficiency
 2025-07-10 16:29:01 -03:00
vitor-aignosi
861cfde9ef SIENTIAPDE-1141 
fix: adjust execution counts and reduce sleep duration in test.ipynb and temporal_manager.py for improved performance
 2025-07-10 15:42:38 -03:00
vitor-aignosi
70f9d4e837 SIENTIAPDE-1141 
fix: update execution counts and refactor query structure in test.ipynb for improved clarity
 2025-07-09 17:21:35 -03:00
vitor-aignosi
bb5d0f15f9 SIENTIAPDE-1141 
fix: update host configuration and execution counts in test.ipynb; refactor schedule creation parameters in orchestrator
 2025-07-09 16:22:15 -03:00
vitor-aignosi
4df1b0240a SIENTIAPDE-1141 
refactor: remove commented-out code and improve timeout settings in orchestrator.py and test_activities.py
 2025-07-09 13:00:05 -03:00
vitor-aignosi
c92017345d SIENTIAPDE-1141 
fix: increase start_to_close_timeout in orchestrator.py to improve workflow execution duration
 2025-07-09 12:52:48 -03:00
vitor-aignosi
68c7e2cf3b SIENTIAPDE-1141 
fix: increase sleep duration in temporal_manager to enhance schedule processing efficiency
 2025-07-09 12:50:26 -03:00
vitor-aignosi
545929c618 SIENTIAPDE-1141 
feat: add asynchronous sleep in temporal_manager to improve schedule processing
 2025-07-09 12:33:12 -03:00
vitor-aignosi
9d63647cf1 SIENTIAPDE-1141 
Update GITHUB_BRANCH in values.yaml and enhance debug logging in temporal_manager.py
 2025-07-09 12:24:27 -03:00
vitor-aignosi
a173f4d451 SIENTIAPDE-1141 
Update GITHUB_BRANCH in values.yaml and add debug logging for schedule ID in temporal_manager.py
 2025-07-09 12:18:57 -03:00
Matheus Demoner
ecda4befed Merge pull request #4 from Aignosi/SIENTIAPDE-1110-criar-testes-e-2-e 
Sientiapde 1110 criar testes e 2 e
 2025-07-08 19:13:10 -03:00
vitor-aignosi
e1f1d3e3f4 SIENTIAPDE-1110 
refactor: remove unused test_prepare_activity function from test_activities.py
 2025-07-08 16:39:35 -03:00
vitor-aignosi
5d4faab557 SIENTIAPDE-1110 
chore: update sientia-dataops-library version to 1.2.1 and add debug_data_package option in test_scouter
 2025-07-08 16:34:47 -03:00
vitor-aignosi
a848f20c6b SIENTIAPDE-1110 
fix: handle missing input filters in predictions_batch function
 2025-07-07 15:56:33 -03:00
vitor-aignosi
f7f95d3148 SIENTIAPDE-1110 
Update GITHUB_BRANCH and helm version in values.yaml for SIENTIAPDE-1110
 2025-07-07 15:50:19 -03:00
vitor-aignosi
0aa58ba1da SIENTIAPDE-1110 
SIENTIAPDE-1110 add debug_data_package configuration option to scouter function
 2025-07-07 11:03:48 -03:00
Bruno Domingues
c16b9caa44 SIENTIAPDE-1111: refactor sonarqube pipeline. 2025-06-23 14:35:12 -03:00
vitor-aignosi
486c6214ac Merge pull request #3 from Aignosi/SIENTIAPDE-1107-testar-o-uso-do-mongo-db-no-lugar-do-couchbase 
Sientiapde 1107 testar o uso do mongo db no lugar do couchbase
 2025-06-17 11:15:01 -03:00
vitor-aignosi
a3bc22c055 SIENTIAPDE-1107 
TEst fix
 2025-06-17 07:51:06 -03:00
vitor-aignosi
f7b73618d8 SIENTIAPDE-1107 
feat: implement MongoDB integration with clear_mongo_id function and related tests
 2025-06-16 16:01:20 -03:00
vitor-aignosi
7984cb29f4 SIENTIAPDE-1107 
fix: remove unused imports from connectors_config.py
 2025-06-16 12:39:37 -03:00
vitor-aignosi
3445c7cdf9 SIENTIAPDE-1107 
fix: update image tag and environment variables for MongoDB integration
 2025-06-16 12:36:05 -03:00
vitor-aignosi
a4e4d3b085 SIENTIAPDE-1107 
feat: add MongoDB integration and update configuration for activities
 2025-06-16 12:05:56 -03:00
Matheus Demoner
2db8435a42 Merge pull request #2 from Aignosi/SIENTIAPDE-1095-realizar-testes-basicos-no-cluster-suse-linux 
Sientiapde 1095 realizar testes basicos no cluster suse linux
 2025-06-12 08:58:31 -03:00
vitor-aignosi
0a612f6a5b fix: update server_name to server_id in predictions batch test 2025-06-10 13:06:13 -03:00
vitor-aignosi
5e2634f062 fix: update key casing for VARIABLES to variables in filter configuration 2025-06-10 11:38:35 -03:00
vitor-aignosi
89ac81e5e5 SIENTIAPDE-1095 
Fix read_tags access in gather_read_tags function and update samples.json to use write_tags
 2025-06-10 08:32:16 -03:00
vitor-aignosi
caa7b125f9 SIENTIAPDE-1095 
Refactor predictions_batch to use server_id instead of server_name; update values.yaml to set GITHUB_BRANCH to main; add new laborious pipeline configuration in samples.json
 2025-06-10 08:25:50 -03:00
vitor-aignosi
a0d8f96a99 SIENTIAPDE-1095 
Fix decoding of active ingestors to handle both bytes and string types
 2025-06-09 17:19:53 -03:00
Matheus Demoner
3bb0c45af8 Merge pull request #1 from Aignosi/SIENTIAPDE-1030-implementar-os-workflows-mapeados-utilizando-as-workers-e-activities-apropriadas 
Sientiapde 1030 implementar os workflows mapeados utilizando as workers e activities apropriadas
 2025-06-09 13:08:59 -03:00
vitor-aignosi
15f1cd92cb SIENTIAPDE-1030 
Add tests for loading OPC slots without decoding and connector configurations
 2025-06-09 12:00:54 -03:00
vitor-aignosi
e81bd61f5a Init files 2025-06-09 11:46:42 -03:00
vitor-aignosi
a5c5187664 workflow fix 2025-06-09 11:21:13 -03:00
vitor-aignosi
1fd8bdc2e3 SIENTIAPDE-1030 
some fixes in workflow
 2025-06-09 08:06:02 -03:00
vitor-aignosi
24ae3bfb9f SIENTIAPDE-1030 
Adding Sonarqube workflow
 2025-06-09 07:38:45 -03:00
vitor-aignosi
13fac6da3b SIENTIAPDE-1051 
Lib version update
 2025-06-06 14:48:44 -03:00
vitor-aignosi
9a18edb0e3 samples and kube updates 2025-06-05 16:17:49 -03:00
vitor-aignosi
c950cb6138 SIENTIAPDE-1030 
fix: update image tag and refactor worker names in values.yaml
 2025-06-05 09:29:45 -03:00
vitor-aignosi
dcbcc70651 fix: update search attribute keys and improve schedule handling 
- Changed search attribute key from "Orchestrated" to "orchestrated" in temporal_manager.py and test cases.
- Enhanced logging for schedule creation and updates in temporal_manager.py.
- Updated schedule creation to use workflow_type directly instead of a hardcoded string.
- Modified gather_read_tags function to use server_id instead of server_name for tag identification.
- Adjusted test cases to reflect changes in server_id usage and ensure consistency across tests.
- Fixed model_name retrieval in common_config to access nested models dictionary.
- Updated test cases to align with new data structures and ensure accurate assertions.
 2025-06-04 15:06:54 -03:00
vitor-aignosi
5dc49b476a SIENTIAPDE-1030 
Add comprehensive tests and utility functions for orchestrator activities

- Introduced tests for the new Formatters class, covering methods for processing schedules and slots.
- Enhanced SlotManager tests with update and delete slot functionalities.
- Added TemporalManager tests for creating, updating, and deleting schedules, including frequency parsing.
- Implemented utility functions for orchestrator operations, including frequency parsing and tag configuration building.
- Created tests for utility functions to ensure correct behavior and integration with orchestrator activities.
- Established a new converters module for parsing frequency strings into seconds.
 2025-06-03 17:29:00 -03:00
vitor-aignosi
43e9695849 SIENTIAPDE-1030 
Refactor path priority handling in predictions_batch function
 2025-05-30 16:26:33 -03:00
vitor-aignosi
4f37b2be02 SIENTIAPDE-1030 
Add unit tests for orchestrator activities and workflows

- Implement tests for Activities class, covering initialization and prepare_activity method.
- Create tests for Couchbase class, including successful and failed query loading.
- Add tests for SlotManager class, verifying OPC slot loading and active ingestor retrieval.
- Develop tests for TemporalManager class, focusing on schedule loading functionality.
- Introduce tests for Orchestrator class, ensuring proper execution of workflow activities.
- Establish a new test suite for orchestrator activities and workflows in the tests directory.
 2025-05-30 16:24:52 -03:00