Commit Graph

217 Commits

Author SHA1 Message Date
vitor-aignosi
0fd631a029 SIENTIAPDE-1150
SIENTIAPDE-1150: enhance MongoDB activities to filter successful pipelines; update orchestration workflow to include timestamp management for updated, created, and deleted pipelines; adjust tests to reflect new success criteria
2025-07-14 16:10:51 -03:00
vitor-aignosi
b3069c8a58 SIENTIAPDE-1150
chore: update image tag to 0.2.4 in values.yaml; refactor logging in slot_manager and temporal_manager for improved readability; modify MongoDB and Redis configurations for better defaults; enhance worker.py with new activities and error handling
2025-07-14 13:42:10 -03:00
vitor-aignosi
f3497beda0 Merge branch 'SIENTIAPDE-1150-ajustar-orquestrador-para-manter-uma-store-de-detalhes-dos-schedules' of github.com:Aignosi/sientia-dataops-orchestrator_temporal into SIENTIAPDE-1150-ajustar-orquestrador-para-manter-uma-store-de-detalhes-dos-schedules 2025-07-14 13:01:26 -03:00
vitor-aignosi
43206b578d SIENTIAPDE-1150
fix: implement schedule normalization and timestamp management in MongoDB activities, enhance orchestration workflow with new formatting and normalization methods
2025-07-14 13:00:46 -03:00
vitor-aignosi
925c246d19 SIENTIAPDE-1150
fix: implement schedule normalization and timestamp management in MongoDB activities, enhance orchestration workflow with new formatting and normalization methods
2025-07-14 12:59:52 -03:00
Matheus Demoner
e3a88eb1d5 Merge pull request #6 from Aignosi/SIENTIAPDE-1148-separar-scouter-laborious-e-orchestrator-por-namespaces
Sientiapde 1148 separar scouter laborious e orchestrator por namespaces
2025-07-14 10:35:47 -03:00
vitor-aignosi
9821b052ae SIENTIAPDE-1148
fix: implement compare_configs method in formatters.py to streamline schedule comparison and update handling
2025-07-11 16:30:09 -03:00
vitor-aignosi
89c769998f SIENTIAPDE-1148
fix: update schedule handling in temporal_manager and formatters to support multiple namespaces, enhance test coverage, and improve configuration handling
2025-07-11 16:22:19 -03:00
vitor-aignosi
0b0bb4bd45 SIENTIAPDE-1148
refactor: remove unused prepare_activity method from Activities class and clean up worker.py activity list
2025-07-11 12:35:36 -03:00
vitor-aignosi
5278159507 SIENTIAPDE-1148
fix: add formatting comments and improve readability in update_schedule function of temporal_manager.py
2025-07-11 12:34:57 -03:00
vitor-aignosi
dc84b152e5 SIENTIAPDE-1148
fix: update execution count to null in test.ipynb and consolidate search-attribute creation commands for multiple namespaces
2025-07-11 12:02:04 -03:00
vitor-aignosi
f3d9c1d685 SIENTIAPDE-1148
fix: improve error handling in temporal_manager.py by ensuring schedule_handles defaults to None and updating error messages for clarity
2025-07-11 11:04:30 -03:00
vitor-aignosi
7ad814408d SIENTIAPDE-1148
chore: add debug logging for schedule handles in temporal_manager.py to enhance visibility during orchestration
2025-07-11 10:57:32 -03:00
vitor-aignosi
25ec695323 SIENTIAPDE-1148
fix: enhance error messages in temporal_manager.py to include client and handle details for better debugging
2025-07-11 10:48:24 -03:00
vitor-aignosi
31a1d5bf4e SIENTIAPDE-1148
refactor: update Temporal configuration keys in activities.py and temporal_manager.py for consistency and clarity
2025-07-11 10:44:26 -03:00
vitor-aignosi
7279192343 SIENTIAPDE-1148
refactor: streamline Temporal connection logic in temporal_manager.py and remove redundant logging in worker.py
2025-07-11 10:42:28 -03:00
vitor-aignosi
96af810755 SIENTIAPDE-1148
feat: add logging for Temporal namespace connection in temporal_manager.py
2025-07-11 10:39:08 -03:00
vitor-aignosi
71f0db1c60 SIENTIAPDE-1148
feat: add logging for Temporal namespace connection in worker.py
2025-07-11 10:38:13 -03:00
vitor-aignosi
7f9efa579a SIENTIAPDE-1148
refactor: update temporal configuration and refactor Activities class to support multiple namespaces for improved orchestration
2025-07-11 10:34:40 -03:00
vitor-aignosi
d84b721798 Merge pull request #5 from Aignosi/SIENTIAPDE-1141-criar-testes-de-carga
Sientiapde 1141 criar testes de carga
2025-07-11 09:24:42 -03:00
vitor-aignosi
fae942136b SIENTIAPDE-1141
fix: remove outdated assertions in test_orchestrator.py to streamline workflow testing
2025-07-11 08:16:28 -03:00
vitor-aignosi
f43e962392 SIENTIAPDE-1141
fix: update execution counts and add schedule deletion logic in test.ipynb for improved error handling
2025-07-11 08:08:08 -03:00
vitor-aignosi
dfd77c1768 SIENTIAPDE-1141
fix: set RPC timeout to 60 seconds in temporal_manager.py for improved schedule description handling
2025-07-10 16:32:58 -03:00
vitor-aignosi
351fce905a SIENTIAPDE-1141
fix: increase sleep duration in temporal_manager.py to improve schedule processing efficiency
2025-07-10 16:29:01 -03:00
vitor-aignosi
861cfde9ef SIENTIAPDE-1141
fix: adjust execution counts and reduce sleep duration in test.ipynb and temporal_manager.py for improved performance
2025-07-10 15:42:38 -03:00
vitor-aignosi
70f9d4e837 SIENTIAPDE-1141
fix: update execution counts and refactor query structure in test.ipynb for improved clarity
2025-07-09 17:21:35 -03:00
vitor-aignosi
bb5d0f15f9 SIENTIAPDE-1141
fix: update host configuration and execution counts in test.ipynb; refactor schedule creation parameters in orchestrator
2025-07-09 16:22:15 -03:00
vitor-aignosi
4df1b0240a SIENTIAPDE-1141
refactor: remove commented-out code and improve timeout settings in orchestrator.py and test_activities.py
2025-07-09 13:00:05 -03:00
vitor-aignosi
c92017345d SIENTIAPDE-1141
fix: increase start_to_close_timeout in orchestrator.py to improve workflow execution duration
2025-07-09 12:52:48 -03:00
vitor-aignosi
68c7e2cf3b SIENTIAPDE-1141
fix: increase sleep duration in temporal_manager to enhance schedule processing efficiency
2025-07-09 12:50:26 -03:00
vitor-aignosi
545929c618 SIENTIAPDE-1141
feat: add asynchronous sleep in temporal_manager to improve schedule processing
2025-07-09 12:33:12 -03:00
vitor-aignosi
9d63647cf1 SIENTIAPDE-1141
Update GITHUB_BRANCH in values.yaml and enhance debug logging in temporal_manager.py
2025-07-09 12:24:27 -03:00
vitor-aignosi
a173f4d451 SIENTIAPDE-1141
Update GITHUB_BRANCH in values.yaml and add debug logging for schedule ID in temporal_manager.py
2025-07-09 12:18:57 -03:00
Matheus Demoner
ecda4befed Merge pull request #4 from Aignosi/SIENTIAPDE-1110-criar-testes-e-2-e
Sientiapde 1110 criar testes e 2 e
2025-07-08 19:13:10 -03:00
vitor-aignosi
e1f1d3e3f4 SIENTIAPDE-1110
refactor: remove unused test_prepare_activity function from test_activities.py
2025-07-08 16:39:35 -03:00
vitor-aignosi
5d4faab557 SIENTIAPDE-1110
chore: update sientia-dataops-library version to 1.2.1 and add debug_data_package option in test_scouter
2025-07-08 16:34:47 -03:00
vitor-aignosi
a848f20c6b SIENTIAPDE-1110
fix: handle missing input filters in predictions_batch function
2025-07-07 15:56:33 -03:00
vitor-aignosi
f7f95d3148 SIENTIAPDE-1110
Update GITHUB_BRANCH and helm version in values.yaml for SIENTIAPDE-1110
2025-07-07 15:50:19 -03:00
vitor-aignosi
0aa58ba1da SIENTIAPDE-1110
SIENTIAPDE-1110 add debug_data_package configuration option to scouter function
2025-07-07 11:03:48 -03:00
Bruno Domingues
c16b9caa44 SIENTIAPDE-1111: refactor sonarqube pipeline. 2025-06-23 14:35:12 -03:00
vitor-aignosi
486c6214ac Merge pull request #3 from Aignosi/SIENTIAPDE-1107-testar-o-uso-do-mongo-db-no-lugar-do-couchbase
Sientiapde 1107 testar o uso do mongo db no lugar do couchbase
2025-06-17 11:15:01 -03:00
vitor-aignosi
a3bc22c055 SIENTIAPDE-1107
TEst fix
2025-06-17 07:51:06 -03:00
vitor-aignosi
f7b73618d8 SIENTIAPDE-1107
feat: implement MongoDB integration with clear_mongo_id function and related tests
2025-06-16 16:01:20 -03:00
vitor-aignosi
7984cb29f4 SIENTIAPDE-1107
fix: remove unused imports from connectors_config.py
2025-06-16 12:39:37 -03:00
vitor-aignosi
3445c7cdf9 SIENTIAPDE-1107
fix: update image tag and environment variables for MongoDB integration
2025-06-16 12:36:05 -03:00
vitor-aignosi
a4e4d3b085 SIENTIAPDE-1107
feat: add MongoDB integration and update configuration for activities
2025-06-16 12:05:56 -03:00
Matheus Demoner
2db8435a42 Merge pull request #2 from Aignosi/SIENTIAPDE-1095-realizar-testes-basicos-no-cluster-suse-linux
Sientiapde 1095 realizar testes basicos no cluster suse linux
2025-06-12 08:58:31 -03:00
vitor-aignosi
0a612f6a5b fix: update server_name to server_id in predictions batch test 2025-06-10 13:06:13 -03:00
vitor-aignosi
5e2634f062 fix: update key casing for VARIABLES to variables in filter configuration 2025-06-10 11:38:35 -03:00
vitor-aignosi
89ac81e5e5 SIENTIAPDE-1095
Fix read_tags access in gather_read_tags function and update samples.json to use write_tags
2025-06-10 08:32:16 -03:00