Commit Graph

46 Commits

Author SHA1 Message Date
vitor-aignosi
29469ede72 SIENTIAPDE-1150
refactor: update samples.json to change server_id from 'default_server' to '1' for multiple tags; add 'active' and 'updated_at' fields for better state management in orchestration
2025-07-14 16:45:22 -03:00
vitor-aignosi
5a421b80c0 SIENTIAPDE-1150
refactor: update orchestration workflow to conditionally execute pipeline timestamp handlers based on report flags, improving efficiency and clarity
2025-07-14 16:26:34 -03:00
vitor-aignosi
14e1366658 SIENTIAPDE-1150
refactor: update orchestration workflow to conditionally start activity methods for pipeline timestamps based on report availability, enhancing efficiency and clarity
2025-07-14 16:24:03 -03:00
vitor-aignosi
0910c0426a SIENTIAPDE-1150
refactor: update orchestration workflow to replace execute_local_activity_method with start_local_activity_method and execute_activity_method with start_activity_method for improved clarity and consistency
2025-07-14 16:21:53 -03:00
vitor-aignosi
7f162a7d4e SIENTIAPDE-1150
refactor: streamline MongoDB activity methods to improve readability and maintainability; replace inline query construction with variable assignments for updated, created, and deleted pipelines
2025-07-14 16:16:29 -03:00
vitor-aignosi
f823d1813f SIENTIAPDE-1150
refactor: restructure services in values.yaml to separate API and OPC configurations; update mongo_db.py to import datetime correctly and enhance readability
2025-07-14 16:14:27 -03:00
vitor-aignosi
0fd631a029 SIENTIAPDE-1150
SIENTIAPDE-1150: enhance MongoDB activities to filter successful pipelines; update orchestration workflow to include timestamp management for updated, created, and deleted pipelines; adjust tests to reflect new success criteria
2025-07-14 16:10:51 -03:00
vitor-aignosi
b3069c8a58 SIENTIAPDE-1150
chore: update image tag to 0.2.4 in values.yaml; refactor logging in slot_manager and temporal_manager for improved readability; modify MongoDB and Redis configurations for better defaults; enhance worker.py with new activities and error handling
2025-07-14 13:42:10 -03:00
vitor-aignosi
43206b578d SIENTIAPDE-1150
fix: implement schedule normalization and timestamp management in MongoDB activities, enhance orchestration workflow with new formatting and normalization methods
2025-07-14 13:00:46 -03:00
vitor-aignosi
9821b052ae SIENTIAPDE-1148
fix: implement compare_configs method in formatters.py to streamline schedule comparison and update handling
2025-07-11 16:30:09 -03:00
vitor-aignosi
89c769998f SIENTIAPDE-1148
fix: update schedule handling in temporal_manager and formatters to support multiple namespaces, enhance test coverage, and improve configuration handling
2025-07-11 16:22:19 -03:00
vitor-aignosi
0b0bb4bd45 SIENTIAPDE-1148
refactor: remove unused prepare_activity method from Activities class and clean up worker.py activity list
2025-07-11 12:35:36 -03:00
vitor-aignosi
5278159507 SIENTIAPDE-1148
fix: add formatting comments and improve readability in update_schedule function of temporal_manager.py
2025-07-11 12:34:57 -03:00
vitor-aignosi
dc84b152e5 SIENTIAPDE-1148
fix: update execution count to null in test.ipynb and consolidate search-attribute creation commands for multiple namespaces
2025-07-11 12:02:04 -03:00
vitor-aignosi
f3d9c1d685 SIENTIAPDE-1148
fix: improve error handling in temporal_manager.py by ensuring schedule_handles defaults to None and updating error messages for clarity
2025-07-11 11:04:30 -03:00
vitor-aignosi
7ad814408d SIENTIAPDE-1148
chore: add debug logging for schedule handles in temporal_manager.py to enhance visibility during orchestration
2025-07-11 10:57:32 -03:00
vitor-aignosi
25ec695323 SIENTIAPDE-1148
fix: enhance error messages in temporal_manager.py to include client and handle details for better debugging
2025-07-11 10:48:24 -03:00
vitor-aignosi
31a1d5bf4e SIENTIAPDE-1148
refactor: update Temporal configuration keys in activities.py and temporal_manager.py for consistency and clarity
2025-07-11 10:44:26 -03:00
vitor-aignosi
7279192343 SIENTIAPDE-1148
refactor: streamline Temporal connection logic in temporal_manager.py and remove redundant logging in worker.py
2025-07-11 10:42:28 -03:00
vitor-aignosi
96af810755 SIENTIAPDE-1148
feat: add logging for Temporal namespace connection in temporal_manager.py
2025-07-11 10:39:08 -03:00
vitor-aignosi
71f0db1c60 SIENTIAPDE-1148
feat: add logging for Temporal namespace connection in worker.py
2025-07-11 10:38:13 -03:00
vitor-aignosi
7f9efa579a SIENTIAPDE-1148
refactor: update temporal configuration and refactor Activities class to support multiple namespaces for improved orchestration
2025-07-11 10:34:40 -03:00
vitor-aignosi
dfd77c1768 SIENTIAPDE-1141
fix: set RPC timeout to 60 seconds in temporal_manager.py for improved schedule description handling
2025-07-10 16:32:58 -03:00
vitor-aignosi
351fce905a SIENTIAPDE-1141
fix: increase sleep duration in temporal_manager.py to improve schedule processing efficiency
2025-07-10 16:29:01 -03:00
vitor-aignosi
861cfde9ef SIENTIAPDE-1141
fix: adjust execution counts and reduce sleep duration in test.ipynb and temporal_manager.py for improved performance
2025-07-10 15:42:38 -03:00
vitor-aignosi
bb5d0f15f9 SIENTIAPDE-1141
fix: update host configuration and execution counts in test.ipynb; refactor schedule creation parameters in orchestrator
2025-07-09 16:22:15 -03:00
vitor-aignosi
4df1b0240a SIENTIAPDE-1141
refactor: remove commented-out code and improve timeout settings in orchestrator.py and test_activities.py
2025-07-09 13:00:05 -03:00
vitor-aignosi
c92017345d SIENTIAPDE-1141
fix: increase start_to_close_timeout in orchestrator.py to improve workflow execution duration
2025-07-09 12:52:48 -03:00
vitor-aignosi
68c7e2cf3b SIENTIAPDE-1141
fix: increase sleep duration in temporal_manager to enhance schedule processing efficiency
2025-07-09 12:50:26 -03:00
vitor-aignosi
545929c618 SIENTIAPDE-1141
feat: add asynchronous sleep in temporal_manager to improve schedule processing
2025-07-09 12:33:12 -03:00
vitor-aignosi
9d63647cf1 SIENTIAPDE-1141
Update GITHUB_BRANCH in values.yaml and enhance debug logging in temporal_manager.py
2025-07-09 12:24:27 -03:00
vitor-aignosi
a173f4d451 SIENTIAPDE-1141
Update GITHUB_BRANCH in values.yaml and add debug logging for schedule ID in temporal_manager.py
2025-07-09 12:18:57 -03:00
vitor-aignosi
a848f20c6b SIENTIAPDE-1110
fix: handle missing input filters in predictions_batch function
2025-07-07 15:56:33 -03:00
vitor-aignosi
f7f95d3148 SIENTIAPDE-1110
Update GITHUB_BRANCH and helm version in values.yaml for SIENTIAPDE-1110
2025-07-07 15:50:19 -03:00
vitor-aignosi
0aa58ba1da SIENTIAPDE-1110
SIENTIAPDE-1110 add debug_data_package configuration option to scouter function
2025-07-07 11:03:48 -03:00
vitor-aignosi
f7b73618d8 SIENTIAPDE-1107
feat: implement MongoDB integration with clear_mongo_id function and related tests
2025-06-16 16:01:20 -03:00
vitor-aignosi
7984cb29f4 SIENTIAPDE-1107
fix: remove unused imports from connectors_config.py
2025-06-16 12:39:37 -03:00
vitor-aignosi
3445c7cdf9 SIENTIAPDE-1107
fix: update image tag and environment variables for MongoDB integration
2025-06-16 12:36:05 -03:00
vitor-aignosi
a4e4d3b085 SIENTIAPDE-1107
feat: add MongoDB integration and update configuration for activities
2025-06-16 12:05:56 -03:00
vitor-aignosi
89ac81e5e5 SIENTIAPDE-1095
Fix read_tags access in gather_read_tags function and update samples.json to use write_tags
2025-06-10 08:32:16 -03:00
vitor-aignosi
caa7b125f9 SIENTIAPDE-1095
Refactor predictions_batch to use server_id instead of server_name; update values.yaml to set GITHUB_BRANCH to main; add new laborious pipeline configuration in samples.json
2025-06-10 08:25:50 -03:00
vitor-aignosi
a0d8f96a99 SIENTIAPDE-1095
Fix decoding of active ingestors to handle both bytes and string types
2025-06-09 17:19:53 -03:00
vitor-aignosi
dcbcc70651 fix: update search attribute keys and improve schedule handling
- Changed search attribute key from "Orchestrated" to "orchestrated" in temporal_manager.py and test cases.
- Enhanced logging for schedule creation and updates in temporal_manager.py.
- Updated schedule creation to use workflow_type directly instead of a hardcoded string.
- Modified gather_read_tags function to use server_id instead of server_name for tag identification.
- Adjusted test cases to reflect changes in server_id usage and ensure consistency across tests.
- Fixed model_name retrieval in common_config to access nested models dictionary.
- Updated test cases to align with new data structures and ensure accurate assertions.
2025-06-04 15:06:54 -03:00
vitor-aignosi
5dc49b476a SIENTIAPDE-1030
Add comprehensive tests and utility functions for orchestrator activities

- Introduced tests for the new Formatters class, covering methods for processing schedules and slots.
- Enhanced SlotManager tests with update and delete slot functionalities.
- Added TemporalManager tests for creating, updating, and deleting schedules, including frequency parsing.
- Implemented utility functions for orchestrator operations, including frequency parsing and tag configuration building.
- Created tests for utility functions to ensure correct behavior and integration with orchestrator activities.
- Established a new converters module for parsing frequency strings into seconds.
2025-06-03 17:29:00 -03:00
vitor-aignosi
43e9695849 SIENTIAPDE-1030
Refactor path priority handling in predictions_batch function
2025-05-30 16:26:33 -03:00
vitor-aignosi
4f37b2be02 SIENTIAPDE-1030
Add unit tests for orchestrator activities and workflows

- Implement tests for Activities class, covering initialization and prepare_activity method.
- Create tests for Couchbase class, including successful and failed query loading.
- Add tests for SlotManager class, verifying OPC slot loading and active ingestor retrieval.
- Develop tests for TemporalManager class, focusing on schedule loading functionality.
- Introduce tests for Orchestrator class, ensuring proper execution of workflow activities.
- Establish a new test suite for orchestrator activities and workflows in the tests directory.
2025-05-30 16:24:52 -03:00