cf3a367794
SIENTIAPDE-1646 SIENTIAPDE-1646: Refactor TemporalManager by extracting schedule update and task queue name building logic into dedicated helper methods.
vitor-aignosi
2026-07-21 11:12:11 -03:00
a4b6f6aa88
SIENTIAPDE-1646 SIENTIAPDE-1646: Remove validate.sh script, refactor TemporalManager for improved readability, and update temporal schedule tests to explicitly define workflow types and align task queue naming conventions.
vitor-aignosi
2026-07-21 10:17:30 -03:00
7b845a7de4
SIENTIAPDE-1646 SIENTIAPDE-1646: Update quality gate workflow to use dataops-module template.
vitor-aignosi
2026-07-21 09:58:02 -03:00
292e84236c
SIENTIAPDE-1646 SIENTIAPDE-1646: Configure quality gate workflow to use requirements-local.txt for dependency scanning.
vitor-aignosi
2026-07-21 09:53:35 -03:00
233a771e36
SIENTIAPDE-1646 SIENTIAPDE-1646 Update RUNTIME_WORKFLOWS in TemporalManager to include 'drift' and 'simple_metrics', expanding workflow capabilities and enhancing orchestration functionality.
vitor-aignosi
2026-06-11 09:44:20 -03:00
c1e399894a
SIENTIAPDE-1646 SIENTIAPDE-1646 Update RUNTIME_WORKFLOWS in TemporalManager to include 'minimal_retrain', enhancing workflow capabilities.
vitor-aignosi
2026-06-10 14:12:34 -03:00
b0f9a1abe4
SIENTIAPDE-1646 Update helm upgrade command version in values.yaml from 0.6.5 to 0.6.6 for sientia-orchestrator-worker.
vitor-aignosi
2026-05-25 16:37:35 -03:00
7b925069ac
SIENTIAPDE-1646 SIENTIAPDE-1646 Update TemporalManager to consistently assign task queues for runtime workflows, enhancing schedule creation logic and ensuring proper handling of runtime names.
vitor-aignosi
2026-05-25 14:46:50 -03:00
7413b70957
Merge branch 'feature/SIENTIAPDE-1646' of github.com:Aignosi/sientia-dataops-orchestrator_temporal into feature/SIENTIAPDE-1646
vitor-aignosi
2026-05-25 10:13:03 -03:00
feca52a357
SIENTIAPDE-1646 SIENTIAPDE-1646 Add support for runtime workflows in TemporalManager by introducing RUNTIME_WORKFLOWS constant and updating schedule creation logic to handle runtime names appropriately.
vitor-aignosi
2026-05-25 10:12:50 -03:00
30d558c299
Merge branch 'main' into feature/SIENTIAPDE-1646
vitor-aignosi
2026-05-25 10:04:30 -03:00
08e28441dc
SIENTIAPDE-1646 Update helm upgrade command version in values.yaml from 0.6.0 to 0.6.5 for sientia-orchestrator-worker.
vitor-aignosi
2026-05-25 10:00:12 -03:00
5e918b458c
SIENTIAPDE-1646 Update GITHUB_BRANCH in values.yaml to feature/SIENTIAPDE-1646, refactor mongo_db.py for cleaner code, and enhance worker.py by adding missing commas for improved syntax consistency.
vitor-aignosi
2026-05-22 16:26:52 -03:00
474c2ef42c
SIENTIAPDE-1646 Enhance orchestration configuration and documentation. Added RUNTIME variable to .env.example, updated .gitignore to exclude openspec/ and .cursor/, and modified README.md to clarify queue naming conventions and runtime handling. Refactored activities to use synchronous database and email handling, improving performance and consistency. Updated test cases to reflect these changes and ensure compatibility with new activity definitions.
vitor-aignosi
2026-05-22 15:02:16 -03:00
4d5231ca16
SIENTIAPDE-1712 Add 'on_conflict' parameter to multiple test cases in test_orchestrator_functions.py for improved error handling consistency.
vitor-aignosi
2026-04-01 13:53:53 -03:00
c4f221438b
SIENTIAPDE-1712 Update GITHUB_BRANCH in values.yaml to fix/SIENTIAPDE-1712 for alignment with the latest bug fix efforts.
vitor-aignosi
2026-03-27 14:53:55 -03:00
d0c37542f7
Merge branch 'main' into fix/SIENTIAPDE-1712
vitor-aignosi
2026-03-27 14:11:17 -03:00
e7705964d5
SIENTIAPDE-1712 Fix error model retrieval in notification_generator.ipynb and add on_conflict parameter to common_config in orchestrator_functions.py for improved error handling.
vitor-aignosi
2026-03-27 14:09:48 -03:00
4f5832cfb3
SIENTIAPDE-1478 Update sientia-dataops-library dependency to version 1.8.2 in requirements.txt
vitor-aignosi
2026-01-23 13:10:16 -03:00
7f8105dd1e
SIENTIAPDE-1478 Fix spelling errors in poller behavior parameters in prepare_worker.py for consistency and clarity.
vitor-aignosi
2026-01-21 15:42:36 -03:00
c9e3a15515
SIENTIAPDE-1478 Update sonar-project.properties to broaden coverage exclusions for worker files, enhancing code quality analysis.
vitor-aignosi
2026-01-19 10:14:36 -03:00
ba73bb7e9d
SIENTIAPDE-1478 Add xgboost functions to schedule_types in formatters.py for enhanced orchestration capabilities
vitor-aignosi
2026-01-15 11:08:48 -03:00
5c9a7948de
SIENTIAPDE-1478 Update init_orchestration.ipynb to reset execution counts and handle ScheduleAlreadyRunningError, ensuring proper error management during schedule creation. Modify values.yaml to change GITHUB_BRANCH to feature/SIENTIAPDE-1478 for alignment with ongoing feature development.
vitor-aignosi
2026-01-09 14:21:23 -03:00
a46eaa2367
SIENTIAPDE-1478 Reintroduce prepare_worker import in worker.py to maintain consistency in worker setup, ensuring clarity and proper initialization for orchestrator workflows.
vitor-aignosi
2026-01-09 12:36:21 -03:00
9079003100
SIENTIAPDE-1478 Refactor worker initialization by introducing prepare_worker function to streamline worker setup for orchestrator, alerts, and reports workflows, enhancing code clarity and maintainability.
vitor-aignosi
2026-01-09 12:35:41 -03:00
4925b2b2be
SIENTIAPDE-1478 Update sientia-dataops-library dependency to version 1.8.0 in requirements.txt
vitor-aignosi
2026-01-09 10:05:36 -03:00
3083c5edc4
SIENTIAPDE-1478 Update version in init_orchestration.ipynb to 3.11.14 and enhance README.md with detailed architecture principles, execution flows, and improved filtering mechanisms in workflows. Refactor orchestrator_functions.py for clarity in filter configuration and add support for PI Web API output configuration in predictions_batch. Update tests to reflect new configurations.
vitor-aignosi
2026-01-09 09:56:50 -03:00
4a6664f9e1
SIENTIAPDE-1461 SIENTIAPDE-1461 Update values.yaml to configure resource limits and requests, enhance liveness and readiness probes, and set PYPI_SERVER environment variable for improved application performance and monitoring.
vitor-aignosi
2026-01-06 11:31:04 -03:00
36c5ddfd51
SIENTIAPDE-1461 Update sientia-dataops-library dependency to version 1.7.1 in requirements.txt
vitor-aignosi
2026-01-06 10:39:41 -03:00
bc8820bda9
SIENTIAPDE-1461 Update values.yaml to change image tag to 1.0.0 and update GITHUB_BRANCH to main for improved versioning and alignment with the main development branch.
vitor-aignosi
2026-01-06 10:37:47 -03:00
23c6b06868
SIENTIAPDE-1445 Refactor test cases in test_orchestrator_functions.py to consolidate read_tags structure and enhance clarity in API error handling, improving test robustness and readability.
vitor-aignosi
2025-12-22 14:45:14 -03:00
886c6362ce
SIENTIAPDE-1445 Enhance MongoDB activity to handle missing topic configurations gracefully by using get() method and skipping empty collections, improving robustness in pipeline processing.
vitor-aignosi
2025-12-18 12:16:37 -03:00
5d2d297aa2
SIENTIAPDE-1445 Refactor tag processing in pi_web_api_scouter function to improve clarity by renaming variables and enhancing readability of the configuration handling.
vitor-aignosi
2025-12-18 11:58:14 -03:00
882f3b4de7
SIENTIAPDE-1445 Refactor values.yaml to comment out email configuration settings for improved security and clarity. Update orchestrator_functions.py to enhance tag processing by iterating over items in read_tags, improving code readability.
vitor-aignosi
2025-12-18 11:51:43 -03:00
381b585c7a
SIENTIAPDE-1445 Refactor gather_read_tags function to remove logger parameter and associated logging statements, streamlining the function for improved clarity and focus on processing pipelines.
vitor-aignosi
2025-12-18 11:34:31 -03:00
97792e36e5
SIENTIAPDE-1445 Refactor gather_read_tags function to accept a logger parameter and replace print statements with structured logging for improved traceability.
vitor-aignosi
2025-12-18 11:32:05 -03:00
4a672745c5
SIENTIAPDE-1445 Add debug print statement in gather_read_tags function to log workflow type and read tags for better traceability.
vitor-aignosi
2025-12-18 11:29:33 -03:00
38684071a5
SIENTIAPDE-1445 Filter gather_read_tags to process only 'scouter' workflow types and add corresponding unit tests to validate this behavior.
vitor-aignosi
2025-12-18 11:21:55 -03:00
c98469efd2
SIENTIAPDE-1445 Update GITHUB_BRANCH to feature/SIENTIAPDE-1445 and enhance formatters with a new registry for workflow types, improving configuration management. Refactor process_schedules to utilize the new registry and add error handling for unsupported workflow types. Update tests to validate new functionality and ensure proper integration.
vitor-aignosi
2025-12-18 10:55:29 -03:00
446da4f897
Merge branch 'main' into feature/SIENTIAPDE-1445
vitor-aignosi
2025-12-18 10:03:09 -03:00
61d4b23e69
SIENTIAPDE-1445 SIENTIAPDE-1273 Add base_scouter and pi_web_api_scouter functions to orchestrator utilities for enhanced configuration management. Update tests to validate new functionalities and ensure proper integration with existing workflows.
vitor-aignosi
2025-12-18 10:02:47 -03:00
62e7a7dee9
SIENTIAPDE-1273 SIENTIAPDE-1273 Add 'save_transform' and 'transform_table_name' parameters to predictions_batch function for enhanced data processing capabilities. Update corresponding test cases to reflect these changes.
vitor-aignosi
2025-11-19 08:12:08 -03:00
81732d1409
SIENTIAPDE-1273 Update image tag in values.yaml from 0.5.0 to 0.5.2 for version consistency.
vitor-aignosi
2025-11-18 09:20:11 -03:00
fdd859de5a
SIENTIAPDE-1273 Enhance orchestrator utilities and activities with improved documentation and functionality. Update README to reflect new orchestrator functions for drift and simple metrics workflows. Refactor email, formatters, mongo_db, slot_manager, and temporal_manager activities to include detailed docstrings and improve clarity on input parameters and return values. Ensure consistent metadata handling across activities for better logging and tracking.
vitor-aignosi
2025-11-17 16:30:29 -03:00
2f06036d0e
SIENTIAPDE-1273 SIENTIAPDE-1273 Refactor drift function in orchestrator utilities for improved configuration and update formatters to include drift import. Enhance tests to validate new configurations and ensure integration with existing workflows.
vitor-aignosi
2025-11-17 12:57:17 -03:00
7d0c23acb6
SIENTIAPDE-1273 Update sientia-dataops-library dependency to version 1.6.1 and add target_table_name to simple_metrics configuration for enhanced metrics tracking.
vitor-aignosi
2025-11-17 10:47:40 -03:00
7b28424a34
SIENTIAPDE-1273 Implement simple metrics configuration in formatters and orchestrator utilities. Update tests to validate new simple metrics functionality and ensure proper integration with existing workflows.
vitor-aignosi
2025-11-14 15:55:06 -03:00
5cc7667fbc
SIENTIAPDE-1273 Update GITHUB_BRANCH to feature/SIENTIAPDE-1273 and increment Helm chart version to 0.6.0. Enhance TemporalManager to include offset in schedule intervals for improved scheduling flexibility.
vitor-aignosi
2025-11-14 12:20:36 -03:00
c9b5e98726
SIENTIAPDE-1273 Implement drift monitoring configuration and update formatters to support drift workflows. Add drift function to orchestrator utilities and enhance tests for drift functionality.
vitor-aignosi
2025-11-14 09:22:24 -03:00
92e87530b8
SIENTIAPDE-1325 SIENTIAPDE-1325 Update release workflow to trigger only on merged pull requests and adjust timestamp formatting in tests for consistency.
vitor-aignosi
2025-11-10 09:51:06 -03:00
4faa7141e7
SIENTIAPDE-1325 Update import statements in mongo_db.py to include DATETIME_FORMAT_WITH_TZ for consistent timestamp formatting in data filtering.
vitor-aignosi
2025-11-06 14:06:22 -03:00
aafc6d27d2
SIENTIAPDE-1325 Update image tag to 0.5.0 in values.yaml and change GITHUB_BRANCH to feature/SIENTIAPDE-1325 for specific external operation metrics. Remove unused timestamp formatting in mongo_db.py to streamline data handling.
vitor-aignosi
2025-11-06 13:57:56 -03:00
acde9475ec
SIENTIAPDE-1325 Remove unused Couchbase configurations and related code. Refactor Activities class to eliminate Couchbase dependency, updating initialization and shutdown methods. Update README and tests to reflect these changes. Upgrade sientia-dataops-library dependency version in requirements.txt.
vitor-aignosi
2025-11-06 10:45:23 -03:00
1e6616cfc2
SIENTIAPDE-1314 Refactor workflow calls to use subworkflow naming convention for load_notification_package and process_notifications in alerts and reports modules. Update corresponding tests to reflect these changes.
vitor-aignosi
2025-10-27 10:24:16 -03:00
de08468dbe
SIENTIAPDE-1314 Update GITHUB_BRANCH in values.yaml to fix/SIENTIAPDE-1314 for adjustments in monitoring layers.
vitor-aignosi
2025-10-24 10:14:53 -03:00
d5a8de6499
SIENTIAPDE-1314 Refactor quality gate workflow to enhance configuration management and streamline analysis processes. Implement shared templates and improve secret inheritance for better project integration.
vitor-aignosi
2025-10-24 07:48:52 -03:00
ec3ab3c936
Merge pull request #27 from Aignosi/feature/SIENTIAPDE-1327-controle-de-releases
Bruno Domingues
2025-10-23 10:45:55 -03:00
16fd31eccb
SIENTIAPDE-1327 Refactor quality gate workflow to utilize shared template and streamline analysis steps. Inherit secrets and specify project name for improved configuration.
vitor-aignosi
2025-10-23 09:58:39 -03:00
f7ed72ee0c
SIENTIAPDE-1312 Update image tag in values.yaml to 0.4.9; refactor imports in email.py, formatters.py, and mongo_db.py for improved organization and clarity.
vitor-aignosi
2025-10-21 16:38:22 -03:00
6882d085e6
SIENTIAPDE-1312 SIENTIAPDE-1312: Refactor build_tag_config to accept a list of tags and return notifications for missing servers. Update Formatters to handle notifications during slot configuration. Enhance tests to validate new behavior and error reporting.
vitor-aignosi
2025-10-21 08:58:39 -03:00
72fd7b2996
SIENTIAPDE-1312 SIENTIAPDE-1312: Update notification_id in TemporalManager to improve error reporting for schedule normalization failures.
vitor-aignosi
2025-10-20 16:30:29 -03:00
61fea4bb75
SIENTIAPDE-1312 SIENTIAPDE-1312: Add 'fill_missing_tags' configuration option to scouter function for enhanced tag management.
vitor-aignosi
2025-10-20 16:26:39 -03:00
e04c91f6f8
SIENTIAPDE-1312 SIENTIAPDE-1312: Update build_tag_config to ensure minimum frequency defaults to 1000 and convert frequency values to integers for accurate calculations of subscription_period_ms.
vitor-aignosi
2025-10-20 12:47:02 -03:00
1666702d73
SIENTIAPDE-1312 SIENTIAPDE-1312: Update build_tag_config to calculate subscription_period_ms based on minimum frequency from tags. Enhance test_build_tag_config to include frequency and validate subscription_period_ms.
vitor-aignosi
2025-10-20 12:42:20 -03:00
10f54d1c3b
SIENTIAPDE-1312 Update GITHUB_BRANCH in values.yaml to reflect improvements and fixes in data pipelines for SIENTIAPDE-1312.
vitor-aignosi
2025-10-20 10:36:48 -03:00
65dc76209b
SIENTIAPDE-1312 Enhance type hinting in test_orchestrator_functions.py by specifying the type of slot_config as a dictionary for improved code clarity.
vitor-aignosi
2025-10-20 10:27:47 -03:00
b095335cdc
SIENTIAPDE-1312 Update sientia-dataops-library dependency to version 1.4.7 and enhance TemporalManager to support offset configuration for scheduling. Added offset handling in common configuration and updated related tests to validate new functionality.
vitor-aignosi
2025-10-20 10:26:53 -03:00
9031b4c88f
SIENTIAPDE-1231 Enhance README and code documentation for clarity and structure
vitor-aignosi
2025-10-16 10:33:58 -03:00
c9f83186c8
SIENTIAPDE-1231 Remove coverage.xml file to streamline project structure and improve version control management.
vitor-aignosi
2025-10-16 10:16:48 -03:00
6b826863f4
SIENTIAPDE-1231 Enhance type hinting and code structure in orchestrator activities
vitor-aignosi
2025-10-16 08:52:38 -03:00
49f3429556
SIENTIAPDE-1222 SIENTIAPDE-1222 Refactor server configuration handling in orchestrator_functions.py and update related tests
vitor-aignosi
2025-09-24 10:57:38 -03:00
dacbcbf56a
SIENTIAPDE-1222 Update .gitignore to include .env file and ensure git_log is tracked, improving project configuration management.
vitor-aignosi
2025-09-24 10:37:05 -03:00
Eduardo Rios
gitea_admin