Commit Graph

280 Commits

Author SHA1 Message Date
vitor-aignosi
08e28441dc SIENTIAPDE-1646
Update helm upgrade command version in values.yaml from 0.6.0 to 0.6.5 for sientia-orchestrator-worker.
2026-05-25 10:00:12 -03:00
vitor-aignosi
5e918b458c SIENTIAPDE-1646
Update GITHUB_BRANCH in values.yaml to feature/SIENTIAPDE-1646, refactor mongo_db.py for cleaner code, and enhance worker.py by adding missing commas for improved syntax consistency.
2026-05-22 16:26:52 -03:00
vitor-aignosi
474c2ef42c SIENTIAPDE-1646
Enhance orchestration configuration and documentation. Added `RUNTIME` variable to `.env.example`, updated `.gitignore` to exclude `openspec/` and `.cursor/`, and modified `README.md` to clarify queue naming conventions and runtime handling. Refactored activities to use synchronous database and email handling, improving performance and consistency. Updated test cases to reflect these changes and ensure compatibility with new activity definitions.
2026-05-22 15:02:16 -03:00
vitor-aignosi
4d5231ca16 SIENTIAPDE-1712
Add 'on_conflict' parameter to multiple test cases in test_orchestrator_functions.py for improved error handling consistency.
2026-04-01 13:53:53 -03:00
vitor-aignosi
c4f221438b SIENTIAPDE-1712
Update GITHUB_BRANCH in values.yaml to fix/SIENTIAPDE-1712 for alignment with the latest bug fix efforts.
2026-03-27 14:53:55 -03:00
vitor-aignosi
d0c37542f7 Merge branch 'main' into fix/SIENTIAPDE-1712 2026-03-27 14:11:17 -03:00
vitor-aignosi
e7705964d5 SIENTIAPDE-1712
Fix error model retrieval in notification_generator.ipynb and add on_conflict parameter to common_config in orchestrator_functions.py for improved error handling.
2026-03-27 14:09:48 -03:00
vitor-aignosi
e5a685eb90 Merge pull request #33 from Aignosi/feature/SIENTIAPDE-1478
SIENTIAPDE-1478: Orchestration Platform Enhancements, Worker Refactoring, and Documentation Updates
2026-01-23 13:48:12 -03:00
vitor-aignosi
4f5832cfb3 SIENTIAPDE-1478
Update sientia-dataops-library dependency to version 1.8.2 in requirements.txt
2026-01-23 13:10:16 -03:00
vitor-aignosi
7f8105dd1e SIENTIAPDE-1478
Fix spelling errors in poller behavior parameters in prepare_worker.py for consistency and clarity.
2026-01-21 15:42:36 -03:00
vitor-aignosi
c9e3a15515 SIENTIAPDE-1478
Update sonar-project.properties to broaden coverage exclusions for worker files, enhancing code quality analysis.
2026-01-19 10:14:36 -03:00
vitor-aignosi
ba73bb7e9d SIENTIAPDE-1478
Add xgboost functions to schedule_types in formatters.py for enhanced orchestration capabilities
2026-01-15 11:08:48 -03:00
vitor-aignosi
5c9a7948de SIENTIAPDE-1478
Update init_orchestration.ipynb to reset execution counts and handle ScheduleAlreadyRunningError, ensuring proper error management during schedule creation. Modify values.yaml to change GITHUB_BRANCH to feature/SIENTIAPDE-1478 for alignment with ongoing feature development.
2026-01-09 14:21:23 -03:00
vitor-aignosi
a46eaa2367 SIENTIAPDE-1478
Reintroduce prepare_worker import in worker.py to maintain consistency in worker setup, ensuring clarity and proper initialization for orchestrator workflows.
2026-01-09 12:36:21 -03:00
vitor-aignosi
9079003100 SIENTIAPDE-1478
Refactor worker initialization by introducing prepare_worker function to streamline worker setup for orchestrator, alerts, and reports workflows, enhancing code clarity and maintainability.
2026-01-09 12:35:41 -03:00
vitor-aignosi
4925b2b2be SIENTIAPDE-1478
Update sientia-dataops-library dependency to version 1.8.0 in requirements.txt
2026-01-09 10:05:36 -03:00
vitor-aignosi
3083c5edc4 SIENTIAPDE-1478
Update version in init_orchestration.ipynb to 3.11.14 and enhance README.md with detailed architecture principles, execution flows, and improved filtering mechanisms in workflows. Refactor orchestrator_functions.py for clarity in filter configuration and add support for PI Web API output configuration in predictions_batch. Update tests to reflect new configurations.
2026-01-09 09:56:50 -03:00
vitor-aignosi
baca5fd5ce Merge pull request #32 from Aignosi/fix/SIENTIAPDE-1461
Enhance Kubernetes Chart Configuration and Update sientia-dataops-library
2026-01-06 11:56:38 -03:00
vitor-aignosi
4a6664f9e1 SIENTIAPDE-1461
SIENTIAPDE-1461 Update values.yaml to configure resource limits and requests, enhance liveness and readiness probes, and set PYPI_SERVER environment variable for improved application performance and monitoring.
2026-01-06 11:31:04 -03:00
vitor-aignosi
36c5ddfd51 SIENTIAPDE-1461
Update sientia-dataops-library dependency to version 1.7.1 in requirements.txt
2026-01-06 10:39:41 -03:00
vitor-aignosi
bc8820bda9 SIENTIAPDE-1461
Update values.yaml to change image tag to 1.0.0 and update GITHUB_BRANCH to main for improved versioning and alignment with the main development branch.
2026-01-06 10:37:47 -03:00
vitor-aignosi
6de590d2f7 Merge pull request #31 from Aignosi/feature/SIENTIAPDE-1445
Refactor and Enhance Scouter Workflow Processing, Configuration, and Robustness
2025-12-22 15:22:49 -03:00
vitor-aignosi
23c6b06868 SIENTIAPDE-1445
Refactor test cases in test_orchestrator_functions.py to consolidate read_tags structure and enhance clarity in API error handling, improving test robustness and readability.
2025-12-22 14:45:14 -03:00
vitor-aignosi
886c6362ce SIENTIAPDE-1445
Enhance MongoDB activity to handle missing topic configurations gracefully by using get() method and skipping empty collections, improving robustness in pipeline processing.
2025-12-18 12:16:37 -03:00
vitor-aignosi
5d2d297aa2 SIENTIAPDE-1445
Refactor tag processing in pi_web_api_scouter function to improve clarity by renaming variables and enhancing readability of the configuration handling.
2025-12-18 11:58:14 -03:00
vitor-aignosi
882f3b4de7 SIENTIAPDE-1445
Refactor values.yaml to comment out email configuration settings for improved security and clarity. Update orchestrator_functions.py to enhance tag processing by iterating over items in read_tags, improving code readability.
2025-12-18 11:51:43 -03:00
vitor-aignosi
381b585c7a SIENTIAPDE-1445
Refactor gather_read_tags function to remove logger parameter and associated logging statements, streamlining the function for improved clarity and focus on processing pipelines.
2025-12-18 11:34:31 -03:00
vitor-aignosi
97792e36e5 SIENTIAPDE-1445
Refactor gather_read_tags function to accept a logger parameter and replace print statements with structured logging for improved traceability.
2025-12-18 11:32:05 -03:00
vitor-aignosi
4a672745c5 SIENTIAPDE-1445
Add debug print statement in gather_read_tags function to log workflow type and read tags for better traceability.
2025-12-18 11:29:33 -03:00
vitor-aignosi
38684071a5 SIENTIAPDE-1445
Filter gather_read_tags to process only 'scouter' workflow types and add corresponding unit tests to validate this behavior.
2025-12-18 11:21:55 -03:00
vitor-aignosi
c98469efd2 SIENTIAPDE-1445
Update GITHUB_BRANCH to feature/SIENTIAPDE-1445 and enhance formatters with a new registry for workflow types, improving configuration management. Refactor process_schedules to utilize the new registry and add error handling for unsupported workflow types. Update tests to validate new functionality and ensure proper integration.
2025-12-18 10:55:29 -03:00
vitor-aignosi
446da4f897 Merge branch 'main' into feature/SIENTIAPDE-1445 2025-12-18 10:03:09 -03:00
vitor-aignosi
61d4b23e69 SIENTIAPDE-1445
SIENTIAPDE-1273 Add base_scouter and pi_web_api_scouter functions to orchestrator utilities for enhanced configuration management. Update tests to validate new functionalities and ensure proper integration with existing workflows.
2025-12-18 10:02:47 -03:00
Matheus Demoner
bfc6991a8f Merge pull request #30 from Aignosi/feature/SIENTIAPDE-1273
SIENTIAPDE-1273: Implement Drift Monitoring, Simple Metrics, and Enhanced Scheduling
2025-11-19 16:55:38 -03:00
vitor-aignosi
62e7a7dee9 SIENTIAPDE-1273
SIENTIAPDE-1273 Add 'save_transform' and 'transform_table_name' parameters to predictions_batch function for enhanced data processing capabilities. Update corresponding test cases to reflect these changes.
2025-11-19 08:12:08 -03:00
vitor-aignosi
81732d1409 SIENTIAPDE-1273
Update image tag in values.yaml from 0.5.0 to 0.5.2 for version consistency.
2025-11-18 09:20:11 -03:00
vitor-aignosi
fdd859de5a SIENTIAPDE-1273
Enhance orchestrator utilities and activities with improved documentation and functionality. Update README to reflect new orchestrator functions for drift and simple metrics workflows. Refactor email, formatters, mongo_db, slot_manager, and temporal_manager activities to include detailed docstrings and improve clarity on input parameters and return values. Ensure consistent metadata handling across activities for better logging and tracking.
2025-11-17 16:30:29 -03:00
vitor-aignosi
2f06036d0e SIENTIAPDE-1273
SIENTIAPDE-1273 Refactor drift function in orchestrator utilities for improved configuration and update formatters to include drift import. Enhance tests to validate new configurations and ensure integration with existing workflows.
2025-11-17 12:57:17 -03:00
vitor-aignosi
7d0c23acb6 SIENTIAPDE-1273
Update sientia-dataops-library dependency to version 1.6.1 and add target_table_name to simple_metrics configuration for enhanced metrics tracking.
2025-11-17 10:47:40 -03:00
vitor-aignosi
7b28424a34 SIENTIAPDE-1273
Implement simple metrics configuration in formatters and orchestrator utilities. Update tests to validate new simple metrics functionality and ensure proper integration with existing workflows.
2025-11-14 15:55:06 -03:00
vitor-aignosi
5cc7667fbc SIENTIAPDE-1273
Update GITHUB_BRANCH to feature/SIENTIAPDE-1273 and increment Helm chart version to 0.6.0. Enhance TemporalManager to include offset in schedule intervals for improved scheduling flexibility.
2025-11-14 12:20:36 -03:00
vitor-aignosi
c9b5e98726 SIENTIAPDE-1273
Implement drift monitoring configuration and update formatters to support drift workflows. Add drift function to orchestrator utilities and enhance tests for drift functionality.
2025-11-14 09:22:24 -03:00
vitor-aignosi
b45aa33188 Merge pull request #29 from Aignosi/feature/SIENTIAPDE-1325-adicionar-metricas-especificas-de-operacoes-externas
SIENTIAPDE-1325: Refactor Activities, Remove Couchbase, Update Release Workflow and Dependencies
2025-11-10 10:09:36 -03:00
vitor-aignosi
92e87530b8 SIENTIAPDE-1325
SIENTIAPDE-1325 Update release workflow to trigger only on merged pull requests and adjust timestamp formatting in tests for consistency.
2025-11-10 09:51:06 -03:00
vitor-aignosi
4faa7141e7 SIENTIAPDE-1325
Update import statements in mongo_db.py to include DATETIME_FORMAT_WITH_TZ for consistent timestamp formatting in data filtering.
2025-11-06 14:06:22 -03:00
vitor-aignosi
aafc6d27d2 SIENTIAPDE-1325
Update image tag to 0.5.0 in values.yaml and change GITHUB_BRANCH to feature/SIENTIAPDE-1325 for specific external operation metrics. Remove unused timestamp formatting in mongo_db.py to streamline data handling.
2025-11-06 13:57:56 -03:00
vitor-aignosi
acde9475ec SIENTIAPDE-1325
Remove unused Couchbase configurations and related code. Refactor Activities class to eliminate Couchbase dependency, updating initialization and shutdown methods. Update README and tests to reflect these changes. Upgrade sientia-dataops-library dependency version in requirements.txt.
2025-11-06 10:45:23 -03:00
Matheus Demoner
f099366bed Merge pull request #28 from Aignosi/fix/SIENTIAPDE-1314-ajustes-nas-camadas-de-monitoramento-do-sientia
Refactor Quality Gate Workflow for Enhanced Configuration and Streamlined Analysis
2025-10-27 14:26:50 -03:00
vitor-aignosi
1e6616cfc2 SIENTIAPDE-1314
Refactor workflow calls to use subworkflow naming convention for load_notification_package and process_notifications in alerts and reports modules. Update corresponding tests to reflect these changes.
2025-10-27 10:24:16 -03:00
vitor-aignosi
de08468dbe SIENTIAPDE-1314
Update GITHUB_BRANCH in values.yaml to fix/SIENTIAPDE-1314 for adjustments in monitoring layers.
2025-10-24 10:14:53 -03:00