Commit Graph

280 Commits

Author SHA1 Message Date
Bruno Domingues
0e9608bcd1 SIENTIAPDE-1945: Remove values.yaml Helm configuration file 2026-07-08 22:13:09 -03:00
Bruno Domingues
56e065d59c chore(sonar): Update project key 2026-07-01 21:15:32 -03:00
vitor-aignosi
fa24a2fb85 Merge pull request #34 from Aignosi/fix/SIENTIAPDE-1712
SIENTIAPDE-1712: Enhance Error Handling and Configuration Alignment
2026-04-02 16:20:48 -03:00
vitor-aignosi
4d5231ca16 SIENTIAPDE-1712
Add 'on_conflict' parameter to multiple test cases in test_orchestrator_functions.py for improved error handling consistency.
2026-04-01 13:53:53 -03:00
vitor-aignosi
c4f221438b SIENTIAPDE-1712
Update GITHUB_BRANCH in values.yaml to fix/SIENTIAPDE-1712 for alignment with the latest bug fix efforts.
2026-03-27 14:53:55 -03:00
vitor-aignosi
d0c37542f7 Merge branch 'main' into fix/SIENTIAPDE-1712 2026-03-27 14:11:17 -03:00
vitor-aignosi
e7705964d5 SIENTIAPDE-1712
Fix error model retrieval in notification_generator.ipynb and add on_conflict parameter to common_config in orchestrator_functions.py for improved error handling.
2026-03-27 14:09:48 -03:00
vitor-aignosi
e5a685eb90 Merge pull request #33 from Aignosi/feature/SIENTIAPDE-1478
SIENTIAPDE-1478: Orchestration Platform Enhancements, Worker Refactoring, and Documentation Updates
2026-01-23 13:48:12 -03:00
vitor-aignosi
4f5832cfb3 SIENTIAPDE-1478
Update sientia-dataops-library dependency to version 1.8.2 in requirements.txt
2026-01-23 13:10:16 -03:00
vitor-aignosi
7f8105dd1e SIENTIAPDE-1478
Fix spelling errors in poller behavior parameters in prepare_worker.py for consistency and clarity.
2026-01-21 15:42:36 -03:00
vitor-aignosi
c9e3a15515 SIENTIAPDE-1478
Update sonar-project.properties to broaden coverage exclusions for worker files, enhancing code quality analysis.
2026-01-19 10:14:36 -03:00
vitor-aignosi
ba73bb7e9d SIENTIAPDE-1478
Add xgboost functions to schedule_types in formatters.py for enhanced orchestration capabilities
2026-01-15 11:08:48 -03:00
vitor-aignosi
5c9a7948de SIENTIAPDE-1478
Update init_orchestration.ipynb to reset execution counts and handle ScheduleAlreadyRunningError, ensuring proper error management during schedule creation. Modify values.yaml to change GITHUB_BRANCH to feature/SIENTIAPDE-1478 for alignment with ongoing feature development.
2026-01-09 14:21:23 -03:00
vitor-aignosi
a46eaa2367 SIENTIAPDE-1478
Reintroduce prepare_worker import in worker.py to maintain consistency in worker setup, ensuring clarity and proper initialization for orchestrator workflows.
2026-01-09 12:36:21 -03:00
vitor-aignosi
9079003100 SIENTIAPDE-1478
Refactor worker initialization by introducing prepare_worker function to streamline worker setup for orchestrator, alerts, and reports workflows, enhancing code clarity and maintainability.
2026-01-09 12:35:41 -03:00
vitor-aignosi
4925b2b2be SIENTIAPDE-1478
Update sientia-dataops-library dependency to version 1.8.0 in requirements.txt
2026-01-09 10:05:36 -03:00
vitor-aignosi
3083c5edc4 SIENTIAPDE-1478
Update version in init_orchestration.ipynb to 3.11.14 and enhance README.md with detailed architecture principles, execution flows, and improved filtering mechanisms in workflows. Refactor orchestrator_functions.py for clarity in filter configuration and add support for PI Web API output configuration in predictions_batch. Update tests to reflect new configurations.
2026-01-09 09:56:50 -03:00
vitor-aignosi
baca5fd5ce Merge pull request #32 from Aignosi/fix/SIENTIAPDE-1461
Enhance Kubernetes Chart Configuration and Update sientia-dataops-library
2026-01-06 11:56:38 -03:00
vitor-aignosi
4a6664f9e1 SIENTIAPDE-1461
SIENTIAPDE-1461 Update values.yaml to configure resource limits and requests, enhance liveness and readiness probes, and set PYPI_SERVER environment variable for improved application performance and monitoring.
2026-01-06 11:31:04 -03:00
vitor-aignosi
36c5ddfd51 SIENTIAPDE-1461
Update sientia-dataops-library dependency to version 1.7.1 in requirements.txt
2026-01-06 10:39:41 -03:00
vitor-aignosi
bc8820bda9 SIENTIAPDE-1461
Update values.yaml to change image tag to 1.0.0 and update GITHUB_BRANCH to main for improved versioning and alignment with the main development branch.
2026-01-06 10:37:47 -03:00
vitor-aignosi
6de590d2f7 Merge pull request #31 from Aignosi/feature/SIENTIAPDE-1445
Refactor and Enhance Scouter Workflow Processing, Configuration, and Robustness
2025-12-22 15:22:49 -03:00
vitor-aignosi
23c6b06868 SIENTIAPDE-1445
Refactor test cases in test_orchestrator_functions.py to consolidate read_tags structure and enhance clarity in API error handling, improving test robustness and readability.
2025-12-22 14:45:14 -03:00
vitor-aignosi
886c6362ce SIENTIAPDE-1445
Enhance MongoDB activity to handle missing topic configurations gracefully by using get() method and skipping empty collections, improving robustness in pipeline processing.
2025-12-18 12:16:37 -03:00
vitor-aignosi
5d2d297aa2 SIENTIAPDE-1445
Refactor tag processing in pi_web_api_scouter function to improve clarity by renaming variables and enhancing readability of the configuration handling.
2025-12-18 11:58:14 -03:00
vitor-aignosi
882f3b4de7 SIENTIAPDE-1445
Refactor values.yaml to comment out email configuration settings for improved security and clarity. Update orchestrator_functions.py to enhance tag processing by iterating over items in read_tags, improving code readability.
2025-12-18 11:51:43 -03:00
vitor-aignosi
381b585c7a SIENTIAPDE-1445
Refactor gather_read_tags function to remove logger parameter and associated logging statements, streamlining the function for improved clarity and focus on processing pipelines.
2025-12-18 11:34:31 -03:00
vitor-aignosi
97792e36e5 SIENTIAPDE-1445
Refactor gather_read_tags function to accept a logger parameter and replace print statements with structured logging for improved traceability.
2025-12-18 11:32:05 -03:00
vitor-aignosi
4a672745c5 SIENTIAPDE-1445
Add debug print statement in gather_read_tags function to log workflow type and read tags for better traceability.
2025-12-18 11:29:33 -03:00
vitor-aignosi
38684071a5 SIENTIAPDE-1445
Filter gather_read_tags to process only 'scouter' workflow types and add corresponding unit tests to validate this behavior.
2025-12-18 11:21:55 -03:00
vitor-aignosi
c98469efd2 SIENTIAPDE-1445
Update GITHUB_BRANCH to feature/SIENTIAPDE-1445 and enhance formatters with a new registry for workflow types, improving configuration management. Refactor process_schedules to utilize the new registry and add error handling for unsupported workflow types. Update tests to validate new functionality and ensure proper integration.
2025-12-18 10:55:29 -03:00
vitor-aignosi
446da4f897 Merge branch 'main' into feature/SIENTIAPDE-1445 2025-12-18 10:03:09 -03:00
vitor-aignosi
61d4b23e69 SIENTIAPDE-1445
SIENTIAPDE-1273 Add base_scouter and pi_web_api_scouter functions to orchestrator utilities for enhanced configuration management. Update tests to validate new functionalities and ensure proper integration with existing workflows.
2025-12-18 10:02:47 -03:00
Matheus Demoner
bfc6991a8f Merge pull request #30 from Aignosi/feature/SIENTIAPDE-1273
SIENTIAPDE-1273: Implement Drift Monitoring, Simple Metrics, and Enhanced Scheduling
2025-11-19 16:55:38 -03:00
vitor-aignosi
62e7a7dee9 SIENTIAPDE-1273
SIENTIAPDE-1273 Add 'save_transform' and 'transform_table_name' parameters to predictions_batch function for enhanced data processing capabilities. Update corresponding test cases to reflect these changes.
2025-11-19 08:12:08 -03:00
vitor-aignosi
81732d1409 SIENTIAPDE-1273
Update image tag in values.yaml from 0.5.0 to 0.5.2 for version consistency.
2025-11-18 09:20:11 -03:00
vitor-aignosi
fdd859de5a SIENTIAPDE-1273
Enhance orchestrator utilities and activities with improved documentation and functionality. Update README to reflect new orchestrator functions for drift and simple metrics workflows. Refactor email, formatters, mongo_db, slot_manager, and temporal_manager activities to include detailed docstrings and improve clarity on input parameters and return values. Ensure consistent metadata handling across activities for better logging and tracking.
2025-11-17 16:30:29 -03:00
vitor-aignosi
2f06036d0e SIENTIAPDE-1273
SIENTIAPDE-1273 Refactor drift function in orchestrator utilities for improved configuration and update formatters to include drift import. Enhance tests to validate new configurations and ensure integration with existing workflows.
2025-11-17 12:57:17 -03:00
vitor-aignosi
7d0c23acb6 SIENTIAPDE-1273
Update sientia-dataops-library dependency to version 1.6.1 and add target_table_name to simple_metrics configuration for enhanced metrics tracking.
2025-11-17 10:47:40 -03:00
vitor-aignosi
7b28424a34 SIENTIAPDE-1273
Implement simple metrics configuration in formatters and orchestrator utilities. Update tests to validate new simple metrics functionality and ensure proper integration with existing workflows.
2025-11-14 15:55:06 -03:00
vitor-aignosi
5cc7667fbc SIENTIAPDE-1273
Update GITHUB_BRANCH to feature/SIENTIAPDE-1273 and increment Helm chart version to 0.6.0. Enhance TemporalManager to include offset in schedule intervals for improved scheduling flexibility.
2025-11-14 12:20:36 -03:00
vitor-aignosi
c9b5e98726 SIENTIAPDE-1273
Implement drift monitoring configuration and update formatters to support drift workflows. Add drift function to orchestrator utilities and enhance tests for drift functionality.
2025-11-14 09:22:24 -03:00
vitor-aignosi
b45aa33188 Merge pull request #29 from Aignosi/feature/SIENTIAPDE-1325-adicionar-metricas-especificas-de-operacoes-externas
SIENTIAPDE-1325: Refactor Activities, Remove Couchbase, Update Release Workflow and Dependencies
2025-11-10 10:09:36 -03:00
vitor-aignosi
92e87530b8 SIENTIAPDE-1325
SIENTIAPDE-1325 Update release workflow to trigger only on merged pull requests and adjust timestamp formatting in tests for consistency.
2025-11-10 09:51:06 -03:00
vitor-aignosi
4faa7141e7 SIENTIAPDE-1325
Update import statements in mongo_db.py to include DATETIME_FORMAT_WITH_TZ for consistent timestamp formatting in data filtering.
2025-11-06 14:06:22 -03:00
vitor-aignosi
aafc6d27d2 SIENTIAPDE-1325
Update image tag to 0.5.0 in values.yaml and change GITHUB_BRANCH to feature/SIENTIAPDE-1325 for specific external operation metrics. Remove unused timestamp formatting in mongo_db.py to streamline data handling.
2025-11-06 13:57:56 -03:00
vitor-aignosi
acde9475ec SIENTIAPDE-1325
Remove unused Couchbase configurations and related code. Refactor Activities class to eliminate Couchbase dependency, updating initialization and shutdown methods. Update README and tests to reflect these changes. Upgrade sientia-dataops-library dependency version in requirements.txt.
2025-11-06 10:45:23 -03:00
Matheus Demoner
f099366bed Merge pull request #28 from Aignosi/fix/SIENTIAPDE-1314-ajustes-nas-camadas-de-monitoramento-do-sientia
Refactor Quality Gate Workflow for Enhanced Configuration and Streamlined Analysis
2025-10-27 14:26:50 -03:00
vitor-aignosi
1e6616cfc2 SIENTIAPDE-1314
Refactor workflow calls to use subworkflow naming convention for load_notification_package and process_notifications in alerts and reports modules. Update corresponding tests to reflect these changes.
2025-10-27 10:24:16 -03:00
vitor-aignosi
de08468dbe SIENTIAPDE-1314
Update GITHUB_BRANCH in values.yaml to fix/SIENTIAPDE-1314 for adjustments in monitoring layers.
2025-10-24 10:14:53 -03:00