vitor-aignosi b203b7d22c SIENTIAPDE-1005
Implement workflows for fake data generation, scouter processing, and core scouter operations

- Added `FakeData` workflow to generate random data and send it to a Kafka topic.
- Implemented `Scouter` workflow to load data from Kafka and trigger the core scouter workflow.
- Created `CoreScouter` workflow to process data through quality gates, aggregation, and export to PostgreSQL.
- Developed comprehensive unit tests for activities and workflows, ensuring proper functionality and error handling.
- Enhanced Redis and Postgres activities with robust testing for data handling and error notifications.
- Introduced quality filters for data validation and implemented tests to verify their functionality.
2025-05-15 16:53:24 -03:00
2025-05-15 16:53:24 -03:00
2025-05-15 16:53:24 -03:00
2025-05-15 16:53:24 -03:00
2025-05-13 12:09:26 -03:00
2025-05-15 16:53:24 -03:00
2025-05-15 16:53:24 -03:00
2025-05-15 16:53:24 -03:00
2025-05-15 16:53:24 -03:00
2025-05-13 11:59:27 -03:00
2025-05-15 16:53:24 -03:00
2025-05-13 12:09:26 -03:00

sientia-dataops-scouter_temporal

Scouter version in Temporal

Description
No description provided
Readme 903 KiB
Languages
Python 66.8%
Jupyter Notebook 30%
Shell 3.2%