gitea_admin/sientia-dataops-scouter_temporal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

SIENTIAPDE-1084

Browse Source 
Update README.md to revise the Scouter Workflow Architecture flowchart, replacing outdated steps with a new data processing sequence that includes data quality checks, aggregation, and metrics writing, enhancing clarity on system operations and service interactions.
This commit is contained in:
vitor-aignosi
2025-08-29 16:39:31 -03:00
parent 6c22b00d5f
commit 791d8b8be2
1 changed files with 6 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
README.md
View File

@@ -152,17 +152,18 @@ The **CoreScouter** workflow implements the core data processing pipeline for in
```mermaid ```mermaid
flowchart TB flowchart TB
subgraph workflow [" "] subgraph workflow [" "]
A[1. get_last_data_timestamp] --> B[2. load_latest_data] --> C[3. put_last_data_timestamp] --> D[4. core_scouter ⬛] A[1. data_quality_gate] --> B[2. aggregate_data] --> C[3. group_and_hold_data] --> D[4. export_data_to_postgres] --> E[5. write_metrics]
end end
subgraph services [" "] subgraph services [" "]
Redis1[(Redis)] ~~~ MongoDB[(MongoDB)] ~~~ Redis2[(Redis)] ~~~ CoreOut[Output] Filters[Quality Filters] ~~~ Redis1[(Redis)] ~~~ Redis2[(Redis)] ~~~ PostgreSQL[(PostgreSQL)] ~~~ Metrics[Prometheus]
end end
A -.-> Redis1 A -.-> Filters
B -.-> MongoDB B -.-> Redis1
C -.-> Redis2 C -.-> Redis2
D -.-> CoreOut D -.-> PostgreSQL
E -.-> Metrics
style workflow fill:none,stroke:none style workflow fill:none,stroke:none
style services fill:none,stroke:none style services fill:none,stroke:none