gitea_admin/sientia-dataops-scouter_temporal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

SIENTIAPDE-1084

Browse Source 
Refactor README.md to update the Scouter Workflow Architecture flowchart, transitioning to a left-to-right layout for improved readability and clarity in depicting data processing steps and service interactions.
This commit is contained in:
vitor-aignosi
2025-08-29 16:41:09 -03:00
parent 791d8b8be2
commit e573923bdd
1 changed files with 7 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files

23
README.md
View File

@@ -150,23 +150,14 @@ The **CoreScouter** workflow implements the core data processing pipeline for in
#### Architecture
```mermaid
flowchart TB
subgraph workflow [" "]
A[1. data_quality_gate] --> B[2. aggregate_data] --> C[3. group_and_hold_data] --> D[4. export_data_to_postgres] --> E[5. write_metrics]
end
flowchart LR
A[1. data_quality_gate] --> B[2. aggregate_data] --> C[3. group_and_hold_data] --> D[4. export_data_to_postgres] --> E[5. write_metrics]
subgraph services [" "]
Filters[Quality Filters] ~~~ Redis1[(Redis)] ~~~ Redis2[(Redis)] ~~~ PostgreSQL[(PostgreSQL)] ~~~ Metrics[Prometheus]
end
A -.-> Filters
B -.-> Redis1
C -.-> Redis2
D -.-> PostgreSQL
E -.-> Metrics
style workflow fill:none,stroke:none
style services fill:none,stroke:none
A -.-> Filters[Quality Filters]
B -.-> Redis1[(Redis)]
C -.-> Redis2[(Redis)]
D -.-> PostgreSQL[(PostgreSQL)]
E -.-> Metrics[Prometheus]
```
### 3. FakeData Workflow (`fake_data.py`)