From 791d8b8be2238caa87b6fcd43b681b71c0433e28 Mon Sep 17 00:00:00 2001 From: vitor-aignosi Date: Fri, 29 Aug 2025 16:39:31 -0300 Subject: [PATCH] SIENTIAPDE-1084 Update README.md to revise the Scouter Workflow Architecture flowchart, replacing outdated steps with a new data processing sequence that includes data quality checks, aggregation, and metrics writing, enhancing clarity on system operations and service interactions. --- README.md | 11 ++++++----- 1 file changed, 6 insertions(+), 5 deletions(-) diff --git a/README.md b/README.md index a58fcb5..10e257e 100644 --- a/README.md +++ b/README.md @@ -152,17 +152,18 @@ The **CoreScouter** workflow implements the core data processing pipeline for in ```mermaid flowchart TB subgraph workflow [" "] - A[1. get_last_data_timestamp] --> B[2. load_latest_data] --> C[3. put_last_data_timestamp] --> D[4. core_scouter ⬛] + A[1. data_quality_gate] --> B[2. aggregate_data] --> C[3. group_and_hold_data] --> D[4. export_data_to_postgres] --> E[5. write_metrics] end subgraph services [" "] - Redis1[(Redis)] ~~~ MongoDB[(MongoDB)] ~~~ Redis2[(Redis)] ~~~ CoreOut[Output] + Filters[Quality Filters] ~~~ Redis1[(Redis)] ~~~ Redis2[(Redis)] ~~~ PostgreSQL[(PostgreSQL)] ~~~ Metrics[Prometheus] end - A -.-> Redis1 - B -.-> MongoDB + A -.-> Filters + B -.-> Redis1 C -.-> Redis2 - D -.-> CoreOut + D -.-> PostgreSQL + E -.-> Metrics style workflow fill:none,stroke:none style services fill:none,stroke:none