gitea_admin/sientia-dataops-scouter_temporal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

SIENTIAPDE-1110

Browse Source 
Add new activities to worker.py for data management: load_latest_data, get_last_data_timestamp, and put_last_data_timestamp.
This commit is contained in:
vitor-aignosi
2025-07-01 15:16:55 -03:00
parent 97d66ed6cd
commit 51f4eb1435
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
scouter/worker/worker.py
View File

@@ -70,6 +70,9 @@ async def main():
task_queue='scouter-queue', task_queue='scouter-queue',
workflows=[Scouter, CoreScouter], workflows=[Scouter, CoreScouter],
activities=[ activities=[
activities.load_latest_data,
activities.get_last_data_timestamp,
activities.put_last_data_timestamp,
activities.load_from_kafka, activities.load_from_kafka,
activities.data_quality_gate, activities.data_quality_gate,
activities.aggregate_data, activities.aggregate_data,