gitea_admin/sientia-dataops-scouter_temporal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

SIENTIAPDE-1110

Browse Source 
Update Druid activity to handle None values for last data timestamp, ensuring default timestamp is set to epoch start. Enhance data loading debug logging for improved traceability.
This commit is contained in:
vitor-aignosi
2025-07-02 10:21:55 -03:00
parent 430fe04202
commit 3bbc6a6a79
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
scouter/activities/pydruid.py
View File

@@ -41,6 +41,8 @@ class Druid(BaseActivity):
metadata = input_data['metadata'] metadata = input_data['metadata']
datasource = f"raw_{input_data['schedule_name']}" datasource = f"raw_{input_data['schedule_name']}"
last_data_timestamp = input_data['last_data_timestamp'] last_data_timestamp = input_data['last_data_timestamp']
last_data_timestamp = last_data_timestamp if last_data_timestamp is not None else datetime(
1970, 1, 1, 0, 0, 0)
self.debug( self.debug(
f"Loading data from Druid: {input_data}", metadata=metadata) f"Loading data from Druid: {input_data}", metadata=metadata)