SIENTIAPDE-1110

Update Kafka polling time in values.yaml and refactor Kafka subscription in kafka.py to use KafkaConsumer for improved message handling.

scouter/activities/kafka.py

@@ -56,7 +56,14 @@ class Kafka(BaseActivity):
         topic = input_data["topic"]
 
         # Subscribe to the specified topic
-        self.kafka_connector.subscribe([topic])
+        self.kafka_connector = KafkaConsumer(
+            topic,
+            bootstrap_servers=self.bootstrap_servers,
+            auto_offset_reset="earliest",
+            enable_auto_commit=True,
+            group_id=self.group_id,
+            value_deserializer=lambda x: json.loads(x.decode("utf-8"))
+        )
 
         # List to store message values
         message_values = []