gitea_admin/sientia-dataops-opc-ingestor
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
77 Commits 3 Branches 0 Tags
725528de45efcdcf16c1bcc985925f1c27b8cda4
Commit Graph

77 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Matheus Demoner
725528de45 Merge pull request #10 from Aignosi/error-test 
Error test
 2025-07-04 16:13:11 -03:00
vitor-aignosi
be7b0d9d8e Merge branch 'main' into error-test 2025-07-04 11:32:56 -03:00
Bruno Domingues
cfc39d82ab SIENTIAPDE-1111: refactor sonarqube pipeline. 2025-07-04 11:23:50 -03:00
Bruno Domingues
53c262329e SIENTIAPDE-1105: add ServiceMonitor configuration for Prometheus metrics collection. 2025-07-04 11:23:50 -03:00
vitor-aignosi
750d947d7e Update MongoDB connection handling in DataManager and enhance IngestorManager configuration 
- Updated DataManager to simplify MongoDB connection logic by removing retry loop and adding logging for connection attempts.
- Enhanced IngestorManager to accept MongoDB connection parameters and export_to_kafka flag as part of its initialization.
- Updated requirements.txt to use the latest version of the sientia-dataops-library.
 2025-07-03 15:35:38 -03:00
vitor-aignosi
28866ac9c8 Update logging in DataManager to use debug level for message skipping and insertion confirmation 
- Changed log level from info to debug for skipping messages to Kafka topic.
- Added debug log for successful message insertion into MongoDB collection.
 2025-07-03 14:13:00 -03:00
vitor-aignosi
b0bbf4cf03 Add EXPORT_TO_KAFKA environment variable and update Ingestor class logic 
- Introduced EXPORT_TO_KAFKA variable in values.yaml to control Kafka export behavior.
- Updated Ingestor class to parse and set the export_to_kafka attribute based on the environment variable.
 2025-07-03 14:10:49 -03:00
vitor-aignosi
cbaa66026c Add support for Kafka export in Ingestor and DataManager classes 
- Introduced EXPORT_TO_KAFKA environment variable in Ingestor class.
- Refactored DataManager to conditionally initialize Kafka producer based on export setting.
- Updated IngestorManager to pass Redis configuration as a dictionary.
- Enhanced error handling and logging for Kafka message publishing.
 2025-07-03 13:45:09 -03:00
vitor-aignosi
682cc338b5 Refactor MongoDB environment variable names in Ingestor class for consistency with updated configuration 2025-07-01 12:52:14 -03:00
vitor-aignosi
c5b23da373 Update MongoDB configuration in values.yaml and enhance Ingestor class to utilize MongoDB connection parameters 2025-07-01 12:31:46 -03:00
vitor-aignosi
d79f882018 Add MongoDB integration to DataManager, switch Python language server to Jedi, and include pymongo in requirements.txt 2025-07-01 12:19:06 -03:00
Bruno Domingues
762b9072dc SIENTIAPDE-1111: refactor sonarqube pipeline. 2025-06-23 12:49:52 -03:00
Bruno Domingues
3f289e8ddd Add ServiceMonitor configuration for Prometheus metrics collection 2025-06-12 09:57:54 -03:00
Bruno Domingues
0f552c97d6 SIENTIAPDE-1105: add ServiceMonitor configuration for Prometheus metrics collection. 2025-06-12 00:31:41 -03:00
vitor-aignosi
0d03141655 Add debug print for exit_signal state in main loop; update GITHUB_BRANCH to error-test 2025-06-11 10:01:27 -03:00
vitor-aignosi
9bbe828296 test 2025-06-11 09:58:14 -03:00
Bruno Domingues
715d6784ea Merge pull request #8 from Aignosi/SIENTIAPDE-988-criar-ingestor-opc 
Sientiapde 988 criar ingestor opc
 2025-06-10 11:14:31 -03:00
vitor-aignosi
38273dab13 Update ingestor_manager.py 2025-06-09 16:48:19 -03:00
vitor-aignosi
5edc2983f7 Merge branch 'main' into SIENTIAPDE-988-criar-ingestor-opc 2025-06-09 16:45:45 -03:00
vitor-aignosi
975c640ea8 SIENTIAPDE-988 
Update NotificationHandler initialization and change GITHUB_BRANCH in values.yaml
 2025-06-09 16:36:29 -03:00
vitor-aignosi
82f3e9358d SIENTIAPDE-988 
Refactor variable naming for clarity and update image tag and service settings in values.yaml
 2025-06-09 16:31:04 -03:00
Matheus Demoner
f8ab32c345 Merge pull request #7 from Aignosi/SIENTIAPDE-1094-atualizar-versao-da-lib 
SIENTIAPDE-1094
 2025-06-09 13:11:01 -03:00
vitor-aignosi
a83d4ac728 SIENTIAPDE-1094 
Refactor test___init__ to remove unnecessary parameters from notification_handler assertion
 2025-06-09 11:30:43 -03:00
vitor-aignosi
1af7e80e5b SIENTIAPDE-1094 
Update settings for language services, adjust simulator port, enhance error handling in ingestor, and refine Redis feeder script
 2025-06-09 08:42:22 -03:00
Bruno Domingues
112d512a02 Bump sientia-module version to 0.0.8. 2025-06-02 16:42:12 -03:00
Bruno Domingues
6dc304d73d SIENTIAPDE-1083: fix app test 2. 2025-05-30 13:21:53 -03:00
Bruno Domingues
7f9d9aeba5 SIENTIAPDE-1083: fix app test. 2025-05-30 12:40:47 -03:00
Bruno Domingues
d7ba8a4ab4 SIENTIAPDE-1083: add env HTTP_SERVER_PORT for prometheus metrics. 2025-05-30 12:30:51 -03:00
Matheus Demoner
36d12bdda8 Merge pull request #6 from Aignosi/feature/SIENTIAPDE-1083 
SIENTIAPDE-1083: Add prometheus metrics
 2025-05-30 12:08:15 -03:00
Bruno Domingues
0fe2343891 SIENTIAPDE-1083: add prometheus metrics to ingestor_manager. 2025-05-29 17:47:53 -03:00
Bruno Domingues
c49f04ded6 SIENTIAPDE-1083: add prometheus metrics to opc_manager. 2025-05-29 16:52:10 -03:00
Bruno Domingues
03ed5784b1 SIENTIAPDE-1083: add prometheus metrics to resource_manager. 2025-05-29 11:38:57 -03:00
Bruno Domingues
f71b4c7937 SIENTIAPDE-1083: add prometheus metrics to data_manager. 2025-05-28 21:30:28 -03:00
Bruno Domingues
8e332da597 SIENTIAPDE-1083: add prometheus metrics to ingestor. 2025-05-28 17:54:44 -03:00
Bruno Domingues
fff52acf79 SIENTIAPDE-1083: add unit tests for app.py. 2025-05-28 16:15:57 -03:00
Bruno Domingues
12e9151b74 SIENTIAPDE-1083: add unit tests for metrics.py. 2025-05-28 15:42:58 -03:00
Bruno Domingues
14c71580e0 SIENTIAPDE-1083: add prometheus and app metrics. 2025-05-28 14:47:52 -03:00
Matheus Demoner
03470872fa Merge pull request #5 from Aignosi/SIENTIAPDE-1073-complementar-a-doc-do-ingestor-com-instrucoes-de-execucao 
SIENTIAPDE-1075
 2025-05-22 10:11:05 -03:00
vitor-aignosi
861101ffc6 SIENTIAPDE-1075 
Add run instructions for the Ingestor
 2025-05-22 10:06:03 -03:00
Matheus Demoner
8b2e158f72 Merge pull request #4 from Aignosi/SIENTIAPDE-1049-lidar-com-erros-de-reconexao-no-ingestor-opc 
Sientiapde 1049 lidar com erros de reconexao no ingestor opc
 2025-05-21 13:09:36 -03:00
vitor-aignosi
26356c05dd final adjust in replicaCount 2025-05-21 09:46:38 -03:00
vitor-aignosi
019dc33fc9 subscribe fix 2025-05-21 09:46:38 -03:00
vitor-aignosi
2612148455 lease fix 2025-05-21 09:46:38 -03:00
vitor-aignosi
c7dbe3585b SIENTIAPDE-1049 
Update ingestor and data manager for improved shutdown handling and logging

- Incremented project version in quality gate configuration.
- Commented out ingestor service in docker-compose for clarity.
- Enhanced main loop in app.py to handle exit signals and exceptions.
- Added shutdown methods in Ingestor and DataManager classes for graceful resource cleanup.
- Updated unit tests to validate shutdown behavior and exception handling.
- Introduced coverage configuration to omit specific files.
 2025-05-21 09:46:38 -03:00
vitor-aignosi
92ed3c9cb2 SIENTIAPDE-1049 
Fix
 2025-05-21 09:46:38 -03:00
vitor-aignosi
2fa1d2175e SIENTIAPDE-1049 
Stability fix try
 2025-05-21 09:46:38 -03:00
vitor-aignosi
1fa6558986 SIENTIAPDE-1049 
Integrity fix
 2025-05-21 09:46:38 -03:00
vitor-aignosi
39530f115e SIENTIAPDE-1049 
Integrity fix
 2025-05-21 09:46:38 -03:00
vitor-aignosi
b03fe75753 SIENTIAPDE-1049 
Handling size change
 2025-05-21 09:46:38 -03:00
vitor-aignosi
bb4ab7d209 SIENTIAPDE-1049 
Refactor logging statements for consistency and clarity; update environment variable parsing to handle string inputs.
 2025-05-21 09:46:38 -03:00