Commit Graph

215 Commits

Author SHA1 Message Date
vitor-aignosi
c29b06288c Merge pull request #29 from Aignosi/fix/SAM0123-231
Python Dependency Refactor, Local Dev Enhancements, and OPC UA Cert Automation
2026-07-23 14:15:24 -03:00
vitor-aignosi
f75aa322cb SAM0123-231: Remove Kafka configuration and infrastructure references; simplify README documentation. 2026-07-23 13:41:56 -03:00
vitor-aignosi
648458510d SAM0123-231: Remove Kafka integration for data streaming and add comprehensive OPC UA client certificate management. 2026-07-23 13:37:56 -03:00
vitor-aignosi
b10c226e4e SAM0123-231: Remove Kafka integration from Ingestor service. 2026-07-23 12:25:29 -03:00
vitor-aignosi
c157d1649a SAM0123-231: Broaden quality gate workflow to include release and feature branches; correct asynchronous call for OPC server updates in ingestor. 2026-07-23 12:04:13 -03:00
vitor-aignosi
0d9d7b2ebe SAM0123-231: Update quality gate workflow to use requirements.txt for the ingestor project. 2026-07-23 12:00:54 -03:00
vitor-aignosi
675f30c60e SAM0123-231: Update GitHub Actions quality gate workflow to use python-quality-gate template and correct requirements file parameter name. 2026-07-23 11:58:26 -03:00
vitor-aignosi
c209796ffb SAM0123-231: Update sientia-dataops-library dependency to version 1.12.1. 2026-07-23 11:51:55 -03:00
vitor-aignosi
046b4064d3 Merge branch 'main' into fix/SAM0123-231 2026-07-23 11:49:44 -03:00
vitor-aignosi
b9c5380690 SAM0123-231: Refactor Python dependencies to use published sientia_do package, introduce requirements-local.txt for local development and quality gates, and add script for automated OPC UA client certificate generation and deployment. 2026-07-23 11:49:28 -03:00
Bruno Domingues
498030dd5f Merge pull request #28 from Aignosi/feature/SIENTIAPDE-1945
SIENTIAPDE-1945: Remove values.yaml
2026-07-10 11:50:21 -03:00
Bruno Domingues
878644c953 SIENTIAPDE-1945: Remove values.yaml. 2026-07-08 22:12:59 -03:00
Bruno Domingues
1e0c83828e chore(sonar): Update project key 2026-07-01 21:11:01 -03:00
vitor-aignosi
b74ec5a08e Merge pull request #27 from Aignosi/feature/SIENTIAPDE-1325-adicionar-metricas-especificas-de-operacoes-externas
SIENTIAPDE-1325: Enhance Asynchronous Operations, Metrics, and Release Workflow
2025-11-10 10:12:05 -03:00
vitor-aignosi
89278827e7 SIENTIAPDE-1325
Enhance release workflow to trigger only on merged pull requests and streamline data insertion in DataManager

- Updated the release workflow to execute only when a pull request is merged.
- Simplified the document insertion logic in DataManager by consolidating the dictionary construction.
- Refactored OPC Manager tests to utilize asynchronous mocks for improved accuracy in testing.
2025-11-10 09:14:35 -03:00
vitor-aignosi
373245d5a1 SIENTIAPDE-1325
Refactor OpcManager to emit connection metrics immediately after connection attempt

- Moved the emission of OPC_CONNECTIONS_TOTAL metric to occur right after the connection attempt, ensuring accurate tracking of connection status.
- Removed redundant metric emission logic that was previously placed after a successful connection.
2025-11-07 09:56:48 -03:00
vitor-aignosi
032be28eb1 SIENTIAPDE-1325
Refactor OpcManager to emit connection metrics after successful connection establishment

- Moved the metric emission for OPC_CONNECTIONS_TOTAL to occur after a successful connection.
- Removed redundant metric increment logic to streamline the connection process.
2025-11-07 08:58:11 -03:00
vitor-aignosi
1cb687aa37 SIENTIAPDE-1325
Update metrics.py to reorganize OPC Manager metrics section

- Added a comment header for OPC Manager metrics for better code organization.
- Removed redundant comment header to streamline the code structure.
2025-11-07 08:49:09 -03:00
vitor-aignosi
c4f8fe95a8 SIENTIAPDE-1325
Update IngestorManager to use asynchronous methods for checking OPC server cycles and listening status
2025-11-06 16:40:45 -03:00
vitor-aignosi
254be06004 SIENTIAPDE-1325
Update requirements.txt to use version 1.5.3 of sientia-dataops-library and enhance DataManager and ResourceManager with improved logging and timestamping for data insertion and retrieval.
2025-11-05 12:38:35 -03:00
vitor-aignosi
e313de453e SIENTIAPDE-1325
Update requirements.txt to use version 1.5.2 of sientia-dataops-library and bump image tag in values.yaml to 0.5.0 for consistency with recent changes.
2025-11-05 09:15:36 -03:00
vitor-aignosi
d93c497914 SIENTIAPDE-1325
Enhance Ingestor Class with Asynchronous Metrics and Monitoring Integration

- Refactored Ingestor class to inherit from SientiaMonitoring for improved observability.
- Updated methods to utilize asynchronous operations for declaring active ingestors and managing slots.
- Integrated pod_id label into various metrics for better tracking.
- Adjusted unit tests to reflect changes in the Ingestor initialization and asynchronous behavior.
2025-11-03 10:33:05 -03:00
vitor-aignosi
dfd08e883f SIENTIAPDE-1325
Refactor Ingestor and Metrics Classes for Enhanced Asynchronous Operations

- Updated IngestorManager, OpcManager, and ResourceManager to utilize asynchronous methods for improved performance.
- Integrated MetricsController into various classes for better observability and monitoring.
- Adjusted unit tests to accommodate the new asynchronous behavior, ensuring proper mocking of async methods.
- Removed deprecated Redis metrics and streamlined resource management logic.
2025-11-03 09:41:49 -03:00
vitor-aignosi
85a371a38b SIENTIAPDE-1325
SIENTIAPDE-1325: Refactor Ingestor and Manager Classes for Enhanced Asynchronous Operations

- Introduced asynchronous methods across Ingestor, IngestorManager, DataManager, and OpcManager to improve performance and responsiveness.
- Integrated MetricsController into various classes for better observability and monitoring.
- Updated Redis and MongoDB interactions to support asynchronous operations, enhancing data handling efficiency.
- Removed deprecated Redis metrics and streamlined resource management logic.
- Adjusted unit tests to accommodate the new asynchronous behavior and ensure proper mocking of async methods.
2025-10-31 16:32:45 -03:00
vitor-aignosi
4158a74cac SIENTIAPDE-1325
Update requirements.txt and values.yaml to reflect new library path and GITHUB_BRANCH for feature SIENTIAPDE-1325
2025-10-30 08:43:32 -03:00
Matheus Demoner
f8e9d9679d Merge pull request #26 from Aignosi/fix/SIENTIAPDE-1314-ajustes-nas-camadas-de-monitoramento-do-sientia
SIENTIAPDE-1314: Refactor IngestorManager and OpcManager for Improved Server Management
2025-10-27 14:27:56 -03:00
vitor-aignosi
92fd2cb356 SIENTIAPDE-1314
Update GITHUB_BRANCH in values.yaml to reflect new monitoring layer adjustments for SIENTIAPDE-1314
2025-10-24 10:14:13 -03:00
vitor-aignosi
b1287acc1c SIENTIAPDE-1314
Enhance type hinting in encrypt.py for better code clarity

- Added type hint for the `file_tree` variable as a dictionary with string keys and Any values.
- Included a type ignore comment for the yaml import to address type checking issues.
2025-10-23 16:12:48 -03:00
vitor-aignosi
8e3d62ff76 SIENTIAPDE-1314
Refactor IngestorManager to streamline server disconnection process

- Simplified the logic in the `update_opc_servers` method by directly appending servers to the disconnection list and utilizing the new `remove_server` method for handling server shutdowns.
- Removed redundant code related to managing the `managed_tags` during server disconnection, enhancing code clarity and maintainability.
2025-10-23 15:17:47 -03:00
vitor-aignosi
56023dfdf4 SIENTIAPDE-1314
Refactor IngestorManager and OpcManager for improved server management

- Introduced a new method `remove_server` in IngestorManager to encapsulate server removal logic, enhancing code clarity and reusability.
- Updated `update_opc_servers` to utilize the new `remove_server` method for better maintainability.
- Refactored security settings in OpcManager to use direct attribute assignments instead of method calls, streamlining the code.
- Adjusted unit tests to reflect changes in the IngestorManager and OpcManager, ensuring proper asynchronous behavior and mocking.
2025-10-23 15:11:32 -03:00
Matheus Demoner
cc0fde664b Merge pull request #25 from Aignosi/fix/hotfix-opc-connection-optimizing
Refactor OPC server integrity checks to be asynchronous
2025-10-23 12:01:42 -03:00
vitor-aignosi
83e43edf95 Fix formatting of NOSONAR comment in update_opc_servers method for consistency 2025-10-23 11:58:00 -03:00
vitor-aignosi
f415207d5b Update OPC server update method to include NOSONAR comment for code quality tools 2025-10-23 11:55:55 -03:00
vitor-aignosi
eea6ccb48f Refactor OPC manager shutdown logic for improved reliability
Updated the IngestorManager class to ensure that OPC managers are properly shut down and removed from the management list when servers are lost or removed. This change enhances the integrity checks for OPC server management by ensuring asynchronous handling of shutdown operations.
2025-10-23 11:52:00 -03:00
vitor-aignosi
6d2a0e46be Refactor OPC server integrity checks to be asynchronous
Updated the Ingestor and IngestorManager classes to use async methods for checking OPC server integrity and shutting down OPC managers. Adjusted related tests to ensure proper mocking of asynchronous behavior.
2025-10-23 11:46:02 -03:00
Bruno Domingues
d62a1e3381 Merge pull request #23 from Aignosi/feature/SIENTIAPDE-1327-controle-de-releases
SIENTIAPDE-1327: Remove push trigger from quality gate workflow
2025-10-23 08:58:23 -03:00
vitor-aignosi
a4664edee0 SIENTIAPDE-1327
Remove unnecessary blank line from quality gate workflow for improved clarity
2025-10-23 08:38:35 -03:00
vitor-aignosi
cb28eb7e0f Merge branch 'main' into feature/SIENTIAPDE-1327-controle-de-releases 2025-10-23 08:05:19 -03:00
vitor-aignosi
7cfc1435f6 SIENTIAPDE-1327
Remove push trigger from quality gate workflow to streamline execution on pull requests only
2025-10-23 07:56:38 -03:00
Bruno Domingues
e97a006068 Merge pull request #22 from Aignosi/feature/SIENTIAPDE-1327-controle-de-releases
Enhance Quality Gate Workflow for Branch-Based Versioning
2025-10-22 16:47:39 -03:00
vitor-aignosi
c33869be9f SIENTIAPDE-1327
SIENTIAPDE-1327: Replace existing release workflow with a template for improved maintainability and permissions
2025-10-22 16:39:00 -03:00
vitor-aignosi
e1da6964f4 SIENTIAPDE-1327
SIENTIAPDE-1327: Add write-all permissions to quality gate workflow for enhanced functionality
2025-10-22 16:31:56 -03:00
vitor-aignosi
6fce58fa6a SIENTIAPDE-1327
Enhance quality gate workflow by adding a blank line for improved readability
2025-10-22 16:25:31 -03:00
vitor-aignosi
8a9d2e4d73 SIENTIAPDE-1327
SIENTIAPDE-1327: Add secrets inheritance to quality gate workflow configuration
2025-10-22 16:21:27 -03:00
vitor-aignosi
a8b2fe0bd9 SIENTIAPDE-1327
Update quality gate workflow path to use the correct GitHub repository template
2025-10-22 16:13:16 -03:00
vitor-aignosi
88129f2914 SIENTIAPDE-1327
Update quality gate workflow path in GitHub Actions configuration
2025-10-22 15:59:13 -03:00
vitor-aignosi
c8bd6c78d7 SIENTIAPDE-1327
Update quality gate workflow path in GitHub Actions configuration
2025-10-22 15:52:26 -03:00
vitor-aignosi
19ee884c0a SIENTIAPDE-1327
test
2025-10-22 15:50:24 -03:00
vitor-aignosi
6bd695d5a2 SIENTIAPDE-1327
Update quality gate workflow path in GitHub Actions configuration
2025-10-22 15:48:00 -03:00
vitor-aignosi
6a65403e17 SIENTIAPDE-1327
Update requirements and simplify quality gate workflow

- Updated the sientia-dataops-library dependency version from 1.4.6 to 1.4.7 in requirements.txt.
- Replaced the existing quality gate workflow with a simplified version that utilizes a template for better maintainability.
2025-10-22 15:44:19 -03:00