Commit Graph

313 Commits

Author SHA1 Message Date
PedroHMCosme
4225789dc8 SIENTIAPDE-1972: localiza criacao das tabelas de predicao (pandas to_sql), adiciona schema/table_name ao contrato NATS e fixa cert bucket aprovado 2026-07-13 17:46:43 -03:00
PedroHMCosme
7cffc2629d SIENTIAPDE-1972: confirma criacao dinamica das tabelas de predicao (coluna no template + backfill) 2026-07-13 17:25:27 -03:00
PedroHMCosme
c31db70c8a SIENTIAPDE-1972: fixa decisoes (JOIN=tag_id, certs=sientia-dataops, metadata vazio) e coluna de write_status via Flyway em tabelas por-modelo 2026-07-13 17:17:19 -03:00
PedroHMCosme
941c6c0029 SIENTIAPDE-1972: resolve bucket de certs (sientia-dataops), mecanica do JOIN 1974 e discrepancia do campo metadata (1600) 2026-07-13 17:09:07 -03:00
PedroHMCosme
8a05ff70da SIENTIAPDE-1972: resolve stack de migracao (Flyway) no spec 2026-07-13 16:58:54 -03:00
PedroHMCosme
524f4d6d3f SIENTIAPDE-1972: fixa NATS como broker decidido (brief/Vitor) e reflete rename da branch 2026-07-13 16:55:27 -03:00
PedroHMCosme
c980092d95 SIENTIAPDE-1972: enriquece design do OPC Gateway com padroes de plataforma (aig-docs) e corrige contrato de status de escrita 2026-07-13 16:47:59 -03:00
PedroHMCosme
6f6f3bf734 SIENTIAPDE-1972: design doc do OPC Gateway (arquitetura, contratos e faseamento) 2026-07-13 16:29:57 -03:00
Bruno Domingues
498030dd5f Merge pull request #28 from Aignosi/feature/SIENTIAPDE-1945
SIENTIAPDE-1945: Remove values.yaml
2026-07-10 11:50:21 -03:00
878644c953 SIENTIAPDE-1945: Remove values.yaml. 2026-07-08 22:12:59 -03:00
1e0c83828e chore(sonar): Update project key 2026-07-01 21:11:01 -03:00
b74ec5a08e Merge pull request #27 from Aignosi/feature/SIENTIAPDE-1325-adicionar-metricas-especificas-de-operacoes-externas
SIENTIAPDE-1325: Enhance Asynchronous Operations, Metrics, and Release Workflow
2025-11-10 10:12:05 -03:00
89278827e7 SIENTIAPDE-1325
Enhance release workflow to trigger only on merged pull requests and streamline data insertion in DataManager

- Updated the release workflow to execute only when a pull request is merged.
- Simplified the document insertion logic in DataManager by consolidating the dictionary construction.
- Refactored OPC Manager tests to utilize asynchronous mocks for improved accuracy in testing.
2025-11-10 09:14:35 -03:00
373245d5a1 SIENTIAPDE-1325
Refactor OpcManager to emit connection metrics immediately after connection attempt

- Moved the emission of OPC_CONNECTIONS_TOTAL metric to occur right after the connection attempt, ensuring accurate tracking of connection status.
- Removed redundant metric emission logic that was previously placed after a successful connection.
2025-11-07 09:56:48 -03:00
032be28eb1 SIENTIAPDE-1325
Refactor OpcManager to emit connection metrics after successful connection establishment

- Moved the metric emission for OPC_CONNECTIONS_TOTAL to occur after a successful connection.
- Removed redundant metric increment logic to streamline the connection process.
2025-11-07 08:58:11 -03:00
1cb687aa37 SIENTIAPDE-1325
Update metrics.py to reorganize OPC Manager metrics section

- Added a comment header for OPC Manager metrics for better code organization.
- Removed redundant comment header to streamline the code structure.
2025-11-07 08:49:09 -03:00
c4f8fe95a8 SIENTIAPDE-1325
Update IngestorManager to use asynchronous methods for checking OPC server cycles and listening status
2025-11-06 16:40:45 -03:00
254be06004 SIENTIAPDE-1325
Update requirements.txt to use version 1.5.3 of sientia-dataops-library and enhance DataManager and ResourceManager with improved logging and timestamping for data insertion and retrieval.
2025-11-05 12:38:35 -03:00
e313de453e SIENTIAPDE-1325
Update requirements.txt to use version 1.5.2 of sientia-dataops-library and bump image tag in values.yaml to 0.5.0 for consistency with recent changes.
2025-11-05 09:15:36 -03:00
d93c497914 SIENTIAPDE-1325
Enhance Ingestor Class with Asynchronous Metrics and Monitoring Integration

- Refactored Ingestor class to inherit from SientiaMonitoring for improved observability.
- Updated methods to utilize asynchronous operations for declaring active ingestors and managing slots.
- Integrated pod_id label into various metrics for better tracking.
- Adjusted unit tests to reflect changes in the Ingestor initialization and asynchronous behavior.
2025-11-03 10:33:05 -03:00
dfd08e883f SIENTIAPDE-1325
Refactor Ingestor and Metrics Classes for Enhanced Asynchronous Operations

- Updated IngestorManager, OpcManager, and ResourceManager to utilize asynchronous methods for improved performance.
- Integrated MetricsController into various classes for better observability and monitoring.
- Adjusted unit tests to accommodate the new asynchronous behavior, ensuring proper mocking of async methods.
- Removed deprecated Redis metrics and streamlined resource management logic.
2025-11-03 09:41:49 -03:00
85a371a38b SIENTIAPDE-1325
SIENTIAPDE-1325: Refactor Ingestor and Manager Classes for Enhanced Asynchronous Operations

- Introduced asynchronous methods across Ingestor, IngestorManager, DataManager, and OpcManager to improve performance and responsiveness.
- Integrated MetricsController into various classes for better observability and monitoring.
- Updated Redis and MongoDB interactions to support asynchronous operations, enhancing data handling efficiency.
- Removed deprecated Redis metrics and streamlined resource management logic.
- Adjusted unit tests to accommodate the new asynchronous behavior and ensure proper mocking of async methods.
2025-10-31 16:32:45 -03:00
4158a74cac SIENTIAPDE-1325
Update requirements.txt and values.yaml to reflect new library path and GITHUB_BRANCH for feature SIENTIAPDE-1325
2025-10-30 08:43:32 -03:00
Matheus Demoner
f8e9d9679d Merge pull request #26 from Aignosi/fix/SIENTIAPDE-1314-ajustes-nas-camadas-de-monitoramento-do-sientia
SIENTIAPDE-1314: Refactor IngestorManager and OpcManager for Improved Server Management
2025-10-27 14:27:56 -03:00
92fd2cb356 SIENTIAPDE-1314
Update GITHUB_BRANCH in values.yaml to reflect new monitoring layer adjustments for SIENTIAPDE-1314
2025-10-24 10:14:13 -03:00
b1287acc1c SIENTIAPDE-1314
Enhance type hinting in encrypt.py for better code clarity

- Added type hint for the `file_tree` variable as a dictionary with string keys and Any values.
- Included a type ignore comment for the yaml import to address type checking issues.
2025-10-23 16:12:48 -03:00
8e3d62ff76 SIENTIAPDE-1314
Refactor IngestorManager to streamline server disconnection process

- Simplified the logic in the `update_opc_servers` method by directly appending servers to the disconnection list and utilizing the new `remove_server` method for handling server shutdowns.
- Removed redundant code related to managing the `managed_tags` during server disconnection, enhancing code clarity and maintainability.
2025-10-23 15:17:47 -03:00
56023dfdf4 SIENTIAPDE-1314
Refactor IngestorManager and OpcManager for improved server management

- Introduced a new method `remove_server` in IngestorManager to encapsulate server removal logic, enhancing code clarity and reusability.
- Updated `update_opc_servers` to utilize the new `remove_server` method for better maintainability.
- Refactored security settings in OpcManager to use direct attribute assignments instead of method calls, streamlining the code.
- Adjusted unit tests to reflect changes in the IngestorManager and OpcManager, ensuring proper asynchronous behavior and mocking.
2025-10-23 15:11:32 -03:00
Matheus Demoner
cc0fde664b Merge pull request #25 from Aignosi/fix/hotfix-opc-connection-optimizing
Refactor OPC server integrity checks to be asynchronous
2025-10-23 12:01:42 -03:00
83e43edf95 Fix formatting of NOSONAR comment in update_opc_servers method for consistency 2025-10-23 11:58:00 -03:00
f415207d5b Update OPC server update method to include NOSONAR comment for code quality tools 2025-10-23 11:55:55 -03:00
eea6ccb48f Refactor OPC manager shutdown logic for improved reliability
Updated the IngestorManager class to ensure that OPC managers are properly shut down and removed from the management list when servers are lost or removed. This change enhances the integrity checks for OPC server management by ensuring asynchronous handling of shutdown operations.
2025-10-23 11:52:00 -03:00
6d2a0e46be Refactor OPC server integrity checks to be asynchronous
Updated the Ingestor and IngestorManager classes to use async methods for checking OPC server integrity and shutting down OPC managers. Adjusted related tests to ensure proper mocking of asynchronous behavior.
2025-10-23 11:46:02 -03:00
Bruno Domingues
d62a1e3381 Merge pull request #23 from Aignosi/feature/SIENTIAPDE-1327-controle-de-releases
SIENTIAPDE-1327: Remove push trigger from quality gate workflow
2025-10-23 08:58:23 -03:00
a4664edee0 SIENTIAPDE-1327
Remove unnecessary blank line from quality gate workflow for improved clarity
2025-10-23 08:38:35 -03:00
cb28eb7e0f Merge branch 'main' into feature/SIENTIAPDE-1327-controle-de-releases 2025-10-23 08:05:19 -03:00
7cfc1435f6 SIENTIAPDE-1327
Remove push trigger from quality gate workflow to streamline execution on pull requests only
2025-10-23 07:56:38 -03:00
Bruno Domingues
e97a006068 Merge pull request #22 from Aignosi/feature/SIENTIAPDE-1327-controle-de-releases
Enhance Quality Gate Workflow for Branch-Based Versioning
2025-10-22 16:47:39 -03:00
c33869be9f SIENTIAPDE-1327
SIENTIAPDE-1327: Replace existing release workflow with a template for improved maintainability and permissions
2025-10-22 16:39:00 -03:00
e1da6964f4 SIENTIAPDE-1327
SIENTIAPDE-1327: Add write-all permissions to quality gate workflow for enhanced functionality
2025-10-22 16:31:56 -03:00
6fce58fa6a SIENTIAPDE-1327
Enhance quality gate workflow by adding a blank line for improved readability
2025-10-22 16:25:31 -03:00
8a9d2e4d73 SIENTIAPDE-1327
SIENTIAPDE-1327: Add secrets inheritance to quality gate workflow configuration
2025-10-22 16:21:27 -03:00
a8b2fe0bd9 SIENTIAPDE-1327
Update quality gate workflow path to use the correct GitHub repository template
2025-10-22 16:13:16 -03:00
88129f2914 SIENTIAPDE-1327
Update quality gate workflow path in GitHub Actions configuration
2025-10-22 15:59:13 -03:00
c8bd6c78d7 SIENTIAPDE-1327
Update quality gate workflow path in GitHub Actions configuration
2025-10-22 15:52:26 -03:00
19ee884c0a SIENTIAPDE-1327
test
2025-10-22 15:50:24 -03:00
6bd695d5a2 SIENTIAPDE-1327
Update quality gate workflow path in GitHub Actions configuration
2025-10-22 15:48:00 -03:00
6a65403e17 SIENTIAPDE-1327
Update requirements and simplify quality gate workflow

- Updated the sientia-dataops-library dependency version from 1.4.6 to 1.4.7 in requirements.txt.
- Replaced the existing quality gate workflow with a simplified version that utilizes a template for better maintainability.
2025-10-22 15:44:19 -03:00
3d5af42fc0 SIENTIAPDE-1327
Remove unnecessary persist-credentials option from quality gate workflow configuration
2025-10-22 15:21:27 -03:00
5c823eea22 SIENTIAPDE-1327
SIENTIAPDE-1312: Enhance quality gate workflow to determine next version based on branch type

- Added steps to fetch the branch name and calculate the next version based on the latest tag.
- Implemented versioning logic to increment major, minor, or patch numbers depending on the branch type (release, feature, fix).
- Updated SonarQube analysis step to use the dynamically calculated version.
2025-10-22 14:52:03 -03:00