Commit Graph

  • 217b411e3b chore: bump version to 0.9.0 main 0.9.0 github-actions[bot] 2026-10-29 18:21:20 +00:00
  • ab98774e29 Merge pull request #51 from Aignosi/feature/SIENTIAPDE-1974-connectors-pi-web-api vitor-aignosi 2026-10-29 15:21:04 -03:00
  • 0b928a0ea3 SIENTIAPDE-1974 SIENTIAPDE-1974-connectors-pi-web-api: Implement OPC UA client certificate handling and update connector security model. Connectors now define security using security.mode and security.policy. Client certificate details (MinIO paths) are fetched from the opc_certificates collection via a MongoDB $lookup and included in the OPC slot. A warning is issued if a connector's client_certificate_id does not resolve to an active client certificate. Documentation (README, CLAUDE.md) and tests have been updated. feature/SIENTIAPDE-1974-connectors-pi-web-api vitor-aignosi 2026-10-29 12:21:11 -03:00
  • 5b47726a64 SIENTIAPDE-1974 SIENTIAPDE-1974 Fix Sonar issues: reduce gather_read_tags complexity, import pytest as module vitor-aignosi 2026-10-29 10:32:06 -03:00
  • 0c9eaab3f5 SIENTIAPDE-1974 SIENTIAPDE-1974-connectors-pi-web-api: Consolidate OPC server and tag data sourcing to the tag database. This change removes the legacy opc-servers collection and enforces tag_id as the sole reference for all read and write tags via connectors and connector_tags. The Orchestrator workflow now exclusively loads OPC server and tag information from the tag database, simplifying data flow and removing conditional logic for legacy data sources. Improved error reporting for pipeline timestamp updates and updated documentation, examples, and tests are also included. vitor-aignosi 2026-10-29 10:25:51 -03:00
  • 9ba2fc74c4 SIENTIAPDE-1974 SIENTIAPDE-1974-connectors-pi-web-api: Remove write tag backfill script and update README to require pre-deployment conversion of write tags to [{tag_id}] format. vitor-aignosi 2026-10-29 09:44:53 -03:00
  • a36d9912ac SIENTIAPDE-1974 SIENTIAPDE-1974-connectors-pi-web-api: Introduce config_hash for robust schedule redeployment. Pipelines now redeploy on any content change (e.g., tag database updates) even without an updated_at bump. orchestrated_schedules tracks the hash; updated documentation, E2E tests, and the SIENTIAPDE-1974 backfill script. vitor-aignosi 2026-10-29 09:36:17 -03:00
  • 2c331b5f16 SIENTIAPDE-1974 SIENTIAPDE-1974 Write OPC tags through the tag database and drop the PI Web API path vitor-aignosi 2026-10-29 08:25:01 -03:00
  • 9eaec54fc8 SIENTIAPDE-1974 SIENTIAPDE-1974 Split orchestrator_functions into pipeline configs, tag database and OPC slots - orchestrator_functions.py held four unrelated concerns (pipeline builders, tag database indexes, PI Web API resolution, OPC slot v2) and had grown to 1135 lines. Move them, unchanged, into: pipeline_configs.py, tag_database.py and opc_slots.py. - Make the helpers shared across modules public: is_complete, tag_id_text and pi_connection. - Split the utils tests the same way, with the pipeline and tag database documents they share in tag_database_fixtures.py. - Point formatters, the orchestrator workflow, README and CLAUDE.md at the new modules. vitor-aignosi 2026-10-28 16:38:53 -03:00
  • 11e350a6ce SIENTIAPDE-1974 Add e2e tag-database scenarios and cover worker/email/formatter gaps vitor-aignosi 2026-10-28 16:07:10 -03:00
  • 16e76f11ea SIENTIAPDE-1974 SIENTIAPDE-1974 Extract PI tag resolution and name Mongo stage constants vitor-aignosi 2026-10-28 15:52:35 -03:00
  • 7e6f1a8782 SIENTIAPDE-1974 Resolve PI Web API pipeline tags through the tag database vitor-aignosi 2026-10-28 15:46:09 -03:00
  • 744ca647f7 SIENTIAPDE-1974 SIENTIAPDE-1974: merge main (0.8.2) into the tag database feature feature/SIENTIAPDE-1974-tag-database vitor-aignosi 2026-10-28 11:06:26 -03:00
  • dba04d6519 chore: bump version to 0.8.2 github-actions[bot] 2026-10-28 11:07:15 +00:00
  • d79e0e94ae Merge pull request #50 from Aignosi/fix/SIENTIAPDE-2212-drift-janela-e-chunk-period vitor-aignosi 2026-10-28 08:07:02 -03:00
  • 2d794d02b2 SIENTIAPDE-2212 SIENTIAPDE-2212-drift-janela-e-chunk-period: Remove default 1-minute margin from drift window calculation. The default interval now directly matches the frequency, ensuring consecutive windows do not overlap. vitor-aignosi 2026-10-27 16:42:48 -03:00
  • 9e160655f2 SIENTIAPDE-2212 Add e2e scenario for drift window and chunk_period vitor-aignosi 2026-10-27 16:27:58 -03:00
  • d1786085d0 SIENTIAPDE-2212 SIENTIAPDE-2212-drift-janela-e-chunk-period: Add configurable chunk period and dynamic window calculation for drift, with warnings for invalid periods. vitor-aignosi 2026-10-27 16:19:51 -03:00
  • 090456e11f fix(ci): restaura pull-requests:read no deploy.yml, exigido pelo release-tarball Bruno Domingues 2026-10-21 14:10:31 -03:00
  • 741be5f357 fix(ci): grant contents:write permission to version-bump workflow Bruno Domingues 2026-10-21 11:45:00 -03:00
  • ac23f729d4 chore(ci): add version-bump.yml, decoupled from deploy Bruno Domingues 2026-10-21 00:35:07 -03:00
  • 78bc10b5c5 chore(ci): switch deploy.yml to manual workflow_dispatch with required chart_ref Bruno Domingues 2026-10-20 18:05:23 -03:00
  • 5568499277 chore(ci): drop feature/** from push trigger to avoid duplicate quality-gate runs [skip ci] Bruno Domingues 2026-10-19 21:22:31 -03:00
  • 491ad5da39 chore: bump version to 0.8.1 0.8.1 github-actions[bot] 2026-10-19 13:46:38 +00:00
  • 3f66253d9d Merge pull request #49 from Aignosi/fix/bump-sientia-do-1.12.5 vitor-aignosi 2026-10-19 10:46:14 -03:00
  • 626281ba6d fix: bump sientia_do to 1.12.5 vitor-aignosi 2026-10-19 10:05:15 -03:00
  • d7945c4c2b chore: bump version to 0.7.0-rc1 0.7.0-rc1 github-actions[bot] 2026-10-09 16:14:55 +00:00
  • 4dc6b0c460 Merge pull request #45 from Aignosi/feature-rc/SIENTIAPDE-1974-slot-v2 Eduardo Rios 2026-10-09 13:14:29 -03:00
  • f1e0c1b419 chore: bump version to 0.8.0 0.8.0 github-actions[bot] 2026-10-08 14:58:02 +00:00
  • 3bf40f837b Merge pull request #47 from Aignosi/feature/SIENTIAPDE-2190-adaptive-frequency vitor-aignosi 2026-10-08 11:57:01 -03:00
  • c96d94a045 chore: bump version to 0.7.0 0.7.0 github-actions[bot] 2026-10-08 14:03:23 +00:00
  • bec855d0b7 Merge branch 'main' into feature/SIENTIAPDE-2190-adaptive-frequency vitor-aignosi 2026-10-08 11:03:12 -03:00
  • d41bef39bd Merge pull request #48 from Aignosi/feature/SIENTIAPDE-2193-parallel-windows vitor-aignosi 2026-10-08 11:02:57 -03:00
  • da27e2ba91 chore: bump version to 0.6.8 0.6.8 github-actions[bot] 2026-10-08 13:52:43 +00:00
  • 3f42cdea74 Merge pull request #46 from Aignosi/fix/SIENTIAPDE-2192-empty-timestamp-filter vitor-aignosi 2026-10-08 10:52:19 -03:00
  • 9f21372ab3 docs: floor warning fires on each schedule create/update; unparseable frequency_alert is ignored (SIENTIAPDE-2193) PedroHMCosme 2026-10-08 08:43:45 -03:00
  • 33d99827b1 docs: clarify floor warning repeats and laborious owns escalation (SIENTIAPDE-2193) PedroHMCosme 2026-10-07 16:37:04 -03:00
  • 2c3ce07f5c docs: simple metrics parallel windows and adaptive frequency convention (SIENTIAPDE-2193) PedroHMCosme 2026-10-07 16:25:30 -03:00
  • 7b3618d274 test(e2e): adaptive frequency escalation and recovery round trip (SIENTIAPDE-2193) PedroHMCosme 2026-10-07 16:22:47 -03:00
  • 0f902b53a9 test(e2e): one simple_metrics schedule per window for the same model (SIENTIAPDE-2193) PedroHMCosme 2026-10-07 15:59:29 -03:00
  • b5512498b9 fix(simple_metrics): ignore unparseable frequency_alert and malformed adaptive_state (SIENTIAPDE-2190) PedroHMCosme 2026-10-08 08:42:49 -03:00
  • d963cd3e8a test(orchestrator): cover mixed and empty timestamp updates/deletes (SIENTIAPDE-2192) PedroHMCosme 2026-10-08 08:46:05 -03:00
  • 7222b5d1ef feat(simple_metrics): warn when frequency_alert is below the 1m floor (SIENTIAPDE-2190) PedroHMCosme 2026-10-07 15:28:45 -03:00
  • 0d3ff73557 fix(orchestrator): do not stamp or untrack every schedule when all updates/deletes fail (SIENTIAPDE-2192) PedroHMCosme 2026-10-07 15:18:38 -03:00
  • 6d6d169b09 SIENTIAPDE-1974: refactor(slots): fix the SonarQube quality gate findings test-SIENTIAPDE-1974-slot-v2 Eduardo Rios 2026-10-07 15:19:36 -03:00
  • 40f8d8174b feat(simple_metrics): use frequency_alert while adaptive_state is escalated (SIENTIAPDE-2190) PedroHMCosme 2026-10-07 15:17:53 -03:00
  • 60f4e3e421 SIENTIAPDE-1974: fix(slots): harden the tag database path after code review Eduardo Rios 2026-10-06 15:59:36 -03:00
  • efa0d9411b SIENTIAPDE-1974: feat(slots): write the OPC slot v2 from pipelines and the tag database Eduardo Rios 2026-10-06 15:44:07 -03:00
  • 6334be2edf chore: bump version to 0.6.7 0.6.7 github-actions[bot] 2026-09-23 11:56:34 +00:00
  • b834c0b8e6 Merge pull request #44 from Aignosi/fix/SIENTIAPDE-2149 vitor-aignosi 2026-09-23 08:56:06 -03:00
  • bc4e64a271 Merge branch 'main' into fix/SIENTIAPDE-2149 vitor-aignosi 2026-09-23 08:41:52 -03:00
  • afb71c27bf chore: bump version to 0.6.6 0.6.6 github-actions[bot] 2026-09-23 11:39:16 +00:00
  • 52dffeecd4 Merge branch 'main' into fix/SIENTIAPDE-2149 vitor-aignosi 2026-09-23 08:39:04 -03:00
  • d0f204d525 Merge pull request #43 from Aignosi/fix/SIENTIAPDE-2013 vitor-aignosi 2026-09-23 08:38:46 -03:00
  • c85c3440ed Merge fix/SIENTIAPDE-2013 into fix/SIENTIAPDE-2149 Eduardo Rios 2026-09-22 16:52:30 -03:00
  • d3104d66ab fix: address review feedback on batch-size default, requirements-local, docstring Eduardo Rios 2026-09-22 16:51:51 -03:00
  • 0edb2b5be0 refactor: extract shared union-or-nothing helper in _compute_query_time_filter Eduardo Rios 2026-09-22 16:48:46 -03:00
  • da8a796197 SIENTIAPDE-2149: model_ids allow-list filter for receiver groups fix/SIENTIAPDE-2149 Eduardo Rios 2026-09-18 15:02:42 -03:00
  • 87ddd02038 fix: correct sientia_do pin to the version actually released (1.12.3) Eduardo Rios 2026-09-18 14:45:56 -03:00
  • 8e6f2eab14 Merge branch 'fix/SIENTIAPDE-2013' of https://github.com/Aignosi/sientia-dataops-orchestrator_temporal into fix/SIENTIAPDE-2013 fix/SIENTIAPDE-2013 Eduardo Rios 2026-09-17 11:52:13 -03:00
  • 739736b824 test(e2e): verify notification_queue_batch_size=0 means unlimited Eduardo Rios 2026-09-17 11:51:49 -03:00
  • 4ece5cf9e3 Merge branch 'main' into fix/SIENTIAPDE-2013 Eduardo Rios 2026-09-17 11:48:58 -03:00
  • 5cc8015fc7 chore: bump version to 0.6.5 0.6.5 github-actions[bot] 2026-09-17 14:36:26 +00:00
  • d6c103c39a Merge pull request #42 from Aignosi/fix/SIENTIAPDE-2012 Eduardo Rios 2026-09-17 11:36:01 -03:00
  • eaf0ca7863 docs: make e2e/scenarios.md a strict 1:1 mirror of actual e2e tests Eduardo Rios 2026-09-17 09:52:38 -03:00
  • d46bd55cb4 test(e2e): add batch-size cap coverage for SIENTIAPDE-2013 Eduardo Rios 2026-09-17 09:39:35 -03:00
  • 9c153041ad SIENTIAPDE-2013: cap load_latest_data's Mongo fetch at a configurable batch size Eduardo Rios 2026-09-17 09:33:46 -03:00
  • b7325938f5 refactor: extract per-group filtering to reduce cognitive complexity fix/SIENTIAPDE-2012 Eduardo Rios 2026-09-15 15:05:59 -03:00
  • 081298a883 fix: annotate already_added_keys to satisfy mypy Eduardo Rios 2026-09-15 14:51:51 -03:00
  • a59cc1c691 fix: apply ruff formatting to _check_keys_and_notif_id Eduardo Rios 2026-09-15 14:48:45 -03:00
  • 6a95b8d2df fix: apply ruff formatting to _check_levels_and_ignore_models_id Eduardo Rios 2026-09-15 14:39:59 -03:00
  • 86962c2cfc Refactorizing function to reduce its Cognitive Complexity Eduardo Rios 2026-09-15 14:35:22 -03:00
  • 9df151d29d SIENTIAPDE-2012: per-group levels/ignore_models_id filtering Eduardo Rios 2026-09-15 13:46:03 -03:00
  • d250383f78 chore: bump version to 0.6.4 0.6.4 github-actions[bot] 2026-09-15 15:26:54 +00:00
  • a259aeeef7 Merge pull request #41 from Aignosi/fix/SIENTIAPDE-2011 vitor-aignosi 2026-09-15 12:26:32 -03:00
  • 3d2a5ecc43 test: lock in that levels union replaces default_filter's level, not AND Eduardo Rios 2026-09-15 11:26:06 -03:00
  • 6479737dfb fix: harden ignore_models_id against explicit null, document levels-union design Eduardo Rios 2026-09-15 11:13:17 -03:00
  • 58c0bd4f2d SIENTIAPDE-2011: normalize notification timestamp in format_log_report Eduardo Rios 2026-09-15 09:35:25 -03:00
  • ed666c260d fix: satisfy mypy in put_last_data_timestamp after utc=True normalization fix/SIENTIAPDE-2011 Eduardo Rios 2026-09-15 08:18:17 -03:00
  • 14b854148a SIENTIAPDE-2011: add e2e coverage for query-time filter, fix stale e2e fixtures Eduardo Rios 2026-09-14 12:15:23 -03:00
  • 1711f3b0d1 SIENTIAPDE-2011: Compute query-time levels union / ignore_models_id intersection Eduardo Rios 2026-09-14 11:46:19 -03:00
  • ff7b441140 ci(deploy): Configure env_list_path as array in deploy workflow Bruno Domingues 2026-09-11 00:25:25 -03:00
  • d12c89e1c5 chore: bump version to 0.6.3 0.6.3 github-actions[bot] 2026-09-10 13:31:42 +00:00
  • b933783e59 Merge pull request #40 from Aignosi/fix/SIENTIAPDE-2068 Bruno Domingues 2026-09-10 10:31:15 -03:00
  • d8ece5ea3c Merge branch 'main' into fix/SIENTIAPDE-2068 Bruno Domingues 2026-09-10 10:26:37 -03:00
  • 30fe5ff69c SIENTIAPDE-2068: Configure deploy workflow to update version in pyproject.toml Bruno Domingues 2026-09-10 10:20:41 -03:00
  • 0c63b68cdd Merge pull request #39 from Aignosi/fix/SIENTIAPDE-2068 0.6.2 Bruno Domingues 2026-09-09 23:30:52 -03:00
  • bfbc71bbfb SIENTIAPDE-2068: feat(cicd): migrate orchestrator-worker deploy to Flow B Bruno Domingues 2026-09-09 23:18:46 -03:00
  • cae514ebae Merge pull request #38 from Aignosi/fix/SIENTIAPDE-2009 vitor-aignosi 2026-09-09 11:07:38 -03:00
  • 3c69b35b3f fix: use DATETIME_FORMAT_MS_WITH_TZ instead of isoformat for last_data_timestamp Eduardo Rios 2026-09-09 10:54:22 -03:00
  • cdb1ed4e40 Code import - branch 0.6.0 0.6.0 gitea_admin 2026-09-09 11:43:11 +00:00
  • 2467d24188 style: fix ruff formatting in test_mongo_db.py fix/SIENTIAPDE-2009 Eduardo Rios 2026-08-13 11:37:13 -03:00
  • 70f6a5d820 chore: ignore .obsidian/ directory Eduardo Rios 2026-08-13 11:31:10 -03:00
  • c3cd58028c SIENTIAPDE-2007 SIENTIAPDE-2007: Compare native datetime in load_latest_data $gt filter and bump sientia_do pin to 1.12.2 Eduardo Rios 2026-08-12 13:45:38 -03:00
  • 7352b1c1df chore(devops): Update CI quality gate workflow and add Claude AI guidance Bruno Domingues 2026-08-05 15:52:11 -03:00
  • 817fcb90be Merge pull request #37 from Aignosi/feature/SIENTIAPDE-1646 vitor-aignosi 2026-07-21 14:55:49 -03:00
  • cf3a367794 SIENTIAPDE-1646 SIENTIAPDE-1646: Refactor TemporalManager by extracting schedule update and task queue name building logic into dedicated helper methods. vitor-aignosi 2026-07-21 11:12:11 -03:00
  • a4b6f6aa88 SIENTIAPDE-1646 SIENTIAPDE-1646: Remove validate.sh script, refactor TemporalManager for improved readability, and update temporal schedule tests to explicitly define workflow types and align task queue naming conventions. vitor-aignosi 2026-07-21 10:17:30 -03:00
  • 7b845a7de4 SIENTIAPDE-1646 SIENTIAPDE-1646: Update quality gate workflow to use dataops-module template. vitor-aignosi 2026-07-21 09:58:02 -03:00
  • 292e84236c SIENTIAPDE-1646 SIENTIAPDE-1646: Configure quality gate workflow to use requirements-local.txt for dependency scanning. vitor-aignosi 2026-07-21 09:53:35 -03:00