Commit Graph

163 Commits

Author SHA1 Message Date
vitor-aignosi
f6831ff0aa SIENTIAPDE-1110
Update image tag in values.yaml from 0.2.1 to 0.2.2
2025-06-26 15:46:07 -03:00
vitor-aignosi
4a90b77786 SIENTIAPDE-1110
Update sientia-dataops-library version to 1.2.0 in requirements.txt; refactor logging in activities to use a unified Logger instance and include metadata in log messages across various activities.
2025-06-26 15:15:31 -03:00
vitor-aignosi
9355af1709 SIENTIAPDE-1110
SIENTIAPDE-1110 Update image tag in values.yaml from 0.1.0-uat to 0.4.0-uat
2025-06-25 10:07:54 -03:00
vitor-aignosi
92ddaaf17a SIENTIAPDE-1110
Update image tag in values.yaml from 0.0.2 to 0.2.1
2025-06-25 09:54:17 -03:00
Bruno Domingues
d31812c7fc SIENTIAPDE-1111: refactor sonarqube pipeline 2. 2025-06-23 22:04:27 -03:00
Bruno Domingues
cff067c517 SIENTIAPDE-1111: refactor sonarqube pipeline. 2025-06-23 21:59:08 -03:00
Matheus Demoner
b6f3e4f813 Merge pull request #5 from Aignosi/SIENTIAPDE-1100-rever-erros-nao-lancados-lancando-os-se-necessario
SIENTIAPDE-1100
2025-06-12 10:42:40 -03:00
vitor-aignosi
d27dde99a9 SIENTIAPDE-1100
Fix error handling in aggregate_data method by raising the caught exception
2025-06-12 09:27:37 -03:00
Matheus Demoner
7b2a5260b3 Merge pull request #4 from Aignosi/SIENTIAPDE-1082-ajustar-o-worker-e-activities-para-ter-um-destrutor-explicito-como-o-laborious
SIENTIAPDE-1082
2025-06-09 16:44:57 -03:00
vitor-aignosi
577513576d Merge branch 'main' into SIENTIAPDE-1082-ajustar-o-worker-e-activities-para-ter-um-destrutor-explicito-como-o-laborious 2025-06-09 15:14:00 -03:00
vitor-aignosi
f541e05e29 Update sientia-mlops-library version to 0.38.1 in requirements.txt 2025-06-09 15:12:43 -03:00
vitor-aignosi
8cf3273714 SIENTIAPDE-1082
Implement shutdown methods for Activities and Kafka; enhance error handling in worker main function
2025-06-09 15:09:53 -03:00
Bruno Domingues
ab0c21f5fb Merge pull request #3 from Aignosi/SIENTIAPDE-1094-atualizar-versao-da-lib
Sientiapde 1094 atualizar versao da lib
2025-06-09 13:33:51 -03:00
vitor-aignosi
b8beb0e151 SIENTIAPDE-1094
Refactor Redis activity tests to improve initialization and assertion logic
2025-06-09 11:06:53 -03:00
vitor-aignosi
3759f10aec SIENTIAPDE-1094
Refactor test imports and remove unused test files
2025-06-09 10:37:06 -03:00
vitor-aignosi
7dbb9a29ea SIENTIAPDE-1094
Update environment configuration and refactor activity imports

- Changed Kafka, Redis, and Temporal host configurations to use localhost.
- Updated the version reference for the sientia-dataops-library in requirements.txt.
- Refactored import paths for activities to align with new module structure.
- Removed unused base.py and postgres.py files.
- Updated logger and policies imports to reflect new module locations.
- Adjusted values.yaml for branch and log level settings.
2025-06-09 09:43:06 -03:00
vitor-aignosi
deafb335a1 Merge pull request #2 from Aignosi/SIENTIAPDE-1005-implementar-os-workflows-mapeados-utilizando-as-workers-e-activities-apropriadas
Sientiapde 1005 implementar os workflows mapeados utilizando as workers e activities apropriadas
2025-05-20 14:37:24 -03:00
vitor-aignosi
7822a41040 Adjusting actions 2025-05-19 16:51:22 -03:00
vitor-aignosi
451dc5fbb7 Removing coveragerc 2025-05-19 16:42:50 -03:00
vitor-aignosi
1839240495 core scouter fix 2025-05-19 16:29:45 -03:00
vitor-aignosi
94aa989029 actions version 2025-05-19 16:24:49 -03:00
vitor-aignosi
33a852c013 Merge branch 'main' into SIENTIAPDE-1005-implementar-os-workflows-mapeados-utilizando-as-workers-e-activities-apropriadas 2025-05-19 16:10:43 -03:00
vitor-aignosi
cefb5e48ff SIENTIAPDE-1005
Unit test fixes
2025-05-19 15:52:39 -03:00
vitor-aignosi
03d62cb5f9 SIENTIAPDE-1005
Add initial implementation of data processing activities and filters
2025-05-19 15:02:30 -03:00
Bruno Domingues
b970f54dea Add quality gate workflow 14. 2025-05-19 14:59:02 -03:00
Bruno Domingues
a07c108595 Add quality gate workflow 13. 2025-05-19 14:59:02 -03:00
Bruno Domingues
9948a2cc9b Add quality gate workflow 12. 2025-05-19 14:59:02 -03:00
Bruno Domingues
79fc605669 Add quality gate workflow 11. 2025-05-19 14:59:02 -03:00
Bruno Domingues
0f753d00cb Add quality gate workflow 10. 2025-05-19 14:59:02 -03:00
Bruno Domingues
0f7a341ff9 Add quality gate workflow 9. 2025-05-19 14:59:02 -03:00
Bruno Domingues
00ec969d29 Add quality gate workflow 8. 2025-05-19 14:59:02 -03:00
Bruno Domingues
822b1f31eb Add quality gate workflow 7. 2025-05-19 14:59:02 -03:00
Bruno Domingues
4e8dcc81b5 Add quality gate workflow 6. 2025-05-19 14:59:02 -03:00
Bruno Domingues
c5295782d6 Add quality gate workflow 5. 2025-05-19 14:59:02 -03:00
Bruno Domingues
602d8caa78 Add quality gate workflow 4. 2025-05-19 14:59:02 -03:00
Bruno Domingues
c60dbe6a3d Add quality gate workflow 3. 2025-05-19 14:59:02 -03:00
Bruno Domingues
0f0a69f4d8 Add quality gate workflow 2. 2025-05-19 14:59:02 -03:00
Bruno Domingues
fb685252e7 Add quality gate workflow. 2025-05-19 14:59:01 -03:00
vitor-aignosi
b29d7ba65d SIENTIAPDE-1005
Adjusting super prepare activity call
2025-05-19 14:56:57 -03:00
vitor-aignosi
bb07de573f SIENTIAPDE-1005
Activities fix
2025-05-19 11:59:41 -03:00
vitor-aignosi
3050b66737 SIENTIAPDE-1005
Prepare activity fix
2025-05-19 11:51:49 -03:00
vitor-aignosi
b01b7c6e42 SIENTIAPDE-1005
Fix
2025-05-19 11:48:38 -03:00
vitor-aignosi
9b715ea8c9 SIENTIAPDE-1005
Redis auth
2025-05-19 10:08:45 -03:00
vitor-aignosi
df8a0fc706 SIENTIAPDE-1005
Enhance README and configuration files; add Redis authentication and update workflows
2025-05-16 16:30:43 -03:00
vitor-aignosi
e252ca7962 SIENTIAPDE-1005
Full coverage

Refactor code structure and improve logging configuration; update tests for activities and connectors
2025-05-16 12:58:36 -03:00
vitor-aignosi
b203b7d22c SIENTIAPDE-1005
Implement workflows for fake data generation, scouter processing, and core scouter operations

- Added `FakeData` workflow to generate random data and send it to a Kafka topic.
- Implemented `Scouter` workflow to load data from Kafka and trigger the core scouter workflow.
- Created `CoreScouter` workflow to process data through quality gates, aggregation, and export to PostgreSQL.
- Developed comprehensive unit tests for activities and workflows, ensuring proper functionality and error handling.
- Enhanced Redis and Postgres activities with robust testing for data handling and error notifications.
- Introduced quality filters for data validation and implemented tests to verify their functionality.
2025-05-15 16:53:24 -03:00
Bruno Domingues
3622d6b68c Add quality gate workflow 14. 2025-05-14 15:36:07 -03:00
Bruno Domingues
06688464eb Add quality gate workflow 13. 2025-05-14 15:25:27 -03:00
Bruno Domingues
e103e7e41b Add quality gate workflow 12. 2025-05-14 15:17:59 -03:00
Bruno Domingues
3155f1a247 Add quality gate workflow 11. 2025-05-14 15:10:07 -03:00