vitor-aignosi
51f4eb1435
SIENTIAPDE-1110
...
Add new activities to worker.py for data management: load_latest_data, get_last_data_timestamp, and put_last_data_timestamp.
2025-07-01 15:16:55 -03:00
vitor-aignosi
97d66ed6cd
SIENTIAPDE-1110
...
Add MongoDB configuration to values.yaml and integrate MongoDB support in worker.py
2025-07-01 15:15:18 -03:00
vitor-aignosi
53337de74a
SIENTIAPDE-1110
...
SIENTIAPDE-1110 Add MongoDB integration and enhance Redis activity with timestamp management functions.
2025-07-01 15:10:32 -03:00
vitor-aignosi
e7b05ebf3a
SIENTIAPDE-1110
...
Add logging for consumer creation in Kafka activity to enhance traceability of topic management.
2025-07-01 11:05:03 -03:00
vitor-aignosi
946d953598
SIENTIAPDE-1110
...
Refactor Kafka activity to improve message consumption by using getmany for batch retrieval, enhancing performance and simplifying message handling logic.
2025-07-01 10:57:12 -03:00
vitor-aignosi
704099c387
SIENTIAPDE-1110
...
Update Kafka activity to use AIOKafkaConsumer for asynchronous message handling, enhancing consumer management and adding support for multiple topics.
2025-07-01 10:44:37 -03:00
vitor-aignosi
66b568838e
SIENTIAPDE-1110
...
Refactor Kafka activity to use instance-level kafka_connector for improved message polling and management, replacing local variable usage with class attribute methods.
2025-07-01 08:21:00 -03:00
vitor-aignosi
a53804331b
SIENTIAPDE-1110
...
Enhance Kafka activity initialization by adding bootstrap_servers and group_id attributes for improved configuration management.
2025-06-30 14:36:15 -03:00
vitor-aignosi
d33a5cbb72
SIENTIAPDE-1110
...
Refactor Kafka activity to use local kafka_connector variable for improved readability and ensure proper closure of the Kafka consumer after polling.
2025-06-30 14:12:02 -03:00
vitor-aignosi
6144bcf8ff
SIENTIAPDE-1110
...
Update Kafka polling time in values.yaml and refactor Kafka subscription in kafka.py to use KafkaConsumer for improved message handling.
2025-06-30 14:11:30 -03:00
vitor-aignosi
9afb74be21
SIENTIAPDE-1110
...
Add metadata to input_data in Scouter and update CoreScouter to use it
2025-06-27 10:07:43 -03:00
vitor-aignosi
74a2d9aa3e
SIENTIAPDE-1110
...
Update GITHUB_BRANCH in values.yaml to SIENTIAPDE-1110-criar-testes-e-2-e and remove prepare_activity from worker.py
2025-06-27 09:34:58 -03:00
vitor-aignosi
99d80020d0
Merge pull request #6 from Aignosi/SIENTIAPDE-1110-criar-testes-e-2-e
...
Sientiapde 1110 criar testes e 2 e
2025-06-26 16:15:25 -03:00
vitor-aignosi
f6831ff0aa
SIENTIAPDE-1110
...
Update image tag in values.yaml from 0.2.1 to 0.2.2
2025-06-26 15:46:07 -03:00
vitor-aignosi
4a90b77786
SIENTIAPDE-1110
...
Update sientia-dataops-library version to 1.2.0 in requirements.txt; refactor logging in activities to use a unified Logger instance and include metadata in log messages across various activities.
2025-06-26 15:15:31 -03:00
vitor-aignosi
9355af1709
SIENTIAPDE-1110
...
SIENTIAPDE-1110 Update image tag in values.yaml from 0.1.0-uat to 0.4.0-uat
2025-06-25 10:07:54 -03:00
vitor-aignosi
92ddaaf17a
SIENTIAPDE-1110
...
Update image tag in values.yaml from 0.0.2 to 0.2.1
2025-06-25 09:54:17 -03:00
Bruno Domingues
d31812c7fc
SIENTIAPDE-1111: refactor sonarqube pipeline 2.
2025-06-23 22:04:27 -03:00
Bruno Domingues
cff067c517
SIENTIAPDE-1111: refactor sonarqube pipeline.
2025-06-23 21:59:08 -03:00
Matheus Demoner
b6f3e4f813
Merge pull request #5 from Aignosi/SIENTIAPDE-1100-rever-erros-nao-lancados-lancando-os-se-necessario
...
SIENTIAPDE-1100
2025-06-12 10:42:40 -03:00
vitor-aignosi
d27dde99a9
SIENTIAPDE-1100
...
Fix error handling in aggregate_data method by raising the caught exception
2025-06-12 09:27:37 -03:00
Matheus Demoner
7b2a5260b3
Merge pull request #4 from Aignosi/SIENTIAPDE-1082-ajustar-o-worker-e-activities-para-ter-um-destrutor-explicito-como-o-laborious
...
SIENTIAPDE-1082
2025-06-09 16:44:57 -03:00
vitor-aignosi
577513576d
Merge branch 'main' into SIENTIAPDE-1082-ajustar-o-worker-e-activities-para-ter-um-destrutor-explicito-como-o-laborious
2025-06-09 15:14:00 -03:00
vitor-aignosi
f541e05e29
Update sientia-mlops-library version to 0.38.1 in requirements.txt
2025-06-09 15:12:43 -03:00
vitor-aignosi
8cf3273714
SIENTIAPDE-1082
...
Implement shutdown methods for Activities and Kafka; enhance error handling in worker main function
2025-06-09 15:09:53 -03:00
Bruno Domingues
ab0c21f5fb
Merge pull request #3 from Aignosi/SIENTIAPDE-1094-atualizar-versao-da-lib
...
Sientiapde 1094 atualizar versao da lib
2025-06-09 13:33:51 -03:00
vitor-aignosi
b8beb0e151
SIENTIAPDE-1094
...
Refactor Redis activity tests to improve initialization and assertion logic
2025-06-09 11:06:53 -03:00
vitor-aignosi
3759f10aec
SIENTIAPDE-1094
...
Refactor test imports and remove unused test files
2025-06-09 10:37:06 -03:00
vitor-aignosi
7dbb9a29ea
SIENTIAPDE-1094
...
Update environment configuration and refactor activity imports
- Changed Kafka, Redis, and Temporal host configurations to use localhost.
- Updated the version reference for the sientia-dataops-library in requirements.txt.
- Refactored import paths for activities to align with new module structure.
- Removed unused base.py and postgres.py files.
- Updated logger and policies imports to reflect new module locations.
- Adjusted values.yaml for branch and log level settings.
2025-06-09 09:43:06 -03:00
vitor-aignosi
deafb335a1
Merge pull request #2 from Aignosi/SIENTIAPDE-1005-implementar-os-workflows-mapeados-utilizando-as-workers-e-activities-apropriadas
...
Sientiapde 1005 implementar os workflows mapeados utilizando as workers e activities apropriadas
2025-05-20 14:37:24 -03:00
vitor-aignosi
7822a41040
Adjusting actions
2025-05-19 16:51:22 -03:00
vitor-aignosi
451dc5fbb7
Removing coveragerc
2025-05-19 16:42:50 -03:00
vitor-aignosi
1839240495
core scouter fix
2025-05-19 16:29:45 -03:00
vitor-aignosi
94aa989029
actions version
2025-05-19 16:24:49 -03:00
vitor-aignosi
33a852c013
Merge branch 'main' into SIENTIAPDE-1005-implementar-os-workflows-mapeados-utilizando-as-workers-e-activities-apropriadas
2025-05-19 16:10:43 -03:00
vitor-aignosi
cefb5e48ff
SIENTIAPDE-1005
...
Unit test fixes
2025-05-19 15:52:39 -03:00
vitor-aignosi
03d62cb5f9
SIENTIAPDE-1005
...
Add initial implementation of data processing activities and filters
2025-05-19 15:02:30 -03:00
Bruno Domingues
b970f54dea
Add quality gate workflow 14.
2025-05-19 14:59:02 -03:00
Bruno Domingues
a07c108595
Add quality gate workflow 13.
2025-05-19 14:59:02 -03:00
Bruno Domingues
9948a2cc9b
Add quality gate workflow 12.
2025-05-19 14:59:02 -03:00
Bruno Domingues
79fc605669
Add quality gate workflow 11.
2025-05-19 14:59:02 -03:00
Bruno Domingues
0f753d00cb
Add quality gate workflow 10.
2025-05-19 14:59:02 -03:00
Bruno Domingues
0f7a341ff9
Add quality gate workflow 9.
2025-05-19 14:59:02 -03:00
Bruno Domingues
00ec969d29
Add quality gate workflow 8.
2025-05-19 14:59:02 -03:00
Bruno Domingues
822b1f31eb
Add quality gate workflow 7.
2025-05-19 14:59:02 -03:00
Bruno Domingues
4e8dcc81b5
Add quality gate workflow 6.
2025-05-19 14:59:02 -03:00
Bruno Domingues
c5295782d6
Add quality gate workflow 5.
2025-05-19 14:59:02 -03:00
Bruno Domingues
602d8caa78
Add quality gate workflow 4.
2025-05-19 14:59:02 -03:00
Bruno Domingues
c60dbe6a3d
Add quality gate workflow 3.
2025-05-19 14:59:02 -03:00
Bruno Domingues
0f0a69f4d8
Add quality gate workflow 2.
2025-05-19 14:59:02 -03:00
