1
0
mirror of https://github.com/pcvolkmer/etl-processor.git synced 2025-04-20 01:36:50 +00:00

103 Commits

Author SHA1 Message Date
79709caa39 Merge remote-tracking branch 'origin/add-docker-build' 2023-08-30 13:29:06 +02:00
c52509054d chore: Add kafka-clients dependency with fixed version to mitigate CVEs
This will use version 3.5.1 of kafka-clients dependency to prevent issues due to
CVE-2023-34453, CVE-2023-34454 and CVE-2023-34455
2023-08-30 13:26:05 +02:00
Jakub Lidke
8fd587c2a3 chore: remove unused HealthCheck.java 2023-08-30 11:54:44 +02:00
Jakub Lidke
edafe30a4b chore: added log msg to GpasPseudonymGenerator 2023-08-30 11:51:08 +02:00
Jakub Lidke
e24be0d325 chore: cleanup deployment docker-compose.yaml and env-sample.env. added 'DNPM' prefix for better integration into productive environment. 2023-08-30 11:50:24 +02:00
5e93e834ad Remove comment to use host alias 2023-08-30 10:24:48 +02:00
Jakub Lidke
5e5bd579fb test: * added additional external host 'localhost', now we can connect without additional host alias. * added akhq to dev-compose.yml 2023-08-30 10:21:38 +02:00
a24f869c84 Update dependencies 2023-08-30 10:03:04 +02:00
Jakub Lidke
635985bfd1 chore: remove previous build via Dockerfile. Fix security issue: CVE-2023-34453, CVE-2023-34454, CVE-2023-34455, CVE-2022-1471 2023-08-28 14:27:28 +02:00
Jakub Lidke
25143745c4 chore: added deployment docker-compose.yaml and env-sample.env added. 2023-08-28 12:54:14 +02:00
Jakub Lidke
532254593f test: * added additional external host 'localhost', now we can connect without additional host alias. * added akhq to dev-compose.yml 2023-08-28 12:47:09 +02:00
Jakub Lidke
01ff53ab23 chore: deployment environment has maria db entries 2023-08-25 13:42:07 +02:00
Jakub Lidke
9643c80cc5 build: locally build docker image has license entry,now 2023-08-25 13:39:42 +02:00
Jakub Lidke
aa40da4995 chore: dev kafka is available via localhost, now. 2023-08-25 13:11:10 +02:00
Jakub Lidke
da26b5a2c8 Merge branch 'master' into add-docker-build
# Conflicts:
#	README.md
#	build.gradle.kts
2023-08-25 12:59:38 +02:00
Jakub Lidke
bbea48322f chore: added deployment port mapping for monitoring access 2023-08-25 12:50:29 +02:00
Jakub Lidke
480f165c7b chore: add deployment docker-compose.yaml and fitting env-sample.env file 2023-08-24 13:48:46 +02:00
Jakub Lidke
3d2c73ff8f doc: gPas Version requirement added 2023-08-24 13:01:29 +02:00
9921e1e684 Throw PseudonymRequestFailed exception with error message
This will throw an exception with error message describing what the error is instead of
having a more generic NoSuchElementException to be thrown if Optional.get() has no value
after calling findFirst() on an empty stream.
2023-08-19 11:45:21 +02:00
5bd26b894c Add information about key based retention config 2023-08-18 22:15:10 +02:00
8dc82225a4
Issue #7: Send and expect requestId in record body, not in record key (#8) 2023-08-16 15:25:46 +02:00
2eb5cc61b9 Change Kafka response body JSON alias 2023-08-15 10:58:17 +02:00
78b2287163 Add information about Kafka retention time 2023-08-15 08:51:40 +02:00
66dc96680d Update dev config and added related information into README.md 2023-08-15 01:09:22 +02:00
64b8636145 Update Apache Kafka service config for KRaft mode 2023-08-15 00:49:43 +02:00
2e7ef25a49 Update project version and versions in gradle file 2023-08-12 23:16:17 +02:00
7186a45f6c Add link to onkostar-plugin-dnpmexport 2023-08-12 22:27:20 +02:00
72295202ec Code cleanup 2023-08-12 22:19:29 +02:00
bc48a7217e Add more information about usage in an ETl process 2023-08-11 14:37:48 +02:00
0e1034d964 New version and add status badge to README.md v0.1.1 2023-08-11 09:47:20 +02:00
6ecb439007
Issue #3: Detect the request type of request with last known status (#5) 2023-08-11 09:22:54 +02:00
cb9c590472
Issue #2: Do not serialize JSON string as custom string (#4)
In addition to that, if REST request did not contain a response body, use empty
string as data quality report string.
2023-08-11 09:13:45 +02:00
044d01534b Build and deploy docker image on new release v0.1.0 2023-08-10 20:29:43 +02:00
4dde13e79a Run tests on each tag 2023-08-10 18:59:04 +02:00
55153d8050 Add information about docker image 2023-08-10 18:55:33 +02:00
25ec557c25 Change condition when to run docker job 2023-08-10 18:44:33 +02:00
2264d85bd1 Run docker workflow after test workflow 2023-08-10 18:29:25 +02:00
2ec5e27a40 Full setup for docker build 2023-08-10 18:07:25 +02:00
d24d9a7fd0 Add docker deploy workflow 2023-08-10 17:46:11 +02:00
1e29ecc891 Fix event name in workflow file 2023-08-10 17:32:02 +02:00
b956eba6c7 Add workflow to run tests on push or pull request 2023-08-10 17:27:14 +02:00
002b0618cf Add tests for KafkaMtbFileSender 2023-08-10 13:35:35 +02:00
2b42a4d262 Tests for RestMtbFileSender 2023-08-10 12:14:13 +02:00
501762d451 Add test logging 2023-08-09 18:32:03 +02:00
1a640ff9df Decouple request and response processing 2023-08-09 18:15:20 +02:00
7f048e2483 Do not append custom prefix to gPAS pseudonym 2023-08-09 12:26:57 +02:00
47830ed9f7 Use single MtbFileSender 2023-08-09 10:34:23 +02:00
13bfa0018d Change endpoint configuration to select single endpoint
* If REST endpoint is configured, it will be used
* If Kafka endpoint is configured, it will be used
* If both endpoints are configured, REST configuration has precedence and will be used
2023-08-09 10:22:03 +02:00
7739afad1f Handle MTB File with rejected consent as deletion request 2023-08-09 08:13:27 +02:00
6ad6ee13a1 Ignore unknown properties in DataQualityResponse 2023-08-08 19:20:45 +02:00