1
0
mirror of https://github.com/pcvolkmer/etl-processor.git synced 2025-04-19 17:26:51 +00:00

274 Commits

Author SHA1 Message Date
3e45de56cf feat: add page that shows transformation configuration v0.2.0 2023-12-04 17:35:44 +01:00
7f54efe034 docs: remove notice on how to setup kafka 2023-12-04 16:11:33 +01:00
effcdd811f style: add colored table rows for requests 2023-12-04 16:11:02 +01:00
acf49a892e chore: update Kotlin and dependency management plugin 2023-12-04 14:37:58 +01:00
284806d130 chore: update Spring Boot to version 3.1.6 2023-11-25 14:36:53 +01:00
cf2d338e13 test: add integration test for mtb file transformation 2023-11-25 14:33:02 +01:00
d5552b3ca4 chore: Update Kotlin version to 1.9.20 2023-11-21 08:31:18 +01:00
892c0dea8f chore: Update Apache Kafka client library to version 3.6.0 2023-10-20 13:50:07 +02:00
0305e69e9e chore: Update Spring Boot to version 3.1.5 2023-10-20 13:49:38 +02:00
1a913b2644 Issue #12: Remove obsolete braces from transformation examples 2023-10-05 12:44:09 +02:00
0eee1908df
Merge pull request #13 from CCC-MF/issue_12
Transformation of MTBFile data based on rules
2023-10-05 12:41:49 +02:00
ffea9343c8 Issue #12: Change README.md to show transformation config names as env var 2023-10-05 12:36:37 +02:00
eb24995ed9 Issue #12: Log transformation count applied on application start 2023-10-05 12:35:29 +02:00
4196664060 Issue #12: Transform MTBFile objects by using transformation rules 2023-10-05 12:09:56 +02:00
2824951e5e Issue #12: Add information about transformation rules in README.md 2023-10-05 11:45:42 +02:00
1e1db1c4d9 Issue #12: Add application config for transformation configuration 2023-10-05 11:37:10 +02:00
7440fe1e23 Issue #12: Basic implementation of transformation service 2023-10-05 10:51:49 +02:00
3f5c5e28fa chore: update Spring Boot dependencies 2023-09-26 09:27:21 +02:00
6397b2a019 chore: pump version to dev version snapshot 2023-09-26 09:27:21 +02:00
jlidke
bf8f87b261
fix: removed gaps system from GPAS pseudonym value. Also added clean up method, which will replace filename invalid characters witch '_'. (#11) 2023-09-04 15:41:22 +02:00
2f32834de0 Release 0.1.2 v0.1.2 2023-08-30 13:45:06 +02:00
79709caa39 Merge remote-tracking branch 'origin/add-docker-build' 2023-08-30 13:29:06 +02:00
c52509054d chore: Add kafka-clients dependency with fixed version to mitigate CVEs
This will use version 3.5.1 of kafka-clients dependency to prevent issues due to
CVE-2023-34453, CVE-2023-34454 and CVE-2023-34455
2023-08-30 13:26:05 +02:00
Jakub Lidke
8fd587c2a3 chore: remove unused HealthCheck.java 2023-08-30 11:54:44 +02:00
Jakub Lidke
edafe30a4b chore: added log msg to GpasPseudonymGenerator 2023-08-30 11:51:08 +02:00
Jakub Lidke
e24be0d325 chore: cleanup deployment docker-compose.yaml and env-sample.env. added 'DNPM' prefix for better integration into productive environment. 2023-08-30 11:50:24 +02:00
5e93e834ad Remove comment to use host alias 2023-08-30 10:24:48 +02:00
Jakub Lidke
5e5bd579fb test: * added additional external host 'localhost', now we can connect without additional host alias. * added akhq to dev-compose.yml 2023-08-30 10:21:38 +02:00
a24f869c84 Update dependencies 2023-08-30 10:03:04 +02:00
Jakub Lidke
635985bfd1 chore: remove previous build via Dockerfile. Fix security issue: CVE-2023-34453, CVE-2023-34454, CVE-2023-34455, CVE-2022-1471 2023-08-28 14:27:28 +02:00
Jakub Lidke
25143745c4 chore: added deployment docker-compose.yaml and env-sample.env added. 2023-08-28 12:54:14 +02:00
Jakub Lidke
532254593f test: * added additional external host 'localhost', now we can connect without additional host alias. * added akhq to dev-compose.yml 2023-08-28 12:47:09 +02:00
Jakub Lidke
01ff53ab23 chore: deployment environment has maria db entries 2023-08-25 13:42:07 +02:00
Jakub Lidke
9643c80cc5 build: locally build docker image has license entry,now 2023-08-25 13:39:42 +02:00
Jakub Lidke
aa40da4995 chore: dev kafka is available via localhost, now. 2023-08-25 13:11:10 +02:00
Jakub Lidke
da26b5a2c8 Merge branch 'master' into add-docker-build
# Conflicts:
#	README.md
#	build.gradle.kts
2023-08-25 12:59:38 +02:00
Jakub Lidke
bbea48322f chore: added deployment port mapping for monitoring access 2023-08-25 12:50:29 +02:00
Jakub Lidke
480f165c7b chore: add deployment docker-compose.yaml and fitting env-sample.env file 2023-08-24 13:48:46 +02:00
Jakub Lidke
3d2c73ff8f doc: gPas Version requirement added 2023-08-24 13:01:29 +02:00
9921e1e684 Throw PseudonymRequestFailed exception with error message
This will throw an exception with error message describing what the error is instead of
having a more generic NoSuchElementException to be thrown if Optional.get() has no value
after calling findFirst() on an empty stream.
2023-08-19 11:45:21 +02:00
5bd26b894c Add information about key based retention config 2023-08-18 22:15:10 +02:00
8dc82225a4
Issue #7: Send and expect requestId in record body, not in record key (#8) 2023-08-16 15:25:46 +02:00
2eb5cc61b9 Change Kafka response body JSON alias 2023-08-15 10:58:17 +02:00
78b2287163 Add information about Kafka retention time 2023-08-15 08:51:40 +02:00
66dc96680d Update dev config and added related information into README.md 2023-08-15 01:09:22 +02:00
64b8636145 Update Apache Kafka service config for KRaft mode 2023-08-15 00:49:43 +02:00
2e7ef25a49 Update project version and versions in gradle file 2023-08-12 23:16:17 +02:00
7186a45f6c Add link to onkostar-plugin-dnpmexport 2023-08-12 22:27:20 +02:00
72295202ec Code cleanup 2023-08-12 22:19:29 +02:00
bc48a7217e Add more information about usage in an ETl process 2023-08-11 14:37:48 +02:00