1
0
mirror of https://github.com/pcvolkmer/etl-processor.git synced 2025-07-04 15:32:55 +00:00
Commit Graph

62 Commits

Author SHA1 Message Date
c2026bdd07 feat: show configured endpoints 2024-01-11 08:51:30 +01:00
d88e2973da feat: add paginator to request page 2024-01-10 09:12:02 +01:00
4a9cffbaa5 feat #17: initial support for request retry 2024-01-04 07:33:03 +01:00
e5d80f89b0 feat #15: add connection checks to bwHC backend 2024-01-02 06:51:01 +01:00
707bc55ab6 fix: Replace the patient's id in more places (#14)
This adds studyInclusionRequests and tumorMorphology.
2023-12-14 12:55:09 +01:00
a62da60809 feat: sort data quality report items by severity 2023-12-05 14:24:53 +01:00
ced6609d9a fix: add info severity to data quality report 2023-12-05 14:24:40 +01:00
3e45de56cf feat: add page that shows transformation configuration 2023-12-04 17:35:44 +01:00
eb24995ed9 Issue #12: Log transformation count applied on application start 2023-10-05 12:35:29 +02:00
4196664060 Issue #12: Transform MTBFile objects by using transformation rules 2023-10-05 12:09:56 +02:00
1e1db1c4d9 Issue #12: Add application config for transformation configuration 2023-10-05 11:37:10 +02:00
7440fe1e23 Issue #12: Basic implementation of transformation service 2023-10-05 10:51:49 +02:00
8dc82225a4 Issue #7: Send and expect requestId in record body, not in record key (#8) 2023-08-16 15:25:46 +02:00
2eb5cc61b9 Change Kafka response body JSON alias 2023-08-15 10:58:17 +02:00
72295202ec Code cleanup 2023-08-12 22:19:29 +02:00
6ecb439007 Issue #3: Detect the request type of request with last known status (#5) 2023-08-11 09:22:54 +02:00
cb9c590472 Issue #2: Do not serialize JSON string as custom string (#4)
In addition to that, if REST request did not contain a response body, use empty
string as data quality report string.
2023-08-11 09:13:45 +02:00
002b0618cf Add tests for KafkaMtbFileSender 2023-08-10 13:35:35 +02:00
2b42a4d262 Tests for RestMtbFileSender 2023-08-10 12:14:13 +02:00
1a640ff9df Decouple request and response processing 2023-08-09 18:15:20 +02:00
7f048e2483 Do not append custom prefix to gPAS pseudonym 2023-08-09 12:26:57 +02:00
47830ed9f7 Use single MtbFileSender 2023-08-09 10:34:23 +02:00
13bfa0018d Change endpoint configuration to select single endpoint
* If REST endpoint is configured, it will be used
* If Kafka endpoint is configured, it will be used
* If both endpoints are configured, REST configuration has precedence and will be used
2023-08-09 10:22:03 +02:00
7739afad1f Handle MTB File with rejected consent as deletion request 2023-08-09 08:13:27 +02:00
6ad6ee13a1 Ignore unknown properties in DataQualityResponse 2023-08-08 19:20:45 +02:00
422441a3b3 Add tests for RequestProcessor 2023-08-08 16:46:02 +02:00
bcc23f6b14 Add RequestService to handle access to requests 2023-08-08 14:57:31 +02:00
459ad59c1d Do not detect duplicates after deletion request 2023-08-04 11:43:23 +02:00
b14f2c1794 Add information about 'no connection' responses 2023-08-03 16:18:16 +02:00
ec76c775d9 Explicit producer topic configuration 2023-08-03 16:04:57 +02:00
3dcee41569 Implement delete request using Apache Kafka
This is implemented using a fake MTB file containing a rejected
consent state and will be mapped to HTTP DELETE on kafka-to-bwhc
consumer.
2023-08-03 15:14:49 +02:00
ac91620651 Use Map as status body since it contains JSON 2023-08-03 12:59:53 +02:00
577509e6f2 Map 'status_code' and 'status code' to same data value 2023-08-02 16:53:09 +02:00
7f8b21efd2 Handle not parsable data quality reports 2023-08-02 16:23:16 +02:00
70d4fa2f0f Use duplication fingerprinting based on MTB file requests only 2023-08-02 16:10:53 +02:00
35cb258b13 Do not return specific status code based on remote status code 2023-08-02 16:10:18 +02:00
51cf7a7917 Add processor to handle responses from Kafka topic 2023-08-02 12:00:04 +02:00
857bd157a0 Modified config property to select pseudonym generator 2023-08-01 16:06:40 +02:00
ccf6908223 Added statistics update using SSE for delete requests 2023-08-01 13:54:26 +02:00
7a7ea8c96d Extract request processing 2023-08-01 12:39:15 +02:00
9c9760c3ec Add delete requests to be shown in statistics page 2023-08-01 08:46:00 +02:00
4f7f5e4d89 Add request type to be saved with each request 2023-08-01 08:39:30 +02:00
a1e56f1596 Handle delete requests by using REST request to bwHC
Kafka implementation is not implemented yet.
2023-07-31 19:25:15 +02:00
9af0e159b0 Enable patient data deletion 2023-07-31 17:08:44 +02:00
aed5f15d2d Add request ID to Kafka key 2023-07-31 10:35:25 +02:00
aa5b35970a Code polish for PR
* Do not use component creation using annotation on classes since components will
  be created within AppConfiguration config class

* Patient PseudonymizeService intentionally uses prefix. If no prefix is configured,
  the default value "UNKNOWN" will be used to prevent conflicts with other
  organizations and to show the source organization.
2023-07-27 23:16:19 +02:00
90c5b81c2b feat: patient pid may be replaced with gPAS pseudonym, now. 2023-07-27 13:01:58 +02:00
79d83ef04a fix: if no prefix is set, _ is also not added as prefix to patient pseudonym. 2023-07-27 12:18:17 +02:00
cf8c5a8692 fix: wait for kafka to accept message and return success than 2023-07-27 11:49:31 +02:00
4c0a444725 fix: fix kafka key values + add missing component attribute 2023-07-27 11:23:47 +02:00