1
0
mirror of https://github.com/pcvolkmer/etl-processor.git synced 2025-04-20 01:36:50 +00:00

155 Commits

Author SHA1 Message Date
8dc82225a4
Issue #7: Send and expect requestId in record body, not in record key (#8) 2023-08-16 15:25:46 +02:00
2eb5cc61b9 Change Kafka response body JSON alias 2023-08-15 10:58:17 +02:00
66dc96680d Update dev config and added related information into README.md 2023-08-15 01:09:22 +02:00
72295202ec Code cleanup 2023-08-12 22:19:29 +02:00
6ecb439007
Issue #3: Detect the request type of request with last known status (#5) 2023-08-11 09:22:54 +02:00
cb9c590472
Issue #2: Do not serialize JSON string as custom string (#4)
In addition to that, if REST request did not contain a response body, use empty
string as data quality report string.
2023-08-11 09:13:45 +02:00
002b0618cf Add tests for KafkaMtbFileSender 2023-08-10 13:35:35 +02:00
2b42a4d262 Tests for RestMtbFileSender 2023-08-10 12:14:13 +02:00
1a640ff9df Decouple request and response processing 2023-08-09 18:15:20 +02:00
7f048e2483 Do not append custom prefix to gPAS pseudonym 2023-08-09 12:26:57 +02:00
47830ed9f7 Use single MtbFileSender 2023-08-09 10:34:23 +02:00
13bfa0018d Change endpoint configuration to select single endpoint
* If REST endpoint is configured, it will be used
* If Kafka endpoint is configured, it will be used
* If both endpoints are configured, REST configuration has precedence and will be used
2023-08-09 10:22:03 +02:00
7739afad1f Handle MTB File with rejected consent as deletion request 2023-08-09 08:13:27 +02:00
6ad6ee13a1 Ignore unknown properties in DataQualityResponse 2023-08-08 19:20:45 +02:00
422441a3b3 Add tests for RequestProcessor 2023-08-08 16:46:02 +02:00
bcc23f6b14 Add RequestService to handle access to requests 2023-08-08 14:57:31 +02:00
459ad59c1d Do not detect duplicates after deletion request 2023-08-04 11:43:23 +02:00
b14f2c1794 Add information about 'no connection' responses 2023-08-03 16:18:16 +02:00
ec76c775d9 Explicit producer topic configuration 2023-08-03 16:04:57 +02:00
3dcee41569 Implement delete request using Apache Kafka
This is implemented using a fake MTB file containing a rejected
consent state and will be mapped to HTTP DELETE on kafka-to-bwhc
consumer.
2023-08-03 15:14:49 +02:00
ac91620651 Use Map as status body since it contains JSON 2023-08-03 12:59:53 +02:00
577509e6f2 Map 'status_code' and 'status code' to same data value 2023-08-02 16:53:09 +02:00
7f8b21efd2 Handle not parsable data quality reports 2023-08-02 16:23:16 +02:00
70d4fa2f0f Use duplication fingerprinting based on MTB file requests only 2023-08-02 16:10:53 +02:00
35cb258b13 Do not return specific status code based on remote status code 2023-08-02 16:10:18 +02:00
51cf7a7917 Add processor to handle responses from Kafka topic 2023-08-02 12:00:04 +02:00
857bd157a0 Modified config property to select pseudonym generator 2023-08-01 16:06:40 +02:00
ccf6908223 Added statistics update using SSE for delete requests 2023-08-01 13:54:26 +02:00
7a7ea8c96d Extract request processing 2023-08-01 12:39:15 +02:00
11ed3a6296 Show request type in addition to state and ID 2023-08-01 08:53:43 +02:00
9c9760c3ec Add delete requests to be shown in statistics page 2023-08-01 08:46:00 +02:00
4f7f5e4d89 Add request type to be saved with each request 2023-08-01 08:39:30 +02:00
a1e56f1596 Handle delete requests by using REST request to bwHC
Kafka implementation is not implemented yet.
2023-07-31 19:25:15 +02:00
e1d05ef574 Mark delete requests with errors or success as expected 2023-07-31 19:23:12 +02:00
9af0e159b0 Enable patient data deletion 2023-07-31 17:08:44 +02:00
aed5f15d2d Add request ID to Kafka key 2023-07-31 10:35:25 +02:00
361bba5b65 Code polish for PR
* Keep old config files
2023-07-31 09:05:51 +02:00
aa5b35970a Code polish for PR
* Do not use component creation using annotation on classes since components will
  be created within AppConfiguration config class

* Patient PseudonymizeService intentionally uses prefix. If no prefix is configured,
  the default value "UNKNOWN" will be used to prevent conflicts with other
  organizations and to show the source organization.
2023-07-27 23:16:19 +02:00
Jakub Lidke
90c5b81c2b feat: patient pid may be replaced with gPAS pseudonym, now. 2023-07-27 13:01:58 +02:00
Jakub Lidke
79d83ef04a fix: if no prefix is set, _ is also not added as prefix to patient pseudonym. 2023-07-27 12:18:17 +02:00
Jakub Lidke
cf8c5a8692 fix: wait for kafka to accept message and return success than 2023-07-27 11:49:31 +02:00
Jakub Lidke
4c0a444725 fix: fix kafka key values + add missing component attribute 2023-07-27 11:23:47 +02:00
Jakub Lidke
0defbb05ba fix: add message key value while producing messages to kafka topic 2023-07-26 12:28:03 +02:00
ed17a803bf Fetch overall request statistic using sql query 2023-07-26 09:50:16 +02:00
5c6384e878 Add statistics for state per patient 2023-07-26 09:39:31 +02:00
26312c8620 Add human readable data quality report 2023-07-26 08:39:58 +02:00
cd20e0a170 Check fingerprint against last accepted mtb file 2023-07-25 21:35:26 +02:00
c8f1f1df14 Remove obsolete return 2023-07-25 21:25:19 +02:00
1a2d4ea7a2 (Near) realtime update of statistics charts 2023-07-25 21:20:50 +02:00
94846deb98 Added Link to request report 2023-07-25 18:37:33 +02:00