1
0
mirror of https://github.com/pcvolkmer/etl-processor.git synced 2025-04-20 01:36:50 +00:00

53 Commits

Author SHA1 Message Date
6ad6ee13a1 Ignore unknown properties in DataQualityResponse 2023-08-08 19:20:45 +02:00
536ecbbd56 Add tests for error response status 2023-08-08 18:52:03 +02:00
422441a3b3 Add tests for RequestProcessor 2023-08-08 16:46:02 +02:00
b75328b74d Move integration tests into own source-set 2023-08-08 15:16:58 +02:00
4051b5094c Keep database testcontainer alive until all tests are done 2023-08-08 14:58:10 +02:00
bcc23f6b14 Add RequestService to handle access to requests 2023-08-08 14:57:31 +02:00
1fc09d691e Rename test class to match applications main class name 2023-08-08 13:34:53 +02:00
3039b4b2a7 Add basic Testcontainers test setup 2023-08-08 13:23:37 +02:00
3dea664999 Update Spring Boot dependencies 2023-08-08 12:46:04 +02:00
459ad59c1d Do not detect duplicates after deletion request 2023-08-04 11:43:23 +02:00
b14f2c1794 Add information about 'no connection' responses 2023-08-03 16:18:16 +02:00
ec76c775d9 Explicit producer topic configuration 2023-08-03 16:04:57 +02:00
3dcee41569 Implement delete request using Apache Kafka
This is implemented using a fake MTB file containing a rejected
consent state and will be mapped to HTTP DELETE on kafka-to-bwhc
consumer.
2023-08-03 15:14:49 +02:00
ac91620651 Use Map as status body since it contains JSON 2023-08-03 12:59:53 +02:00
577509e6f2 Map 'status_code' and 'status code' to same data value 2023-08-02 16:53:09 +02:00
7f8b21efd2 Handle not parsable data quality reports 2023-08-02 16:23:16 +02:00
70d4fa2f0f Use duplication fingerprinting based on MTB file requests only 2023-08-02 16:10:53 +02:00
35cb258b13 Do not return specific status code based on remote status code 2023-08-02 16:10:18 +02:00
51cf7a7917 Add processor to handle responses from Kafka topic 2023-08-02 12:00:04 +02:00
db631fbd8e Added more information about pseudonym generators 2023-08-01 16:06:57 +02:00
857bd157a0 Modified config property to select pseudonym generator 2023-08-01 16:06:40 +02:00
ccf6908223 Added statistics update using SSE for delete requests 2023-08-01 13:54:26 +02:00
7a7ea8c96d Extract request processing 2023-08-01 12:39:15 +02:00
11ed3a6296 Show request type in addition to state and ID 2023-08-01 08:53:43 +02:00
9c9760c3ec Add delete requests to be shown in statistics page 2023-08-01 08:46:00 +02:00
4f7f5e4d89 Add request type to be saved with each request 2023-08-01 08:39:30 +02:00
a1e56f1596 Handle delete requests by using REST request to bwHC
Kafka implementation is not implemented yet.
2023-07-31 19:25:15 +02:00
e1d05ef574 Mark delete requests with errors or success as expected 2023-07-31 19:23:12 +02:00
9af0e159b0 Enable patient data deletion 2023-07-31 17:08:44 +02:00
aed5f15d2d Add request ID to Kafka key 2023-07-31 10:35:25 +02:00
2d140d94b2 Add Apache Kafka to dev compose file 2023-07-31 10:35:25 +02:00
c8b2e50d47
Merge pull request #1 from CCC-MF/add-gPas-support
Add g pas support
2023-07-31 09:07:14 +02:00
361bba5b65 Code polish for PR
* Keep old config files
2023-07-31 09:05:51 +02:00
aa5b35970a Code polish for PR
* Do not use component creation using annotation on classes since components will
  be created within AppConfiguration config class

* Patient PseudonymizeService intentionally uses prefix. If no prefix is configured,
  the default value "UNKNOWN" will be used to prevent conflicts with other
  organizations and to show the source organization.
2023-07-27 23:16:19 +02:00
Jakub Lidke
90c5b81c2b feat: patient pid may be replaced with gPAS pseudonym, now. 2023-07-27 13:01:58 +02:00
Jakub Lidke
79d83ef04a fix: if no prefix is set, _ is also not added as prefix to patient pseudonym. 2023-07-27 12:18:17 +02:00
Jakub Lidke
469c58fe26 chore: update .gitignore do not checkin gpas files 2023-07-27 11:50:49 +02:00
Jakub Lidke
cf8c5a8692 fix: wait for kafka to accept message and return success than 2023-07-27 11:49:31 +02:00
Jakub Lidke
e9e7139ca4 test: add kafka test/dev environment docker-compose.dev.yml; add README_TEST_WITH_GPAS.md 2023-07-27 11:25:32 +02:00
Jakub Lidke
4c0a444725 fix: fix kafka key values + add missing component attribute 2023-07-27 11:23:47 +02:00
Jakub Lidke
0defbb05ba fix: add message key value while producing messages to kafka topic 2023-07-26 12:28:03 +02:00
ed17a803bf Fetch overall request statistic using sql query 2023-07-26 09:50:16 +02:00
5c6384e878 Add statistics for state per patient 2023-07-26 09:39:31 +02:00
26312c8620 Add human readable data quality report 2023-07-26 08:39:58 +02:00
cd20e0a170 Check fingerprint against last accepted mtb file 2023-07-25 21:35:26 +02:00
c8f1f1df14 Remove obsolete return 2023-07-25 21:25:19 +02:00
1a2d4ea7a2 (Near) realtime update of statistics charts 2023-07-25 21:20:50 +02:00
94846deb98 Added Link to request report 2023-07-25 18:37:33 +02:00
cd46fa7e09 Add start and statistics page 2023-07-25 16:50:20 +02:00
46928964ef Add postgres migration file and configuration for postgres 2023-07-25 16:48:45 +02:00