Code

BC-5628 cyclic data deletion#4557

Code

Merged

WojciechGrancow merged 116 commits intomainhpi-schul-cloud/schulcloud-server:mainfrom BC-5628-cyclic-data-deletionhpi-schul-cloud/schulcloud-server:BC-5628-cyclic-data-deletionCopy head branch name to clipboardNov 28, 2023

+561-34

Commits

Commits on Oct 19, 2023

• first commit

  WojciechGrancow

  committed
  ca59c48

Commits on Oct 20, 2023

• add some tests

  WojciechGrancow

  committed
  5838b81

Commits on Oct 27, 2023

• add test cases and services

  WojciechGrancow

  committed
  7df7c23

Commits on Oct 30, 2023

• add new (almost empty for now) batch deletion app

  bn-pass

  committed
  1b07d3f

Commits on Oct 31, 2023

• refactor config vars

  bn-pass

  committed
  dec5292

• add optional env var for specifying delay between the API calls

  bn-pass

  committed
  29c58a0

Commits on Nov 1, 2023

• add usecases and test cases

  WojciechGrancow

  committed
  a853ea7

• Merge branch 'main' into BC-5521-implementation-KNL-Module

  WojciechGrancow

  committed
  72c84b4

• fix importing

  WojciechGrancow

  committed
  c56ae3d

Commits on Nov 2, 2023

• add type in uc

  WojciechGrancow

  committed
  cad4491

• fix import

  WojciechGrancow

  committed
  b80ff0e

• add references service that'll load all the references to the data we want to delete

  bn-pass

  committed
  5d764d0

Commits on Nov 3, 2023

• fix most of issue form review

  WojciechGrancow

  committed
  c226c6d

• Merge branch 'BC-5521-implementation-KNL-Module' into BC-5629-batch-deletion-mechanism

  bn-pass

  committed
  31a225c

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  fdbe8c9

Commits on Nov 4, 2023

• add deletion API client with just a single method for now that allows for sending a deletion request

  bn-pass

  committed
  78ed3b9

• refactor the env vars for configurting the Admin API

  bn-pass

  committed
  3acf266

• add exporting DeletionClientConfig

  bn-pass

  committed
  f2ac1bc

• move references service to the deletion module

  bn-pass

  committed
  b69741a

• delete unused code

  bn-pass

  committed
  0c02d6d

• add batch deletion service that makes it possible ot queue deletion for many references at once

  bn-pass

  committed
  30412f9

• move some parts of the interface to the interface subdir

  bn-pass

  committed
  13f7b57

• add an interface for the batch deletion summary

  bn-pass

  committed
  61a0814

• move some interfaces to a separate subdir

  bn-pass

  committed
  6c72715

• refactor the batch deletion summary interface

  bn-pass

  committed
  46395c0

• add uc for the batch deletion

  bn-pass

  committed
  f204220

Commits on Nov 6, 2023

• remove unused annotation

  bn-pass

  committed
  3ecc282

• refactor deletion client implementation

  bn-pass

  committed
  78dedbf

• add batch deletion service implementation

  bn-pass

  committed
  6c66cf6

Commits on Nov 7, 2023

• add UC for the batch deletion

  bn-pass

  committed
  1c8cae9

• add a console app for the deletion module and a console command to manage deletion requests queue

  bn-pass

  committed
  90aca19

• remove no longer used app, add param to make it possible to define delay between the client calls for the case one would like to queue many thousands of deletion requests at once

  bn-pass

  committed
  20a04e9

• remove no longer used separate batch-deletion module (it became a part of the main deletion module)

  bn-pass

  committed
  9e0d281

• fix invalid key

  bn-pass

  committed
  ab14b19

• remove no longer used config vars

  bn-pass

  committed
  4d13aa5

• remove no longer used commands

  bn-pass

  committed
  ee43ec2

• remove no longer used Nest cli config

  bn-pass

  committed
  8dbeeb7

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  8018c6e

• remove no longer used code

  bn-pass

  committed
  71d0b40

• change name of the method that prepares default headers

  bn-pass

  committed
  4c5de4e

• add builders for most of the interfaces

  bn-pass

  committed
  02c5ed4

• add builders for the remaining interfaces

  bn-pass

  committed
  df4124e

• add type in catch clause

  bn-pass

  committed
  0d0fdb2

• do some adjustments, move PushDeletionRequestsOptions interface to a separate file

  bn-pass

  committed
  62695f5

• remove unused import

  bn-pass

  committed
  a1c7477

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  141d5d2

• rollback

  bn-pass

  authored
  5d19f5d

• remove unnecessary indent

  bn-pass

  authored
  a63c594

• remove unnecessary indents

  bn-pass

  authored
  2f52adc

• remove empty line

  bn-pass

  authored
  9001592

• remove repeated imports

  bn-pass

  committed
  da9c2a6

• refactor some imports to omit calling Configuration.get() on every subpackage import

  bn-pass

  committed
  66daec1

Commits on Nov 8, 2023

• add builder for the DeletionRequestOutput class

  bn-pass

  committed
  2bffa6d

• add unit tests for the batch deletion service

  bn-pass

  committed
  06ef50b

• add unit tests for the BatchDeletionUc

  bn-pass

  committed
  5317dae

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  e9d5559

• modify env keys for the Admin API client configuration, refactor the way the deletion module's console is bootstrapped

  bn-pass

  committed
  a1b117b

• Merge branch 'BC-5629-batch-deletion-mechanism' of https://github.com/hpi-schul-cloud/schulcloud-server into BC-5629-batch-deletion-mechanism

  bn-pass

  committed
  5dd40a7

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  aa378b0

• fix invalid import, remove unused undefined arg

  bn-pass

  committed
  ebfe6bd

• add comment to ignore console.ts file for coverage

  bn-pass

  committed
  9f62aa7

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  8706f50

• move deletion client config interface to a separate file, refactor function that prepares current config, add unit tests for it

  bn-pass

  committed
  abc6656

• Merge branch 'BC-5629-batch-deletion-mechanism' of https://github.com/hpi-schul-cloud/schulcloud-server into BC-5629-batch-deletion-mechanism

  bn-pass

  committed
  e057fe0

• fix invalid import

  bn-pass

  committed
  638d1e9

• add more test cases to the deletion client unit tests

  bn-pass

  committed
  a5180ae

• change invalid import

  Show description for e1c9312
  

  bn-pass

  and

  WojciechGrancow

  authored
  e1c9312

• fix invalid import

  bn-pass

  committed
  b35aa9c

• add builder for the PushDeletionRequestsOptions class, add unit tests for the DeletionQueueConsole

  bn-pass

  committed
  667427f

• rename the file containing the deletion module console to deletion.console.ts, add coverage exclusion for it for the Sonar coverage analysis

  bn-pass

  committed
  02bd3a2

• remove deletion.console.ts from the sonar.coverage.exclusions param as it doesn't seem to work anyway

  bn-pass

  committed
  88b0b28

• add deletion.console.ts file to the coverage exclusions (another try with different path)

  bn-pass

  committed
  7f06aa6

Commits on Nov 9, 2023

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  4e26016

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  009bdd1

• change name of the file containing the deletion console app

  bn-pass

  committed
  4d18313

• Merge branch 'BC-5629-batch-deletion-mechanism' of https://github.com/hpi-schul-cloud/schulcloud-server into BC-5629-batch-deletion-mechanism

  bn-pass

  committed
  b12527c

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  d17c097

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  acf51b9

Commits on Nov 10, 2023

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  cca5fff

• add deletion client method that allows for triggering a deletion requests executions

  bn-pass

  committed
  199f582

Commits on Nov 13, 2023

• fix some imports

  bn-pass

  committed
  a3037ea

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  1217640

• move default value for the ADMIN_API_CLIENT object to default.schema.json

  bn-pass

  committed
  d8ff82f

• move default for the BASE_URL

  bn-pass

  committed
  5624dc5

• move Deletion module console app to the apps/ dir

  bn-pass

  committed
  8ec624f

• add separate functino to log error and set exit code

  bn-pass

  committed
  e87ede7

• add handling of the case that only CR chars are used as a line separators

  bn-pass

  committed
  abc83e5

• add use of the BatchDeletionSummaryBuilder in place of an anonymous object creation

  bn-pass

  committed
  3cd6e25

• fix some imports/exports

  bn-pass

  committed
  3bf6813

Commits on Nov 14, 2023

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  28753a5

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  30cfe39

• Merge branch 'main' into BC-5629-batch-deletion-mechanism

  bn-pass

  authored
  d61d6c8

Commits on Nov 15, 2023

• Merge branch 'BC-5629-batch-deletion-mechanism' into BC-5628-cyclic-data-deletion

  bn-pass

  committed
  1c5051d

• add an interface for the deletion execution trigger result, add builder for it as well

  bn-pass

  committed
  ba8a8b9

• add use case for the deletion executions

  bn-pass

  committed
  a148651

• add new interface for the deletion execution trigger options, add builder for it

  bn-pass

  committed
  b7472d1

• add console command for triggering the deletion execution

  bn-pass

  committed
  af2268f

• add Admin API client secret provisioned by 1Password

  bn-pass

  committed
  5e954a7

Commits on Nov 16, 2023

• Merge branch 'main' into BC-5628-cyclic-data-deletion

  bn-pass

  authored
  71dc318

• add data deletion trigger cronjob

  bn-pass

  committed
  c228695

• Merge branch 'BC-5628-cyclic-data-deletion' of https://github.com/hpi-schul-cloud/schulcloud-server into BC-5628-cyclic-data-deletion

  bn-pass

  committed
  ec511e8

• add metadata to the data deletion trigger CronJob

  bn-pass

  committed
  4be9d00

• add task to add data deletion trigger CronJob

  bn-pass

  committed
  6bea44c

Commits on Nov 17, 2023

• Merge branch 'main' into BC-5628-cyclic-data-deletion

  bn-pass

  authored
  ae51bf1

Commits on Nov 21, 2023

• Merge branch 'main' into BC-5628-cyclic-data-deletion

  bn-pass

  authored
  bce7b5a

Commits on Nov 22, 2023

• rewrite HTTP client execution to try/catch block, modify types of returned errors to meet current project's convention

  bn-pass

  committed
  046589f

• modify the solution to not catch the client's exception in the use case, but in the console app's command

  bn-pass

  committed
  f269a64

• add more test cases

  bn-pass

  committed
  014c17a

• delete unnecessary cronjob label

  Show description for 49029ce
  

  bn-pass

  and

  mamutmk5

  authored
  49029ce

• merge labels into metadata

  Show description for 537dc70
  

  bn-pass

  and

  mamutmk5

  authored
  537dc70

• BC-5628 - move logic of errors

  SevenWaysDP

  committed
  982d83d

• Merge branch 'main' into BC-5628-cyclic-data-deletion

  bn-pass

  authored
  1d80735

• adjusted the second client method according to Sergej's proposal

  bn-pass

  committed
  61560e9

• Update apps/server/src/modules/deletion/client/deletion.client.ts

  Show description for d1142da
  

  bn-pass

  and

  SevenWaysDP

  authored
  d1142da

• remove unnecessary label

  bn-pass

  committed
  56bfa00

Commits on Nov 28, 2023

• Merge branch 'main' into BC-5628-cyclic-data-deletion

  WojciechGrancow

  committed
  0f379a0