Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UIDATIMP-1528 Forward merge of file-splitting/DI Task force work for Poppy. #1471

Merged
merged 36 commits into from
Oct 12, 2023
Merged

UIDATIMP-1528 Forward merge of file-splitting/DI Task force work for Poppy. #1471

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
1e6cd05
add multipart upload utility file
JohnC-80 Sep 25, 2023
bbfc863
add composite job status utilities
JohnC-80 Sep 26, 2023
ef68260
add uploadConfiguration to UploadingJobsContext and Provider
JohnC-80 Sep 26, 2023
19c589e
account for uploadConfiguration/splitStatus in DataFetcher
JohnC-80 Sep 26, 2023
d39304b
update multipart upload to handle multiple simultaneous files
JohnC-80 Sep 29, 2023
ac09dd1
implement S3-like upload
JohnC-80 Sep 29, 2023
85f18ec
data fetcher lifecycle adjustment
JohnC-80 Sep 29, 2023
85c5253
add job parts column to job logs
JohnC-80 Sep 29, 2023
4ecd61f
run job modal and job profile view with splitting message and job par…
JohnC-80 Sep 29, 2023
d3fc858
DataFetcher tests
JohnC-80 Sep 29, 2023
2a04d13
translations
JohnC-80 Sep 29, 2023
8924158
filename cell formatter
JohnC-80 Sep 29, 2023
54669f7
wrap all routes, including settings, in UploadJobsContext
JohnC-80 Sep 29, 2023
e32ceb7
Composite job details, running jobs
JohnC-80 Sep 29, 2023
e511ea8
Job Summary and tests
JohnC-80 Sep 29, 2023
c8fb238
util tests
JohnC-80 Sep 29, 2023
0073c97
tests- uploading job display, file item, uploading job context
JohnC-80 Sep 29, 2023
7f46b64
update jobExecution PropTypes
JohnC-80 Sep 29, 2023
4467526
job logs container test
JohnC-80 Sep 29, 2023
4bfff34
view job profile tests
JohnC-80 Sep 29, 2023
a050779
add mock for stripes-connect props parameter to ViewAllLogs test
JohnC-80 Oct 2, 2023
8c4be23
Merge branch 'master' into UIDATIMP-1528
JohnC-80 Oct 3, 2023
c902dfa
fix history mocking in tests, lint
JohnC-80 Oct 3, 2023
2844e5d
Merge branch 'master' into UIDATIMP-1528
JohnC-80 Oct 4, 2023
3f2551a
resolve code smells
JohnC-80 Oct 4, 2023
9e4d7a5
Merge branch 'UIDATIMP-1528' of https://github.com/folio-org/ui-data-…
JohnC-80 Oct 4, 2023
0f1ed28
bump version, log changes
JohnC-80 Oct 4, 2023
a29ed97
update mod-data-import interface version
JohnC-80 Oct 5, 2023
2986bb7
pull props from this in cdu lifecycle
JohnC-80 Oct 5, 2023
e460345
fetch newest upload definitions instead of depending on context
JohnC-80 Oct 5, 2023
fa48693
unify appearance of Job profile and download links
JohnC-80 Oct 5, 2023
036ef4b
skip the single failure for now
JohnC-80 Oct 6, 2023
2fbb7e0
Merge branch 'master' into UIDATIMP-1528
ncovercash Oct 9, 2023
d5117ab
Revert version change
ncovercash Oct 9, 2023
5ea3b23
Update permissions
ncovercash Oct 10, 2023
ac415c2
Merge branch 'master' into UIDATIMP-1528
ncovercash Oct 12, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,13 @@
* leverage jest-config-stripes for all jest and testing-library packages (UIDATIMP-1508)
* *BREAKING* bump `react-intl` to `v6.4.4` (UIDATIMP-1520)
* Bump the major versions of @folio/plugin-find-organization optionalDependencies (UIDATIMP-1532)
* Implement file upload to S3 (UIDATIMP-1460)
* Perform rough split on front-end for multipart Upload (UIDATIMP-1468)
* Notify users that large files will be split (UIDATIMP-1463)
* Retrieve backend configuration for splitting in UI (UIDATIMP-1462)
* Render details of composite jobs in on consolidated running job cards (UIDATIMP-1466)
* Display a link to download a slice from the automated splitting process (UIDATIMP-1510)
* Cancel upload/running a split job (UIDATIMP-1469)
* Fetch Job summary data with for a particular tenant id (UIDATIMP-1540)

### Bugs fixed:
Expand Down
170 changes: 89 additions & 81 deletions package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,7 +168,7 @@
}
],
"okapiInterfaces": {
"data-import": "3.0",
"data-import": "3.1",
"source-manager-job-executions": "3.0",
"data-import-converter-storage": "1.2"
},
Expand All @@ -183,27 +183,31 @@
"displayName": "Data import: Can upload files, import, and view logs",
"subPermissions": [
"module.data-import.enabled",
"metadata-provider.logs.get",
"metadata-provider.jobexecutions.get",
"data-import.uploaddefinitions.get",
"data-import.uploaddefinitions.post",
"data-import.uploaddefinitions.delete",
"data-import.uploaddefinitions.files.delete",
"data-import.upload.file.post",
"data-import.fileExtensions.get",
"data-import.uploaddefinitions.files.post",
"source-storage.records.get",
"change-manager.records.delete",
"change-manager.jobexecutions.get",
"inventory-storage.authorities.collection.get",
"invoice-storage.invoices.item.get",
"invoice-storage.invoice-lines.item.get",
"converter-storage.jobprofile.get",
"converter-storage.matchprofile.get",
"change-manager.records.delete",
"configuration.entries.collection.get",
"converter-storage.actionprofile.get",
"converter-storage.jobprofile.get",
"converter-storage.mappingprofile.get",
"converter-storage.matchprofile.get",
"converter-storage.profileassociation.get",
"configuration.entries.collection.get",
"data-import.assembleStorageFile.post",
"data-import.fileExtensions.get",
"data-import.jobexecution.cancel",
"data-import.upload.file.post",
"data-import.uploaddefinitions.delete",
"data-import.uploaddefinitions.files.delete",
"data-import.uploaddefinitions.files.post",
"data-import.uploaddefinitions.get",
"data-import.uploaddefinitions.post",
"data-import.uploaddefinitions.put",
"data-import.uploadUrl.get",
"invoice-storage.invoice-lines.item.get",
"invoice-storage.invoices.item.get",
"metadata-provider.jobexecutions.get",
"metadata-provider.logs.get",
"source-storage.records.get",
"ui-data-import.view",
"ui-orders.orders.view"
],
"visible": true
Expand All @@ -213,11 +217,13 @@
"displayName": "Data import: Can view only",
"subPermissions": [
"module.data-import.enabled",
"change-manager.jobexecutions.get",
"data-import.downloadUrl.get",
"data-import.splitconfig.get",
"data-import.uploaddefinitions.get",
"metadata-provider.logs.get",
"metadata-provider.jobexecutions.get",
"source-storage.records.get",
"change-manager.jobexecutions.get"
"metadata-provider.logs.get",
"source-storage.records.get"
],
"visible": true
},
Expand All @@ -243,63 +249,64 @@
"displayName": "Settings (Data import): Can view, create, edit, and remove",
"subPermissions": [
"settings.data-import.enabled",
"data-import.fileExtensions.get",
"data-import.fileExtensions.post",
"data-import.fileExtensions.put",
"data-import.fileExtensions.delete",
"data-import.fileExtensions.default",
"acquisitions-units.units.collection.get",
"batch-groups.collection.get",
"configuration.entries.collection.get",
"converter-storage.actionprofile.delete",
"converter-storage.actionprofile.get",
"converter-storage.actionprofile.post",
"converter-storage.actionprofile.put",
"converter-storage.field-protection-settings.delete",
"converter-storage.field-protection-settings.get",
"converter-storage.field-protection-settings.post",
"converter-storage.field-protection-settings.put",
"converter-storage.field-protection-settings.delete",
"converter-storage.jobprofilesnapshots.get",
"converter-storage.jobprofilesnapshots.post",
"converter-storage.profileSnapshots.get",
"converter-storage.jobprofile.delete",
"converter-storage.jobprofile.delete",
"converter-storage.jobprofile.get",
"converter-storage.jobprofile.post",
"converter-storage.jobprofile.put",
"converter-storage.jobprofile.delete",
"converter-storage.matchprofile.get",
"converter-storage.matchprofile.post",
"converter-storage.matchprofile.put",
"converter-storage.matchprofile.delete",
"converter-storage.jobprofile.delete",
"converter-storage.actionprofile.get",
"converter-storage.actionprofile.post",
"converter-storage.actionprofile.put",
"converter-storage.actionprofile.delete",
"converter-storage.jobprofilesnapshots.get",
"converter-storage.jobprofilesnapshots.post",
"converter-storage.mappingprofile.delete",
"converter-storage.mappingprofile.get",
"converter-storage.mappingprofile.post",
"converter-storage.mappingprofile.put",
"converter-storage.mappingprofile.delete",
"converter-storage.matchprofile.delete",
"converter-storage.matchprofile.get",
"converter-storage.matchprofile.post",
"converter-storage.matchprofile.put",
"converter-storage.profileassociation.get",
"inventory-storage.identifier-types.collection.get",
"inventory-storage.instance-statuses.collection.get",
"inventory-storage.statistical-codes.collection.get",
"inventory-storage.statistical-code-types.collection.get",
"inventory-storage.nature-of-content-terms.collection.get",
"inventory-storage.holdings-types.collection.get",
"inventory-storage.locations.collection.get",
"converter-storage.profileSnapshots.get",
"data-import.fileExtensions.default",
"data-import.fileExtensions.delete",
"data-import.fileExtensions.get",
"data-import.fileExtensions.post",
"data-import.fileExtensions.put",
"data-import.splitconfig.get",
"finance.expense-classes.collection.get",
"finance.funds.collection.get",
"inventory-storage.call-number-types.collection.get",
"inventory-storage.ill-policies.collection.get",
"inventory-storage.holdings-note-types.collection.get",
"inventory-storage.electronic-access-relationships.collection.get",
"inventory-storage.material-types.collection.get",
"inventory-storage.holdings-note-types.collection.get",
"inventory-storage.holdings-types.collection.get",
"inventory-storage.identifier-types.collection.get",
"inventory-storage.ill-policies.collection.get",
"inventory-storage.instance-statuses.collection.get",
"inventory-storage.item-damaged-statuses.collection.get",
"inventory-storage.loan-types.collection.get",
"inventory-storage.item-note-types.collection.get",
"configuration.entries.collection.get",
"inventory-storage.loan-types.collection.get",
"inventory-storage.locations.collection.get",
"inventory-storage.material-types.collection.get",
"inventory-storage.nature-of-content-terms.collection.get",
"inventory-storage.statistical-code-types.collection.get",
"inventory-storage.statistical-codes.collection.get",
"mapping-rules.get",
"mapping-rules.update",
"mapping-rules.restore",
"mapping-rules.update",
"metadata-provider.jobexecutions.get",
"organizations.organizations.collection.get",
"tags.collection.get",
"tags.item.post",
"acquisitions-units.units.collection.get",
"batch-groups.collection.get",
"finance.funds.collection.get",
"finance.expense-classes.collection.get",
"organizations.organizations.collection.get",
"ui-orders.orders.view"
],
"visible": true
Expand All @@ -309,38 +316,39 @@
"displayName": "Settings (Data import): Can view only",
"subPermissions": [
"settings.data-import.enabled",
"data-import.fileExtensions.get",
"acquisitions-units.units.collection.get",
"batch-groups.collection.get",
"configuration.entries.collection.get",
"converter-storage.actionprofile.get",
"converter-storage.field-protection-settings.get",
"converter-storage.jobprofilesnapshots.get",
"converter-storage.profileSnapshots.get",
"converter-storage.jobprofile.get",
"converter-storage.matchprofile.get",
"converter-storage.actionprofile.get",
"converter-storage.jobprofilesnapshots.get",
"converter-storage.mappingprofile.get",
"converter-storage.matchprofile.get",
"converter-storage.profileassociation.get",
"inventory-storage.identifier-types.collection.get",
"inventory-storage.instance-statuses.collection.get",
"inventory-storage.statistical-codes.collection.get",
"inventory-storage.statistical-code-types.collection.get",
"inventory-storage.nature-of-content-terms.collection.get",
"inventory-storage.holdings-types.collection.get",
"inventory-storage.locations.collection.get",
"converter-storage.profileSnapshots.get",
"data-import.fileExtensions.get",
"data-import.splitconfig.get",
"finance.expense-classes.collection.get",
"finance.funds.collection.get",
"inventory-storage.call-number-types.collection.get",
"inventory-storage.ill-policies.collection.get",
"inventory-storage.holdings-note-types.collection.get",
"inventory-storage.electronic-access-relationships.collection.get",
"inventory-storage.material-types.collection.get",
"inventory-storage.holdings-note-types.collection.get",
"inventory-storage.holdings-types.collection.get",
"inventory-storage.identifier-types.collection.get",
"inventory-storage.ill-policies.collection.get",
"inventory-storage.instance-statuses.collection.get",
"inventory-storage.item-damaged-statuses.collection.get",
"inventory-storage.loan-types.collection.get",
"inventory-storage.item-note-types.collection.get",
"configuration.entries.collection.get",
"inventory-storage.loan-types.collection.get",
"inventory-storage.locations.collection.get",
"inventory-storage.material-types.collection.get",
"inventory-storage.nature-of-content-terms.collection.get",
"inventory-storage.statistical-code-types.collection.get",
"inventory-storage.statistical-codes.collection.get",
"mapping-rules.get",
"metadata-provider.jobexecutions.get",
"tags.collection.get",
"acquisitions-units.units.collection.get",
"batch-groups.collection.get",
"finance.funds.collection.get",
"finance.expense-classes.collection.get"
"tags.collection.get"
],
"visible": true
}
Expand Down
Loading
Loading