Proposal: Large Data Support

[cmbz]

Purpose

Define a proposed set of service categories, offerings, and related policies for supporting large data in the Harvard Dataverse Repository.

Background

• The number of requests for depositing large datasets into Harvard Dataverse has increased over the past several years.
  Datasets in Harvard Dataverse are growing in size, in some cases beyond the 2.5T limit for Harvard affiliates and the 1T limit for non-Harvard affiliates. We need an approach to manage this growth. Efforts to monitor and enforce collection size are underway.
• The Dataverse Project has committed to support for large data and for using Harvard Dataverse as a metadata registry--with data stored elsewhere--as part of its participation in the NIH GREI OTA grant.
• This proposal connects these related concerns and workstreams to advance several service categories, policies, and service offerings for supporting large data in Harvard Dataverse.

Overview

• This proposal leverages four existing Harvard data storage options to define large data support service categories and related service offerings and policies.
• Proposal: Large Data Support for Harvard Dataverse.

Related Use Cases

• Project: MOC Proof-of-Concept#105
• Project: ADMIRE Project Proof-of-Concept#104

[cmbz]

2024/06/05

• Closing as complete. Continued in Service: Harvard Dataverse Repository Large Data Services #268