# Storage options for researchers with large data sets

**URL:** <https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218>\
**Category:** Large Data Sets\
**Tags:** data, hpc-getting-started, data-transfer, data-management, data-science-support, big-data, cloud-storage\
**Created:** [February 23, 2022, 4:32am UTC](https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218 "2022-02-23T04:32:08Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![jma](https://ask.cyberinfrastructure.org/user_avatar/ask.cyberinfrastructure.org/jma/32/303_2.png) [@jma](https://ask.cyberinfrastructure.org/u/jma)\
**Post date:** [February 23, 2022, 4:32am UTC](https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218/1 "2022-02-23T04:32:08Z")

</div>

I have a 250T data set that I share with researchers across the country. What resources are available for storing and sharing my data set?

---

<div class="post-metadata">

**Author:** ![oglesbys](https://ask.cyberinfrastructure.org/letter_avatar_proxy/v4/letter/o/41988e/32.png) [@oglesbys](https://ask.cyberinfrastructure.org/u/oglesbys)\
**Post date:** [February 23, 2022, 5:36pm UTC](https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218/2 "2022-02-23T17:36:52Z")

</div>

HI Julie,  
You might be able to leverage the Open Storage Network (assuming the data classification is appropriate). For 250TB you’ll need to contact them directly: [https://www.openstoragenetwork.org/get-involved/get-an-allocation/](https://www.openstoragenetwork.org/get-involved/get-an-allocation/)

Stephen Oglesby (CSU)

(Edit): I forgot to include other Xsede resources as an option, you can view these at this website: [XSEDE User Portal | User Guides](https://portal.xsede.org/user-guides)

---

<div class="post-metadata">

**Author:** ![j\_fossot](https://ask.cyberinfrastructure.org/user_avatar/ask.cyberinfrastructure.org/j_fossot/32/916_2.png) [@j\_fossot](https://ask.cyberinfrastructure.org/u/j_fossot)\
**Post date:** [February 23, 2022, 9:11pm UTC](https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218/3 "2022-02-23T21:11:11Z")

</div>

Just to add to oglesbys. OSN already talks about Globus in their [software stack](https://www.openstoragenetwork.org/documentation/documentation/). You can use  
[Globus to share and manage data](https://www.globus.org/) (very handy)

---

<div class="post-metadata">

**Author:** ![sarya](https://ask.cyberinfrastructure.org/letter_avatar_proxy/v4/letter/s/3ab097/32.png) [@sarya](https://ask.cyberinfrastructure.org/u/sarya)\
**Post date:** [March 16, 2023, 6:02am UTC](https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218/4 "2023-03-16T06:02:30Z")

</div>

here are several resources available for storing and sharing large data sets like yours. Here are a few options you may want to consider:

1. Cloud-based storage: Cloud storage services like Amazon S3, Microsoft Azure Blob Storage, and Google Cloud Storage provide scalable, cost-effective storage solutions for large data sets. These services also offer features like data encryption, access control, and high availability to ensure that your data is secure and easily accessible.
2. Data sharing platforms: There are many data sharing platforms that allow researchers to share and collaborate on large data sets, such as Globus, Figshare, and Zenodo. These platforms often have features like version control, access control, and DOI assignment to make it easy to share and cite your data.
3. Academic research networks: Many academic research networks offer data storage and sharing services for researchers, such as XSEDE, Internet2, and Eduroam. These networks often provide high-speed connectivity, security, and support for data-intensive research projects.
4. National data repositories: There are several national data repositories that provide long-term storage and sharing of large data sets, such as the National Center for Biotechnology Information (NCBI) and the National Oceanic and Atmospheric Administration (NOAA) National Centers for Environmental Information (NCEI).

---

<div class="post-metadata">

**Author:** ![jfossot](https://ask.cyberinfrastructure.org/user_avatar/ask.cyberinfrastructure.org/jfossot/32/932_2.png) [@jfossot](https://ask.cyberinfrastructure.org/u/jfossot)\
**Post date:** [April 14, 2023, 3:38pm UTC](https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218/5 "2023-04-14T15:38:20Z")

</div>

Sarya,  
Please note that jma is asking about storing and sharing 250T of data (This a large volume of data). your point 1 is a viable storage solution and if you couple that with Globus then you have a way to store, manage and share **large** data. As for the rest of your points I am not quite sure how they address the question
