# \#scaling

**URL:** https://ask.cyberinfrastructure.org/tag/scaling/213.md

[Latest](https://ask.cyberinfrastructure.org/latest.md) · [Categories](https://ask.cyberinfrastructure.org/categories.md) · [Tags](https://ask.cyberinfrastructure.org/tags.md)

---

## [Is there a way to process archived files without fully extracting them to disk?](https://ask.cyberinfrastructure.org/t/is-there-a-way-to-process-archived-files-without-fully-extracting-them-to-disk/264)

<div class="topic-metadata">

**Author:** [@jkingsley](https://ask.cyberinfrastructure.org/u/jkingsley)\
**Replies:** 7\
**Last updated:** [May 31, 2019, 8:27pm UTC](https://ask.cyberinfrastructure.org/t/is-there-a-way-to-process-archived-files-without-fully-extracting-them-to-disk/264 "2019-05-31T20:27:49Z")

</div>

For a particular type of analysis, I have a large set of \*.tar.gz files. While they are relatively modest in size (100MB-1GB), they are full of roughly 1kB files. In testing, the overhead of extracting hundreds of thou…

---

## [My R loop slows down when I increase the number of iterations on an HPC](https://ask.cyberinfrastructure.org/t/my-r-loop-slows-down-when-i-increase-the-number-of-iterations-on-an-hpc/215)

<div class="topic-metadata">

**Author:** [@ktrn](https://ask.cyberinfrastructure.org/u/ktrn)\
**Replies:** 1\
**Last updated:** [May 31, 2018, 9:09pm UTC](https://ask.cyberinfrastructure.org/t/my-r-loop-slows-down-when-i-increase-the-number-of-iterations-on-an-hpc/215 "2018-05-31T21:09:27Z")

</div>

I wrote an R script and tested it on my laptop. It finishes 100 iterations in about 1 minute. However I need to run this code for 10,000 iterations, so I submitted my job to run on a cluster. I expected my script to take…