Ask.Cyberinfrastructure

How to achieve the best throughput of many parallel jobs? [Q&A] (2)
How I can improve the performance of my job that needs to perform many I/O operations with a very large text file [Q&A] (2)
I am an LSF user moving to SLURM. What are a few basic commands that I can use to get started? [Q&A] (3)
What speed up does the latest Intel compiler achieve on the Stream benchmark relative to the latest GNU compilers? [Q&A] (2)
Which R package is more efficient to use for parallelization? [Q&A] (4)
What are some ways to organize the modules created to manage multiple versions and combinations of compilers, tools, drivers and libraries on a shared cluster? [Q&A] (3)
Transferring multiple TB-sized files between my local cluster and AWS S3 storage [Q&A] (2)
When should I use CfnCluster over Batch for HPC workloads in AWS? [Q&A] (2)
How suited to HPC software are cloud resources, including AWS, Azure and GCE? [Discussion Zone] (2)
How do you handle emergency resource requests with the SGE scheduler, while still maintaining fair access to all users? [Discussion Zone] (2)
What is a "tarpipe" and how do I use it? [Q&A] (2)
Can anyone provide a brief overview of LAMMPS and its capabilities? [Q&A] (2)
What is a "Burst Buffer"? [Q&A] (2)
How will the AWS suspend capability affect price comparisons between in-house operated resources and cloud based? [Q&A] (2)
"slurmstepd: error: Exceeded step memory limit at some point" [Q&A] (3)
How can I manage a large number of very small independent jobs of varying length with some order dependencies? [Q&A] (3)
How can I find information about the version of GPFS running on a cluster? [Q&A] (2)
Build of Abinit v8 with netCDF [Q&A] (2)
How do I do a "parameter-sweep" with SGE? [Q&A] (2)
How can I use SLURM’s sacct command to show memory usage statistics on a cluster that I am administering? [Q&A] (3)
How do I get my jobs to be scheduled as fast as possible? [Q&A] (4)
How to use a parameter-sweep or task array without numbering the files? [Q&A] (2)
HPC versus HTC differences [Q&A] (2)
How do I run Apache Spark in an HPC environment? [Q&A] (2)
How do I write a SLURM batch script for jobs that use both MPI and OpenMP? [Q&A] (2)
Obtaining local (temporary) disk space information using SLURM [Q&A] (3)
Why am I exceeding the quota? [Q&A] (3)
How do I know if my job is parallelizing when submitted as a batch script? [Q&A] (4)
How can I run Gaussian09 on a server? [Q&A] (2)
How many processors and how much memory should I request for a Gaussian calculation? [Q&A] (2)