# \#hpc-getting-started **URL:** https://ask.cyberinfrastructure.org/tag/hpc-getting-started/14.md [Latest](https://ask.cyberinfrastructure.org/latest.md) · [Categories](https://ask.cyberinfrastructure.org/categories.md) · [Tags](https://ask.cyberinfrastructure.org/tags.md) --- ## [Best Practices for asking and answering questions on Ask.CI](https://ask.cyberinfrastructure.org/t/best-practices-for-asking-and-answering-questions-on-ask-ci/4214)
**Author:** [@ktrn](https://ask.cyberinfrastructure.org/u/ktrn)\ **Replies:** 1\ **Last updated:** [April 18, 2025, 3:24pm UTC](https://ask.cyberinfrastructure.org/t/best-practices-for-asking-and-answering-questions-on-ask-ci/4214 "2025-04-18T15:24:35Z")
What are the best practices for asking questions and answering questions on Ask.CI? --- ## [What solution is used by your institution to document Research Computing Activities?](https://ask.cyberinfrastructure.org/t/what-solution-is-used-by-your-institution-to-document-research-computing-activities/4437)
**Author:** [@jfossot](https://ask.cyberinfrastructure.org/u/jfossot)\ **Replies:** 0\ **Last updated:** [June 4, 2026, 3:17pm UTC](https://ask.cyberinfrastructure.org/t/what-solution-is-used-by-your-institution-to-document-research-computing-activities/4437 "2026-06-04T15:17:52Z")
This summary reflects the collective experience and advice of research IT professionals, providing a practical reference for organizations seeking to improve their documentation solutions. To create a brief report of th… --- ## [Question about using HPC ecosystem](https://ask.cyberinfrastructure.org/t/question-about-using-hpc-ecosystem/3140)
**Author:** [@noorollah.hematidous](https://ask.cyberinfrastructure.org/u/noorollah.hematidous)\ **Replies:** 3\ **Last updated:** [May 30, 2024, 3:09pm UTC](https://ask.cyberinfrastructure.org/t/question-about-using-hpc-ecosystem/3140 "2024-05-30T15:09:22Z")
Hello, I am a student in Iran but I am currently in Italy and doing research in an Italian university. Can I use ACCESS HPC for running my simulation codes? Is there any restriction on Iranian students for using HPC ec… --- ## [HPC Training Resources](https://ask.cyberinfrastructure.org/t/hpc-training-resources/197)
**Author:** [@wirawan0](https://ask.cyberinfrastructure.org/u/wirawan0)\ **Replies:** 5\ **Last updated:** [May 23, 2024, 5:53pm UTC](https://ask.cyberinfrastructure.org/t/hpc-training-resources/197 "2024-05-23T17:53:52Z")
Looks like training and education in the HPC/research computing realm needs its own place. This will be an area where one asks questions about approaches in training and education. --- ## [How do I create my own cluster?](https://ask.cyberinfrastructure.org/t/how-do-i-create-my-own-cluster/856)
**Author:** [@vsoch](https://ask.cyberinfrastructure.org/u/vsoch)\ **Replies:** 5\ **Last updated:** [May 23, 2024, 5:35pm UTC](https://ask.cyberinfrastructure.org/t/how-do-i-create-my-own-cluster/856 "2024-05-23T17:35:17Z")
I’ve been seeing posts around like this and I’m genuinely interested in what it takes to create your own little cluster. A lot of these discussions start with the assumption that I have a crapton of old equipment lying a… --- ## [Resources for GPU and Google JAX programming](https://ask.cyberinfrastructure.org/t/resources-for-gpu-and-google-jax-programming/3133)
**Author:** [@sam\_dt](https://ask.cyberinfrastructure.org/u/sam_dt)\ **Replies:** 0\ **Last updated:** [May 17, 2024, 2:27pm UTC](https://ask.cyberinfrastructure.org/t/resources-for-gpu-and-google-jax-programming/3133 "2024-05-17T14:27:23Z")
When I first started my project in Google JAX, I knew that that Google JAX was a pretty new coding library made for GPUs and that examples and teaching materials would be scarce for that. And in addition, I was pretty ne… --- ## [Installation of R packages binaries not supported](https://ask.cyberinfrastructure.org/t/installation-of-r-packages-binaries-not-supported/3089)
**Author:** [@ppaxisa](https://ask.cyberinfrastructure.org/u/ppaxisa)\ **Replies:** 4\ **Last updated:** [May 3, 2024, 10:56am UTC](https://ask.cyberinfrastructure.org/t/installation-of-r-packages-binaries-not-supported/3089 "2024-05-03T10:56:46Z")
Hi, I’m trying to install some R packages, using the R install on the McCleary cluster(module load R/4.3.0-foss-2020b). I noticed that all packages were installed from source. I tried to switch to binary but got this: … --- ## [Remote VSCode on Compute Nodes](https://ask.cyberinfrastructure.org/t/remote-vscode-on-compute-nodes/3099)
**Author:** [@mitchellxh](https://ask.cyberinfrastructure.org/u/mitchellxh)\ **Replies:** 4\ **Last updated:** [April 17, 2024, 4:23pm UTC](https://ask.cyberinfrastructure.org/t/remote-vscode-on-compute-nodes/3099 "2024-04-17T16:23:00Z")
I’m following up to a question I submitted about a year ago for this very issue, in hope that someone might have some guidance! Our group is seeing more users access our cluster via remote VSCode, meaning hosting the VS… --- ## [How do containers differ from virtual machines with regards to their function and resource utilization?](https://ask.cyberinfrastructure.org/t/how-do-containers-differ-from-virtual-machines-with-regards-to-their-function-and-resource-utilization/2827)
**Author:** [@aolawal](https://ask.cyberinfrastructure.org/u/aolawal)\ **Replies:** 3\ **Last updated:** [March 11, 2024, 2:45pm UTC](https://ask.cyberinfrastructure.org/t/how-do-containers-differ-from-virtual-machines-with-regards-to-their-function-and-resource-utilization/2827 "2024-03-11T14:45:35Z")
How do containers differ from virtual machines with regards to their function and resource utilization? --- ## [I can't login to DARWIN](https://ask.cyberinfrastructure.org/t/i-cant-login-to-darwin/3028)
**Author:** [@anita](https://ask.cyberinfrastructure.org/u/anita)\ **Replies:** 1\ **Last updated:** [January 12, 2024, 6:35pm UTC](https://ask.cyberinfrastructure.org/t/i-cant-login-to-darwin/3028 "2024-01-12T18:35:00Z")
I received information from ACCESS about my allocation approved and credits exchanged on DARWIN, but I can’t login to DARWIN. --- ## [Trouble logging in to ACCESS](https://ask.cyberinfrastructure.org/t/trouble-logging-in-to-access/2469)
**Author:** [@jma](https://ask.cyberinfrastructure.org/u/jma)\ **Replies:** 1\ **Last updated:** [January 13, 2024, 12:54am UTC](https://ask.cyberinfrastructure.org/t/trouble-logging-in-to-access/2469 "2024-01-13T00:54:55Z")
If you are a previous XSEDE user, your XSEDE credentials have been moved over to ACCESS. To access your account, choose ACCESS-CI as your identity provider in Cilogin, and then use your XSEDE credentials to log in. If y… --- ## [How do I find and load software on DARWIN?](https://ask.cyberinfrastructure.org/t/how-do-i-find-and-load-software-on-darwin/3030)
**Author:** [@anita](https://ask.cyberinfrastructure.org/u/anita)\ **Replies:** 1\ **Last updated:** [January 12, 2024, 9:02pm UTC](https://ask.cyberinfrastructure.org/t/how-do-i-find-and-load-software-on-darwin/3030 "2024-01-12T21:02:09Z")
I have looked for Modules on DARWIN but it doesn’t seem to be there. --- ## [Who can get an allocation to use HPC resources through ACCESS?](https://ask.cyberinfrastructure.org/t/who-can-get-an-allocation-to-use-hpc-resources-through-access/3019)
**Author:** [@Andrew\_Pasquale](https://ask.cyberinfrastructure.org/u/Andrew_Pasquale)\ **Replies:** 1\ **Last updated:** [December 20, 2023, 9:43pm UTC](https://ask.cyberinfrastructure.org/t/who-can-get-an-allocation-to-use-hpc-resources-through-access/3019 "2023-12-20T21:43:02Z")
Who is eligible to get an allocation on the wide range of services and resources provided by ACCESS? --- ## [Error 'STORAGE LIMIT EXCEEDED' HPC](https://ask.cyberinfrastructure.org/t/error-storage-limit-exceeded-hpc/2953)
**Author:** [@ShrutiDongare](https://ask.cyberinfrastructure.org/u/ShrutiDongare)\ **Replies:** 3\ **Last updated:** [September 26, 2023, 2:14pm UTC](https://ask.cyberinfrastructure.org/t/error-storage-limit-exceeded-hpc/2953 "2023-09-26T14:14:00Z")
I’m in the process of transferring data files from local storage to HPC. Each data file comprises a large number of small files, totaling over 10 million individual files. Despite having ample storage space available in … --- ## [Remote VSCode: Recommended Method for Connecting?](https://ask.cyberinfrastructure.org/t/remote-vscode-recommended-method-for-connecting/2864)
**Author:** [@mitchellxh](https://ask.cyberinfrastructure.org/u/mitchellxh)\ **Replies:** 3\ **Last updated:** [June 28, 2023, 3:26pm UTC](https://ask.cyberinfrastructure.org/t/remote-vscode-recommended-method-for-connecting/2864 "2023-06-28T15:26:02Z")
Recently, my group has experienced an influx in requests to remotely connect to the cluster with their local VSCode environment. When the login nodes do not provide enough resources, what methods are people advising thei… --- ## [How to use multiple GPU node to train/fine-tune large language models?](https://ask.cyberinfrastructure.org/t/how-to-use-multiple-gpu-node-to-train-fine-tune-large-language-models/2816)
**Author:** [@sohil.shrestha](https://ask.cyberinfrastructure.org/u/sohil.shrestha)\ **Replies:** 3\ **Last updated:** [May 31, 2023, 7:00pm UTC](https://ask.cyberinfrastructure.org/t/how-to-use-multiple-gpu-node-to-train-fine-tune-large-language-models/2816 "2023-05-31T19:00:57Z")
I am using UT’s Texas Advanced Computing Center (TACC)'s resources to fine tune large language models. However, I am able to fine-tune it with 1-batch size making the fine-tuning extremely slow and unstable. My understa… --- ## [Python code editor](https://ask.cyberinfrastructure.org/t/python-code-editor/2034)
**Author:** [@Cam](https://ask.cyberinfrastructure.org/u/Cam)\ **Replies:** 5\ **Last updated:** [May 28, 2023, 3:46pm UTC](https://ask.cyberinfrastructure.org/t/python-code-editor/2034 "2023-05-28T15:46:50Z")
What is the best way to edit a Python file in command line on mac? --- ## [Tips for running cp2k singularity on Expanse](https://ask.cyberinfrastructure.org/t/tips-for-running-cp2k-singularity-on-expanse/2802)
**Author:** [@akchem](https://ask.cyberinfrastructure.org/u/akchem)\ **Replies:** 1\ **Last updated:** [May 25, 2023, 9:36pm UTC](https://ask.cyberinfrastructure.org/t/tips-for-running-cp2k-singularity-on-expanse/2802 "2023-05-25T21:36:09Z")
Hello, I am new to using containers and was wondering if anyone has experience using cp2k singularity container on Expanse or any other resource in the ACCESS ecosystem. If there are any tips, examples, etc. that you wo… --- ## [Storage options for researchers with large data sets](https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218)
**Author:** [@jma](https://ask.cyberinfrastructure.org/u/jma)\ **Replies:** 4\ **Last updated:** [April 14, 2023, 3:38pm UTC](https://ask.cyberinfrastructure.org/t/storage-options-for-researchers-with-large-data-sets/2218 "2023-04-14T15:38:20Z")
I have a 250T data set that I share with researchers across the country. What resources are available for storing and sharing my data set? --- ## [About the Large Data Sets Affinity](https://ask.cyberinfrastructure.org/t/about-the-large-data-sets-affinity/2217)
**Author:** [@jma](https://ask.cyberinfrastructure.org/u/jma)\ **Replies:** 0
For people who evaluate or use storage options for researchers with large data sets and accompanies the Large Data Sets Affinity Group on ConnectCI. --- ## [Campus Champion ACCESS Allocation Tutorial](https://ask.cyberinfrastructure.org/t/campus-champion-access-allocation-tutorial/2700)
**Author:** [@dsarojini](https://ask.cyberinfrastructure.org/u/dsarojini)\ **Replies:** 0\ **Last updated:** [March 12, 2023, 6:28pm UTC](https://ask.cyberinfrastructure.org/t/campus-champion-access-allocation-tutorial/2700 "2023-03-12T18:28:46Z")
The GitHub link provides resources to request an ACCESS Campus Champions allocation. ACCESS requests proposals are to be written following NSF proposal guidelines. The request at the DISCOVER level is appropriate for Ca… --- ## [DUO MFA in HPC with PBS, error log file and output log file not generate](https://ask.cyberinfrastructure.org/t/duo-mfa-in-hpc-with-pbs-error-log-file-and-output-log-file-not-generate/2632)
**Author:** [@Vimal\_Sen](https://ask.cyberinfrastructure.org/u/Vimal_Sen)\ **Replies:** 1\ **Last updated:** [January 23, 2023, 9:54am UTC](https://ask.cyberinfrastructure.org/t/duo-mfa-in-hpc-with-pbs-error-log-file-and-output-log-file-not-generate/2632 "2023-01-23T09:54:23Z")
I have also installed duo unix on HPC and everything is ok but when user trying to run the jobs in HPC then error log file and output log file not generate, I have also check PBS moms log then showing error ER;Permission… --- ## [Environments or Containers?](https://ask.cyberinfrastructure.org/t/environments-or-containers/2543)
**Author:** [@alkurdi](https://ask.cyberinfrastructure.org/u/alkurdi)\ **Replies:** 13\ **Last updated:** [December 9, 2022, 4:35pm UTC](https://ask.cyberinfrastructure.org/t/environments-or-containers/2543 "2022-12-09T16:35:04Z")
I have a beginner question if I may ask: if wanting to create a “environment” shared between multiple users, are apptainer containers my go to solution? no such thing as a shared conda env? For my usecase, I don’t want … --- ## [Systems Administrators in New York City: Servers, Clusters and Supercomputers for Computational Biochemistry](https://ask.cyberinfrastructure.org/t/systems-administrators-in-new-york-city-servers-clusters-and-supercomputers-for-computational-biochemistry/2350)
**Author:** [@DESRESCareers](https://ask.cyberinfrastructure.org/u/DESRESCareers)\ **Replies:** 0\ **Last updated:** [May 18, 2022, 11:42am UTC](https://ask.cyberinfrastructure.org/t/systems-administrators-in-new-york-city-servers-clusters-and-supercomputers-for-computational-biochemistry/2350 "2022-05-18T11:42:31Z")
Exceptional sysadmins sought to manage systems infrastructure, networks, and information security for a New York–based interdisciplinary research group. Successful hires will be responsible for our servers and cluster e… --- ## [Getting started with a distributed file system](https://ask.cyberinfrastructure.org/t/getting-started-with-a-distributed-file-system/2241)
**Author:** [@jeremy\_evert](https://ask.cyberinfrastructure.org/u/jeremy_evert)\ **Replies:** 3\ **Last updated:** [October 11, 2022, 2:36am UTC](https://ask.cyberinfrastructure.org/t/getting-started-with-a-distributed-file-system/2241 "2022-10-11T02:36:08Z")
Hello Friends, I am working on a storage system with some 12 year old servers. My goal is to get something working as a persistent file system while I am setting up our compute cluster. I had started to look at Ceph and … --- ## [Globus Endpoint Install Guide](https://ask.cyberinfrastructure.org/t/globus-endpoint-install-guide/2316)
**Author:** [@tylerbrianburkett](https://ask.cyberinfrastructure.org/u/tylerbrianburkett)\ **Replies:** 0\ **Last updated:** [April 22, 2022, 3:45pm UTC](https://ask.cyberinfrastructure.org/t/globus-endpoint-install-guide/2316 "2022-04-22T15:45:08Z")
This document provides instructions on setting up a new Globus endpoint, focusing on first-time creation. This guide assumes that no subscription is used, so it will only focus on using Globus to create a file collection… --- ## [Sys Amin Job Opening at Rutgers University](https://ask.cyberinfrastructure.org/t/sys-amin-job-opening-at-rutgers-university/2389)
**Author:** [@JanaeBaker](https://ask.cyberinfrastructure.org/u/JanaeBaker)\ **Replies:** 0\ **Last updated:** [June 10, 2022, 6:18pm UTC](https://ask.cyberinfrastructure.org/t/sys-amin-job-opening-at-rutgers-university/2389 "2022-06-10T18:18:28Z")
Dear Colleagues, The Rutgers University Office of Advanced Research Computing (OARC) is seeking a Systems Administrator to join our team. We are a large and diverse team working to create an outstanding environment for… --- ## [What are nodes and cores, how many can I use, and why does she keep saying “processor”?](https://ask.cyberinfrastructure.org/t/what-are-nodes-and-cores-how-many-can-i-use-and-why-does-she-keep-saying-processor/2142)
**Author:** [@lllowe](https://ask.cyberinfrastructure.org/u/lllowe)\ **Replies:** 0\ **Last updated:** [December 3, 2021, 1:59pm UTC](https://ask.cyberinfrastructure.org/t/what-are-nodes-and-cores-how-many-can-i-use-and-why-does-she-keep-saying-processor/2142 "2021-12-03T13:59:35Z")
Check out our video on HPC terms and concepts. It includes visual explanations of: nodes, processors, and cores; tasks, threads, and processes; and shared vs distributed memory. HPC Terminology and ‘Core’ Concepts - W… --- ## [Where can I find details on the HPC clusters at URI?](https://ask.cyberinfrastructure.org/t/where-can-i-find-details-on-the-hpc-clusters-at-uri/2010)
**Author:** [@gkhanna](https://ask.cyberinfrastructure.org/u/gkhanna)\ **Replies:** 0\ **Last updated:** [August 9, 2021, 6:08pm UTC](https://ask.cyberinfrastructure.org/t/where-can-i-find-details-on-the-hpc-clusters-at-uri/2010 "2021-08-09T18:08:23Z")
Detailed information on URI’s three HPC clusters: Andromeda, BlueWaves and SeaWulf may be found on this website: https://web.uri.edu/hpc-research-computing/ Briefly … Andromeda: 34 nodes with 1188 threads of computatio… --- ## [I can't seem to logon to BlueWaves/Andromeda/SeaWulf; authentication failure](https://ask.cyberinfrastructure.org/t/i-cant-seem-to-logon-to-bluewaves-andromeda-seawulf-authentication-failure/2011)
**Author:** [@gkhanna](https://ask.cyberinfrastructure.org/u/gkhanna)\ **Replies:** 0\ **Last updated:** [August 12, 2021, 12:12am UTC](https://ask.cyberinfrastructure.org/t/i-cant-seem-to-logon-to-bluewaves-andromeda-seawulf-authentication-failure/2011 "2021-08-12T00:12:58Z")
You have a set up ssh keys to access all URI HPC clusters. This issue usually pops up if your keys are not set up correctly. You must generate an ssh key and send the public half ( never send the private key) to hpc@eta… [Next page](https://ask.cyberinfrastructure.org/tag/hpc-getting-started/14.md?match_all_tags=true&page=1&tags%5B%5D=hpc-getting-started)