Ask.Cyberinfrastructure

How do I get started with Python on HPC?

If I am new to HPC (but perhaps have used Python) what modules should I take a look at?

There is a really fantastic list of resources I’ve unearthed here:

http://andy.terrel.us/blog/2012/09/27/starting-with-python/

Specifically, it reviews tutorials, Python modules intended for HPC, and resources to help learn about performance, profiling, and scaling. Some of the notes might be a bit old, so if you find an issue please comment on the author’s disqus (at the bottom of the page) to see if an update can be made.

I’d also suggest checking out Dask (https://dask.org/) and Ray (https://github.com/ray-project/ray).

1 Like

Here is another nice post on Python Performance Optimization:

And here is another great resources that goes through Python bulletins worth learning!

https://treyhunner.com/2019/05/python-builtins-worth-learning/