Ask.Cyberinfrastructure

What is a "tarpipe" and how do I use it?

data-transfer

#1

I have seen the concept of a “tarpipe” mentioned in a few places, in the context of data transfer. It is often noted to be faster than scp or rsync. What is this, and how would I use it to more effectively transfer files?


#2

It is using a pipe to direct the output of tar often used in conjunction with ssh, or other communication tools.

There are some good bits on this on unix.stackexchange and superuser.