I have seen the concept of a “tarpipe” mentioned in a few places, in the context of data transfer. It is often noted to be faster than scp
or rsync
. What is this, and how would I use it to more effectively transfer files?
It is using a pipe to direct the output of tar often used in conjunction with ssh, or other communication tools.
There are some good bits on this on unix.stackexchange and superuser.