faster rsync of huge directories

faster rsync of huge directories

Shachar Shemesh shachar at shemesh.biz
Mon Apr 12 11:23:44 IDT 2010


Tom Rosenfeld wrote:
> Hi,
>
> I am a great fan of rsync for copying filesystems. However I now have 
> a filesystem which is several hundred gigabytes and apparently has a 
> lot of small files. I have been running rsync all night and it still 
> did not start copying as it is still building the file list.
> Is there any way to get it to start copying as it goes. Or do any of 
> you have a better tool?
Yes, there is a better tool.

Upgrade both ends to rsync version 3 or later. That version starts the 
transfer even before the file list is completely built.

Shachar

-- 
Shachar Shemesh
Lingnu Open Source Consulting Ltd.
http://www.lingnu.com

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.huji.ac.il/pipermail/linux-il/attachments/20100412/aa90f3be/attachment-0001.html>


More information about the Linux-il mailing list