faster rsync of huge directories

[Shachar Shemesh]

Tom Rosenfeld wrote:
>
>
> On Mon, Apr 12, 2010 at 9:41 AM, Tom Rosenfeld <trosen at bezeqint.net 
> <mailto:trosen at bezeqint.net>> wrote:
>
>     Hi,
>
>     I am a great fan of rsync for copying filesystems. However I now
>     have a filesystem which is several hundred gigabytes and
>     apparently has a lot of small files. I have been running rsync all
>     night and it still did not start copying as it is still building
>     the file list.
>     Is there any way to get it to start copying as it goes. Or do any
>     of you have a better tool?
>
>     Thanks,
>     -tom
>
>
>
> Thanks for all the suggestions!
>
> I realized that in my case I did not really need rsync since it is a 
> local disk to disk copy.
Please note that rsync from local to local is just a glorified cp. It 
does not do file comparisons at all.
> It was also pointed out that ver 3 of rsync now does start to copy 
> before it indexes all the files. Unfortunately, it is not available on 
> CentOS 5.
>
wget http://samba.anu.edu.au/ftp/rsync/src/rsync-3.0.7.tar.gz
tar xvzf rsync-3.0.7.tar.gz
cd rsync-3.0.7.tar.gz
./configure
make
su
make install

Shachar

-- 
Shachar Shemesh
Lingnu Open Source Consulting Ltd.
http://www.lingnu.com

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.huji.ac.il/pipermail/linux-il/attachments/20100412/cad3d024/attachment.html>