faster rsync of huge directories

faster rsync of huge directories

Vitaly linux at karasik.org
Mon Apr 12 10:04:10 IDT 2010


2010/4/12 Tom Rosenfeld <trosen at bezeqint.net>
>
> Hi,
>
> I am a great fan of rsync for copying filesystems. However I now have a filesystem which is several hundred gigabytes and apparently has a lot of small files. I have been running rsync all night and it still did not start copying as it is still building the file list.
> Is there any way to get it to start copying as it goes. Or do any of you have a better tool?
>

Are both servers in the same LAN? IMHO, your problem in network band
witchbetween source and destination.
I have ~4M files, ~800GB - rsync is very fast in the same LAN (1Gb),
and slowly for remote destination.

Regards,
Vitaly



More information about the Linux-il mailing list