[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Sheflug] Filesystem replication
[[ posted to both shef lugs, so some people may see this twice ]]
Hi all,
Anyone had any experience with any form of FS replication on large (80+ GB)
filesystems? Tried to rsync between two servers on an 81GB filesystem, and
after rsync expecting each file for four hours, the server shutdown with
nothing copied - rsync seems to inspect each file first, regardless of
whether it exists or not on the server, before actually starting to copy
updates.
Using rsync in daemon mode on server #1, and can't remember off top of head
how invoking rsync (certainly using -az though), connected through a 100Mbit
card (like to use gigbit, but one server doesn't have gigabit card), and
using RH 6.1 on one, and RH 9.x on t'other. Dell Poweredge servers - disk
and processor isn't a /huge/ issue (RAID 5 on one, RAID 1 on t'other), so
looks like rsync's algorithm is the thing that's making it a problem.
So, any magic incantations to speed rsync up, or possible alternatives
that people know about or use. At the moment, we're just breaking the rsync
into smaller chunks which it seems quite happy with :)
Chris...
--
\ Chris Johnson \ NP: Dire Straits - Brothers in Arms
\ cej [at] nightwolf.org.uk \
\ http://cej.nightwolf.org.uk/ \
\ http://redclaw.org.uk/ ~---------------------------------------
___________________________________________________________________
Sheffield Linux User's Group -
http://www.sheflug.co.uk/mailfaq.html
GNU the choice of a complete generation.