rsync writefd_unbuffered failed to write error

[acoza]

I'm transferring 3.5M+ (~1TB) of images from my US server to EU through rsync. I initiate the transfer with the following command:

rsync -rv --progress LOCAL_DIR root@REMOTE_SERVER:/REMOTE_DIR

It runs for a while and then, randomly and unexpectedly, stop and outputs:

rsync: writefd_unbuffered failed to write 4 bytes to sotcket [sender]: Broken pipe (32)
rsync: connection unexpectedly closed (3488850 bytes to receiver so far) [sender]
rsync error: unexpected error (code 255) at io.c(601) [sender=3.0.7]

The local server runs Debian 6 64-bit. The OS is under the ext4 file system and the storage partition is under the XFS file system (this is where the files that are being transfered are stored.) This runs on 2x1TB HDs in soft-RAID0.

The remote server runs Debian 6 64-bit as well. It's just a single 2TB disk with a single ext4 file system. So if the file systems are in question, I am moving files from XFS to ext4.

Any help will be greatly appreciated!

acoza Reviewed by acoza on 28th Jun 2012. rsync writefd_unbuffered failed to write error I'm transferring 3.5M+ (~1TB) of images from my US server to EU through rsync. I initiate the transfer with the following command: rsync -rv --progress LOCAL_DIR root@REMOTE_SERVER:/REMOTE_DIR It runs for a while and then, randomly and unexpectedly, stop and outputs: rsync: writefd_unbuffered failed to write 4 bytes to sotcket : Broken pipe (32) rsync: connection unexpectedly closed (3488850 bytes to receiver so far) rsync error: unexpected error (code 255) at io.c(601) Rating: 5

[vgnheart]

looks like server is denying the write request. check if the remote file system is in good condition and there is no active firewall that block the connection.
Also make sure there is enough ram on both side to handle the rsync process

[Gavo]

This site is using a hacked database of W junction

[acoza]

looks like server is denying the write request. check if the remote file system is in good condition and there is no active firewall that block the connection.
Also make sure there is enough ram on both side to handle the rsync process

The sender has an Atom D520 2GB RAM. Receiver has X5620 24GB RAM. I think the receriver's file system is good as it just received a fresh OS install.

I do not use a firewall on the server level, but the DC does have a network wide firewall to guard against DDoS. Do you think this could be it?

[vgnheart]

" DC does have a network wide firewall to guard against DDoS" then there is a chance of blockade by DC router. contact them and ask if they block any traffic from your server.

Also rsync can work in two method.

1) Download from remote server and save on local server
or
2) Upload from local server to remote

Which method you used. give a try on other method.