rsyncable compression option

Post here if you want to request a features that has not been implemented yet
Post Reply
esskov
Posts: 2
Joined: Tue Apr 09, 2013 1:31 pm

rsyncable compression option

Post by esskov » Tue Apr 09, 2013 2:16 pm

We have a NAS server containing a number of xx GB .fsa files that are mirrored to a remote server using rsync. Due to the compressed nature of the archives, rsync will normally retransmit the entire file when it's updated locally -- even though only a small proportion of the files inside (on the stored partitions) have actually changed.

Recent versions of gzip and pigz have a "--rsyncable option" to remedy this problem. See e.g. http://mail.zlib.net/pipermail/pigz-ann ... 00003.html

If there was a way to enable this rsyncable option, say for fsarchiver compression levels 2-4 (that use gzip), that could make rsyncing the resulting fsa archives considerably more efficient, and would save many GBs of transmitted data when updating.

Thanks for considering this.

Post Reply