librelist archives

« back to archive

Backing up from/to NFS

Backing up from/to NFS

From:
Ahmad Khayyat
Date:
2015-05-19 @ 11:22
I want to backup my data to a disk attached to a low-end ARM redundant file
server that cannot run Attic, so I must run Attic remotely, which raises
two concerns.

Backup up from NFS
-------------------

Are there any concerns with backing up data from an NFS-mounted filesystem?


Backup up to NFS
-----------------

I saw one reference to Attic over NFS in the mailing list archive, which
suggests it should be avoided:

http://librelist.com/browser/attic/2014/1/31/attic-vs-obnam/#2463fa3617f48e0bff2254ccd711d15e

In my case, this appears to be the most convenient option (more convenient
alternatives welcome!). So how bad, or how supported, is running Attic on
an NFS-mounted repository?

I see the following alternatives (additional ones welcome, too):

1. Run Attic remotely over SSH as suggested in the docs. This won't work
for me because of an issue with running Attic on ARM (
https://github.com/jborg/attic/issues/309), but I still would like to see
how this option rates against the others if it becomes feasible. For
example, would this still be practical in the case of an under-powered
remote repository?

2. Run Attic locally on the more powerful machine, then rsync the Attic
repository to the ARM file server. The inconvenience here is having to have
a large enough local disk on the more powerful machine creating the
archives.

What do you think my best option is?

Sv: [attic] Backing up from/to NFS

From:
Petter Gunnerud
Date:
2015-05-19 @ 20:15
I tried attic to offsite nfs over ipsec. With my large dataset (1GB sparse
vm diskfiles) this was so slow that even the smallest change to a file 
would make the next backup run for days. I'm now running over ssh, and 
it's a totally different speed. If you have small dataset it might work. 
Allthou, if you have a small dataset, having a local repo and rsync it 
wouldn't make you run into local space issues either.
You might discover that attic dedup keeps the repo small, so you don't run
into space issues anyway.
As you say you'll be backing up a fileserver, I think a internal 
backupdisk for local attic repo would be your saver. I've using a bunch of
old 500GB laptopdrives for this purpose. As pepole upgrade to ssd in their
laptops, I've collected their old drives.

What kind of data is the source? For my fileservers I use Unison for 
backup. It has no deduplication, but does a good job keeping files in 
sync. It also keeps old versions of files. It's not suitable for large 
files with small changes thou.

      Fra: Ahmad Khayyat <akhayyat@gmail.com>
 Til: attic@librelist.com 
 Sendt: Tirsdag, 19. mai 2015 13.22
 Emne: [attic] Backing up from/to NFS
   


I want to backup my data to a disk attached to a low-end ARM redundant 
file server that cannot run Attic, so I must run Attic remotely, which 
raises two concerns.

Backup up from NFS
-------------------

Are there any concerns with backing up data from an NFS-mounted filesystem?


Backup up to NFS
-----------------

I saw one reference to Attic over NFS in the mailing list archive, which 
suggests it should be avoided:

http://librelist.com/browser/attic/2014/1/31/attic-vs-obnam/#2463fa3617f48e0bff2254ccd711d15e

In my case, this appears to be the most convenient option (more convenient
alternatives welcome!). So how bad, or how supported, is running Attic on 
an NFS-mounted repository?

I see the following alternatives (additional ones welcome, too):

1. Run Attic remotely over SSH as suggested in the docs. This won't work 
for me because of an issue with running Attic on ARM 
(https://github.com/jborg/attic/issues/309), but I still would like to see
how this option rates against the others if it becomes feasible. For 
example, would this still be practical in the case of an under-powered 
remote repository?

2. Run Attic locally on the more powerful machine, then rsync the Attic 
repository to the ARM file server. The inconvenience here is having to 
have a large enough local disk on the more powerful machine creating the 
archives.

What do you think my best option is?


   

Re: [attic] Backing up from/to NFS

From:
Ahmad Khayyat
Date:
2015-05-19 @ 20:35
​Actually, my file server is local. It also happens to be my central
unison​ hub for syncing multiple not-always-on machines. And for the
purposes of the Attic-related discussion, it is going to host a local copy
of Attic backups, which are then rsynced/ftped/whatever-works to an offsite
location. The Attic backup will include much more than just the
unison-synced data.

I guess backing up _from_ NFS is safe, isn't it? If so, I'd like to get
that out of the way. If not, this entire scheme may not work at all!

For storing the Attic repository, I may try doing so over NFS, given it's
going to be over a LAN, but I am considering creating a local repository
and rsyncing it to the file server, at least for comparison.

What I was more interested in is whether backuping up over NFS is less
reliable, and whether there are any guarantees that it _should_ work, from
a support standpoint. For example, would it not working be considered a bug?