Backing up FreeNAS to Amazon S3

ZFS is excellent at storing all your data safely but “there are still lots of potential ways for your data to die, and you still need to back up your pool. Period. PERIOD!

The process below shows how you can setup a regular sync to Amazon S3 and was tested on FreeNAS-9.3-STABLE-201509022158.

Setup the S3 Folders and Upload User

Log on to the AWS interface

Select Services -> S3

  • create a bucket
  • configure the logs as requested

Select Services -> Security and Identity -> IAM

  • On the left either click “Users” or click “Create individual IAM users” in the main interface
  • Create a new user and note the AWS Access Key and AWS Secret Key
  • Select the user and give is the permission “AmazonS3FullAccess”

Add Jail for s3cmd

On FreeNAS: Click Jails -> Add Jail and give it a name s3cmd.

So attached to the jail and install s3cmd.

ssh root@freenas.local
jls
jexec <1> /bin/tcsh (where 1 is the jail ID from the previous command)
pkg install py27-dateutil-2.4.2
pkg install py27-magic-5.25
pkg install gnupg
pkg install py27-s3cmd-1.6.0
rehash
mkdir /mnt/zfspool

Click Jails -> s3cmd -> Storage -> Add storage

Then configure the following

  • Source is the folder in the zfspool you want to backup
  • Destination is /mnt/zfspool/new_folder
  • Ensure its set as Read Only
  • Select Create Directory

Configure s3cmd

root@s3cmd:~ # s3cmd --configure
Then configure the following:
AWS Access Key
AWS Secret Key
Default Region: US
Encryption password: password safe
Path to gpg: /usr/local/bin/gpg
Use HTTPS: No

 

root@s3cmd:~ # s3cmd ls
2016-02-29 05:09  s3://Bucket1
2015-03-12 04:36  s3://Bucket2
2015-12-07 05:43  s3://Bucket3

Start your first sync

root@s3cmd:~ # s3cmd -v sync /mnt/ s3://Bucket1
INFO: Compiling list of local files...
INFO: Running stat() and reading/calculating MD5 values on 96943 files, this may take some time...
<snip>

 

Advertisements

One thought on “Backing up FreeNAS to Amazon S3

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s