autorestic/README.md

194 lines
6.3 KiB
Markdown
Raw Normal View History

2019-06-20 10:17:20 +02:00
# autorestic
2019-10-26 21:34:02 +02:00
High backup level CLI utility for [restic](https://restic.net/).
Autorestic is a wrapper around the amazing [restic](https://restic.net/). While being amazing the restic cli can be a bit overwhelming and difficoult to manage if you have many different location that you want to backup to multiple locations. This utility is aimed at making this easier 🙂
2019-06-21 12:25:54 +02:00
2019-10-26 21:30:47 +02:00
![Sketch](./docs/Sketch.png)
## 🌈 Features
- Config files, no CLI
- Predictable
- Backup locations to multiple backends
- Snapshot policies and pruning
2019-10-26 21:30:47 +02:00
- Simple interface
2019-10-26 21:40:15 +02:00
- Fully encrypted
2019-06-21 12:25:54 +02:00
## Installation
```
2019-11-27 19:30:01 +01:00
curl -s https://raw.githubusercontent.com/CupCakeArmy/autorestic/master/install.sh | bash
2019-06-21 12:26:32 +02:00
```
2019-10-26 21:30:47 +02:00
## 🚀 Quickstart
### Setup
First we need to configure our locations and backends. Simply create a `.autorestic.yml` either in your home directory of in the folder from which you will execute `autorestic`.
2019-10-26 21:40:15 +02:00
Optionally you can specify the location of your config file by passing it as argument: `autorestic -c ../path/config.yml`
2019-10-26 21:30:47 +02:00
```yaml
locations:
home:
from: /home/me
to: remote
2019-10-26 21:30:47 +02:00
important:
from: /path/to/important/stuff
to:
- remote
- hdd
backends:
remote:
type: b2
path: 'myBucket:backup/home'
B2_ACCOUNT_ID: account_id
B2_ACCOUNT_KEY: account_key
2019-10-26 21:30:47 +02:00
hdd:
type: local
path: /mnt/my_external_storage
```
Then we check if everything is correct by running the `check` command. We will pass the `-a` (or `--all`) to tell autorestic to check all the locations.
2019-12-04 20:45:58 +01:00
Lets see a more realistic example (from the config above)
2019-10-26 21:30:47 +02:00
```
2019-12-04 20:45:58 +01:00
autorestic check -l important
2019-10-26 21:30:47 +02:00
```
If we would check only one location we could run the following: `autorestic -l home check`.
2019-10-26 21:30:47 +02:00
### Backup
```
autorestic backup -a
```
### Restore
```
autorestic restore -a -- --target /path/where/to/restore
```
2019-10-26 21:40:15 +02:00
2019-12-04 20:45:58 +01:00
This will restore all the locations to the selected target. If for one location there are more than one backends specified autorestic will take the first one.
```
autorestic restore -l home --from hdd -- --target /path/where/to/restore
```
This will restore the location `home` to the `/path/where/to/restore` folder and taking the data from the backend `hdd`
2019-10-26 21:40:15 +02:00
## 🗂 Locations
A location simply a folder on your machine that restic will backup. The paths can be relative from the config file. A location can have multiple backends, so that the data is secured across multiple servers.
```yaml
locations:
my-location-name:
from: path/to/backup
to:
- name-of-backend
- also-backup-to-this-backend
```
## 💽 Backends
2019-10-26 21:48:32 +02:00
Backends are the place where you data will be saved. Backups are incremental and encrypted.
### Fields
2019-10-26 21:49:25 +02:00
##### `type`
2019-10-26 21:48:32 +02:00
Type of the backend see a list [here](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html)
Supported are:
- [Local](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#local)
- [Backblaze B2](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#backblaze-b2)
- [Amazon S3](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#amazon-s3)
- [Minio](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#minio-server)
- [Google Cloud Storage](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#google-cloud-storage)
- [Microsoft Azure Storage](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#microsoft-azure-blob-storage)
For each backend you need to specify the right variables as shown in the example below.
2019-10-26 21:49:25 +02:00
##### `path`
2019-10-26 21:48:32 +02:00
The path on the remote server.
For object storages as
2019-10-26 21:48:32 +02:00
2019-10-26 21:49:25 +02:00
##### Example
2019-10-26 21:49:06 +02:00
2019-10-26 21:48:32 +02:00
```yaml
backends:
name-of-backend:
type: b2
path: 'myAccount:myBucket/my/path'
B2_ACCOUNT_ID: backblaze_account_id
B2_ACCOUNT_KEY: backblaze_account_key
```
## Pruning and snapshot policies
Autorestic supports declaring snapshot policies for location to avoid keeping old snapshot around if you don't need them.
This is based on [Restic's snapshots policies](https://restic.readthedocs.io/en/latest/060_forget.html#removing-snapshots-according-to-a-policy), and can be enabled for each location as shown below:
```yaml
locations:
etc:
from: /etc
to: local
keep:
# options matches the --keep-* options used in the restic forget CLI
# cf https://restic.readthedocs.io/en/latest/060_forget.html#removing-snapshots-according-to-a-policy
last: 5 # always keep at least 5 snapshots
hourly: 3 # keep 3 last hourly shapshots
daily: 4 # keep 4 last daily shapshots
weekly: 1 # keep 1 last weekly shapshots
monthly: 12 # keep 12 last monthly shapshots
yearly: 7 # keep 7 last yearly shapshots
within: "2w" # keep snapshots from the last 2 weeks
```
2019-10-26 21:48:32 +02:00
Pruning can be triggered using `autorestic forget -a`, for all locations, or selectively with `autorestic forget -l <location>`. **please note that contrary to the restic CLI, `restic forget` will call `restic prune` internally.**
Run with the `--dry-run` flag to only print information about the process without actually pruning the snapshots. This is especially useful for debugging or testing policies:
```
$ autorestic forget -a --dry-run --verbose
Configuring Backends
local : Done ✓
Removing old shapshots according to policy
etc ▶ local : Removing old spnapshots… ⏳
etc ▶ local : Running in dry-run mode, not touching data
etc ▶ local : Forgeting old snapshots… ⏳Applying Policy: all snapshots within 2d of the newest
keep 3 snapshots:
ID Time Host Tags Reasons Paths
-----------------------------------------------------------------------------
531b692a 2019-12-02 12:07:28 computer within 2w /etc
51659674 2019-12-02 12:08:46 computer within 2w /etc
f8f8f976 2019-12-02 12:11:08 computer within 2w /etc
-----------------------------------------------------------------------------
3 snapshots
```
2019-10-26 21:48:32 +02:00
2019-10-26 21:49:25 +02:00
##### Note
2019-10-26 21:40:15 +02:00
Note that the data is automatically encrypted on the server. The key will be generated and added to your config file. Every backend will have a separate key. You should keep a copy of the keys somewhere in case your server dies. Otherwise DATA IS LOST!
2019-12-03 09:19:26 +01:00
## Contributors
2019-12-03 09:52:11 +01:00
This amazing people helped the project!
- @ChanceM [Docs]
- @EliotBerriot [Docs, Pruning, S3]