autorestic/README.md

242 lines
7.6 KiB
Markdown
Raw Permalink Normal View History

2019-06-20 08:17:20 +00:00
# autorestic
2019-10-26 19:34:02 +00:00
High backup level CLI utility for [restic](https://restic.net/).
Autorestic is a wrapper around the amazing [restic](https://restic.net/). While being amazing the restic cli can be a bit overwhelming and difficoult to manage if you have many different location that you want to backup to multiple locations. This utility is aimed at making this easier 🙂
2019-06-21 10:25:54 +00:00
2019-10-26 19:30:47 +00:00
![Sketch](./docs/Sketch.png)
## 🌈 Features
- Config files, no CLI
- Predictable
- Backup locations to multiple backends
- Snapshot policies and pruning
2019-10-26 19:30:47 +00:00
- Simple interface
2019-10-26 19:40:15 +00:00
- Fully encrypted
2019-06-21 10:25:54 +00:00
2019-12-04 23:31:05 +00:00
###### 📒 Docs
- [Locations](#-locations)
2019-12-04 23:31:41 +00:00
- [Pruning & Deleting old files](#pruning-and-snapshot-policies)
- [Excluding files](#excluding-filesfolders)
- [Hooks](#before--after-hooks)
2019-12-04 23:31:05 +00:00
- [Backends](#-backends)
## 🛳 Installation
Linux & macOS. Windows is not supported.
2019-06-21 10:25:54 +00:00
```
2019-11-27 18:30:01 +00:00
curl -s https://raw.githubusercontent.com/CupCakeArmy/autorestic/master/install.sh | bash
2019-06-21 10:26:32 +00:00
```
2019-10-26 19:30:47 +00:00
## 🚀 Quickstart
### Setup
First we need to configure our locations and backends. Simply create a `.autorestic.yml` either in your home directory of in the folder from which you will execute `autorestic`.
2019-10-26 19:40:15 +00:00
Optionally you can specify the location of your config file by passing it as argument: `autorestic -c ../path/config.yml`
2019-10-26 19:30:47 +00:00
```yaml
locations:
home:
from: /home/me
to: remote
2019-10-26 19:30:47 +00:00
important:
from: /path/to/important/stuff
to:
- remote
- hdd
backends:
remote:
type: b2
path: 'myBucket:backup/home'
B2_ACCOUNT_ID: account_id
B2_ACCOUNT_KEY: account_key
2019-10-26 19:30:47 +00:00
hdd:
type: local
path: /mnt/my_external_storage
```
Then we check if everything is correct by running the `check` command. We will pass the `-a` (or `--all`) to tell autorestic to check all the locations.
2019-12-04 22:43:01 +00:00
If we would check only one location we could run the following: `autorestic check -l home`. Otherwise simpply check all locations with `autorestic check -a`
2019-12-04 19:45:58 +00:00
2019-12-04 22:43:01 +00:00
##### Note
2019-10-26 19:30:47 +00:00
2019-12-04 22:43:01 +00:00
Note that the data is automatically encrypted on the server. The key will be generated and added to your config file. Every backend will have a separate key. You should keep a copy of the keys somewhere in case your server dies. Otherwise DATA IS LOST!
2019-10-26 19:30:47 +00:00
2019-12-04 23:27:01 +00:00
### 📦 Backup
2019-10-26 19:30:47 +00:00
```
autorestic backup -a
```
2019-12-04 23:27:01 +00:00
### 📼 Restore
2019-10-26 19:30:47 +00:00
```
2019-12-04 19:50:12 +00:00
autorestic restore -a --to /path/where/to/restore
2019-10-26 19:30:47 +00:00
```
2019-10-26 19:40:15 +00:00
2019-12-04 19:45:58 +00:00
This will restore all the locations to the selected target. If for one location there are more than one backends specified autorestic will take the first one.
2019-12-04 22:43:01 +00:00
Lets see a more realistic example (from the config above)
2019-12-04 19:45:58 +00:00
```
2019-12-04 19:50:12 +00:00
autorestic restore -l home --from hdd --to /path/where/to/restore
2019-12-04 19:45:58 +00:00
```
This will restore the location `home` to the `/path/where/to/restore` folder and taking the data from the backend `hdd`
2019-12-04 23:27:01 +00:00
### 📲 Updates
Autorestic can update itself! Super handy right? Simply run `autorestic update` and we will check for you if there are updates for restic and autorestic and install them if necessary.
2019-10-26 19:40:15 +00:00
## 🗂 Locations
A location simply a folder on your machine that restic will backup. The paths can be relative from the config file. A location can have multiple backends, so that the data is secured across multiple servers.
```yaml
locations:
my-location-name:
from: path/to/backup
to:
- name-of-backend
- also-backup-to-this-backend
```
2019-12-04 23:31:05 +00:00
#### Pruning and snapshot policies
Autorestic supports declaring snapshot policies for location to avoid keeping old snapshot around if you don't need them.
This is based on [Restic's snapshots policies](https://restic.readthedocs.io/en/latest/060_forget.html#removing-snapshots-according-to-a-policy), and can be enabled for each location as shown below:
```yaml
locations:
etc:
from: /etc
to: local
2019-12-04 22:39:19 +00:00
options:
forget:
keep-last: 5 # always keep at least 5 snapshots
keep-hourly: 3 # keep 3 last hourly shapshots
keep-daily: 4 # keep 4 last daily shapshots
keep-weekly: 1 # keep 1 last weekly shapshots
keep-monthly: 12 # keep 12 last monthly shapshots
keep-yearly: 7 # keep 7 last yearly shapshots
keep-within: "2w" # keep snapshots from the last 2 weeks
```
2019-10-26 19:48:32 +00:00
Pruning can be triggered using `autorestic forget -a`, for all locations, or selectively with `autorestic forget -l <location>`. **please note that contrary to the restic CLI, `restic forget` will call `restic prune` internally.**
Run with the `--dry-run` flag to only print information about the process without actually pruning the snapshots. This is especially useful for debugging or testing policies:
```
$ autorestic forget -a --dry-run --verbose
Configuring Backends
local : Done ✓
Removing old shapshots according to policy
etc ▶ local : Removing old spnapshots… ⏳
etc ▶ local : Running in dry-run mode, not touching data
etc ▶ local : Forgeting old snapshots… ⏳Applying Policy: all snapshots within 2d of the newest
keep 3 snapshots:
ID Time Host Tags Reasons Paths
-----------------------------------------------------------------------------
531b692a 2019-12-02 12:07:28 computer within 2w /etc
51659674 2019-12-02 12:08:46 computer within 2w /etc
f8f8f976 2019-12-02 12:11:08 computer within 2w /etc
-----------------------------------------------------------------------------
3 snapshots
```
2019-10-26 19:48:32 +00:00
2019-12-04 23:31:05 +00:00
#### Excluding files/folders
2019-12-04 22:48:22 +00:00
If you want to exclude certain files or folders it done easily by specifiyng the right flags in the location you desire to filter. The flags are taken straight from the [restic cli exclude rules](https://restic.readthedocs.io/en/latest/040_backup.html#excluding-files).
```yaml
locations:
my-location:
from: /data
to:
- local
- remote
options:
backup:
exclude:
- '*.nope'
- '*.abc'
exclude-file: .gitignore
backends:
local:
...
remote:
...
```
2019-12-04 23:31:05 +00:00
#### Before / After hooks
2019-12-04 23:22:01 +00:00
Sometimes you might want to stop an app/db before backing up data and start the service again after the backup has completed. This is what the hooks are made for. Simply add them to your location config. You can have as many commands as you wish.
```yaml
locations:
my-location:
from: /data
to:
- local
- remote
hooks:
before:
- echo "Hello"
- echo "Human"
after:
- echo "kthxbye"
```
2019-12-04 23:31:05 +00:00
## 💽 Backends
Backends are the place where you data will be saved. Backups are incremental and encrypted.
### Fields
##### `type`
Type of the backend see a list [here](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html)
Supported are:
- [Local](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#local)
- [Backblaze B2](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#backblaze-b2)
- [Amazon S3](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#amazon-s3)
- [Minio](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#minio-server)
- [Google Cloud Storage](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#google-cloud-storage)
- [Microsoft Azure Storage](https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html#microsoft-azure-blob-storage)
For each backend you need to specify the right variables as shown in the example below.
##### `path`
The path on the remote server.
For object storages as
##### Example
```yaml
backends:
name-of-backend:
type: b2
path: 'myAccount:myBucket/my/path'
B2_ACCOUNT_ID: backblaze_account_id
B2_ACCOUNT_KEY: backblaze_account_key
```
2019-12-03 08:19:26 +00:00
## Contributors
2019-12-03 08:52:11 +00:00
This amazing people helped the project!
- @ChanceM [Docs]
- @EliotBerriot [Docs, Pruning, S3]