Unraid
Mastering ZFS: Easily Auto Snapshot & Replicate a ZFS
Mastering ZFS: Easily Auto Snapshot & Replicate a ZFS Dataset – Part A
#Mastering #ZFS #Easily #Auto #Snapshot #Replicate #ZFS
“Spaceinvader One”
Effortlessly set up automatic snapshots and replicate a ZFS dataset on your Unraid server with the provided script. This not only facilitates quick autosnapshot configurations but also allows you to replicate (or backup) your data to another dataset, be it locally or over a network or the…
source
To see the full content, share this page by clicking one of the buttons below |
Wow! 😍
Thanks for this great series. I finally came around setting everything up and it works like a dream. The V2 of the Auto Conversion script is also really great, especially the skip when the destination is already a dataset.
I have some questions:
– I´ve set up one script per dataset i want to snapshot and replicate. Multiple datasets pers script are not supported or did i miss something?
– What is the best strategy for offsite backups? I have a second unraid server 500km away and would like to replicate to it too. Do i just set up every script again, but with the remote server? What source pool do i choose in this case (the one on my cache again or the one in the array)? If i have 15 datasets to replicate, that would be 30 scripts then xD.
Question, can this do recursive? I have quite a few datasets, and setting up a user script for each one was a pain, and now I've found an issue in that if one is running when the next starts it throws an error. So yeah '-r' option, if so where?
Anyone know how I can replicate a zfs data set to another encrypted zfs data set? Everything works great until the target is locked
Hi Spaceinvader! Awesome video! Seems a couple of people including myself are experiencing that snapshots in the destination folder aren't being deleted to mirror the source 1:1. Any idea on a fix for this? syncoid_mode="strict-mirror" so it should work 😕
For backups, I'd highly recommend Borgbackup instead of rsync.
i made a cache pool with 2 1TB NVME as a ZFS Mirror. Question now that i have: How to replace one NVME in case of failure. Just replace the Drive and Unraid will rebuild the mirror itself?
Thank you so much for another great video. Every time i watch a tutorial from you i always pick up great stuff besides what the tutorial is about.
I'm not that skilled so i like many backup fallbacks. I have a few questions:
– "mbuffer not available on source [local machine] – sync will continue without source buffering." i guess this is because i'm writing appdata from and SSD disk to a mekanic one?
– Now i have appdata in two places and on both i have the ability to revert a snapshot. I don't get where i should do what and in witch scenario?
– I have an GDrive mounted that i can put stuff i want to secure in the cloud. Should i run a rsync from the appdata on the SSD cache or from the mekanic zfs drive?
Thank you again for your very easy to follow tutorials.
/Peter (Sweden)
Thanks!
Love the videos, thank you for all of your hard work. Would love to see how you did the “Plex” zfs pool, does it refer back to your Unraid server media folder??
Destination isn't cleaning up old snaps I have 2 weeks worth now, it's working fine on source
I have followed your tutorial setting up an appdata backup from my ssd to my ZFS array disk and it's working great. I have now decided to encrypt all my disks.
I have watched your tutorials how to use mover and unbalance to encrypt disks one by one, but could you perhaps make a video of what to watch out for when doing this with ZFS Disks (in terms of snapshots and datasets)?
For some reason it isn't deleting the snapshots on my backup drive. I have 13 snapshots on my cache drive with the appdata. While I have 24 on the backup drive.
what plugin is giving you sub tabs under the main tab?
Great video/ Great script / Great job!
Am I missing something for restoring a snapshot from the array disk? If I use rollback, I get a message saying it's successful, but nothing is restored to the cache drive. I guess I could copy all of the files out of the backup drive and move them to cache, but it's a little inconvenient.
The only way I can get anything to restore is if I roll back a snapshot on the cache drive itself.
Edit: maybe I'm going about it wrong, I was thinking of restoring snapshot from my array to cache, but everything is replicated in the share, I can move from backup to cache. Either way, I'll probably give it a whirl since I'm adding another NVME drive and my current + new will have to be formatted (guessing because of ZFS+encryption on current).
Awsome Video thank you!
I have 3 Questions for you.
1) If I want to snapshot all of my shares is there a way to add that to the script or do i have to create a duplicate script for every other shares?
2) What happens if the drive has no more free space will it auto delete older snapshots or fail to create new snapshots?
3) how many hdd's would you need for say a 84tb snapshot backup? I have 6 free 14tb drives (mostly empty + a 14tb parity), and 14tb for zfs backups) but id like to have everthing snapshotted. Is it a 1:1 ratio? would i need 6 14tb zfs backups?
I still hope that unraid can realize these automatic backup functions in gui like truenas
Isn't dangerous to snapshot database files or open files in general? A part of the content is in ram so it gets lost. Corruption can happen so I think you need to stop the containers or dump contents anyway.
Thank you for finishing this multipart ZFS series for this version of UnRaid. The one week anticipated time-frame for its release came and went long ago.Your videos explain a lot, are well done and appreciated. I watched this video can see why it was delayed and realize how much work went into the creation. I can now set up the new server which has more drive slots and I can max out my drive limit. I used to do Microsoft Tech Support before it moved to India and am still learning new things. Excuse my impatience but if I was a food item my Sell By Date expired years ago and my Expiration Date is faded badly enough that it can't be read.
And once again…..thankyou for your generosity Spaceinvader One, We are all blessed by your videos. I have now successfully changed over my mirrored-cache and my downloads pools to ZFS with absolute ease….. for a total noob. Thankyou for all that you do!!!
I did drop UnRaid total now… I guess it’s useless when you need Hackintosh. Support is to much poor for MacOS.
How did you get the "Main" tab separated into tabs for Array Devices, Pool Devices, etc? I like this so much better than having to scroll up & down.
Just to clarify, source/dest datasets can only be top level(?) For example appdata and not appdata/nextcloud. When I tried to backup specific programs in appdata, the backup would fail
fantastic video! thank you
25:23 how is everything a child dataset of appdata? do I have to create that for individual containers?
Thank you for the great video. I hope people understand the time and the effort needed for all the content you do. I did everything from the video then did some tests and everything is working. But i don't understand why my zfs disk on the array is always spin up even i exclude it from all of the shares? It is used only for the zfs replication. And is it possible do make the replication on an Unassigned Devices to prevent the array to spin up?
Thanks! Your videos are incredibly helpful and I appreciate all the time and effort you put into it
Where do you get your thumbnail graphics from? i.e the deathstar with the UnRaid logo on etc?
Thanks so much for all your videos, you are such a help to the unraid community. Regarding the ZFS Master plugin do you or anyone else here know anything about the issue where all ZFS pool drives are constantly written to when this plugin is installed and the web UI is left on the main tab? I had installed it after watching the previous videos and uninstalling it was the only thing that fixed the problem, has that issue been fixed or does using the tabbed view help mitigate it?
Awesome video Ed, thank you! Everything is working great except the script doesn't seem to be pruning the snapshots in the destination. I have 6 hourly snapshots set and those get pruned on the source dataset but not on the destination. What am I missing?
Sir .. please upload more videos , update the old content according to latest version of unraid its really helpful and we all thank you ❤
what if you want to snapshot multiple datasets in the same source pool? comma separate them?
Maybe it's pretty self-evident but could you possibly do a quick restore from the backups? single container, multiple containers and the whole appdata folder.