I’ve been selfhosting a while. I run around 15 distinct services in docker containers, all on a single machine with a medium sized disk. It’s a small form factor, and I recently had to add space, so I’ve attached an external USB storage device.
It feels clunky.
At what point does a performant SAN/NAS make sense more than local storage? When did you make the jump?
You must log in or # to comment.
When you want to disconnect compute from storage.
If you have more than one compute node you can reboot one without taking any services down. Or you can add more nodes and they share the storage.
I have two proxmox servers, but I don’t run separate storage. Small services use zfs and replication. My big media server VM stays put and has to be shut down if I reboot its host.
For me it was when I noticed that some of my photos had been affected by bitrot.
Instarted building my NAS last year, and got caught up in the increased HDD cost, I need two more 8TB drives to get my 32TB Zraid2 going.
I was going to use TrueNAS, but now that they have turned their back on opensource, I am not so sure anymore
Went from TrueNAS to OpenMediaVault and we are quite happy atm. Very reliable, decent documentation, easy to use. We were between this and Proxmox when we switched but ultimately chose OMV for its ease. It’s been at least a year and with ~100 containers running and some friends asking for VMs it would have been useful to be in proxmox, but not a biggie. However, be sure of your usecase and try imagining future needs just to be prepared and avoid more migrations ;)
When you run out of local storage…
If you have a single node, external USB storage is 100% fine. Even if you have more machines, if you don’t actually need a massive amount of storage, you can share that external drive as NFS.
when you can’t add more local storage, or networked storage gets cheaper
networked storage is slower and eats up the bandwidth, so not really a great option on a small scale
I won’t comment on the when of it, you have a lot of good answers here already.
But I’d like to add that “performant” is a much lower bar than you think. Gigabit has been fine for my nearly 25 containers to use NFS as their storage, video streaming included.
When you need the data on more than one machine.
Honestly this is the simple answer. My partner and I needed to access the same files often enough that we started using a NAS before I even got into self hosting. In fact, really, the NAS was my gateway drug haha.
I have always used small, cheap devices for the servers and NAS storage. I actually had a NAS for a long time to backup my personal devices, too, even before self-hosting. The NAS uses cheaper, slower drives but larger anf more of them and in RAID configuration for redundancy because I’ve had too many drives die on me over the years. And I then use NFS to cache the data locally on the servers which benefit from faster drives which can then be much smaller because they are more expensive per GB.
