Linux

51482 readers

273 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
No misinformation
No NSFW content
No hate speech, bigotry, etc

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago

MODERATORS

nooter692@lemmy.ml

MarcellusDrum@lemmy.ml

cypherpunks@lemmy.ml

cyclohexane@lemmy.ml

Docker to Kubernetes, ZFS to ... ? (lemmy.nowsci.com)

submitted 2 days ago by fmstrat@lemmy.nowsci.com to c/linux@lemmy.ml

1 comments fedilink hide all child comments

Hi all,

I've been running a bunch of services in docker containers using Docker Compose for a while now, with data storage on ZRAID mirrored NVME and/or ZRAID2 HDDs.

I've been thinking about moving from my single server setup to three micro-servers (Intel N150s), both for redundancy, learning, and fun.

Choosing Kubernetes was easy, but I'd like to get some outside opinions on storage. Some examples of how I'm using storage:

Media and large data storage: Currently on the ZRAID2 HDDs, will stay here but be migrated to a dedicated NAS
High IO workloads like Postgresql and email: Currently running on the NVMEs
General low-volume storage: Also currently on NVMEs, but different use case. These are lower IO, like data storage for Nextcloud, Immich, etc

I'm a huge fan of being able to snapshot with ZFS, as I mirror all my data off-site with hourly pushes for some container data, and daily for the rest. I'd like to be able to continue this kind of block-level backups if possible.

Assume I'm a noob at Kubernetes storage (have been reading, but still fresh to me). I'd love to know how others would set up their storage interfaces for this.

I'm trying to understand if there's a way to have the storage "RAIDed" across the drives in the three micro-servers, or if things work differently than I expect. Thanks!

you are viewing a single comment's thread
view the rest of the comments

[–] 8osm3rka@lemmy.world 1 points 1 day ago* (last edited 1 day ago)

I'd recommend Ceph (in the form of Rook ) if you're willing to put in the time to learn it. For a simpler solution, check out Longhorn. Ceph is more mature, and Rook is just a solution that almost fully automates its deployment on kubernetes, while Longhorn is built from scratch as a kubernetes native storage solution. The people who built Longhorn (Rancher Labs) also make a FOSS kubernetes management service called Rancher, so if you prefer a more intuitive web UI for K8s, be sure to check that out too

Rook is the 2nd most used container storage solution I've encountered or set up at my job, with legacy storage appliances like IBM FlashSystem and NetApp being the first