Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
view the rest of the comments
2.5" is going to limit the storage size a lot. So if you need >4TB, the internal option isn't going to work. A janky solution would be to route the SATA and power connector outside the mini-pc so that you can fit a larger drive, but that's going to be pretty ugly, and still limit you to only a single drive.
A single hdd can be fast enough to serve UHD ripped 4k video, but it's much closer to the limit than an ssd would be, and might not be a great experience if you will be doing anything else with that drive at that time. Having a cache drive or multiple hdds in an array (or even better, both) greatly improves this.
A usb enclosure would let you easily have multiple hdds, but as everyone will say, they are less reliable. My opinion is that while you should never use one as a boot/system drive, they're fine for bulk storage for home use. Make sure you're not writing logs or anything like that to it, it should be on demand use only, and you might have to reconnect it occasionally. Anecdotally, I've never had issues with usb enclosures, they've worked fine for me in the past and I continue to use one for backups, but maybe people with some horror stories would have very different views on this.
You might be mixing up your units here as 4k UHD is typically <90Mb/s while large HDDs typically cap out at 120MB/s, which equates to 960Mb/s (bits vs bytes). You could likely stream 10 4k UHD movies at once from a single HDD before running into bandwidth issues and with the cost of SSDs versus HDDs, it's almost a no-brainer to go with an HDD.
I'm not mixing up units, but let me better explain what I mean. The max speed is only in a best case scenario with a single sequential reader, and that speed drops dramatically when adding other simultaneous operations because the read head needs to seek to different locations. Random read speeds regularly test at less than 1MB/s, and even though multiple sequential streams wouldn't be random, it'd still require plenty of seek time.
I did a little testing on a drive I have here just now to make sure I'm not completely full of shit. Single stream read was about 120MB/s and I was surprised how well it handled multiple read streams. My drive could handle roughly 9 sequential read streams from different locations on the drive while staying above 10MB/s, so while it wasn't reaching its max speed, it wasn't horrible, matched your expectations almost exactly. The real killer, though, was writing. If I added in a single write stream, the read speed dropped to about 1.5MB/s because it seemed to strongly prioritize writing over reading. Maybe some configuration could improve this? Interestingly, adding more readers improved this, but only up to about 4.5MB/s.
My results shouldn't be taken seriously, it's just one drive and me mucking around with dd, but I think still illustrative of what I was alluding to, that if you are using a single HDD for multiple things simultaneously, the performance can suffer badly. Actual performance will depend on its use, of course, and honestly the results are way better than I expected, so this isn't likely a realistic concern at all unless you will be constantly writing large amounts of data to the drive.
Thanks for calling me out on this, these are really interesting results, I think.
Thanks for the detailed answer! :) Indeed, I read that I would be limited in storage size if choosing the internal option. That said I am not sure I will be using more than 4tb in the next months, considering also that I don't have the need for 4k videos at the moment. Would it be a "waste" to just go for an internal ssd to start, and then upgrade to a larger hdd (external) in the future?
Also, sorry just to clarify, when you say
Does downloading media to the drive still counts as a viable thing to do? And I guess the on demand use would be e.g. streaming.
Sorry, on demand is not a good way to state this, it's just how my weird mind thinks of things. By "on demand", I mean, like you are actively using it to store something or view something. If you're not intentionally doing something with it, the drive should be completely idle. That's more of a target than a requirement, though. It's a way to keep storage drives tidy and not littered with temporary cache files, or databases used to store runtime state by various services. It's just a strategy I like to take, to keep bulk storage separated from the applications and services that use it.
Even if a usb drive is intended to be permanently attached, it should still be treated as a temporary component. The reason is so that if something happens and the drive is disconnected, it limits the disruption to the system. You lose your media and documents until it's reattached, of course, but the computer keeps chugging along happily.
If you use it for writing log files, then its loss can disrupt those services (and also prevent the problem from being reported). Also it'll be constantly making noise, which can be annoying.
That's my reasoning, anyway, you might prefer it done differently.
No worries! I think I got what you meant, just wanted to make sure. I agree with you to separate storage from apps and systems, in this way if something goes wrong with the main drive (I think) I should also be able to restore the system and not lose any downloaded media or data.