this post was submitted on 08 Jul 2025
92 points (96.9% liked)

Selfhosted

49240 readers
598 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
HybridSarcasm@lemmy.world
HybridSarcasm@lemmy.hybridsarcasm.xyz
92
PSA: If the first Smart Search in Immich takes a while (lemmy.ca)
submitted 1 day ago* (last edited 1 day ago) by avidamoeba@lemmy.ca to c/selfhosted@lemmy.world
37 comments fedilink hide all child comments
 

Your ML model cache volume is getting blown up during restart and the model is being re-downloaded during the first search post-restart. Either set it to a path somewhere on your storage, or ensure you're not blowing up the dynamic volume upon restart.

In my case I changed this:

  immich-machine-learning:
    ...
    volumes:
      - model-cache:/cache

To that:

  immich-machine-learning:
    ...
    volumes:
      - ./cache:/cache

I no longer have to wait uncomfortably long when I'm trying to show off Smart Search to a friend, or just need a meme pronto.

That'll be all.

you are viewing a single comment's thread
view the rest of the comments
[–] avidamoeba@lemmy.ca 13 points 1 day ago* (last edited 1 day ago) (2 children)

Oh, and if you haven't changed from the default ML model, please do. The results are phenomenal. The default is nice but only really needed on really low power hardware. If you have a notebook/desktop class CPU and/or GPU with 6GB+ of RAM, you should try a larger model. I used the best model they have and it consumes around 4GB VRAM.

[–] apprehensively_human@lemmy.ca 7 points 1 day ago (1 children)

Which model would you recommend? I just switched from ViT-B/32 to ViT-SO400M-16-SigLIP2-384__webli since it seemed to be the most popular.

[–] avidamoeba@lemmy.ca 9 points 1 day ago (1 children)

I switched to the same model. It's absolutely spectacular. The only extra thing I did was to increase the concurrent job count for Smart Search and to give the model access to my GPU which sped up the initial scan at least an order of magnitude.

[–] apprehensively_human@lemmy.ca 2 points 2 hours ago

Seems to work really well. I can do obscure searches like Outer Wilds and it will pull up pictures I took from my phone of random gameplay movements, so it's not doing any filename or metadata cheating there.

[–] Showroom7561@lemmy.ca 2 points 23 hours ago (1 children)

Is this something that would be recommended if self-hosting off a Synology 920+ NAS?

My NAS does have extra ram to spare because I upgraded it, and has NVME cache 🤗

[–] avidamoeba@lemmy.ca 2 points 21 hours ago* (last edited 21 hours ago) (1 children)

That's a Celeron right? I'd try a better AI model. Check this page for the list. You could try the heaviest one. It'll take a long time to process your library but inference is faster. I don't know how much faster it is. Maybe it would be fast enough to be usable. If not usable, choose a lighter model. There's execution times in the table that I assume tell us how heavy the models are. Once you change a model, you have to let it rescan the library.

[–] Showroom7561@lemmy.ca 3 points 21 hours ago (2 children)

That’s a Celeron right?

Yup, the Intel J4125 Celeron 4-Core CPU, 2.0-2.7Ghz.

I switched to the ViT-SO400M-16-SigLIP2-384__webli model, same as what you use. I don't worry about processing time, but it looks like a more capable model, and I really only use immich for contextual search anyway, so that might be a nice upgrade.

[–] iturnedintoanewt@lemmy.world 1 points 17 hours ago* (last edited 17 hours ago) (1 children)

What's your consideration for choosing this one? I would have thought ViT-B-16-SigLIP2__webli to be slightly more accurate, with faster response and all that while keeping a slightly less RAM consumption (1.4GB less I think).

[–] Showroom7561@lemmy.ca 2 points 16 hours ago

Seemed to be the most popular. LOL The smart search job hasn't been running for long, so I'll check that other one out and see how it compares. If it looks better, I can easily use that.

[–] avidamoeba@lemmy.ca 1 points 20 hours ago (1 children)

Did you run the Smart Search job?

[–] Showroom7561@lemmy.ca 2 points 16 hours ago (1 children)

Running now.

[–] avidamoeba@lemmy.ca 1 points 13 hours ago (1 children)

Let me know how inference goes. I might recommend that to a friend with a similar CPU.

[–] Showroom7561@lemmy.ca 2 points 4 hours ago (1 children)

I decided on the ViT-B-16-SigLIP2__webli model, so switched to that last night. I also needed to update my server to the latest version of Immich, so a new smart search job was run late last night.

Out of 140,000+ photos/videos, it's down to 104,000 and I have it set to 6 concurrent tasks.

I don't mind it processing for 24h. I believe when I first set immich up, the smart search took many days. I'm still able to use the app and website to navigate and search without any delays.

[–] avidamoeba@lemmy.ca 1 points 3 hours ago (1 children)

Let me know how the search performs once it's done. Speed of search, subjective quality, etc.

[–] Showroom7561@lemmy.ca 1 points 2 hours ago

Search speed was never an issue before, and neither was quality. My biggest gripe is not being able to sort search by date! If I had that, it would be perfect.

But I'll update you once it's done (at 97,000 to go... )