What do you use to run it locally? If there was something that could use speech to text reliably to be able to use a open source option, I consider switching.
tupalos
joined 6 months ago
What is this article even talking about? It’s making no sense.
Yeah, I think the Apple speech to text is pretty decent, but I think on ChatGPT they use the whisper API to return the text and it just seems to be a lot more reliable, especially when it comes to understanding random words in context
How much VRAM do you have on the 3060 to be able to fit the whole thing on the GPU?