My server is way to weak for that unfortunately. I run some llms on my laptop with ollama but it’s not particularly effective. I use it to run dolphin series models when k need an uncensored LLM I have tried running some of the coding models but they just aren’t smart enough on my level of compute for any useful work so Ive ended up just paying api prices on open routers.
My server is way to weak for that unfortunately. I run some llms on my laptop with ollama but it’s not particularly effective. I use it to run dolphin series models when k need an uncensored LLM I have tried running some of the coding models but they just aren’t smart enough on my level of compute for any useful work so Ive ended up just paying api prices on open routers.