Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • realitaetsverlust@piefed.zip
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    2
    ·
    5 days ago

    Jup. Ollama and OpenWebUI is a great stack to tinker with some LLM models. They’re kinda useful for aggregating large datasets, translations, frontend development and gathering relevant sources for me to read into. Also, Qwen has been amazing in understanding frameworks without documentation and writing one for me. I had to use some self-developed PHP framework for a task once and without qwen, I would’ve taken probably two more weeks to get the task done.

    MiniCPM has also been REALLY good at image detection, describing it as accurately as possible, feeding it into qwen who then searches what the object could be and returning the result. I always liked google lense and that stack gave me a TEMU-Version of google lense that isn’t quite as reliable, but definitely very useful.