Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • rando@lemmy.ml
    link
    fedilink
    English
    arrow-up
    1
    ·
    6 days ago

    I’ve been testing coding capabilities a bit (mostly scripts - so that work done by ai is reproducible).

    1. Context size is very much a required thing along with model capabilities.
    2. Local model can generate good enough script in one shot - but reiterations r crazy
    3. Use git to keep files tracked (easy to revert) and make a modular script - main script calls function a, function b etc where functions are relatively self contained (no need to look at others) when u need new capability add function c
    4. If something need changing- try to do it urself (unless it’s whole architectural change, then just start new project)

    As for image gen + chat . as long as chat model + context + image model fits, u should be fine.