Wondering about services to test on either a 16gb ram “AI Capable” arm64 board or on a laptop with modern rtx. Only looking for open source options, but curious to hear what people say. Cheers!

  • afk_strats@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    18 hours ago

    I have this exact same setup. Open Web UI has more features than I’ve been able to use such as functions and pipelines.

    I use it to share my LLMs across my network. It has really good user management so I can set up a user for my wife or brother in law and give them general use LLM while my dad and I can take advantage of Coding-tuned models.

    The code formatting and code execution functions are great. It’s overall a great UI.

    Ive used LLMs to rewrite code, help format PowerPoint slides, summarize my notes from work, create D&D characters, plan lessons, etc