What is currently the leading chatbot that can be self hosted on your computer?

I have heard about alot of them and it seems like everyone and there dog is making one however I’m not sure which one I should be use.

Edit : I am running a 3060 with 12GB of ram

  • centomila@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I recommend LMSTUDIO (https://lmstudio.ai/).

    It allows you to manage and download models from Hugging Face, and suggests models compatible with your machine. Additionally, it can initiate a local HTTP server that functions similarly to OpenAI’s API."