Mistral seems to be the popular choice. I think it’s the most open-source friendly out of the bunch. I will keep function calling in mind as I design some of our models! Thanks for bringing that up.

After finally having a chance to test some of the new Llama-2 models, I think you’re right. There’s still some work to be done to get them tuned up… I’m going to dust off some of my notes and get a new index of those other popular gen-1 models out there later this week.

I’m very curious to try out some of these docker images, too. Thanks for sharing those! I’ll check them when I can. I could also make a post about them if you feel like featuring some of your work. Just let me know!

Appreciate the insight. I like that approach. I just learned you can become an Alchemist too. That’s a nice touch.

Alternatively you can become an Alchemist worker which is much more lightweight and can even run on CPU (i.e. without a GPU).

If you’re reading this, consider turning your PC into a Horde Worker! It’s a great way to contribute to AI (text & image-based) if you have the power to spare.

• AI Horde
• How to Setup Your Hardware for AI Horde!

Thanks for sharing!

Hey! Appreciate your post. The AI Horde has been one of my favorite projects to see evolve over the course of this year. Consider me subbed.

For myself (and others not as knowledgeable on the project), do you think you could briefly describe the main differences between how The AI Horde approaches crowd compute / inference compared to something like Petals? I know you mentioned here that the horde doesn’t do training. Is that the biggest difference to note?

Thanks again for your contribution to democratizing AI. Excited to see what The AI Horde can do with more supporters. I’ll be dedicating a few more nodes when I have a chance to spin them up.

Assuming everything from the papers translate into current platforms, yes! A rather significant one at that. Time will tell us the true results as people begin tinkering with this new approach in the near future.

Thanks for reading! I’m glad you enjoy the content. I find this tech beyond fascinating.

Who knows, over time you might even begin to pick up on some of the nuance you describe.

We’re all learning this together!

If you’re looking for more tools, you’re one click away from !fosai@lemmy.world where you’ll find a plethora of resources on the sidebar.

If one click is too much, allow me to share the sidebar tools here!

Resources

The FOSAI Nexus & Lemmy Crash Course are the most cataloged in terms of open-source applications.

Fediverse / FOSAI

• The Internet is Healing
• FOSAI Welcome Message
• FOSAI Crash Course
• FOSAI Nexus Resource Hub

LLM Leaderboards

• HF Open LLM Leaderboard
• LMSYS Chatbot Arena

LLM Search Tools

• LLM Explorer
• Open LLMs

LLM Eval & Benchmark Resources

• Holistic Evaluation of Language Models (HELM)
• TextSynth
• The Curious Case of LLM Evaluations
• Mosaic Benchmarks

Hope you find what you’re looking for!