Check out 14 outstanding open-source LLMs perfect for any project!
Conversation
Notices
-
It's FOSS (itsfoss@mastodon.social)'s status on Thursday, 04-Jul-2024 14:50:31 JST It's FOSS -
Nazo (nazokiyoubinbou@mastodon.social)'s status on Thursday, 04-Jul-2024 15:47:11 JST Nazo @itsfoss These are pretty dated and several are not realistic or impossible to run locally besides. (It's a fast moving field.) Most home users want an 8B, 11B or 13B depending with a few higher depending on hardware and context. MoEs are taking over as focused models for many of these tasks though. 4x7, 4x8 and even 8x7/8 for higher end hardware. I mostly use it for story/RP stuff, but I do hear Beyonder 4x8B was good for coding though.
-