Conversation

Notices

1. Iska (iska@catposter.club)'s status on Thursday, 14-Dec-2023 07:06:26 JST Iska

   • ✡️ ((fuggy)) :swastika:

   @fuggy@skippers-bin.com thinking of trying out AI LLMs, do you know the best self-hosted setup for someone with an RX6800?

   • ✡️ ((fuggy)) :swastika: (fuggy@skippers-bin.com)'s status on Thursday, 14-Dec-2023 07:06:24 JST ✡️ ((fuggy)) :swastika:

     in reply to

     @iska@catposter.club just use this and ComfyUI
     https://github.com/YellowRoseCx/koboldcpp-rocm

   • ✡️ ((fuggy)) :swastika: (fuggy@skippers-bin.com)'s status on Thursday, 14-Dec-2023 07:08:10 JST ✡️ ((fuggy)) :swastika:

     in reply to

     @iska@catposter.club might be better ways now I'm not sure, honestly haven't played around with AI in a while

   • ✡️ ((fuggy)) :swastika: (fuggy@skippers-bin.com)'s status on Thursday, 14-Dec-2023 07:12:08 JST ✡️ ((fuggy)) :swastika:

     in reply to

     @iska@catposter.club actually might be able to use normal KoboldCPP now? Seems to support HIP, I'm not sure

   • ✡️ ((fuggy)) :swastika: (fuggy@skippers-bin.com)'s status on Thursday, 14-Dec-2023 07:14:53 JST ✡️ ((fuggy)) :swastika:

     in reply to

     @iska@catposter.club nvm I'm dumb forgot everything I said