In the meantime, I got an LLM to work on my AMD GPU, the text generation speed is pretty decent. (Q4KM mixtral, 18 GPU layers)
Conversation
Notices
-
Iska (iska@catposter.club)'s status on Thursday, 22-Feb-2024 16:24:07 JST Iska - New Janny in Town likes this.
-
Iska (iska@catposter.club)'s status on Thursday, 22-Feb-2024 16:24:08 JST Iska hello fellow kitties
The instance was down for almost 2 days, I had to borrow the ethernet and SATA cable from the server PC for the X99 build
It did not boot :sad_cat:
It's probably caused by bent pins
At least the BMC works, though trying to boot from it just gives me a fail, not even going into POST or explaining anything