Apparently you can run sm64 pretty well on RISC-V, even though the VisionFive2 is restricted to OpenGL ES, though the RPI build flag (if you are compiling on the VisionFive2 using the original sm64pc codebase) is all you need to get it to allow you to run it.

Although I must say it took a long time to figure out why it wasn't working.