Any future upgrades?

#4
by PsiCat - opened

Hello and many thanks for this finetune. I think this is the best choice for my rp case with mid hardware (sorry for the language mistakes, it's not my native).
But is there any chance for another MoE models for WorldSim finetune in the future (like gemma4 26b a4b)? Also I found that LuffyTheFox made a fix for qwen3.6 35b a3b. He fixed a lot that was broken slightly improving the work of this llm. His fix called Genesis v2. I believe that your WorldSim experiment deserved to stay alive and move on.
What is my (and not only my) problem? I have 12 GB of video RAM and 32 GB of RAM. Dense models >20b are too slow for me. But too small models are not so smart and can't hold attention to many things. Modern models are much better at this with the same cost, but there is not so much rp choice yet. So MoE rp finetunes like your WorldSim has demand.

Sign up or log in to comment