Post
50
Hello everyone! We are Smilyai-labs, a small team of 4 high school students who love AI and find it very interesting! We are super excited to launch our first preview edition of our Nova-Standard model! Nova-1 is a small family of LLM's which we built from scratch! We designed a custom efficient architecture, featuring MoD layers and much more! We have added RoPE, making it perfect to use YaRN for context extrapolation! From internal tests, we have found that it can support 8K reasonably well and 16K with some performance decreases! Please note, that this is only a Beta version for testing, and we are actively working to fix it! We are only a small group of 4 students, so our progress might be a bit slow! Thank you for your patience! Thank you for checking out our work and a small follow would be appreciated! We are constantly updating, and we will roll out a gradio demo ASAP! Our hugging face org is at: 
Smilyai-labs . Our model is at: Smilyai-labs/Nova-1-standard-pretrained-preview . The Beta testers org is at: 
Smilyai-labs-beta-testers .