Scaling Embeddings Outperforms Scaling Experts in Language Models

1 points | by simonpure 2 hours ago