Out-of-core LLM inference engine written from scratch in Rust

4 points | by Vage91 20 hours ago

1 comments