200K-Token LLM Serving on a 24 GiB Laptop with Just-in-Time State Management

2 points | by Betelbuddy 4 hours ago