Basically a 25 watt Raspberry Pi with an integrated CUDA-capable GPU. Haven't got one myself, but this probably represents the greatest size/performance inflection point for consumers right now.
Man I had the Titan Pocket. I got it and loved the physical keyboard. What a disappointment though. The wifi would just cut out, and no solutions available.
I'm running Ollama + Smollm on this thing: https://pine64.org/devices/quartz64_model_b/
Very cool to learn about that device. I want to see how small I can get. The main surprise for me was being able to run the 7B parameters version
Nvidia's Orin Nano Super is pretty recent and a very neat little piece of kit for the price: https://www.nvidia.com/en-us/autonomous-machines/embedded-sy...
Basically a 25 watt Raspberry Pi with an integrated CUDA-capable GPU. Haven't got one myself, but this probably represents the greatest size/performance inflection point for consumers right now.
[dead]
>Unihertz
Man I had the Titan Pocket. I got it and loved the physical keyboard. What a disappointment though. The wifi would just cut out, and no solutions available.