actually, currently it is not open source, but I am thinking about making it open source so that other developers can also contribute in it(espeically data layer). what do you think?
very nice idea. Would be nice if you could also keep desired context as a free parameter and let the models tell you what maximum context you could have.
Very broken: "live minimums" do not allow me to remove 512 token limit and put a bigger number easily.
No unified or shared memory scenarios (like Apple's M platform or AMD's integrated GPU platform).
actually that input is broken. and sorry for that. and I am adding shared memory features in next iterations.
that broken input is fixed
Was going to mention this. I'm on an M1 Max and wanted to see what the site suggested.
Awesome, how do I contribute to this? A gihub link or smthg?
actually, currently it is not open source, but I am thinking about making it open source so that other developers can also contribute in it(espeically data layer). what do you think?
very nice idea. Would be nice if you could also keep desired context as a free parameter and let the models tell you what maximum context you could have.
actually that's free by design, it is just broken. fixing it in next sprint. And really thanks for your feedback!!!
now that is fixed, please try it