Join me for a full day workshop at @gopherconuk on Practical AI and how you can integrate AI/LLMs in your #golang applications.
It draws on my experience of working at the forefront of AI development for the past few years.
Looking forward to share all of this with you!
I created the Model Playground in Kronk, kronkai.com, because nothing I could find so far allowed me to optimize llama.cpp for _my_ hardware.
Tokens / s mean nothing when your context window can take up to 3x times more minutes to fill than it needs to.