profile picture

1 pages tagged with "docker"

GPU-Accelerated LLM on ARM64...in Docker!

August 19, 2023 - 911 words - 5 mins
I think the current "AI" hype is overblown, but certainly the recent advances in ML around large language models (LLMs) have been impressive. So, when Machine Learning Compilation (MLC) recently posted an LLM chat demo that can run on the Mali G610 GPU, I was intrigued. read more