↳ In-reply-to » @bender Ollama currently. It's been rock solid.

@prologic@twtxt.net currently playing with:

NAME                 ID              SIZE      MODIFIED           
qwen2.5-coder:32b    4bd6cbf2d094    19 GB     About a minute ago 
qwq:latest           46407beda5c0    19 GB     10 minutes ago     
codestral:latest     0898a8b286d5    12 GB     14 minutes ago     
codellama:34b        685be00e1532    19 GB     17 minutes ago     
gemma2:27b           53261bc9c192    15 GB     29 minutes ago     
phi3:14b             cf611a26b048    7.9 GB    23 hours ago       

Which run really well on a regular (non-pro) M4.