I am running it on a single RTX 3090 (24GB VRAM). Some folks on Reddit are havin... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

delicious_apple 34 days ago | parent | context | favorite | on: Muse Glimmer: 30B-parameter model optimized for al...

I am running it on a single RTX 3090 (24GB VRAM).

Some folks on Reddit are having the same experience: https://www.reddit.com/r/LocalLLaMA/comments/1vkm42m/muse_gl...

It uses an order of magnitude less VRAM at longer contexts which is a huge advantage over Qwen 3.6 27B

r0b05 34 days ago [–]

Seems like that's the tradeoff with this model. Close to 27b intelligence while using less vram.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact