Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

No compaction happened. (That is set near 256k.) It seems to really not like my domain but I've seen it for various things as well (especially high-entropy tokens). Dropping random characters or various things. I've tried various flash attention and context quantization settings but nothing seemed to resolve it completely.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: