Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Article has a section about context window size settings

I love not getting compacted so often, but 1M context is trash right now, the degradation in speed and quality is too great above ~600k context

Not different than what everyone knows, but the 1M context is masqueraded as an innovation the same way 64k context used to be to 8k context



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: