Discussion about this post

User's avatar
Sairam Sundaresan's avatar

My prediction for 2024 is that we'll see a proliferation of smaller language (and vision) models and active research into efficient attention mechanisms or alternatives. We've already seen the latter progress this year.

Expand full comment
1 more comment...

No posts