Tensorization: Breaking Through The Ranks

In the previous blog post of our model compression series we went over the available quantization libraries and their features. In a similar fashion, we will now go over the packages and...

We’re very excited to announce The Unify LLM Hub: a collection of LLM endpoints, with live runtime benchmarks all plotted across time 📈 Knowing which LLM to use is very complex, and even after deciding which model to use, it’s equally complex to choose the right provider.

The LLM landscape is incredibly fast moving, with new models coming out every week. In the last few weeks alone, Mamba showed that structured state space models are more...

Following up with our model compression blog post series, we will now delve into quantization, one of the more powerful compression techniques that we can leverage to reduce the size and memory footprint of our models.‍Going forward, we will assume that you have read the first blog post of the series, where we introduced the concept of quantization. Building on top of this introduction....

One of the key drivers behind the rapid expansion in machine learning growth is the technological progress made in the development of...