15X

In short Xiaomi and inference partner TileRT have broken 1,000 tokens per second on a 1 trillion-parameter model, a first at that …