Meta's next-generation AI chips will make its rating fashions sooner

Meta has promised that the following era of its customized AI chips can be extra highly effective and capable of practice its rating fashions a lot sooner.

Meta Coaching and Inference Accelerator (MTIA) is designed to work finest with Meta's rating and suggestion fashions. Chips may help make coaching extra environment friendly and inference – that’s, the precise reasoning duties – simpler.

The corporate mentioned in a weblog put up that MTIA is an enormous a part of its long-term plan to construct an infrastructure primarily based on the way it makes use of AI in its providers. It seeks to design its chips to work with present know-how infrastructure and future advances in GPUs.

“Reaching our ambitions for our customized silicon means investing not solely in compute silicon but in addition in reminiscence bandwidth, networking and capability, in addition to different next-generation {hardware} methods,” Meta mentioned in its put up.

Meta introduced MTIA v1 in Could 2023, specializing in offering these chips to knowledge facilities. The subsequent-generation MTIA chip will possible goal knowledge facilities as effectively. MTIA v1 was not anticipated to be launched till 2025, however Meta mentioned each MTIA chips are actually in manufacturing.

Proper now, MTIA primarily trains rating and suggestion algorithms, however Meta mentioned the purpose is to finally develop the chip's capabilities to start out coaching generative AI like its llama language mannequin.

Meta mentioned the brand new MTIA chip is “essentially centered on offering the appropriate stability of compute, reminiscence bandwidth and reminiscence capability.” This chip may have 256MB of reminiscence on-chip with a clock frequency of 1.3GHz in comparison with the v1's 128MB and 800GHz. Meta's preliminary take a look at outcomes confirmed that the brand new chip carried out thrice higher than the first-generation model throughout 4 fashions evaluated by the corporate.

The competitors to buy highly effective chips underlined the necessity for customized chips to run AI fashions. Demand for chips has grown a lot that Nvidia, which at present dominates the AI ​​chip market, is valued at $2 trillion.