Meta is working on its own chip, data center design for AI workloads

Data center corridor of servers with abstract overlay of digital connections.



Sdecoret / Getty Pictures




































Fb guardian firm Meta has revealed plans for the event of its personal customized chip for operating manmade intelligence fashions, and a brand new information heart structure for AI workloads.

“We're executing on an formidable plan to construct the following era of Meta’s AI infrastructure and at this time, we’re sharing some particulars on our progress. This contains our first customized silicon chip for operating AI fashions, a brand new AI-optimized information heart design and the second section of our 16,000 GPU supercomputer for AI analysis,” Santosh Janardhan, head of infrastructure at Meta, wrote in a weblog submit Thursday.

Meta’s customized chip for operating AI fashions, known as Meta Coaching and Inference Accelerator (MTIA), is designed to offer larger compute energy and effectivity than CPUs in the marketplace at this time, based on Janardhan.

MTIA is custom-made for inner workloads resembling content material understanding, feeds, generative AI, and advert rating, the corporate mentioned, including that the primary model of the chip was designed in 2020.

Meta’s announcement of the strides it's making to provide its personal customized chips for operating AI fashions comes at a time when different massive know-how firms — pushed by the proliferation of massive language fashions and generative AI —are both engaged on or have already launched their very own chips for AI workloads

Earlier this month, information studies claimed that Microsoft was working with chip-maker AMD to develop its personal chip for operating AI workloads. AWS has additionally launched its personal chip for operating AI workloads.

On its half, Meta additionally mentioned Thursday that its new information heart design might be optimized to coach AI fashions, a course of that allows them to raised their efficiency as they ingest extra information..

“This new information heart might be an AI-optimized design, supporting liquid-cooled AI hardware and a high-performance AI community connecting hundreds of AI chips collectively for information center-scale AI coaching clusters,” Janardhan wrote, including that the brand new information heart techniques might be quicker and cheaper to construct than earlier services.

Along with the brand new information heart design, the corporate mentioned that it was engaged on growing AI supercomputers that may assist coaching of next-generation AI fashions, energy augmented actuality instruments, and assist real-time translation know-how.

ENDS

Post a Comment

Previous Post Next Post