Categories News

AI chip startup Groq acquires Definitive Intelligence to scale its cloud platform

AI chipmaker Groq Inc. has acquired analytics provider Definitive Intelligence Inc.. The undisclosed deal will enhance Groq’s current offerings, specifically its cloud platform GroqCloud. Founded in 2016, Groq currently boasts a funding sum of $360 million. Their core product is the LPU Inference Engine, an AI chip optimized to handle large language models focused on the task of running an AI after it’s been trained.

In a recent benchmark test, Groq’s LPU set an inference speed record while running Meta’s Llama 2 70B LLM. The LPU is made up of cores, or TSPs, that each carry about 230 megabytes of memory. These TSPs connect via an on-chip network that relays information on data travel time between the different cores, leading to faster response times. By leveraging its onboard network’s data, an LLM can pinpoint the quickest data travel routes and speed up calculations. Groq claims their chip can perform inference up to ten times faster than their competitors.

Definitive Intelligence, Groq’s recent acquisition, is an analytics provider based in Palo Alto, California. Prior to the acquisition, it had raised $10 million in funding. Definitive Intelligence’s main product is an AI-driven application that allows users to command datasets with natural language instructions and create data visualizations. Over the past months, Definitive Intelligence played a significant role in shaping GroqCloud, which provides on-demand access to LPUs. Developers can use GroqCloud to get familiar with Groq’s chips and construct applications optimized for their architecture.

Post-acquisition, Definitive Intelligence’s CEO and co-founder, Sunny Madra, will join Groq to lead the business unit for GroqCloud. Key priorities for this unit include expanding the platform’s capacity and growing its user base. Alongside this, the acquisition will also support the formation of a new department, Groq Systems, which will concentrate on helping entities such as government agencies deploy the company’s LPUs.

Source: AI chip startup Groq acquires Definitive Intelligence to scale its cloud platform }}.