Connect with us

Business

Groq, an AI Chip Firm, raises $640 Million to take on Nvidia

Published

on

A fresh investment round led by Blackrock has secured $640 million for Groq, a business that is creating chips to run generative AI models faster than traditional processors. The company announced this information on Monday. Participating companies included Samsung Catalyst Fund, Cisco, KDDI, Neuberger Berman, and Type One Ventures.

Groq, which was allegedly hoping to raise $300 million at a somewhat lower ($2.5 billion) valuation, is celebrating a significant victory with this tranche, which puts the company’s total raised to over $1 billion and values it at $2.8 billion. Groq raised approximately $1 billion in April 2021 and $300 million in a funding round headed by D1 Capital Partners and Tiger Global Management. This valuation more than doubles that amount.

Groq also announced today that Stuart Pann, the former head of Intel’s foundry business and former CIO at HP, will join the startup as chief operational officer. Yann LeCun, the main AI scientist at Meta, will advise the company technically. Given Meta’s investments in its own AI chips, LeCun’s appointment is a little surprising, but it definitely provides Groq a strong ally in a competitive market.

Groq is developing an LPU (language processing unit) inference engine after coming out of stealth in 2016. The business asserts that their LPUs can operate generative AI models that are currently in use at 10 times the speed and 1/10th the energy of OpenAI’s ChatGPT and GPT-4o.

Jonathan Ross, the CEO of Groq, is renowned for his contribution to the creation of the tensor processing unit (TPU), Google’s proprietary AI accelerator processor used for model training and execution. Nearly ten years ago, Ross co-founded Groq with Douglas Wightman, an entrepreneur and former engineer at Google parent firm Alphabet’s X moonshot lab.

Groq offers an LPU-powered developer platform called GroqCloud, which includes an API that lets users use its chips in cloud instances, as well as “open” models like Google’s Gemma, OpenAI’s Whisper, Mistral’s Mixtral, and Meta’s Llama 3.1 series. (Groq also runs GroqChat, an AI-powered chatbot playground that it introduced at the end of last year.) More than 356,000 developers were using GroqCloud as of July. According to Groq, some of the money raised during this round will be utilized to expand the company’s capacity and introduce new models and features.

“Many of these developers are at large enterprises,” stated Stuart Pann, COO of Groq. “By our estimates, over 75% of the Fortune 100 are represented.”

As generative AI becomes more popular, Groq will have to contend with competition from rival AI chip startups as well as Nvidia, the industry leader in AI hardware.

Nvidia is attempting to preserve its dominance in the market for AI processors, which are needed to train and implement generative AI models. The company is expected to dominate between 70% and 95% of this industry.

As opposed to every other year, like in the past, Nvidia has pledged to release a new AI chip architecture annually. Additionally, it is apparently starting a new business unit dedicated to creating custom chips for cloud computing companies as well as other businesses, including AI devices.

Groq faces competition from Nvidia as well as Amazon, Google, and Microsoft, who now provide or plan to provide customized chips for artificial intelligence workloads on the cloud. Customers of Google Cloud can use the aforementioned TPUs as well as Google’s Axion chip in due course. Microsoft recently introduced Azure instances in preview for its Cobalt 100 CPU, with Maia 100 AI Accelerator instances to follow in the coming months. Amazon offers its Trainium, Inferentia, and Graviton processors through AWS.

Analysts predict that in the next five years, the AI chip market might exceed $400 billion in sales, and Groq may see competition from Arm, Intel, AMD, and an increasing number of startups. Due in large part to cloud vendors’ increasing capital expenditures to meet the capacity demand for generative AI, Arm and AMD in particular have seen their AI chip businesses flourish.

Late last year, D-Matrix secured $110 million to launch a platform for inference computation that it described as unique in the market. With $120 million, Etched came out of stealth in June to unveil a processor designed specifically to accelerate the transformer, the most popular generative AI model architecture available today. Masayoshi Son of SoftBank is purportedly trying to fund $100 billion for a chip business in order to take on Nvidia. Additionally, it’s said that OpenAI is in discussions to start a chip-making venture with investment firms.

Groq is significantly spending on industry and government outreach in an effort to carve out its niche.

To create Groq Systems, a new business unit, Groq bought Definitive Intelligence, a Palo Alto-based company that provides a variety of business-oriented AI solutions, in March. Serving entities, such as sovereign nations and U.S. government agencies, that want to construct new data centers employing Groq processors or integrate Groq chips into already-existing ones falls within stems’ jurisdiction.

More recently, the startup Groq signed an agreement to install tens of thousands of its LPUs in the Norway data center of the European company Earth Wind & Power. Additionally, Groq teamed with Carahsoft, a government IT contractor, to market its solutions to public sector clients through Carahsoft’s reseller partners.

Additionally, Groq and Aramco Digital, a Saudi Arabian consulting business, are working together to install LPUs in upcoming Middle Eastern data centers.

Groq, a company located in Mountain View, California, is developing new ties with customers while simultaneously moving forward with the development of its microprocessor. The company said in August of last year that it will be working with Samsung’s foundry division to produce 4nm LPUs, which are anticipated to outperform Groq’s initial 13nm chips in terms of efficiency and performance.

By the end of Q1 2025, Groq intends to deploy over 108,000 LPUs.

Business

IBM Purchases Kubecost, a Kubernetes Cost Optimization Company

Published

on

Kubecost is a FinOps business that assists teams like Allianz, Audi, Rakuten, and GitLab in monitoring and optimizing their Kubernetes clusters with an emphasis on cost and efficiency. IBM announced on Tuesday that it has purchased Kubecost.

The news on Tuesday comes after IBM acquired Apptio, a different FinOps business, for $4.3 billion in 2023. Additionally, in prior years, IBM purchased businesses such as application performance monitoring startup Instana and cloud app and network management company Turbonomic. With the acquisition of KubeCost, IBM is now able to further strengthen its IT and FinOps capabilities in response to businesses’ growing need for better management of their increasingly complicated on-premises and cloud infrastructure.

“Since launching in 2019, our mission has been to optimize the world’s infrastructure,” co-founder and CEO of Kubecost Webb Brown stated on the business blog. “We started with Kubernetes cost monitoring, and we’ve proudly become the most widely adopted solution in the cloud native ecosystem. Now, as a result of this merger, we’re poised to accelerate our mission by delivering broader, end-to-end cost management solutions to teams everywhere.”

It’s important to remember that OpenCost, the foundation of Kubecost’s commercial solution, is an open source project that is vendor-neutral and created by Kubecost. OpenCost is one of the sandbox projects of the Cloud Native Computing Foundation, having debuted in 2022.

Although Apptio purchased Cloudability in 2019 and Turbonomic, IBM claims that Kubecost will be integrated into its FinOps Suite. However, it wouldn’t be shocking if IBM also further integrated Kubecost/OpenCost into its OpenShift enterprise platform.

The purchase price was kept a secret by the two businesses. In 2022, Kubecost completed a $25 million Series A fundraising round headed by Coatue Management. In 2021, First financing Capital led a $5.5 million seed financing for the startup.

Continue Reading

Business

An SEO startup has raised $850,000 to assist businesses in utilizing AI-powered search

Published

on

Pre-seed finance totaling $850,000 has been received by Ecomtent, an AI start-up that assists retailers and sellers in getting ready for the AI-driven e-commerce search of the future. The investment was spearheaded by MaRS Investment Accelerator Fund (IAF) and included senior leadership from the tech sector, Techstars x eBay Ventures, and C-Suite Angels from Retailers.

Ecoment is going to completely change how merchants and sellers are ready for a world where searches are based on LLM. Ecomtent was founded in 2022 by Timur Luguev, a PhD & Postdoctoral Researcher in Machine Learning, and Max Sinclair, who worked for six years at Amazon on strategic initiatives such as the launch of Amazon in Singapore and the EU’s first grocery store. Ecomtent’s technology allows sellers and retailers to create written and visual content that is specifically optimized for AI-powered search across large catalogues at scale, eliminating bottlenecks on internal content teams and outside agencies and saving weeks of labor.

CEO Sinclair predicted a “Ecommerce is about to change fundamentally,” in e-commerce. “Generative AI will completely transform how consumers shop online, with conversational-style search poised to become the new normal. The current best SEO practices will look completely outdated in just 12 months. Longtail keyword matching is dead, and the future will be matching customer intent across both written and visual assets.”

With two major retailers having annual revenues of $11 billion and $14 billion, respectively, the company has already completed successful pilots with both, demonstrating considerable market progress. These successes have made Ecomtent a popular choice among Amazon Seller and Amazon Agency communities, allowing these clients to produce infographics, optimized content, A+ Content, and high-quality lifestyle photos at scale. With a recent submission approved by the USPTO, its patent-pending technology has demonstrated that AI-generated content may raise product listing conversion rates by as much as 30%.

“I have been incredibly impressed with Ecomtent’s technology, which has augmented our internal content team’s speed and scale to be 10x more productive,” stated Vincenzo Toscano, CEO of Full-Service Amazon and Walmart Agency Ecomcy. A key component of succeeding in e-commerce is having the appropriate software tools in your toolbox, according to Ben Leonard, a seven-figure Amazon seller and best-selling author of Quit Stalling and Build Your Brand. Beyond simply being the product listing tool of the future, ecomtent currently outperforms its closest, more established competitors in terms of results.

With the help of this most recent fundraising round, Ecomtent will be able to develop faster, hire more people, improve its AI capabilities, and extend its operations in order to satisfy the increasing demand from companies figuring out how to use AI-powered search. According to Emil Savov, Managing Director of MaRS IAF, “We are excited by the unique composition of Ecomtent’s founding team, and the specialist AI talent from elite institutions they have recruited around them, to capitalize on this moment of incredible opportunity to build a category-defining business.”

Continue Reading

Business

Singaporean Venture Capital Raises Startup Debt Fund Despite Low Valuations

Published

on

Private lender Genesis Alternative Startups, which supports startups and growth-stage businesses, closed its second loan fund below target because foreign investors are still wary of Southeast Asia’s startup scene.

The Singaporean company secured additional investors, such as Israel’s OurCrowd Ltd. and Japan’s Mizuho Bank, to raise $125 million for the fund, which will support startup businesses throughout Southeast Asia. The fund took almost two years to close, having sought between $120 and $180 million.

Private lender Genesis Alternative startups, which supports startups and growth-stage businesses, closed its second loan fund below target because foreign investors are still wary of Southeast Asia’s startup scene.

The Singaporean company secured additional investors, such as Israel’s OurCrowd Ltd. and Japan’s Mizuho Bank, to raise $125 million for the fund, which will support startup businesses throughout Southeast Asia. The fund took almost two years to close, having sought between $120 and $180 million.

In recent quarters, there has been an increasing interest in venture lending, or loans given to startups, as more businesses choose to use the debt market rather than raise equity. The values of computer businesses have been severely damaged by a bleak prognosis for the global economy, and venture capital firms have been finding it difficult to raise money in the midst of a sluggish market for IPOs. Nevertheless, because many of its still-unprofitable businesses are seen as high-risk by global venture capitalists, Southeast Asia continues to be a difficult market for raising both financing and equity.

“It’s never easy to raise funds, and it’s been more difficult in this environment,” Genesis managing partner and co-founder Jeremy Loh stated in an interview. “This is a period of time where founders must be able to demonstrate that they can grow at a sustainable pace without relying on too much equity.”

Aozora Bank Ltd., Korea Development Bank, and Silverhorn Group were among the more than 80% of investors in Genesis’s inaugural fund who also made investments in its most recent fund.

Nine firms, including Aonic, Eezee Pte, and Akulaku Inc., have already received more than $20 million in loans from the second fund, according to Loh. Because businesses lack collateral or aren’t yet profitable, entrepreneurs that don’t often qualify for standard bank loans are given credit by Genesis. In Southeast Asia, the company’s initial $90 million fund has supported 25 firms, ranging from Series A to pre-IPO. Among its portfolio firms are the online lender Akulaku, located in Jakarta, and the buy-now, pay-later startup Pace.Singaporean Venture Capital Raises Startup Debt Fund Despite Low Valuations

Continue Reading

Trending

error: Content is protected !!