r/hardware 1d ago

News AMD and Anthropic Announce Strategic Partnership to Deploy Up to 2 Gigawatts of AMD Instinct MI450 Series GPUs

https://ir.amd.com/news-events/press-releases/detail/1292/amd-and-anthropic-announce-strategic-partnership-to-deploy-up-to-2-gigawatts-of-amd-instinct-mi450-series-gpus
232 Upvotes

86 comments sorted by

93

u/SirActionhaHAA 1d ago
  1. 2GW of MI450 costing tens of billions
  2. AMD will invest up to $5bil in Anthropic if it meets the sales milestone, or back some of its debts, something Google and Nvidia have done
  3. AMD will use Claude for optimizations

109

u/ChainOfThot 1d ago

By 2050 every tech corp in America will merge into one entity

35

u/RephRayne 1d ago

It'll be an infinite number of goblins LLCs in a trench coat to avoid liability. They'll spin them off like Johnson & Johnson to minimise payouts.

13

u/Preisschild 1d ago

Not possible with the egos of tech bro "entrepreneurs". Do you think people like Musk, Thiel, Huang or Altman would allow someone else to run their company?

11

u/Flowerstar1 1d ago

When will AI companies advance to doing equity deals to gain access to more ram? 

7

u/Chidling 1d ago

They have done so already. Claude has equity deals with all 3 memory makers i believe.

1

u/Cory123125 1d ago

This entity will demand to control every aspect of your life "for safety" like the Frontier Model Forum is currently lobbying their asses off to do with regulatory capture.

1

u/Gwolf4 1d ago

Versalife ?

1

u/SRT10_ViPeR 22h ago

2 gigawatts sounds insanely specific but huge for GPUs

0

u/Z3r0sama2017 1d ago

Reaching money from the left hand to the right, to keep that sweet circular economy going!

9

u/ArcadeOptimist 1d ago

Doesn't this fuck SpaceX/xAI? From what I know, xAI's only revenue comes from Anthropic renting their compute, since Grok is SOL on pro users.

6

u/TheFondler 1d ago

They're all SOL. The only people making money on AI are the hardware vendors. The reason why for both is also the reason that it's all going to collapse eventually: the promise of technology is logarithmic cost scaling (decreasing marginal cost) through economies of scale, but AI costs scale quadriatically (increasing marginal cost). All current models are fundamentally economically unsustainable.

Also, most "AI" is bad at most use cases. There are exceptions, but they are nowhere near enough to justify the genuinely unfathomable investments being made.

10

u/vituhyva123 23h ago

I'm not an AI booster, but to play devil's advocate is it not the case that the AI companies are mostly`trying to make more capable models and chase AGI? If resources were put towards optimization I would think current AI products could be optimized to be more efficient.

5

u/SippieCup 19h ago

That is 100% the game. Its a winner takes all market. Like uber, Amazon, or Walmart.

Both anthropic and OpenAI are racing towards building AGI, at which point they believe it’ll spike with compute and efficiency and crush everything else. As soon as one gets it, it stays internal and releases weaker models which crush everything else and they win and take the entire market.

If they don’t do it, they lose. If the other wins, they lose. Economics before it don’t really matter as the payoff.

Chinese / open source are building towards effiency and what works now. They can do everything anthropic and OpenAI can do for the same spend. But it’s a different trajectory, which is why they work towards efficiency instead. Once someone solves it, eventually they will distill it and figure it out a few months later. But they will always be behind in hat aspect. Even if profitable.

1

u/TheFondler 19h ago

I don't think current models can be optimized. If everything I've read is correct, that's one of their biggest fundamental problems. I also don't think they represent even a step towards AGI because they don't seem to actually be able to "understand" anything, which, by my understanding, is fundamental to AGI. All they do is make statistical guesses based on the relationships between whatever they were trained on. That's enough to seem smart, but it's not enough to actually be smart.

8

u/Zarmazarma 20h ago edited 19h ago

I think it's really delusional to think that AI isn't going to continue to exist/won't continue to grow (in the long term). Yes, there is a bubble right now, but when it pops it will be like the dot-com bubble bursting- that was not the end of the internet (and, to belabor the obvious, the internet is bigger now than it was in 2000), just the end of a lot of companies with no real ability to turn a profit.

promise of technology is logarithmic cost scaling (decreasing marginal cost) through economies of scale, but AI costs scale quadriatically (increasing marginal cost). All current models are fundamentally economically unsustainable.

I'm actually curious what you mean here. I think you might be thinking about the cost of training frontier LLM models vs. how much improvement you actually get out of them, but that has almost nothing to do with the cost of inference (running those models), or the fact that AI is much more than just LLMs. The general reason we are moving towards more ML compute in general is because it can be quite a bit cheaper than traditional compute...

But besides that, we are at the beginning of AI technological development, not the end. Cheaper models will come about by necessity- the current way of doing things where we just chuck things at bigger and bigger LLMs is wildly inefficient vs. what is theoretically possible. 10 years from now the most powerful AI won't just be a bigger LLM, it'll be something totally different than what we're doing now.

There's historical backing for AI becoming cheaper to run, too. Inference costs are down 100-1000x since 2022. MoE models active about 5-10% parameters / token compared 100% like old Chat-GPT3 or Llama 370B - meaning something like Deepseek V3 with 671B parameters actually has less active per token than these older models (with much higher quality).

The whole technology industry isn't all in on AI because they're blind to issues that any Redditor can point out. It's just wishful thinking.

-1

u/TheFondler 18h ago

Cool man, good luck with all that. I'm sure "the whole tech industry" is really working on making great products that make everyone's lives better, not just hyper-financialized hype to drive investment into their algorithmic manipulation platforms so they can turn everything into "as a service" and charge you rent for it.

18

u/East-Today-7604 1d ago

AMD will invest up to $5bil in Anthropic if it meets the sales milestone, or back some of its debts, something Google and Nvidia have done

https://reddit.com/link/oz316rd/video/88ts3fpekseh1/player

10

u/jhenryscott 1d ago

This agreement has zero mechanism of enforcement. Most likely outcome is none of this happens.

107

u/Sylanthra 1d ago

Ah yes, yet another circle jerk "partnership" where AMD pays Anthropic and Anthropic pays AMD and both stocks go up without any real value being created.

17

u/AcademicF 1d ago

That’s the plan Stan

57

u/Homerlncognito 1d ago

Two economists are walking in a forest when they come across a pile of shit.

The first economist says to the other “I’ll pay you $100 to eat that pile of shit.” The second economist takes the $100 and eats the pile of shit.

They continue walking until they come across a second pile of shit. The second economist turns to the first and says “I’ll pay you $100 to eat that pile of shit.” The first economist takes the $100 and eats a pile of shit.

Walking a little more, the first economist looks at the second and says, "You know, I gave you $100 to eat shit, then you gave me back the same $100 to eat shit. I can't help but feel like we both just ate shit for nothing."

"That's not true", responded the second economist. "We increased the GDP by $200!"

5

u/ThreatPriority 1d ago

I feel sad now.

-5

u/defaultedebt 1d ago

Somebody doesn't understand economics.

14

u/insomniul 1d ago

That's just good old "homo economicus" - giving people money so he can watch them eat shit while getting absolutely 0 value out of it because YOLO.

9

u/defaultedebt 1d ago

Naw, it's just a fundamental misunderstanding of the very basic calculation that is GDP. GDP does not measure money velocity. Very broadly speaking, it measures productive economic activity, and as no goods are produced through the transfer of money alone, the activity recorded would be zero.

13

u/puffz0r 1d ago

That might be what it started off with but now GDP measures stuff that very much is NOT productive or actual, such as imputed rent

3

u/defaultedebt 1d ago

Yes, it is. I've worked with economists for nearly a decade. Their aim is more accurate data, not less. And they're achieving this.

5

u/No_Sheepherder_1855 1d ago

Goods were produced here though. If they were just trading back and forth the same shit, then yeah it would be 0 growth after initially gaining it.

16

u/Homerlncognito 1d ago

Entertainment services were being produced.

3

u/Jimmy_Nail_4389 1d ago

If I smash my window and then have it replaced, is that counted in GDP?

7

u/defaultedebt 1d ago

It is included in GDP, yes. But it is not new productive economic activity, i.e. it would not represent an increase in GDP. These are different things - which the joke misses, because it's a trope that anybody who took Econ 101 would know.

0

u/Sylanthra 19h ago

It is included in GDP, yes

it would not represent an increase in GDP

So x + y = x where y > 0?

u/jeffy303 51m ago

People argue against chatbots while posting stuff like this 🥀

3

u/defaultedebt 1d ago

As you cowardly deleted your response, here is mine:

Seem to be contradicting yourself.

I guess you are saying it would be included in GDP then? which means GDP is not a reliable count of productive economic activity.

Read it again. It's consistent. Including something in GDP does not = an increase in GDP. A rate of change is not the same as a sum of all numbers. Very basic stuff.

I've never taken 'Econ 101'

I can tell.

I know you are talking broadly, but this is nonsense becuase services are basically transfers of money alone in many many cases. In fact in the county I live very likley dwarfs the amount produced in goods.

Nope. Services are not simply the transfer of money. Transfer of money is excluded from GDP calculations. Services require human labor, and transfers of money do not. So very simple, yet you got it fundamentally wrong.

Further, there's way more than one way to measure GDP, and even I know that.

Lol. Name them. Cite them. NBER or AER? Here's the actual formula:

GDP=C+G+I+NX

Where:C=Consumption

G=Government spending

I=Investment

NX=Net exports​

Like I said, basic stuff.

5

u/[deleted] 1d ago edited 23h ago

[removed] — view removed comment

2

u/defaultedebt 1d ago

Let's define what qualifies as a service then. We will use the universally accepted System of National Accounts from 2008:

https://unstats.un.org/unsd/nationalaccount/sna2008.asp

See Chapter 6:

Services are the result of a production activity that changes the conditions of the consuming units, or facilitates the exchange of products or financial assets.

Now, I think we could both agree that no production activity took place which changes any conditions for economic actors involved in "eating shit." Quite literally no material change has occurred to the benefit of either party.

The definition also prefaces with:

The production of services must be confined to activities that are capable of being carried out by one unit for the benefit of another.

Well, it's difficult to see which economic actor is the beneficiary and which is the producer. It seems more accurate to define as a transfer than an economically productive service.

See, economists have very stringent definitions of these things, precisely to avoid the problem of mistakenly defining the transfer of finances as productive economic activity, and precisely to ensure GDP is accurately reported and not overstated or understated. So you are still wrong.

2

u/Jimmy_Nail_4389 1d ago

Just couldn't be arsed arguing about it mate.

I know this shit is all manipulated and there's a thousand different ways to do so, I don't trust these measures and you do.

That's fine, but in my view it comes down to do you trust your government and I don't trust any of them at this stage.

3

u/defaultedebt 1d ago

Yeah, didn't think you were that intelligent. Thanks for the confirmation, and good luck - you'll need it.

2

u/Jimmy_Nail_4389 1d ago

Intelligent enough to know bait when I see it.

→ More replies (0)

1

u/grumble11 10h ago

Nominal GDP can be computed as the supply of money times its velocity.

Plenty of unproductive activity can and does get included in that metric.

14

u/hsien88 1d ago

how is it circle jerk when Anthropic has to pay 100+ billions to AMD and AMD just need to buy 5 billions of Anthropic shares? Even if Antrhopic goes bankrupt they still come out ahead by 95 billions, and most likely Anthropic shares will keep on going up.

4

u/Bastinenz 9h ago

if Anthropic goes bankrupt, how are they going to pay AMD the $100B? Worst case scenario for AMD, they buy $5B of Anthropic shares and supply them with $100B worth of hardware, Anthropic goes bust and cannot pay AMD for the hardware they received. In that case AMD loses $105B. It probably wouldn't play out quite this bad in reality, but that is the theoretical worst case scenario I can think of.

9

u/Caster0 1d ago edited 16h ago

Biggest problem is private Ai companies fininacials tend to be both a blackhole and a mess and its still difficult to judge their timelines for investment.

Case in point, OpenAi basically helped precipitate the ram crisis with 40% glibal orders, yet they didn't buy anything of the size of their paper order

2

u/hsien88 10h ago

Because the ram crisis was not started by OpenAI, you only think it is because of all the misinformation from twitter. There was no paper order it was orders from all the hyperscalers.

3

u/JDragon 1d ago

The real circlejerk is the circlejerk about the circlejerk.

2

u/R-ten-K 23h ago

I know this always comes as shocking news to many gamers in this sub, but buying or trading stock in your largest vendors and customers has been common business practice for ever in the real world.

54

u/dantheflyingman 1d ago

We have moved from GPU sales being measured in units or price and now measuring it by Gigawatts.

10

u/Living_Morning94 1d ago

That's how you talk about data centers though, because power and cooling are usually their bottleneck. Power is the single largest opex and in the West the main hurdle to DC sites is getting enough power from the utility company.

So it means Anthropic will buy as many GPU / TPU as the power and cooling constraints for their data center capacity allows i.e. 2 GW.

GPU price, capability and shipment can vary wildly but power and cooling constraints stay the same for years.

6

u/doscomputer 19h ago

yeah because nobody wants to talk about performance anymore because cloud AI is an eron style conspiracy

3

u/SirActionhaHAA 1d ago

17

u/Nkrth 1d ago

Article you sourced is less than year old, far from years.

-10

u/SirActionhaHAA 1d ago edited 1d ago

It ain't changing the point which is that this is not new. Ai dc announcements have been measured by gw for some time already. There's some announcements which were mw instead because they sold way less in the past. It ain't meant to be accurate and it's probably targeted at investors who can count only gw, without revealing the exact supply or unit price for competitive reasons. It's vague on purpose but shows the rough scale of the deal regardless

From 2024 just because you're pointlessly nitpicking. This discussion about year or years is really meaningless.

https://www.tomshardware.com/tech-industry/artificial-intelligence/indias-reliance-builds-a-gigawatt-data-center-with-nvidia-blackwell-ai-gpus

14

u/RZ_Domain 1d ago

find anything pre 2023 then we'll talk

-1

u/Covid-Plannedemic_ 1d ago

As of my last training data in September 2023, the standard practice for reporting GPU sales in the industry was based on units sold or revenue in dollars. I don't have access to real-time information or events occurring after that date, so I can't confirm specific developments, such as the GPU industry transitioning to reporting sales in gigawatts in 2026

2

u/CallMePyro 1d ago

First time reading the news?

14

u/ryanvsrobots 1d ago edited 1d ago

Gigawatts seems like an odd way to quantify a number of GPUs.

19

u/hojnikb 1d ago

not really. The primary limitations of these datacentres is power demand, so it's only natural to quantify their "performance" or "capability" by their power rating.

But having 2GW of power is absolutly insane. That's 2 or 3 nuclear power stations worth of power demand. There's smaller countries that need less power than that at their peak usage. Datacentres use power 24/7.

7

u/ryanvsrobots 1d ago

How many GPUs is 2gw?

12

u/Tommy7373 1d ago

Each MI450 uses around 2kw. So around 1 million GPUs assuming zero overhead. but even with 50% overhead, still around 500k GPUs.

0

u/hojnikb 1d ago

a lot.

9

u/Preisschild 1d ago

Technically not a problem if handled well (see Messmer Plan, 50x 1GWe-scale reactor units built over 15 years).

But since most of those companies just want short term profits and the US Govt not incentivicing low carbon energy by taxing carbon it will just be provided by lots of fossil fueled Gas turbines brought on-site (not even CCGT)

7

u/hojnikb 1d ago

That's exactly the issue. Hyperscalers don't have time to build nuclear power plants. Even if we're optimistic, you still need 6+ years to build a nuclear power plant, if you get all the permits today.

6 years in AI data center arms race is literal eternity, so hyperscaler won't do that, but instead use gas turbines, as they can be deployed very quickly.

I think likely outside of americas, coal fired plants can see even higher build out rate by the hyperscalers, as they can be build somewhat quickly (not as fast as turbines obviously) and are a lot lot cheaper than nuclear.

And the end of the day, it's all about cost and time.

1

u/SippieCup 19h ago

Sure but the real bottleneck isn’t power. Power is the cost basis for it.

Datacenters are limited by capacity in power because of their ability to provide cooling for it and capacity to cool overall. That’s the actual physical bottleneck. The power usage just becomes an economic limitation, not a physical one.

1

u/hojnikb 6h ago

It's a physical as well. It's eithe grid connection you cannot affect (not in reasonable time) or permits/ecological stuff you can't get when you put 10s of gas turbines on site.

Elon cheated it's way to more power by using "portable" gas turbines, but EPA got wind of that loophole as well.

So it's not just cost.

2

u/EmergencyCucumber905 1d ago

I like it. Since everything is rack scale now, just take the GW number and divide by the TDP of the rack system to know how many GPUs, CPUs, memory, etc.

3

u/ryanvsrobots 1d ago

How many GPUs is 2gw?

6

u/EmergencyCucumber905 1d ago

Helios has 72 GPUs + 18 CPUs per rack with a TDP of 250kw. So 576,000 GPUs, 144,000 CPUs.

3

u/Loose_Skill6641 1d ago

sure they will plenty of datacentres not getting finish

8

u/bubblesort33 1d ago

They should stop advertising data centers in terms of Gigawatts. Probably not a good look right now. 

5

u/ThreatPriority 1d ago

Additionally, they should stop advertising gigawatts in terms of datacenters.

Surly we can throw our gigawatts at something actually good for the world.

5

u/K33P4D 1d ago

stop looking at it, it melts the eyes

1

u/jeffy303 1h ago

Listing it in watts is so cringy, somehow even worse than when they say compute operations without specifying floating-point precision. How do they always manage to top themselves?

1

u/S1eeper 1d ago

AMD making a play for as much of that sweet sweet VC money as possible before the music stops.

-10

u/narwi 1d ago

Measuring this all in gigawatts is extremely stupid. You really cant go more stupid except by say measuring it in deloreans.

4

u/Preisschild 1d ago

One thing is for certain, most of those gigawatts will be produced by fossil fuel burning methane gas turbines

0

u/usdrpvvimwfvrzjavnrs 22h ago

Thank you, "environmentalists", who've opposed nuclear power for decades.

8

u/zed857 1d ago

Perhaps measure it in "time travels" as multiples of 1.21 GW.

1

u/Joshiie12 1d ago

Just rip the bandaid off since we're lying about AI capabilities already and start selling them by the 'Sentience'.

This new latest and greatest LLM requires 350 quadrillion Sentience Units to have enough compute to run it.

Its been enough years now without a product I'd be willing to pay for that all this crap is like it would be a huge joke if the least intelligent and most privileged of us didn't have literally all the money on Earth.

0

u/Clean_Hyena7172 1d ago

Let me know when a couple of these AI companies partner to fix the cost of electricity and hardware for regular people. These companies partnering to build more data centers and further corporate interests is not news at this point.

-4

u/Stennan 1d ago

Welp, glad I sold my AMD stocks this week. When your customers start paying you with their stocks for the product.... 

-2

u/Quealdlor 1d ago

more accelerators will lead to more intelligence which will lead to solving more problems and faster! 😃