Inder's Desk
Inder's Desk Podcast
Podcast: Memory Investing Primer
0:00
-7:15

Podcast: Memory Investing Primer

Everyone knows NVIDIA.

Almost nobody understands memory.

But here’s the thing.

A GPU without memory is like a Formula One car without fuel.

It doesn’t matter how fast the engine is...

If it can’t access the data it needs.

And that’s why, quietly, memory has become one of the biggest investment stories in artificial intelligence.

Today I want to give you a mental model.

Not a specification sheet.

Not a semiconductor textbook.

A framework.

Because once you understand the memory hierarchy...

You’ll never look at AI hardware the same way again.

Let’s start with a simple question.

What exactly is memory?

Most people think memory is one thing.

It isn’t.

There are really four different families.

DRAM.

HBM.

NAND.

And NOR.

Each solves a completely different problem.

Think of your own desk.

The papers spread out directly in front of you...

That’s DRAM.

It’s your working memory.

Fast.

Easy to access.

But the moment you leave the desk...

Everything disappears.

That’s exactly how DRAM behaves.

It’s incredibly fast.

But it’s volatile.

Turn the power off...

Everything is gone.

Now imagine you replace that desk with an entire wall of filing cabinets.

The information stays there forever.

It’s slower to reach...

But nothing gets lost.

That’s NAND.

It’s storage.

Your SSD.

Your laptop.

Your cloud storage.

Not particularly fast...

But it remembers everything.

Now here’s where AI changes the game.

Traditional DRAM was good enough for CPUs.

It isn’t good enough for modern AI.

Today’s GPUs consume data so quickly...

That ordinary memory simply can’t feed them fast enough.

And that’s where HBM enters the picture.

High Bandwidth Memory.

If normal DRAM is like driving across a city using roads...

HBM is like living in a high-rise apartment with an express elevator.

Instead of traveling long distances...

The memory is stacked vertically.

Right next to the processor.

The data barely travels at all.

It simply moves up and down.

The result is extraordinary bandwidth.

That’s why every modern AI accelerator...

Whether it’s an NVIDIA Blackwell...

An AMD MI350...

Or Google’s TPU...

Uses HBM.

Without it...

Those chips simply couldn’t operate at today’s scale.

Now here’s the part investors often miss.

HBM isn’t replacing DRAM.

It’s consuming it.

HBM is actually built from DRAM dies...

Stacked on top of each other.

Which means every wafer diverted into HBM production...

Is one less wafer producing traditional DRAM.

That matters.

Because supply tightens.

Commodity DRAM prices rise.

And suddenly...

Even businesses that aren’t selling HBM begin benefiting from the AI boom.

That’s one of the most important second-order effects in the entire memory industry.

Now let’s talk about the companies.

At first glance...

The market looks competitive.

In reality...

It’s remarkably concentrated.

Three companies dominate.

Samsung.

SK Hynix.

And Micron.

Together...

They control roughly ninety percent of global DRAM production.

But they’re no longer equal.

Samsung remains the largest overall memory company.

Micron is the only major American pure play.

And SK Hynix has quietly become the leader where it matters most.

HBM.

Today...

If you’re buying an NVIDIA AI accelerator...

There’s a very good chance the HBM inside came from SK Hynix.

That’s one of the biggest shifts in the semiconductor industry over the past few years.

Leadership changed...

Without many investors noticing.

Storage tells a different story.

NAND remains a much more competitive market.

Samsung.

Kioxia.

SanDisk.

Micron.

SK Group.

And increasingly...

Chinese manufacturers.

Competition keeps margins lower.

Which is why DRAM has historically produced much better profitability than NAND.

One is an oligopoly.

The other...

Is much closer to a knife fight.

Now let’s talk about the investment opportunity.

Memory has always been one of the most cyclical industries in technology.

Prices rise.

Everyone expands production.

Supply catches demand.

Prices collapse.

Then the cycle begins again.

It’s happened for decades.

AI has changed some of those dynamics.

But it hasn’t eliminated the cycle.

In fact...

It may simply have created a more profitable version of the same cycle.

Here’s where many investors get trapped.

Memory stocks often look cheapest...

Exactly when they’re most dangerous.

Why?

Because earnings are temporarily inflated.

Peak pricing creates peak profits.

Peak profits create low P/E ratios.

The stock looks cheap...

Right before the cycle turns.

That’s why experienced memory investors spend as much time looking at book value...

Capacity additions...

And supply growth...

As they do earnings.

This is one of the few industries where the lowest multiple can actually represent the highest risk.

So where does that leave us today?

Demand remains exceptionally strong.

AI infrastructure continues expanding.

HBM remains sold out.

Server DRAM markets remain tight.

And NAND pricing has improved dramatically.

Those are all positives.

But investors should always remember...

Memory rewards patience.

Not excitement.

Because eventually...

Every cycle turns.

The challenge isn’t predicting whether that day comes.

It’s recognizing where we are before everyone else does.

If you remember one thing from today’s discussion...

Make it this.

AI isn’t just creating demand for faster chips.

It’s creating demand for faster access to data.

And in computing...

Moving data has become just as important as processing it.

That’s why memory has moved from being a commodity...

To becoming one of the most strategic pieces of the AI stack.

And understanding that...

May give you an edge long before the next earnings report does.

Discussion about this episode

User's avatar

Ready for more?