My understanding is like this.
Intel x86 & AMD are the 2 leading CPU architectures used in server market covering 99% of the market. Source : Intel/AMD x86 computer CPU market share 2024 | Statista.
Typically, the server makers (like Dell/Lenovo/Hp etc…) work very closely with CPU makers like Intel/AMD on these server release every time there is a newer version of the CPU under work. Typical server launch cycle can be anywhere like 1-2 year. During this period, the CPU and server building company work very closely with each other. Server maker has access to the reference design of CPU and motherboard from the CPU player. One can easily appreciate the importance of confidentiality clauses when this happens.
Till now, nVIDIA was a major GPU player and both Intel/AMD server designs supported their GPUs. In fact, there isn’t much to do in a server to support GPU. It’s a plug and play kind of design to support most GPUs. At max the work needed from the server team is on GPUs thermal management (cooling the GPU by ramping the fan etc) side. That also is not always true as many GPUs are now coming with their own thermal management.
Now, this is where things get complicated, with nVIDIA showing ambition of it’s own CPU based on ARM architecture launched in 2023 Source : NVIDIA Introduces Grace CPU Superchip | NVIDIA Newsroom
This is a direct attack on the bread and butter of Intel/AMD server business.
It’s understandable NVIDIA need partners who can make servers for their CPUs. From what i understand and can see on plain google search usual server makers like Lenovo/Dell/Hp are not supporting the nVIDIA Grace CPUs as of today.
This is where Netweb has entered into picture by becoming partner for manufacturing of servers based on the Grace and GraceHopper CPUs.
Trying to bust some myths as per my understanding:
-
Server design and manufacturing is a very complex process -
Not that great deal IMHO. Server design process starts at CPU makers (Intel/AMD). They share a reference architecture of the server with server manufacturers (Hp/Dell/Lenovo…). What the server manufacturer does is make different design of servers with diff. configs like 1U/2U/blade/multiple processor support/etc etc. One can liken the server mfg’s process to a laptop manufacturer who uses same Intel processor and gives multiple options in laptop with diff. capabilities like storage/display/etc etc…
The design capabilities required for a server maker are not R&D level, it’s more a implementation level with active guidance from CPU manufacturer at each step.
Once design is ready. Most server makers outsource the actual manufacturing to the OEMS like Foxconn/Gigabyte/Wistron etc etc…OEMs manufacture the server motherboards/boxes etc. Parts like Harddisk/GPU/RAM/wires, as we all know have diff. reputed manufacturers and all this is assembled by OEM and they put the sticker of vendor like (HP/Dell).
Server makers capability lies in customer management/sales/support/ etc… -
How did they develop all the Super Computers listed in their deck…
At a very simplistic level, a super computer is not one huge complicated computer (if you are thinking of it like that). It’s just thousands (or tens of thousands) of servers networked with each other where a software layers has the capability of pooling these compute resource to tackle a problem needing such high compute power. Huge numbers of server networked with each other , mostly in a single premise. Does it sound that intimidating anymore ?
Hope this part is answered. Others are manufacturing servers which supports nVIDIA GPUs. Just like Netweb also does with their Intel x86 based servers support nVIDIA GPUs. Netweb is not going to manufacture NVIDIA Grace (Hopper) Superchip CPUs. They will likely manufacture the server to support those CPUs. But we have to keep in mind, as on today the market share of NVIDIA CPU in server market is close to ZERO. It’s a good thing or bad thing, time will tell. CPU/GPU manufacturing is still in the capability of exclusive club with the likes of TSMC/Samsung. No Indian company has come anywhere close to such capabilities as of today. We may, in future!!
Subscribe To Our Free Newsletter |