Marvell Announces Innovations in AI Memory

<p><b>SANTA CLARA<&sol;b> – <a href&equals;"http&colon;&sol;&sol;www&period;marvell&period;com&sol;">Marvell Technology<&sol;a>&comma; a provider of data infrastructure semiconductor solutions&comma;  announced new innovations across its AI memory infrastructure portfolio&comma; advancing its position spanning server-level AI storage&comma; rack-scale CXL memory expansion and pooling&comma; and pod-level optical shared memory&period; The portfolio helps hyperscalers and cloud providers scale memory more independently from compute&comma; improving infrastructure utilization&comma; scalability and token efficiency for agentic AI inference&period;<&sol;p>&NewLine;<p>As agentic AI inference scales&comma; memory capacity&comma; bandwidth and connectivity are becoming as critical as compute&period; Larger models&comma; longer context windows and growing KV caches are driving unprecedented memory demands and exposing the limits of traditional server-attached architectures&period; Increasingly&comma; AI performance and token efficiency depend on how efficiently processors can access and move data across memory resources&period;<&sol;p>&NewLine;<p>Memory disaggregation addresses this challenge by enabling memory to be expanded&comma; pooled and shared more independently of compute&period; By making memory more accessible and reducing data movement and latency&comma; the Marvell portfolio helps reduce GPU stalls and improve model FLOPs utilization&comma; allowing AI infrastructure to generate more tokens within the same data center footprints and power envelopes&period;<&sol;p>&NewLine;<p>&OpenCurlyDoubleQuote;AI infrastructure is moving beyond isolated servers to systems where compute&comma; memory and connectivity operate seamlessly together&comma;” said Will Chu&comma; executive vice president and general manager&comma; Custom Cloud Solutions&comma; at Marvell&period; &OpenCurlyDoubleQuote;As AI scales&comma; memory must scale more independently of compute so resources can be deployed where they deliver the greatest value&period; With the industry’s broadest AI memory infrastructure portfolio&comma; Marvell is helping customers improve utilization&comma; boost token efficiency and scale AI without compromising performance&comma; power or cost&period;”<&sol;p>&NewLine;<p>&OpenCurlyDoubleQuote;As AI workloads grow larger and more complex&comma; memory capacity&comma; bandwidth&comma; latency and data movement are becoming primary constraints on AI performance&comma;” said Alan Weckel&comma; co-founder and technology analyst at 650 Group&period; &OpenCurlyDoubleQuote;Marvell’s memory and storage portfolio gives hyperscalers and cloud providers a strong foundation for building scalable&comma; efficient AI systems capable of supporting increasingly advanced workloads&period;”<&sol;p>&NewLine;<p><b>Server-level AI Storage<&sol;b><&sol;p>&NewLine;<p>The Marvell Bravera SC6 PCIe® 6&period;0 SSD controller advances storage performance for AI inference&comma; enabling more KV cache to move from high-bandwidth memory to SSD to improve infrastructure efficiency&period; Doubling the performance of the widely deployed Bravera SC5 PCIe 5&period;0 SSD controller&comma; Bravera SC6 helps cloud providers support demanding AI&comma; cloud and enterprise workloads while improving performance&comma; reducing write amplification and extending NAND endurance&period; Optimized for hyperscale deployments&comma; Bravera SC6 supports NAND from multiple suppliers&comma; providing cloud providers with greater flexibility in storage sourcing and deployment&period;<&sol;p>&NewLine;<p><b>Rack-level Memory Expansion and Pooling<&sol;b><&sol;p>&NewLine;<p>The Marvell Structera X memory expansion solutions help hyperscalers scale memory more efficiently for increasingly memory-intensive AI workloads&period; Developed in close collaboration with leading hyperscalers&comma; Structera X enables customers to expand&comma; optimize and better utilize memory resources&comma; including extending the value of existing memory investments while supporting demanding AI inference applications&period; As larger models&comma; longer context windows and growing KV-cache requirements make memory capacity and bandwidth critical infrastructure constraints&comma; Structera X provides a path toward more flexible and disaggregated memory architectures&period; By enabling larger memory pools and more efficient sharing of resources across servers&comma; the platform helps improve infrastructure utilization&comma; operational efficiency and total cost of ownership while laying the foundation for future advances in CXL-based memory pooling and sharing&period;<&sol;p>&NewLine;<p><b>Pod-level Optical Shared Memory<&sol;b><&sol;p>&NewLine;<p>The Marvell Photonic Fabric memory modules&comma; Photonic Fabric NIC and Photonic Fabric chiplets are foundational elements of a multi-rack optical shared-memory architecture for AI inference&period; The solution creates a new shared-memory tier across multiple XPUs and racks up to 50 meters&comma; enabling up to 32TB of warm KV cache offload with high bandwidth and extremely low latency&period; By expanding memory access across AI clusters and enabling KV cache to be loaded from a shared memory tier rather than storage&comma; Photonic Fabric helps increase inference throughput&comma; support larger models and longer context lengths&comma; and increase token efficiency by delivering up to 2-3x higher token throughput within existing data center footprints and power envelopes&period; <b><&sol;b><&sol;p>&NewLine;<p>The Marvell Bravera SC6 PCIe 6&period;0 SSD controller is expected to begin sampling in Q4 2026&period;<&sol;p>&NewLine;

Editor

Apple Unveils Foldable iPhone Duo

CUPERTINO -- New Apple CEO John Ternus introduced iPhone Duo, the first foldable iPhone, at…

2 days

SciFin Debuts With $44 Million Seed Funding

SAN FRANCISCO -- SciFin, a company that helps revenue teams turn fragmented information into timely…

5 days

Sapiom Scores $35 Million for AI Agents

SAN FRANCISCO -- Sapiom, a platform builders use to ship, run, and scale AI agents,…

5 days

New Apple CEO Ternus Receives $3 Million Salary

John Ternus [pictured] officially took over as CEO of Apple Inc. on September 1, with…

5 days

Gimlet Labs Valued at $3 Billion With $300 Million Round

SAN FRANCISCO -- Gimlet Labs, an Applied AI research and product company, has raised $300…

1 week

Adobe Executive Named New CEO

SAN JOSE — Adobe's Board of Directors announced that Anil Chakravarthy, president of Adobe’s Customer…

1 week