SanDisk Introduces High Bandwidth Flash to Boost AI Model Storage

Article Highlights
Off On

In a groundbreaking move, SanDisk has unveiled its revolutionary memory architecture named High Bandwidth Flash (HBF), marking a significant milestone since its separation from Western Digital. This innovative architecture combines the vast storage capacity of 3D NAND flash memory with the high bandwidth attributes typically linked to High Bandwidth Memory (HBM). The sophisticated hybrid memory structure utilizes the vertical stacking of 16 layers of 3D NAND dies, integrated with through-silicon vias (TSVs), to create intricate data pipelines that enable rapid data transfer.

Enhanced Storage and Bandwidth Capabilities

The HBF architecture deviates from traditional NAND designs by dividing each die into numerous sub-arrays that can be accessed randomly and in parallel. This design choice significantly boosts bandwidth while maintaining the cost-effective and high-capacity advantages of NAND. Furthermore, HBF provides 8 to 16 times more capacity per stack compared to current HBM solutions, making it particularly suitable for substantial AI workloads. For example, systems outfitted with eight HBF stacks could offer up to 4 terabytes of storage, enabling the direct storage of massive AI models such as GPT-4 on GPU hardware.

Despite its promising prospects, the HBF architecture does face some challenges. One of the primary issues is the inherently higher latency of NAND compared to DRAM, which can affect performance. Additionally, potential problems with write endurance and block-based addressing may arise. As a result, SanDisk is targeting HBF primarily for read-intensive AI inference tasks that require high bandwidth and capacity but can tolerate higher latency levels. Nonetheless, the architecture’s unique attributes make it a compelling choice for advancing AI model storage capabilities.

Open Standard and Future Applications

SanDisk’s HBF architecture epitomizes a remarkable blend of high capacity and high-speed attributes, which are critical for meeting the increasing demands for data processing and storage in today’s tech-driven world. This innovation is likely to significantly impact various sectors, from computing to data centers, making information access and management more efficient. By integrating the benefits of both 3D NAND and HBM, SanDisk has set a new benchmark in the memory industry, promising enhanced performance and greater efficiency.

Explore more

Creating Gen Z-Friendly Workplaces for Engagement and Retention

The modern workplace is evolving at an unprecedented pace, driven significantly by the aspirations and values of Generation Z. Born into a world rich with digital technology, these individuals have developed unique expectations for their professional environments, diverging significantly from those of previous generations. As this cohort continues to enter the workforce in increasing numbers, companies are faced with the

Unbossing: Navigating Risks of Flat Organizational Structures

The tech industry is abuzz with the trend of unbossing, where companies adopt flat organizational structures to boost innovation. This shift entails minimizing management layers to increase efficiency, a strategy pursued by major players like Meta, Salesforce, and Microsoft. While this methodology promises agility and empowerment, it also brings a significant risk: the potential disengagement of employees. Managerial engagement has

How Is AI Changing the Hiring Process?

As digital demand intensifies in today’s job market, countless candidates find themselves trapped in a cycle of applying to jobs without ever hearing back. This frustration often stems from AI-powered recruitment systems that automatically filter out résumés before they reach human recruiters. These automated processes, known as Applicant Tracking Systems (ATS), utilize keyword matching to determine candidate eligibility. However, this

Accor’s Digital Shift: AI-Driven Hospitality Innovation

In an era where technological integration is rapidly transforming industries, Accor has embarked on a significant digital transformation under the guidance of Alix Boulnois, the Chief Commercial, Digital, and Tech Officer. This transformation is not only redefining the hospitality landscape but also setting new benchmarks in how guest experiences, operational efficiencies, and loyalty frameworks are managed. Accor’s approach involves a

CAF Advances with SAP S/4HANA Cloud for Sustainable Growth

CAF, a leader in urban rail and bus systems, is undergoing a significant digital transformation by migrating to SAP S/4HANA Cloud Private Edition. This move marks a defining point for the company as it shifts from an on-premises customized environment to a standardized, cloud-based framework. Strategically positioned in Beasain, Spain, CAF has successfully woven SAP solutions into its core business