SIMT

SIMD and SIMT: The Parallel Blades in High-Performance Computing Clusters

by
SIMD and SIMT: The Parallel Blades in High-Performance Computing Clusters

In the field of high-performance computing (HPC), improving computational efficiency and breaking through computational bottlenecks has always been an unremitting goal. SIMD (Single Instruction, Multiple Data) and SIMT (Single Instruction, Multiple Threads) technologies act like two sharp blades, cutting through various high-performance computing scenarios and playing a key role in significantly advancing computational capabilities. 1. … Read more

A Comprehensive Comparison of SIMD vs SIMT in Parallel Computing

by
A Comprehensive Comparison of SIMD vs SIMT in Parallel Computing

Comprehensive Comparison Table Feature SIMD (Single Instruction, Multiple Data) SIMT (Single Instruction, Multiple Threads) Core Essence A data parallel execution paradigm/instruction type. A single instruction operates on multiple data elements simultaneously. A thread parallel execution model. A single instruction is executed by multiple threads simultaneously, with each thread processing its own private data. The hardware … Read more

Analysis of the Reasons Behind the Ecological Gap Between Huawei Ascend NPU and NV GPGPU

by
Analysis of the Reasons Behind the Ecological Gap Between Huawei Ascend NPU and NV GPGPU

The original text is a discussion on Zhihu regarding “Is Huawei’s NPU Ascend chip a major strategic misstep, and should GPGPU have been chosen, leading to the CANN software stack facing obsolescence?” Many respondents provided insightful comments, and this article organizes the excellent responses from several contributors. —————————————— The main text begins: The essence of … Read more