3x Inference Acceleration on RISC-V CPU! V-SEEK: Accelerating 14B LLM on SOPHON SG2042

3x Inference Acceleration on RISC-V CPU! V-SEEK: Accelerating 14B LLM on SOPHON SG2042

Keywords: V-SEEK, LLM Inference Optimization, RISC-V, SOPHON SG2042, llama.cpp, NUMA Optimization V–SEEK: ACCELERATING LLM REASONING ON OPEN-HARDWARE SERVER-CLASS RISC-V PLATFORMS https://arxiv.org/abs/2503.17422 In recent years, the exponential growth of large language models (LLMs) has relied on GPU-based systems. However, CPUs are gradually becoming a flexible and cost-effective alternative, especially for inference (the phase where the model … Read more

In-Depth Understanding of C++ Performance Optimization: From Memory Management to Compiler Optimization Practices

In-Depth Understanding of C++ Performance Optimization: From Memory Management to Compiler Optimization Practices

Learning website for Eight-legged essays:https://www.chengxuchu.com Hello everyone, I am Chef, a programmer who loves cooking and has obtained a chef qualification certificate. C++ is a system-level language that is close to hardware, and its performance advantages have always been favored by developers. However, writing high-performance C++ code in actual projects is not a simple task, … Read more

Do C++ References Actually Consume Memory? Don’t Be Deceived by ‘Zero Overhead’!

Do C++ References Actually Consume Memory? Don't Be Deceived by 'Zero Overhead'!

C++ references are often touted as “zero-cost abstractions,” with some claiming they “consume no memory at all.” But is this really an absolute truth? Today, I will delve into the truth about references from the perspective of compiler implementation. 📚 The C++ Knowledge Base is now live on ima! The current content covered by the … Read more

The Underlying Secrets Behind the C Language Main Function (Part Seven)

The Underlying Secrets Behind the C Language Main Function (Part Seven)

As developers using the C language, we interact with the main function daily, yet few truly understand the complex mechanisms behind this program entry point. This article will delve into the complete process from program startup to the execution of the main function, revealing key details hidden by the compiler. 1. The Complete Chain of … Read more

Rust 1.87.0 Released! A Comprehensive Analysis of the Latest Version Unveiling New Heights in Performance and Safety

Rust 1.87.0 Released! A Comprehensive Analysis of the Latest Version Unveiling New Heights in Performance and Safety

On May 16, 2025, the highly anticipated Rust programming language welcomed its new stable version—Rust 1.87.0! As one of the leading, safest, and high-performance system-level languages in the industry, Rust continuously enhances the development experience and underlying technology through version upgrades. This 1.87.0 iteration brings several important new features and stability improvements, covering core language … Read more

Embedded Development in C: When to Use the Volatile Keyword for Variables?

Embedded Development in C: When to Use the Volatile Keyword for Variables?

What is the volatile keyword? In embedded programming with C, the volatile keyword is very important. Its English meaning is “changeable”. Its main function is to inform the compiler that the value of the variable it modifies may change in ways that the compiler cannot predict during program execution. Therefore, the compiler cannot perform regular … Read more

Can You Believe It? Assembly Language Ranks in the Top 10 Programming Languages for July

Can You Believe It? Assembly Language Ranks in the Top 10 Programming Languages for July

TIOBE has updated the programming language rankings for July 2016, and the biggest highlight this month is that the low-level assembly language has once again entered the top 10. Many people are surprised by the reasons that have led this low-level programming language to re-enter the top 10. They do not understand why a language … Read more

Understanding noexcept in C++: Performance Optimization or Hidden Trap?

Understanding noexcept in C++: Performance Optimization or Hidden Trap?

In C++, we often hear the term “exception safety”. It is not only about whether the program runs stably but also closely related to performance. The protagonist we are discussing today, noexcept, is a keyword closely related to exceptions. It can help us optimize program performance, but improper use may also create “hidden traps”. Today, … Read more