In the previous issue, we introduced the use of LoRA to train instruction models. In this issue, we will continue to train our own R1 model. LoRA has a wide range of applications in vertical fields such as law, healthcare, image processing, education, and programming. We will take education as an example to train a … Read more
On November 28, the Ministry of Industry and Information Technology (MIIT) released Announcement No. 52 of 2019, further regulating various aspects of low-power short-range radio transmission equipment. After the announcement, some industry insiders believe that due to certain restrictions in the new regulations, the low-power, long-range local area network wireless standard LoRa may face significant … Read more
Title: LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging Paper Link: https://arxiv.org/pdf/2511.07129 Innovations For the first time, a combination of Generative Mask and Discriminative Mask is used, where the generative mask is applied to video data reconstruction tasks, and the discriminative mask is used for video understanding tasks. Both share the same network … Read more
🗼 In interviews related to large model fine-tuning, the question “What are the differences between full parameter tuning, LoRA, and QLoRA?” is a frequently asked topic. The standard answer generally unfolds from five dimensions: principles, resource requirements, effects, advantages and disadvantages, and applicable scenarios. Below is a high-quality template answer for interviews. 1. Full Parameter … Read more
Adam created a project called Stixs Radio simply because he found that none of the handheld walkie-talkies he used in recent years could fully meet all his needs.Essentially, this is a handheld radio platform based on Linux (Armbian system) that integrates analog VHF/UHF FM voice, LoRa data networking, and Wi-Fi connectivity. Its design aims to … Read more
In the previous article, we introduced the principles of LoRA fine-tuning. In this issue, we will get hands-on with supervised fine-tuning (SFT) of a basic pre-trained model, transforming it into an instruction model capable of interacting with users in a dialogue system. LoRA Fine-Tuning Principles JunJun AI, WeChat Official Account: JunJun AI. What exactly is … Read more
As the number of Internet of Things (IoT) devices continues to grow, the communication and connection between these devices has become an important topic of consideration. Communication is essential and critical for IoT, whether it involves short-range wireless transmission technologies or mobile communication technologies, all of which impact the development of IoT. Among these, communication … Read more
Arduino Nesso N1: A New Species of IoT Empowered by RISC-V? Arduino Nesso N1 has emerged as not just a compact IoT controller, but also an innovative product integrating RISC-V architecture, Wi-Fi 6, Thread, and LoRa protocols. Developed in collaboration between Arduino and M5Stack, can this device become the ultimate tool for rapid prototyping and … Read more
Click “Read the original text” to go directly to the official GitHub. The following code implements the LoRA (Low-Rank Adaptation) technique, which fine-tunes pre-trained models without significantly increasing the number of parameters. Here, I will explain the function and role of each part in detail: Core Class: LoRALayer This is the base class for all … Read more
During the storage of tobacco leaves, the temperature and humidity are easily affected by changes in the environmental temperature and humidity. If there is an imbalance in temperature and humidity, it may lead to moisture absorption or even mold growth in the tobacco leaves. To ensure stability and safety during the storage of tobacco leaves, … Read more
