Skip to content
View beanscrack's full-sized avatar

Highlights

  • Pro

Block or report beanscrack

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
beanscrack/README.md

Jerry Wu

Software engineer. Interested in what happens underneath.

Computer Science at the University of Waterloo. I build systems in C++ and CUDA, apply machine learning to real problems, and make tools for building software.

The questions I come back to: Where does the memory go? What is the bottleneck? How do I know the result is right?

LinkedIn · Email

Start here

Project What I built A useful place to look
Native LLM inference A C++/CUDA runtime for Qwen with quantized weights, hybrid attention, and CPU-to-GPU weight streaming. Weight residency and prefetching · Numerical reference
TruthTone++ Audio deepfake detection with spectral analysis and a per-second confidence timeline. Best Audio AI Hack, CxC 2026. Watch the 36-hour hackathon build · Architecture and setup
Claude–Codex Duo An experiment in coordinating a read-only planner and a code-writing implementer through a local message board and shared workspace. How the loop works

Open-source contributions

I have contributed seven merged pull requests to codebases owned by other developers:

  • Haven-HV — five merged PRs spanning core AI infrastructure, automation services, memory, and tests.
  • SkinSight — two merged PRs delivering the ML implementation and frontend.

Next: build a sustained contribution record in a larger, widely used project.

Production experience

Across two software engineering internships, I have worked on infrastructure automation with Kubernetes, Helm, PostgreSQL, S3, and KMS; repaired authorization across 50+ services; built account-migration tooling; decoupled services with Kafka; improved CI; and shipped tested data pipelines for quantitative-finance systems.

One engineering problem I’m working on

Running a 27B model on a 16 GB GPU.

My inference engine keeps part of the model in GPU memory and streams the remaining layers from pinned host memory. The work is in the details: packed weight formats, asynchronous copies, kernel behavior, and checking the output against a NumPy reference.

The next step is to measure how much transfer time prefetching actually hides, then improve the streamed decode path. The engineering notes include the measured results, numerical differences, and unfinished work.

Smaller builds, foundational ideas

  • Microheap — a learning-focused C allocator with explicit chunk metadata, gap reuse, and memory-layout inspection.
  • Generic merge sort in C — working with generic data and low-level memory operations.
  • Risk-parity optimizer — a Python exploration of risk budgets and combining portfolio scenarios.

Open to software engineering opportunities and conversations about systems, ML infrastructure, and developer tools.

Popular repositories Loading

  1. real-time-dashboard real-time-dashboard Public

    Top GitHub repository by stars

    JavaScript 1

  2. Microheap-A-Minimalist-Manual-Memory-Manager-in-C Microheap-A-Minimalist-Manual-Memory-Manager-in-C Public

    A learning-focused C allocator with linked chunk metadata, gap reuse, and memory-layout inspection.

    C 1

  3. libmsort-Generic-Merge-Sort-Library-in-C libmsort-Generic-Merge-Sort-Library-in-C Public

    generic merge sort in c

    C 1

  4. Multi-Layer-Risk-Parity-Portfolio-Optimizer Multi-Layer-Risk-Parity-Portfolio-Optimizer Public

    This project implements a multi-scenario risk parity portfolio construction engine using Python. It optimizes asset weights such that each component contributes equally to overall portfolio risk, a…

    Python 1

  5. compareSuite---made-for-cs246-tests compareSuite---made-for-cs246-tests Public

    the bash script takes in two exe and a suite.txt file and then compares the output of the two exe

    Shell 1

  6. Black-Litterman_Idzorek-s_Method Black-Litterman_Idzorek-s_Method Public

    This project implements a Black-Litterman portfolio construction which follow's Idzorek's method of constructing the omega diagonal matrix.

    Python