SCRATCH EXTENSION DEVELOPMENT

Built an extension to the Scratch GUI, creating custom blocks that enable real-time interaction with ML models. Developed block definitions and code generators in JavaScript, with focus on performance and usability.

ML MODEL INTEGRATION

Integrated multiple TensorFlow.js models for real-time inference: PoseNet for body tracking, HandPose for gesture recognition, and custom Teachable Machine models. Implemented browser-based transfer learning capabilities.

PERFORMANCE ENGINEERING

Engineered for low-latency interaction using WebGL acceleration, WebWorkers for compute-intensive tasks, and caching solutions. Implemented pre-computed video loops with cached AI outputs for resource-constrained devices.

MEDIA PROCESSING

Implemented media handling using WebAudio API for audio processing and synthesis, and the W3C MediaRecorder API for video capture. Built a video recording system for project sharing and documentation.

IDEATION

Had an idea for a "Code your own Minecraft" coding tutorial where students could create their own 3D Minecraft worlds in-browser using blocks-based programming.

Built a tutorial prototype during a hackathon. The team found this idea so exciting that we reached out to the Minecraft Education team about producing a full Minecraft Hour of Code tutorial.

DESIGN AND PROTOTYPING

Spent a week with the Minecraft Education team in Seattle collaboratively designing the student experience and proving out the technical approach.

Mocked up student programs, worked with learning team at Code.org and game designers at Minecraft Education to design an hour-long learning experience we could build within a few short months.

TECH RESEARCH + BUILD SYSTEM

Researched & evaluated options for Canvas/WebGL game development, ultimately building on top of Phaser.js. Built proof-of-concept and "prototyping playground" to use while collaborating with Minecraft Education engineers on the game world.

LEVEL EDITOR

Built level editor for learning team and game designers to independently build and tweak levels during the development process.

Editor now used for adding new Minecraft levels to Code.org's yearlong curricula.

BLOCKLY INTEGRATION

Defined code blocks and APIs to program mini-Minecraft world.

Integrated our mini-visualization with full Code.org scaffolding. Added site-wide support for sound effect selection and rich-text level instructions.

Devised mechanisms to support entity/agent-based behavior blocks and keyboard/mouse/swipe-based player movement.

UI RE-DESIGN, MUSIC

Worked with artists on Minecraft Education team to tweak the look and feel of Code Studio website to reflect Minecraft aesthetic. Achieved crisp "pixel art feel" for both UI and game view.

Picked out, edited, and integrated music clips from C418's Minecraft soundtrack to play in short interludes throughout tutorial.

Supported both LTR and RTL (right-to-left, for e.g. Arabic) modes.

OPTIMIZATION + TESTING

Optimized tutorial load sequence and load times to support slower internet connections. Added cross-browser visual tests with Selenium, Sauce Labs and Applitools to ensure it worked on the types of computers found in schools. Used NewRelic to discover and squash edge-case browser-specific bugs before launch.

CLASSROOM TESTING AND SUPPORT

Visited classrooms before the Hour of Code to play test and iterate on tutorial. Visited classrooms during the Hour of Code to talk with students about learning to code and careers in game design and programming. Fielded questions from teachers in customer support system.

DESIGN PROCESS

Collaborated with Code.org's learning and product teams to understand student and teacher needs, define the course needs and come up with creative approaches to integrating the web curriculum with physical computing component.

Brainstormed paradigms for integrating physical computing with Code.org's online learning curriculum for the middle school Computer Science Discoveries course.

Evaluated options for web / Arduino connection, prototyping the most promising ones.

RESEARCH & RELATIONSHIPS

Visited Sparkfun Electronics education team to learn about Arduino-based electronics and common pitfalls for classroom-integrated Arduino curricula and tools. Met with team behind Johnny-Five to discuss upcoming open web technologies and constraints for web to physical computing in classrooms.

Worked closely with team at Adafruit to provide a custom version of Firmata to ship directly with Circuit Playground boards for use in classrooms.

Exchanged "lessons learned" with creators of NodeRED, Codebender, Chrome Serialport and other open source web electronics community members.

PROTOTYPE ITERATION & PLAYTESTING

Built initial prototype page for fleshing out board interaction APIs. Integrated board connection as an extension to the App Lab blocks-and-text coding environment.

Built fun example projects with team, students, and teachers. Held periodic hackathons and "bug bashes" to gather feedback on the tool.

TROUBLESHOOTING & SUPPORT

Built interactive setup tool for making installation easy to follow.

Established easy feedback mechanism for gathering setup issues and responding to them quickly.

CORE TEAM TRAININGS

Prepared and delivered hands-on lessons on laptop learning software, maintenance and hardware repair for the local OLPC Rwanda Core Team based out of the Kigali Institute of Science and Technology.

Produced USB keys full of utilities for use by the core team, including the latest Sugar operating system, extra apps, documents on laptop use and repair, etc.

WORK WITH STUDENTS & TEACHERS

Facilitated lessons with teachers and students on creating projects in Scratch, Etoys, Turtle Art and other XO/Sugar learning apps.

LAPTOP MAINTENANCE AND REPAIRS

Worked with local team to update software and test early batches of laptops before distribution, re-flashing thousands of laptops before distribution to students.

OLPCORPS TRAINING

OLPCorps was an initiative in the summer of 2009 to support students partnering with local NGOs to run test-deployments of 100 XO laptops in schools in sub-Saharan Africa. The training was held in Kigali, Rwanda, in coordination with OLPC team members in Rwanda.

As part of the pre-summer training, prepared training materials & utility USB keys for student groups to use in their deployments.

NEWSLETTER

Started a weekly programming interview preparation newsletter in December of 2011.

Weekly emails consisted of:

1. Topic overview (typically a data structure or algorithm, like "hash tables" or "depth-first searching"
2. Interesting programming links of the week
3. Interview question of the week
4. Solution & explanation of question from the previous week

The newsletter eventually outgrew MailChimp's free plan, necessitating finding a way to financially sustain the newsletter.

PRODUCT DEVELOPMENT

Following the "customer development" approach to product development, interviewed dozens of newsletter subscribers about their experiences preparing for programming interviews and what pain points there were in the process.

Identified "information overload", "guidance on what to review", and "how to get un-stuck during an interview" as common pain points, designed and prepared an online interview course.

Synthesized a "problem solving formula" 7-step guide for approaching programming interview problems & getting un-stuck.

Recorded and edited over 7 hours and 63 lectures worth of course content.

ADVICE CALLS

Offered free interview prep + job search advice calls over the phone & Google Hangouts.

Conducted resume reviews & mock interviews for job hunters.

STARTUP ADVISING

Informally advised startups in the programming interview preparation & computer science career spaces.

Assisted with ideation for product development, community outreach and marketing.