• AI PhD
  • Computer Vision & NLP
  • Researcher @ DeepMind

Hi, this is Jason Lin|

who .

 NEW!  Creator of Transformer & Attention Mechanisms for Udacity's Generative AI nanodegree.
 NEW!  Invited by United Nations to deliver opening keynote at 2022 Innovations Dialogue.

About Me

headshot

LinkedIn
Jason Lin


Hi! I graduated with a M.S. in Computer Science from Georgia Institute of Technology, specializing in Machine Learning and Computer Vision . I earned my dual degree in Computer Science & Business at the University of Southern California.

 [2021 - now] I'm focusing on large language models (LLMs), sparse mixture models, and multimodal NLP. 
My M.S. research interests were in deep learning for object detection and 3D understanding, with an emphasis on perception and human-centered AI. In undergrad I specialized in OS, computer networks and security.

I've been fortunate to live in many places: New York, Los Angeles, Atlanta, Philadelphia, Hong Kong, San Jose, Palo Alto, and (currently) San Francisco. In my spare time, I enjoy hiking outdoors and reading history.

Research

   

ScreenAI: A Vision-Language Model for UI and Infographics Understanding
anonymous.
International Joint Conferences on Artificial Intelligence (IJCAI)
, under review
paper. 2024.

   

Explore, Establish, Exploit: Red Teaming Language Models from Scratch
Stephen Casper, Jason Lin, et al.
International Conference on Learning Representations (ICLR)
, under review
paper. 2023.

   

Zorro: the masked multimodal Transformer
Adria Recasens, Jason Lin, Joao Carreira, et al.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
, under review
paper. 2023.

   

Diffusion Models as Visual Reasoners
Jason Lin*, Maya Srikanth*.
AAAI Conference on Artificial Intelligence (AAAI) workshop
, Creative AI Across Modalities
paper. poster. 2023.

   

A Distribution-Aware Approach to Dense Retrieval
Jason Lin, Justin Young, Simran Arora.
Best Poster Award / CS224N, advised by Christopher Manning (Stanford)
paper. poster. 2022.

   

IOTA: A Cryptographic Perspective
Bryan Baek, Jason Lin.
Blockchain and Cryptocurrency, advised by Vladimir Kolesnikov (Georgia Tech)
paper. Technical Report 2019.

   

AutoML: Automatic Data Augmentation with LSTM and Policy Optimization
Yousef Emam, Jason Lin.
Reinforcement Learning and Adaptive Control, advised by Byron Boots (UW)
paper. code. 2019.

   

Interactive Classification for Deep Learning Interpretation
Angel Cabrera, Fred Hohman, Jason Lin, Duen Horng Chau.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Demo

arXiv. code. 2018.

   

AdVis: Visualizing and Attributing ML Attacks to scalable Adversarial Inputs
Jason Lin, Dilara Soylu.
Advanced Computer Vision, advised by James Hays (Georgia Tech)
poster. code. YouTube. 2018.

   

Detecting Graphical Regions of Interest with Gaussian Process Bayesian Optimization
Jason Lin, Hakki Mert Torun, Weihua Zhu, Jingjing Pan.
Probabilistic Graphical Models, advised by Faramarz Fekri (Georgia Tech)
slides. 2018.



Research interests: computer vision, language reasoning, deep learning  
Contact: jlin401 [at] gatech [dot] edu  Google Scholar

 

Experience

2019

Image
Google X

2020

Image
Lyft Self-Driving

2021

Image
Faber Labs

2022

Image
DeepMind

Projects

2019

Image

3D Detection with RGB-D

Indoor scene understanding

Image

BubblePop: Gamify Awareness

Opinion exchanges & Inclusion offline

Image

Automatic Augmentation

Image Augmentation from experience

2018

Image

CVPR: Visualizing Classifers

Interactive Deep Learning Classification

Image

Advanced CV: AdVis.js

Exploring Adversarial Attacks

Image

PGM - Regions of Interest

Graphical Models in Saliency Detection

2017

Image

Graduate Computer Vision

SIFT, Projection, Scene Understanding

Image

Cue: Bias-busting VR

Exposing unconscious bias by Q&A

Image

Artemis

Food-tracking IoT Intelligence

Image

Stockpedia

Data Driven Stock Analytics

Image

Keplerian VR

Immersive team collaboration in VR


2016

Image

SoundScape

Location Aware Speakers

Image

OlympicBPM

Biosensor in Olympics

Image

SudoMap

Never miss a beat

Image

Speed of Sound

NLP: Summarize & review on the fly

Image

FooedBar

VR Food Experience

2015

Image

Innovation Insight

Computer vision for the blind

Image

Groupazza

Study group & chatrooms

Image

Jola!

Android personal assistant

Image

Vectorizor

Pencil sketch to SVG

Image

TweeTINT

Sentiment Analysis Webapp

Image

Data Visualization

D3.js rendering



#HackathonWinners
Image       Image       Image     Image     Image       Image       Image  Image    Image      Image    

Image
Image

Image
Image
Image
Image

Blog

Like what you see? There's always more. Somewhere.

Visit Blog Medium
Image unique visitors since July 2015