Log inSign up
Jonathan Fly ๐Ÿ‘พ
7,429 posts
Image
user avatar
Jonathan Fly ๐Ÿ‘พ
@jonathanfly
CEO of bad ideas. Using the wrong tool. The least efficient way. For no good reason. ๐Ÿ‘พ suno.com/@jonathanfly youtube.com/c/JonathanFly
github.com/JonathanFly/
Joined April 2009
3,116
Following
5,523
Followers
  • Pinned
    user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Apr 23, 2023
    Bark Text-to-Audio Model Full Text Input: "Why was six afraid of seven?" Ignore Bark's "I'm done with this input" token and tell Bark to just keep generating more audio anyway.
    Image
    00:00
    462K
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Sep 2, 2020
    Trying out Wav2Lip. It will happily try to lip lync sync a constantly morphing face.
    Image
    00:00
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Jun 28, 2019
    Experimenting with 'upscaling' old video games with @nvidia's #GauGAN
    Image
    GIF
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Jul 17, 2019
    'Pair Programming' with GPT-2 trained on 2 million GitHub files. Straightforward near-term practical use of deep learning. I wish they had better examples - for example, I bet if you name a variable Gryffindor it will suggest Hufflepuff for the next one! tabnine.com/blog/deep
    Image
    00:00
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Sep 17, 2019
    Trying depth-mapping on abstract art. I don't know what you would call 'working properly' here, it's just fascinating to see a neural network try to interpret a Jackson Pollock painting as a 3D landscape. (Convergence, 1952)
    Image
    00:00
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Jun 20, 2020
    Replying to @tg_bomze @Rob__Milliken and @h_bash
    Image
    Image
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Jul 7, 2024
    Luma's start and end keyframes are a game changer. With a sequence of keyframes from the original film, we can seamlessly remaster stop motion classics like "Jason and the Argonauts" as modern single-take action scenes.
    Image
    00:00
    5.4M
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Mar 20, 2020
    NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis Input is images with known camera poses. Can't wait to disable all the sanity checks and see what this renders if I give it impossible geometry. abs: arxiv.org/abs/2003.08934 site: matthewtancik.com/nerf
    Image
    00:00
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Jun 20, 2020
    Replying to @tg_bomze
    I love that your Tweet turned into a giant collaboration thread with everyone posting their own hilarious upscales. My favorite so far is this ๐Ÿ˜… guy. (If you want to get similarly creative interpretations keep the steps low.)
    Image
    Image
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Feb 22, 2020
    Upscaling from 16x16 pixels all the way up 4k with 3 Face Super Resolution models chained together. Genuinely impressed by how this one came out. ๐Ÿ™‹โ€โ™€๏ธ
    Image
    Image
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Feb 24, 2020
    "Once trained on a set of videos of the same category (e.g. faces), our method can be applied to any object of this class." Well you can *apply* the method to anything. Like the Avatar the Last Airbender Intro. Sort of AI human face interpretive dance. (watch past 9 seconds)
    Image
    00:00
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Jun 21, 2020
    Replying to @jonathanfly @tg_bomze and 2 others
    Image
    Image
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Apr 27, 2020
    The good news is StarGAN v2 code is out. The better news is if you put a human into the animal model you do in fact get out a feline version of the human, and it's even wearing a suit. github.com/clovaai/stargaโ€ฆ h/t @ak92501
    Image
    Image
    Image
    Image
  • user avatar
    Jonathan Fly ๐Ÿ‘พ
    @jonathanfly
    Dec 27, 2019
    I am so excited for when @facebookai drops Vid2Game code. Imagine all the amazing things you could do with this. Maybe the models are even playable in a Colab? FMV games: The Next Generation? abs: arxiv.org/abs/1904.08379 vid: youtube.com/watch?v=GprHGpโ€ฆ
    Image
    00:00

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

TermsยทPrivacyยทCookiesยทAccessibilityยทAds Infoยทยฉ 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up
Advertisement
Advertisement