1. X
  2. Spiral
Log inSign up
Spiral
111 posts
Spiral profile banner
user avatar

Spiral

@SpiralDB
Multimodal data curation. Petabytes in, signal out. From the creators of @vortexdotdev.
NYC & London
spiraldb.com
Joined March 2023
11
Following
845
Followers
RepliesRepliesMediaMedia

Log in or sign up for X

See what’s happening and join the conversation

Continue with phone
or
Log in with username or email
Terms·Privacy·Cookies·Accessibility·Ads Info·© 2026 X Corp.
  • user avatar
    Spiral
    @SpiralDB
    15h
    spiraldb.com
    Image
  • user avatar
    Spiral
    @SpiralDB
    Aug 25
    From MCAPs to policies with SpQL 1/n
    Image
  • user avatar
    Spiral
    @SpiralDB
    Aug 25
    "You probably do need a custom file format. You just shouldn't have to build one from scratch."
    user avatar
    Nicholas Gates
    @ngates_
    Aug 14
    I’ve written enough file formats to know the bytes are the easy part. I/O, pruning, scheduling, pushdown eat the weekends. I built Vortex so I never have to do this again! spiraldb.com/blog/vortex-th…
  • user avatar
    Spiral
    @SpiralDB
    Aug 13
    Another heater from our CTO @ngates_ on processing videos at scale 🍿
    user avatar
    Nicholas Gates
    @ngates_
    Aug 13
    Four innocent lines of PyTorch hide a video preprocessing footgun. In our H100 benchmark, the resulting physical plan made the model’s first operator run 8.9× slower. The code is clean. The physical plan isn’t. 🧵
  • user avatar
    Spiral
    @SpiralDB
    Aug 13
    🏇🏇🏇
    user avatar
    Nicholas Gates
    @ngates_
    Aug 13
    Spiral's optimizer is getting quite good these days
    Image
Advertisement
Advertisement