Pinned
First demo of our new aerial Visual-Inertial Positioning System (VIO+VPS): 40m positioning accuracy (CEP) in a 50 kilometer flight using a camera, consumer-grade IMU and a barometer! No GPS
00:00
Otto Seiskari
95 posts
Otto Seiskari
@oseiskar
CEO @ Spectacular AI
- GPS-free visual-inertial navigation in real time on Raspberry Pi 5 with a consumer-grade IMU and camera (and this is not even the slowest CPU this runs on!)
00:00 - Easiest way to calibrate a camera on Linux. No ROS, no Docker, no CMake. Just @FFmpeg and Spectacular AI command line tool installable via Python pip: sudo apt install ffmpeg pip install spectacularAI[full] sai-cli calibrate your-data.mkv
00:00 - In the 3rd flight test, we basically duct-taped a smartphone to a Cessna to highlight that our GPS-free Visual-Inertial Positioning runs on consumer-grade sensors (32 m CEP positioning accuracy over 55 kilometers, only using phone camera, IMU and barometer)
00:00 - New #drone demo! GPS-free navigation using VIO with two test payloads: one global shutter, one rolling shutter setup. < 1% accumulated drift in both cases.
00:00 - We have now released Spectacular AI Mapping API: a low-level SLAM API for embedded devices. It can also be tested on OAK-D devices + PC. In addition, our C++ SDKs for OAK and RealSense devices are now publicly available for x86_64 (see 🧵 for links)
00:00 - Mixed Reality with 135 lines of Python, and the new Spectacular AI SDK (on OAK-D). You could also replace the PyOpenGL rendering part with Unity or Unreal, but that would be less fun. With our SDK, you can also glTranslatef the #metaverse.
00:00 - Another GPS-free aircraft navigation demo wth our new Visual-Inertial Positioning System: 77 km flight, 21 m CEP. If you are interested in early access of the solution, send us a message at spectacularai.com/#contact . More technical details in 🧵
00:00 - Spectacular Rec app released for iOS and Android! Combined with a good GPU and Nerfstudio, our tools enable fast #gaussiansplatting reconstructions without uploading the data to a cloud or using COLMAP. Results can be viewed in the browser! Links in 🧵
00:00 - Replying to @oseiskarFeatures of the new Spectacular AI SDK 1.38 include: ⭐ ONNX-based VPS acceleration: allows full VIO+VPS operation even on Cortex A53s ⭐ Built-in IMU-camera calibration Python tool, based on our fork of Basalt (separate post to follow) For more details:
- Gaussian Splatting on the Move updated! ⭐IMU is now optional: supports motion blur or rolling shutter compensation with plain video data ⭐Existing work comparison: Outperforms BAD-NeRF ⭐Rebased on latest Nerfstudio for improved accuracy
00:00 - Our first public outdoor drone demo! Spectacular AI SDK can be used to track the position of a drone without GPS. Demonstrated here with our low-cost reference HW design (the round thing under the off-the-shelf DJI drone) and compared to the on-board GPS as the ground truth
00:00 - We are releasing Gaussian Splatting on the Move, a method for creating crisp #gaussiansplatting reconstructions from blurry and wobbly smartphone captures! ⭐Paper: arxiv.org/pdf/2403.13327… ⭐Code: github.com/SpectacularAI/… ⭐Website: spectacularai.github.io/3dgs-deblur
00:00 - The simplest way to improve VISLAM accuracy: buy a better IMU. We finally tested this in practice: Built a device with two IMUs (the cheap @InvenSense MPU6050 and the high-end @MurataEurope SCHA634), and tested which one is better when all other aspects of the data and are fixed
00:00
