I know WALs on S3 is all the rage on X at the moment, but I want to introduce you S3 over RDMA support on AIStor which is a game changer for AI Workloads.
A lot of the time wasted during training, checkpointing or restoring a model weights is lost due to the time waster copying
