TinyFormer: A 300KB Model Surpassing MobileNetv2, Achieving 50x Speedup with LayerNorm!
↑ ClickBlue text Follow the Extreme City platformAuthor丨AI Vision EngineSource丨AI Vision EngineEditor丨Extreme City Platform Extreme City Guide This article presents the TinyFormer framework for developing Transformers on resource-constrained devices. By implementing a minimal and efficient Transformer on MCUs, it introduces Transformers into the TinyML scenario. Experimental results on CIFAR-10 show that TinyFormer achieves 96.1% accuracy, … Read more
