How do you keep 70-billion-parameter quality while running up to 20 times as fast? AWS researchers combined knowledge distillation with parallel decoding. For @bookingcom's Smart Filters, that meant responses 15 times as fast for 99% of queries.
The latest news and research from Amazon's science community. #AmazonScience


