Blazingly Fast Computer Vision Training with the Mosaic ResNet and ComposerJune 9, 2022 by Matthew Leavitt, Erica Ji Yuen and Kobie Crawford in Mosaic Research Match benchmark accuracy on ImageNet (He et al., 2015) in 27 minutes, a 7x speedup (ResNet-50 on 8xA100s). Reach higher levels of accuracy...
Efficiently Estimating Pareto Frontiers with Cyclic Learning Rate SchedulesApril 7, 2022 by Jacob Portes in Mosaic Research Benchmarking the tradeoff between model accuracy and training time is computationally expensive. Cyclic learning rate schedules can construct a tradeoff curve in a...