OlmoEarth v1.2: A more efficient family of OlmoEarth models

We present a set of improvements to the OlmoEarth family. These improvements allow us to cut compute costs during training ($3.0\times$ reduction in GPU hours required to train our Base models) and inference ($2.9\times$ reductions in MACs on Sentinel-2 tasks), while maintaining the models’ overall performance. All training code is available at github.com/allenai/olmoearth_pretrain.