Purdue University

Clay

Clay Foundation Model is an open-source foundational model of Earth. It uses an expanded visual transformer upgraded to understand geospatial and temporal relations on Earth data. The model is trained as a self-supervised Masked Autoencoder (MAE).

The Clay model can be used in three main ways:

• Generate semantic embeddings for any location and time.
• Fine-tune the model for downstream tasks such as classification, regression, and generative tasks.
• Use the model as a backbone for other models.

module load gfms
module load Clay

>>> import os 
>>> model_path = os.getenv("MODEL_DIR") 
>>> model_path 
'/apps/gfms/Clay' 
>>> from claymodel.datamodule import ClayDataModule
>>> from claymodel.module import ClayMAEModule
>>> model = ClayMAEModule.load_from_checkpoint(model_path + "/clay-v1.5.ckpt")