Caching
Language model activations
encoding.utils.ActivationCachepersists multi-layer activations to a single.pklper configencoding.utils.LazyLayerCacheloads metadata fast and layers on demandCache keys include story, model name, context type, lookback, dataset_type, etc.
Speech activations
encoding.utils.SpeechActivationCacheandSpeechLazyLayerCachemirror the API for speech features with optional time arrays
Model artifacts
encoding.utils.ModelSaverrecords hyperparameters and metrics per run directory (hash + timestamp)Use
list_runs()to enumerate previous runs