kempnerforge.config.checkpoint

Checkpoint configuration.

Classes

AsyncCheckpointMode
CheckpointConfig	Checkpointing settings.

class kempnerforge.config.checkpoint.AsyncCheckpointMode

Bases: StrEnum

disabled = 'disabled'

async_ = 'async'

async_pinned = 'async_with_pinned_mem'

__new__(value)

class kempnerforge.config.checkpoint.CheckpointConfig

Bases: object

Checkpointing settings.

dir: str = 'checkpoints'

interval: int = 1000

async_mode: AsyncCheckpointMode = 'disabled'

keep_last_n: int = 3

load_path: str | None = None

export_dtype: Literal['float32', 'bfloat16'] = 'bfloat16'

exclude_from_loading: list[str]

__init__(dir='checkpoints', interval=1000, async_mode=AsyncCheckpointMode.disabled, keep_last_n=3, load_path=None, export_dtype='bfloat16', exclude_from_loading=<factory>)

Parameters:

• dir (str)

• interval (int)

• async_mode (AsyncCheckpointMode)

• keep_last_n (int)

• load_path (str | None)

• export_dtype (Literal['float32', 'bfloat16'])

• exclude_from_loading (list[str])

Return type:

None