kempnerforge.config.eval

Evaluation configuration.

Classes

EvalConfig

Evaluation pipeline settings (disabled by default).

class kempnerforge.config.eval.EvalConfig

Bases: object

Evaluation pipeline settings (disabled by default).

token_dtype is the integer type of the raw .bin eval shards, as DataConfig.token_dtype is for the training shards.

enabled: bool = False

interval: int = 1000

steps: int = 50

dataset_path: str = ''

file_pattern: str = '*.npy'

token_dtype: str = ''

hf_dataset_name: str | None = None

hf_dataset_config: str | None = None

hf_dataset_split: str = 'validation'

__init__(enabled=False, interval=1000, steps=50, dataset_path='', file_pattern='*.npy', token_dtype='', hf_dataset_name=None, hf_dataset_config=None, hf_dataset_split='validation')

Parameters:

• enabled (bool)

• interval (int)

• steps (int)

• dataset_path (str)

• file_pattern (str)

• token_dtype (str)

• hf_dataset_name (str | None)

• hf_dataset_config (str | None)

• hf_dataset_split (str)

Return type:

None