tatm

Introduction:

  • Getting Started
  • Package Configuration

Examples:

  • Loading Text Data for LLM Training
  • Dataset Metadata
  • Dataset Splitting

Administration:

  • Metadata Store Setup

API Reference:

  • tatm CLI Reference
  • tatm.data Data Module API
  • tatm.config Config API Reference
  • tatm.tokenizer Tokenizer API Reference
  • Metadata Store API
tatm
  • Search


© Copyright 2024, Kempner Institute at Harvard University.

Built with Sphinx using a theme provided by Read the Docs.