# `tatm.tokenizer` Tokenizer API Reference

```{eval-rst}
.. automodule:: tatm.tokenizer
    :members:
    :undoc-members:
    :show-inheritance:
```

## `tatm.tokenize` Sub components

```{eval-rst}
.. automodule:: tatm.tokenizer.engine
    :members:
    :undoc-members:
    :show-inheritance:
```