.product documentation
.TXT makes LLMs speak the language of every application. We provide high-performance libraries to obtain structured outputs with language models.
dotjson
dotjson
constrains LLMs to generate properly structured JSON objects that conform to a predefined JSON Schema, accessible through a simple C++ or Python API.
dotgrammar
dotgrammar
enables grammar-based structured text generation, constraining LLMs to outputs that conform to predefined formal grammars.
- Support for context-free grammars in multiple formats (GBNF, Lark, yacc, tree-sitter)
- High performance with minimal runtime overhead
- Simple logit masking in C++ or Python
dotregex
dotregex
provides regex-based text generation, ensuring LLM outputs match specific regular expression patterns.
- Support for advanced regex features
- High performance with minimal runtime overhead
- Simple logit masking in C++ or Python
AWS Marketplace
We are working an inference service powered by dotjson
, available on the AWS Marketplace.
Need structured outputs?
Email us at [email protected] or schedule a demo call with us.
Register your interest in our structured generation API by filling out this survey.