dty

Dotyali डोटेली

ISO 639-3: dty I L

32,797 Words in vocabulary

4.54x Best compression

0.9032 Best isotropy

Sample text

Excerpts from Dotyali Wikipedia articles.

सुखविंदर सिंह भारतीय सांगीतिक क्षेत्रका पाश्व गायक हुन। सन्दर्भ गिदाराअन

सिंगौडी दैलेख जिल्लामी पडडे एक गाऊ विकास समिति हो । यी पनि हेर जिल्ला विकास समित...

बेनिन अफ्रिका महाद्वीपमाई रयाको एक देश हो। सन्दर्भ देशअन

The 20 most frequently used words in Dotyali Wikipedia.

Explore Dotyali interactively with browser-based demos.

Key metrics for all model types at a glance.

from wikilangs import tokenizer
tok = tokenizer('latest', 'dty', 32000)
tokens = tok.tokenize("Your text here")

from wikilangs import ngram
ng = ngram('latest', 'dty', gram_size=3)
score = ng.score("Your text here")

from wikilangs import markov
mc = markov('latest', 'dty', depth=3)
text = mc.generate(length=50)

from wikilangs import vocabulary
vocab = vocabulary('latest', 'dty')
info = vocab.lookup("word")

from wikilangs import embeddings
emb = embeddings('latest', 'dty', dimension=64)
vec = emb.embed_word("word")

Model Type	Variants	Description
Tokenizers	8k, 16k, 32k, 64k	BPE tokenizers with different vocabulary sizes
N-gram (Word)	2, 3, 4, 5-gram	Word-level language models
N-gram (Subword)	2, 3, 4, 5-gram	Subword-level language models
Markov (Word)	Depth 1–5	Word-level text generation
Markov (Subword)	Depth 1–5	Subword-level text generation
Vocabulary	—	Word dictionary with frequency and IDF
Embeddings	32d, 64d, 128d	Position-aware word embeddings