Fulah Fulfulde

ISO 639-1: ff ISO 639-3: ful M L

109,082 Words in vocabulary

4.16x Best compression

0.8804 Best isotropy

Sample text

Excerpts from Fulah Wikipedia articles.

Tuobo District is one of 10 districts of River Gee County, Liberia. As of the po...

Sapele Latake hukuma pamarun Diiwal Delta lysidi Naajeeriya

Tienie ko wuro e nder diiwaan Grand Cape Mount, to leydi Liberiya.

The 20 most frequently used words in Fulah Wikipedia.

Explore Fulah interactively with browser-based demos.

Key metrics for all model types at a glance.

from wikilangs import tokenizer
tok = tokenizer('latest', 'ff', 32000)
tokens = tok.tokenize("Your text here")

from wikilangs import ngram
ng = ngram('latest', 'ff', gram_size=3)
score = ng.score("Your text here")

from wikilangs import markov
mc = markov('latest', 'ff', depth=3)
text = mc.generate(length=50)

from wikilangs import vocabulary
vocab = vocabulary('latest', 'ff')
info = vocab.lookup("word")

from wikilangs import embeddings
emb = embeddings('latest', 'ff', dimension=64)
vec = emb.embed_word("word")

Model Type	Variants	Description
Tokenizers	8k, 16k, 32k, 64k	BPE tokenizers with different vocabulary sizes
N-gram (Word)	2, 3, 4, 5-gram	Word-level language models
N-gram (Subword)	2, 3, 4, 5-gram	Subword-level language models
Markov (Word)	Depth 1–5	Word-level text generation
Markov (Subword)	Depth 1–5	Subword-level text generation
Vocabulary	—	Word dictionary with frequency and IDF
Embeddings	32d, 64d, 128d	Position-aware word embeddings