gan

Gan Chinese 贛語

ISO 639-3: gan I L

6,911 Words in vocabulary

2.13x Best compression

0.2986 Best isotropy

Sample text

Excerpts from Gan Chinese Wikipedia articles.

區劃隆共管到八隻鎮同到兩隻鄉：鎮：湘東鎮、荷堯鎮、老關鎮、下埠鎮、臘市鎮、麻山鎮、排上鎮、東橋鎮。鄉：廣寒寨鄉、白竺鄉。外部連接湘東區政府網站

崇義係贛州管到嗰一隻縣。行政區劃鎮：橫水鎮、揚眉鎮、過埠鎮、鉛廠鎮、長龍鎮、關田鎮鄉：龍勾鄉、杰壩鄉、金坑鄉、思順鄉、麟潭鄉、上堡鄉、聶都鄉、文英鄉、樂洞...

文身一般係話一隻人完身嗰器官組織，好似由上到下嗰頭、頸、胸、肚、腳箇滴子身體部件。別嗰條目文身最大嗰器官

The 20 most frequently used words in Gan Chinese Wikipedia.

Explore Gan Chinese interactively with browser-based demos.

Key metrics for all model types at a glance.

from wikilangs import tokenizer
tok = tokenizer('latest', 'gan', 32000)
tokens = tok.tokenize("Your text here")

from wikilangs import ngram
ng = ngram('latest', 'gan', gram_size=3)
score = ng.score("Your text here")

from wikilangs import markov
mc = markov('latest', 'gan', depth=3)
text = mc.generate(length=50)

from wikilangs import vocabulary
vocab = vocabulary('latest', 'gan')
info = vocab.lookup("word")

from wikilangs import embeddings
emb = embeddings('latest', 'gan', dimension=64)
vec = emb.embed_word("word")

Model Type	Variants	Description
Tokenizers	8k, 16k, 32k, 64k	BPE tokenizers with different vocabulary sizes
N-gram (Word)	2, 3, 4, 5-gram	Word-level language models
N-gram (Subword)	2, 3, 4, 5-gram	Subword-level language models
Markov (Word)	Depth 1–5	Word-level text generation
Markov (Subword)	Depth 1–5	Subword-level text generation
Vocabulary	—	Word dictionary with frequency and IDF
Embeddings	32d, 64d, 128d	Position-aware word embeddings