Serbo-Croatian srpskohrvatski / српскохрватски

ISO 639-1: sh ISO 639-3: hbs M L

831,692 Words in vocabulary

4.49x Best compression

0.6562 Best isotropy

Sample text

Excerpts from Serbo-Croatian Wikipedia articles.

Galbenu ima više značenja: Galbenu, Galbenu Opština Galbenu, Brăila

Molekulska formula se može odnositi na: Deksrazoksan Pentostatin Acetilkarnozin

Marcucci ima više značenja: Marcucci, Lucca Marcucci, Macerata

The 20 most frequently used words in Serbo-Croatian Wikipedia.

Explore Serbo-Croatian interactively with browser-based demos.

Key metrics for all model types at a glance.

from wikilangs import tokenizer
tok = tokenizer('latest', 'sh', 32000)
tokens = tok.tokenize("Your text here")

from wikilangs import ngram
ng = ngram('latest', 'sh', gram_size=3)
score = ng.score("Your text here")

from wikilangs import markov
mc = markov('latest', 'sh', depth=3)
text = mc.generate(length=50)

from wikilangs import vocabulary
vocab = vocabulary('latest', 'sh')
info = vocab.lookup("word")

from wikilangs import embeddings
emb = embeddings('latest', 'sh', dimension=64)
vec = emb.embed_word("word")

Model Type	Variants	Description
Tokenizers	8k, 16k, 32k, 64k	BPE tokenizers with different vocabulary sizes
N-gram (Word)	2, 3, 4, 5-gram	Word-level language models
N-gram (Subword)	2, 3, 4, 5-gram	Subword-level language models
Markov (Word)	Depth 1–5	Word-level text generation
Markov (Subword)	Depth 1–5	Subword-level text generation
Vocabulary	—	Word dictionary with frequency and IDF
Embeddings	32d, 64d, 128d	Position-aware word embeddings