Translation of "tokenization" into Chinese

Token 化, 词汇切分 are the top translations of "tokenization" into Chinese.

tokenization noun grammar

The act or process of tokenizing. [..]

+ Add

English-Chinese dictionary

  • Token 化

    In text mining or Full-Text Search, the process of identifying meaningful units within strings, either at word boundaries, morphemes, or stems, so that related tokens can be grouped. For example, although "San Francisco" is two words, it could be treated as a single token.

  • 词汇切分

    In text mining or Full-Text Search, the process of identifying meaningful units within strings, either at word boundaries, morphemes, or stems, so that related tokens can be grouped. For example, although "San Francisco" is two words, it could be treated as a single token.

  • Show algorithmically generated translations

Automatic translations of "tokenization" into Chinese

  • Glosbe

    Glosbe Translate
  • Google

    Google Translate

Phrases similar to "tokenization" with translations into Chinese

Add

Translations of "tokenization" into Chinese in sentences, translation memory