Last Updated
：2025/11/24
tokenizations
Noun
form-of
plural
Japanese Meaning
トークン化、すなわちテキストやデータを個々の要素（トークン）に分解する処理の複数形
Sense（1）
Quizzes for review
See correct answer
tokenizations
Research on neural language models often compares different tokenizations to understand how they affect vocabulary size and downstream performance.
See correct answer
Research on neural language models often compares different tokenizations to understand how they affect vocabulary size and downstream performance.
音声機能が動作しない場合はこちらをご確認ください
English - English
Word Edit Setting
- Users who have edit permission for words - All Users
- Screen new word creation
- Screen word edits
- Screen word deletion
- Screen the creation of new headword that may be duplicates
- Screen changing entry name
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
Sentence Edit Setting
- Users who have edit permission for sentences - All Users
- Screen sentence deletion
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
Quiz Edit Setting
- Users who have edit permission for quizzes - All Users
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
