Last Updated：2025/11/24
Sentence
ニューラル言語モデルの研究では、語彙サイズや下流の性能にどのように影響するかを理解するために、異なるトークン化手法を比較することがよくあります。
Quizzes for review
Research on neural language models often compares different tokenizations to understand how they affect vocabulary size and downstream performance.
See correct answer
Research on neural language models often compares different tokenizations to understand how they affect vocabulary size and downstream performance.
音声機能が動作しない場合はこちらをご確認ください
Related words
tokenizations
Noun
form-of
plural
Japanese Meaning
トークン化、すなわちテキストやデータを個々の要素（トークン）に分解する処理の複数形
English - English
Word Edit Setting
- Users who have edit permission for words - All Users
- Screen new word creation
- Screen word edits
- Screen word deletion
- Screen the creation of new headword that may be duplicates
- Screen changing entry name
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
Sentence Edit Setting
- Users who have edit permission for sentences - All Users
- Screen sentence deletion
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
Quiz Edit Setting
- Users who have edit permission for quizzes - All Users
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
