Last Updated：2025/11/24
Sentence
Quizzes for review
Accurate tokenization is essential for reliable text analysis.
See correct answer
Accurate tokenization is essential for reliable text analysis.
音声機能が動作しない場合はこちらをご確認ください
Related words
tokenization
Noun
countable
uncountable
Japanese Meaning
トークン化する行為またはプロセス、すなわち文章やデータを意味ある最小単位（トークン）に分割する処理 / トークン化されたもの（トークンに変換された結果）
Related Words
English - English
Word Edit Setting
- Users who have edit permission for words - All Users
- Screen new word creation
- Screen word edits
- Screen word deletion
- Screen the creation of new headword that may be duplicates
- Screen changing entry name
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
Sentence Edit Setting
- Users who have edit permission for sentences - All Users
- Screen sentence deletion
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
Quiz Edit Setting
- Users who have edit permission for quizzes - All Users
- Users authorized to vote on judging - Editor
- Number of votes required for decision - 1
