Huawei_Technology
/
mindspore
Not watched
1
0
Fork 0
Code
Releases 13 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
19829 Commits
11 Branches
1.3 GB
177 Download
 
 
 
 
 
 
Tree: b8b96e15e7
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'b8b96e15e7'
${ noResults }
mindspore/tests/ut/data/dataset/testTokenizerData
Xiao Tianci 0659473535 add TruncateSequencePair, ToNumber C++ API and enable three test cases 5 years ago
..
1.txt Add UnicodeCharTokenizer for nlp 5 years ago
basic_tokenizer.txt Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 5 years ago
bert_tokenizer.txt BasicTokenizer not case fold on preserverd words 5 years ago
normalize.txt Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 5 years ago
regex_replace.txt Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 5 years ago
regex_tokenizer.txt Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 5 years ago
sentencepiece_tokenizer.txt add sentence piece 5 years ago
to_number.txt add TruncateSequencePair, ToNumber C++ API and enable three test cases 5 years ago
wordpiece_tokenizer.txt Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 5 years ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

C++ Python Text Unity3D Asset C other