zzy34407230
/
mindspore2022
Not watched
1
0
Fork 0
Code
Releases 22 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
4014 Commits
18 Branches
584 MB
776 Download
 
 
 
 
 
 
Tree: 62aed2ff30
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '62aed2ff30'
${ noResults }
mindspore2022/mindspore/ccsrc/dataset/text/kernels
qianlong 980ddd32a2 change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors 6 years ago
..
CMakeLists.txt remove graphengine changes 6 years ago
basic_tokenizer_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
basic_tokenizer_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
bert_tokenizer_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
bert_tokenizer_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
case_fold_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
case_fold_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
jieba_tokenizer_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
jieba_tokenizer_op.h Clean up work for text python package 6 years ago
lookup_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
lookup_op.h phase I of Vocab rework 6 years ago
ngram_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
ngram_op.h Implemented n-gram for dataset TensorOp 6 years ago
normalize_utf8_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
normalize_utf8_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
regex_replace_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
regex_replace_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
regex_tokenizer_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
regex_tokenizer_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
to_number_op.cc remove graphengine changes 6 years ago
to_number_op.h remove graphengine changes 6 years ago
truncate_sequence_pair_op.cc Truncate Pair 6 years ago
truncate_sequence_pair_op.h Truncate Pair 6 years ago
unicode_char_tokenizer_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
unicode_char_tokenizer_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
unicode_script_tokenizer_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
unicode_script_tokenizer_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
whitespace_tokenizer_op.cc Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
whitespace_tokenizer_op.h Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 6 years ago
wordpiece_tokenizer_op.cc change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors 6 years ago
wordpiece_tokenizer_op.h change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors 6 years ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

阿对对队

C++ Python Text C Unity3D Asset other