Zirui Wu
40ea84ae81
fix from_file validator minor error, 1 line change
add test case
5 years ago
xulei2020
18b519ae0f
add sentence piece
5 years ago
mindspore-ci-bot
a84092e89d
!3102 [MD] Add additional parameter checks in RandomCropWithBBoxOp and RandomResizeWithBbox
Merge pull request !3102 from nhussain/random_crop_fixes
5 years ago
nhussain
5871ba8a05
more validator fixes
5 years ago
YangLuo
4136892a3e
add SlidingWindow Op
5 years ago
Zirui Wu
63185cb20f
fix some validators errors
address review cmts
addr review cmts
5 years ago
nhussain
05b2a57d2a
fix validation errors, and fix try catch error tests
5 years ago
Jesse Lee
7c1bc5192b
Initial Drop of CacheOp Phase I
5 years ago
mindspore-ci-bot
6284c42a76
!2941 MD tokenizer support output offsets
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
5 years ago
xiefangqi
47060631e5
add offsets feature to tokenizer
5 years ago
Zirui Wu
7b15e5a742
rework on lookup
add test caser
fix ci
address review cmts
ci
addr review cmt
fix typo
address review cmts
add 2 more test cases
cpplint fix
addr cpplint
addr ci
fix tst case err
fix doc str
5 years ago
nhussain
6c37ea3be0
fix validators
fixed random_apply tests
fix validators
fixed random_apply tests
fix engine validation
5 years ago
mindspore-ci-bot
1ea38eb60c
!2375 Add Python Tokenizer
Merge pull request !2375 from h.farahat/python_tokenizer
5 years ago
hesham
e981c67acd
Python Tokenizer
!38 Synchronize with latest Ascend software suite 17 Jun 2020
Merge pull request !38 from yanghaoran/master
5 years ago
hesham
674415f7be
Cleanup work for Concate, Mask, Slice, PadEnd and TruncatePair
5 years ago
peilinwang
1e36b0649f
remove graphengine changes
remove graphengine changes
concat op
Truncate Pair
concat_op
remove graph engine changes
ToNumberOp implementation almost done
ToNumberOp complete
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
merge conflicts
5 years ago
Zirui Wu
b6e9504b31
phase I of Vocab rework
phase II vocab rework
added more test cases
fix api doc string
address review cmts and fix CI
address ci complains
fix review cmts
ci
5 years ago
Zirui Wu
8f2674850b
address API doc style and content
addr review cmts
revert
ci
private class
ci
fix ci
address ci
address review cmts
fix style err
5 years ago
hesham
b9495a9ccc
Truncate Pair
5 years ago
Zirui Wu
880ce5ea26
implemented from_dataset
fix complie error
more tests
address CI complains
fix ci
adress review comments
address review cmts
5 years ago
Zirui Wu
dbf9936ec4
Implemented n-gram for dataset TensorOp
5 years ago
hesham
6c21e556c4
Clean up work for text python package
5 years ago
Zirui Wu
25ab2ef303
Implemented lookup and vocab
5 years ago