xulei2020
5dd651f1a5
fix bug for extractchannel when type is UINT16
5 years ago
Cathy Wong
4b1ccf9dd5
dataset: Use int32_t for text's vocab_size
5 years ago
Zirui Wu
fa553956ef
add num_epochs to CPP API Dataset::CreateIterator(columns,num_epochs)
5 years ago
mohammad
f48ab2b5c9
make MD public headers standalone
5 years ago
Zirui Wu
0e68575e77
port over getter pass
port over tensor_op_fusion pass
add fusion support for prebuildOpeartion (TensorOpeartion)
5 years ago
mindspore-ci-bot
5fd77356c9
!9687 Adding AddChild functionality to SamplerObj
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
a5869f2984
!10142 dataset CPP UT: Updates for ExecTree to IRTree Support
From: @cathwong
Reviewed-by:
Signed-off-by:
5 years ago
Nat Sutyanyong
7c5b2de1ec
dataset CPP UT: Updates for ExecTree to IRTree Support
5 years ago
Zirui Wu
0a31f563a7
minor fixes
5 years ago
mindspore-ci-bot
20df37e428
!10287 Add ut for dataset to_number
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
5 years ago
Zirui Wu
0e2f7a9e9e
add validate param to base class DatasetNode
5 years ago
YangLuo
da6de519ae
Add ut for dataset to_number
5 years ago
Xiao Tianci
633f97bb48
fix get dataset size in distributed scenario
5 years ago
xiefangqi
3c6cc3c58c
Add NormalizePadOp
5 years ago
Mahdi
0f2b5d8cac
Changed SamplerObj validate params to return status and added AddChild to it
5 years ago
Zirui Wu
91a6b2b0ca
Add checks to RandomData and LookUp
5 years ago
mindspore-ci-bot
317a97e6b9
!9336 auto num_parallel_workers setup
From: @ziruiwu
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
a2c80435ce
!9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
Zirui Wu
d6df1b0832
Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled
5 years ago
Lixia Chen
32b82c2737
Fix a core dump in TreeConsumer::Terminate()
and other minor cache changes
5 years ago
Xiao Tianci
0659473535
add TruncateSequencePair, ToNumber C++ API and enable three test cases
5 years ago
mindspore-ci-bot
49fd5308a4
!9564 Tidy up code in dataset compilation phase
From: @nsyca
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
6b5626634c
!9530 add BasicTokenizer and BertTokenizer C++ API
From: @tiancixiao
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
Nat Sutyanyong
41ea1621c5
Tidy up TreeAdapter::Compile
5 years ago
shenwei41
206ae1a7c3
Add Three text C++ API
5 years ago
Nat Sutyanyong
4cb78f2e03
Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass
5 years ago
Jesse Lee
0c8dfc68ec
Fix hang on RequestFreeTag
5 years ago
Xiao Tianci
290cc72887
add BasicTokenizer and BertTokenizer C++ API
5 years ago
Nat Sutyanyong
d69a29a44e
Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass
5 years ago
mindspore-ci-bot
73c91e05b1
!9398 Change Build to return status
From: @alex-yuyue
Reviewed-by: @mikef
Signed-off-by:
5 years ago
alex-yuyue
ccff3a5316
Change build to return status
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
YangLuo
a2ec7ad5bd
Fix concat issue & fix schema doc
5 years ago
mindspore-ci-bot
df44e1339e
!9249 Optimizing GetDatasetSize
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
9ed31ea2cb
!9339 Disable getter optimization pass
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
5 years ago
Eric
db2a8b5e1d
Disable getter pass
5 years ago
Mahdi
f80553bc6e
Optimization for GetDatasetSize
5 years ago
mindspore-ci-bot
da8d7d661a
!9283 Modify the dataset ut log message
From: @liucunwei
Reviewed-by: @pandoublefeng,@heleiwang,@jonyguo
Signed-off-by: @heleiwang,@jonyguo
5 years ago
liucunwei
8ef4b2796e
modify the dataset ut log message
5 years ago
shenwei41
3bea84d0f7
add four new text API
5 years ago
mindspore-ci-bot
7748ae823a
!9141 Fix DatasetCache C++ API cache sharing behavior
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
mindspore-ci-bot
a37e9710b5
!9038 port name functions from TensorOp to TensorOperation
From: @mhmotallebi
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
a6845395e6
!9181 Add some ut pipeline test case for C++ dataset
From: @liucunwei
Reviewed-by: @pandoublefeng,@jonyguo
Signed-off-by: @jonyguo
5 years ago
liucunwei
e612e23a05
Add some ut pipeline test case for C++ dataset
5 years ago
liucunwei
7f13f2ad0e
add some pipeline ut test cases for c++ dataset
5 years ago
mohammad
9cfeb08c4d
port name() to TensorOperation and its derived classes
5 years ago
Lixia Chen
e8247eadef
Same runtime CacheClient if c++ cache is shared
5 years ago
Zirui Wu
36bfd0d8ad
address left over cmts from 8802
5 years ago
liucunwei
3e57236fe3
add some new ut test for minddataset
5 years ago
shenwei41
4e56618d18
Add text C++ API
5 years ago
Nat Sutyanyong
5e1bb0b697
boilerplate code for future IR optimizer
add 2 test cases to IRNode Deepcopy()
address review cmts
fix ut
samplerObj copy
ci
fix ci
fix ci round III
address further review cmts
add a missing macro
fix merge conflict
fix complie err
fix lite compile err
fix compile err
fix lite compile round III
address an issue
fix minor comments
5 years ago