alex-yuyue
b54e01bfb4
Tensor op decoupling stage 2
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
TinaMengtingZhang
4812fece80
[Part I] Push down json save logic to IR and add getter to each IR node
4 years ago
Nat Sutyanyong
686772cce7
Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code)
with comments from the peer view addressed
5 years ago
mindspore-ci-bot
7957a3b6f5
!10988 Tensor op decoupling stage 1
From: @ezphlow
Reviewed-by:
Signed-off-by:
4 years ago
Eric
be46ccf721
Started vision decoupling
map validate params
Changing bindings
Change behavior of vision.cc
Added signature and changed Cmake
Compiling
Need to fix compile
Added compiling random transforms
python changes for decoupling
two failed test case remaining
Compiling random choice
passes all ut
Changed assert
review comments
Added validate params
add back return value
Fix lint
py lint fix
pylint 2
Addressing comments
5 years ago
Zirui Wu
0e68575e77
port over getter pass
port over tensor_op_fusion pass
add fusion support for prebuildOpeartion (TensorOpeartion)
5 years ago
mindspore-ci-bot
03e655f14a
!10070 Fixing GetDatasetSize issue with chained samplers
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
4 years ago
Xiao Tianci
31fed1a2f6
change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine
5 years ago
mindspore-ci-bot
20df37e428
!10287 Add ut for dataset to_number
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
5 years ago
Zirui Wu
a1355a827c
introduce a master switch to turn on and off profiler
5 years ago
YangLuo
da6de519ae
Add ut for dataset to_number
5 years ago
mindspore-ci-bot
d99189f681
!10207 Fix some minor doc, typo related to AutoNumWorker
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
5 years ago
Zirui Wu
4ae7102fd3
address 2 tickets
5 years ago
Mahdi
98ea8fa6ea
Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers
5 years ago
mindspore-ci-bot
fc11b7dd68
!10074 Fix a testcase error when shuffle is above cache
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
5 years ago
mindspore-ci-bot
691e3baab6
!10109 [MD] Fix Decode doc & RandomNode log
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
5 years ago
mindspore-ci-bot
6035823c4b
!10044 fix get num classes of concat
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
5 years ago
luoyang
595b7a782f
[MD] Fix Decode doc & RandomNode log
5 years ago
Lixia Chen
a7f0e13234
Remove special treatment for cache above repeat
5 years ago
YangLuo
df9f4f41e8
fix get num classes of concat
5 years ago
Xiao Tianci
633f97bb48
fix get dataset size in distributed scenario
5 years ago
mindspore-ci-bot
c4f284b928
!9910 [MD][Perf] MindData add NormalizePad for GPU performance
From: @xiefangqi
Reviewed-by:
Signed-off-by:
5 years ago
xiefangqi
3c6cc3c58c
Add NormalizePadOp
5 years ago
YangLuo
18e61a627a
python eager add decode
5 years ago
mindspore-ci-bot
ad6507d88a
!9825 [MD] fix pad, normalize in c_trasnform
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
5 years ago
luoyang
1cc147df1d
fix pad, normalize in c_trasnform
5 years ago
Zirui Wu
77521e78d2
staging
5 years ago
Zirui Wu
91a6b2b0ca
Add checks to RandomData and LookUp
5 years ago
mindspore-ci-bot
317a97e6b9
!9336 auto num_parallel_workers setup
From: @ziruiwu
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
a2c80435ce
!9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
Zirui Wu
d6df1b0832
Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled
5 years ago
Lixia Chen
32b82c2737
Fix a core dump in TreeConsumer::Terminate()
and other minor cache changes
5 years ago
hesham
ff65f6feb8
Remove batch_map multiprocess test case
5 years ago
mindspore-ci-bot
aa5d4e08a9
!9544 Fix a possible seg fault in GenerateCRC caused by std::regex
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
5 years ago
Lixia Chen
27579fe858
Fix a seg fault caused by std::regex
5 years ago
Nat Sutyanyong
4cb78f2e03
Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass
5 years ago
mindspore-ci-bot
3280474d71
!9533 dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
5 years ago
Jesse Lee
0c8dfc68ec
Fix hang on RequestFreeTag
5 years ago
Cathy Wong
69b269c6cf
dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix
5 years ago
mindspore-ci-bot
4f607e9c26
!9335 Add multiprocessing support to per_batch_map
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
Nat Sutyanyong
d69a29a44e
Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass
5 years ago
alex-yuyue
ccff3a5316
Change build to return status
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
hesham
809f9c91be
Add multiprocessing support to per_batch_map
5 years ago
mindspore-ci-bot
df44e1339e
!9249 Optimizing GetDatasetSize
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
4ffd9b578f
!9331 More cache minor fix for HQ testers
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
Mahdi
f80553bc6e
Optimization for GetDatasetSize
5 years ago
Lixia Chen
2ddb1fb75e
More CRC fix and blocking BatchOp under cache
5 years ago
mindspore-ci-bot
920bbf1541
!9277 fix schema & zip validation
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
5 years ago
YangLuo
5cc3b76577
fix schema & zip validation
5 years ago
mindspore-ci-bot
af3c27d354
!9244 Fix core dump with concat and getter_pass
From: @ziruiwu
Reviewed-by:
Signed-off-by:
5 years ago