liyong
c257cf36e2
refactor mindrecord
4 years ago
ms_yan
36a8886ca2
Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab .
Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"
This reverts commit 4e6f7dc97d .
delete pass_registry_test.cc
comment hiai_nlu_model_multi.pb related line
4 years ago
djc
b077aa1cab
[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset
4 years ago
djc
4e6f7dc97d
[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset
4 years ago
xiefangqi
0e2efc2501
fix minddata code clean
4 years ago
jonyguo
42b3512a1b
fix: when field is none in mr
4 years ago
shenwei41
59efbb88ec
fix waring
4 years ago
shenwei41
e3385e2564
fix waring to master
4 years ago
jonyguo
52db81a0ab
fix: sqlite inject
4 years ago
i-robot
7fe8eddc42
!20589 [MD] fix security check in master
Merge pull request !20589 from liyong126/fix_security_check
4 years ago
liyong
e262b11901
fix security check
4 years ago
jonyguo
a8076a7a2d
fix: code review check
4 years ago
Lixia Chen
3c0129226b
Fix codex, codecheck, shellcheck issues
4 years ago
jonyguo
7ebf5b6011
fix: regular path
4 years ago
mindspore-ci-bot
e5f4e2c4b5
!17729 Fix pclint warning in master
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @robingrosman
4 years ago
hesham
2c4cb4f3bc
pclint fixes to master
4 years ago
liyong
487c330985
fix codecheck
4 years ago
liyong
322c342979
fix codecheck
4 years ago
jonyguo
9452142b50
enhance: enable shuffle infile / files when mindrecord
4 years ago
Lixia Chen
5967cb2cd7
Unblock mindrecord under cache
4 years ago
Jamie Nisbet
e53bab18f9
fix MR sampler with replacement case
4 years ago
Jamie Nisbet
515c936b85
MindRecord becomes a mappable dataset
updates
review touches
ci fixes
ci fix
ci fixin
ci fix
review updates
further cleanup
updates
updates
update
update comment
5 years ago
liyong
710b3d2236
fix bug in save
4 years ago
jonyguo
8fed2affe3
fix: max length func
4 years ago
jonyguo
dcab396d96
fix: random_device(...) failed in some situation
5 years ago
liyong
0708cc66d2
refactor pk sampler in minddataset
5 years ago
luoyang
624511337c
MindData Codespell correction
5 years ago
hesham
7120c66998
Add SubsetSampler
5 years ago
jonyguo
4dbe6737e7
fix: enhance rpath link for minddata lib and execute
5 years ago
jonyguo
f97d03f695
impl mindrecord lazy load
5 years ago
xiaoyisd
5b31b46c8c
mac build plus
5 years ago
xiaoyisd
424999267a
mac build
5 years ago
jonyguo
cfc826feed
enhance: use multi thread to load metadata in mindrecord
5 years ago
liyong
0d40abf5dd
fix md padding bug
5 years ago
liyong
ee042b90f7
fix num_sample in sequentialSampler and randomSampler
5 years ago
luoyang
2dc8e5f421
[MD] C++ api add MindDataset
5 years ago
liyong
a0cba2a4c5
fix bug when read multiple mindrecord files
5 years ago
liyong
981f9bc609
fix mindrecord log
5 years ago
YangLuo
0770eef37b
[MD] Log update for mindrecord shard reader
5 years ago
shenwei41
f2e34b2eaf
Clean up the view code
5 years ago
liyong
930e85ed5c
fix get_dataset_size in distributedSampler & num_samples
5 years ago
liyong
2e5a809933
fix mindrecord log
5 years ago
liyong
ac39c20f41
del finish in FileReader
5 years ago
heleiwang
8ee4d8e92d
Gnn data processing supports distributed scenarios
5 years ago
genglishuai
4d4df68d1e
add DistributedSampler for Concat op
5 years ago
mindspore-ci-bot
c6acafcbc6
!4268 fix glog level dont work
Merge pull request !4268 from liubuyu/master
5 years ago
liubuyu
25a67602b7
bug fix for glog level don't work
5 years ago
liyong
7341421d3b
fix num samples in pk sampler
5 years ago
liubuyu
195f04e50e
compile the core directory into a separate static library
5 years ago
liubuyu
d81862a916
decoupling core and context
5 years ago