liyong
2412ee09ce
fix distributedSampler reshuffle and fix random_device failed
5 years ago
jonyguo
fb73c9c215
fix: db close fail
5 years ago
liyong
d4f8f57c7e
add split in minddataset
5 years ago
jonyguo
bb2082daec
fix: MindDataset padded log error
5 years ago
Yang
525d063abf
[Dataset] Fix codedex.
5 years ago
liyong
feff8899ac
support padding samples
5 years ago
mindspore-ci-bot
6f733ec113
!1308 Stage 2 of adding support for string Tensor
Merge pull request !1308 from h.farahat/string_tensor2
5 years ago
heleiwang
599a449e0b
Support processing GNN data
5 years ago
hesham
df361d1d26
Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
5 years ago
jonwe
bb51bb88d7
add compress in mindrecord
5 years ago
liyong
dbfa34a3f5
remove dead code
5 years ago
liyong
aa3f89e74f
mindrecord support read file list
5 years ago
jonyguo
cf352d190f
format func name for mindrecord
5 years ago
jonyguo
d4d236bcce
fix: use MindDataset by column_names get data error in some situation
5 years ago
jonwe
353b3b7944
optimize mindrecord writer performance
5 years ago
panfengfeng
b31946750b
回退 'Pull Request !182 : Tuning mindrecord writer performance'
5 years ago
mindspore-ci-bot
c73301bad9
!182 Tuning mindrecord writer performance
Merge pull request !182 from jonathan_yan/write_a
5 years ago
jonwe
f4bae5f364
optimize mindrecord writer performance
5 years ago
liyong
f1542a90a3
add pk sampler
6 years ago
chenjianping
1286767d0e
support building on windows
6 years ago
liyong
0ce83e39e1
fix TestShardSampleWrongNumber
adjust internal api
6 years ago
liyong
11403492ae
add mindrecord subset random sampler
6 years ago
jonyguo
a9443635b7
fix: mindpage enhance parameter check and search by filename failed
6 years ago
mindspore-ci-bot
bd7ac259af
!147 Parallelize mindrecord index writer via std::thread
Merge pull request !147 from ZiruiWu/master
6 years ago
Zirui Wu
5637f80692
implemented multi-thread index writer for mindrecord
num threads cannot be more than num shards
minor fix
clang style fix
address review comments
6 years ago
jonyguo
20d1b64443
fix: error info is not exactly when column list invalid
6 years ago
zhunaipan
930a1fb0a8
initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
6 years ago