xunxue
87aa9c8f7a
PadEndOp
5 年前
Junhan Hu
57f3732ac3
Move python tree transformation into cpp pass.
5 年前
mindspore-ci-bot
5850b99161
!2211 Add TruncatePair Op to dataset
Merge pull request !2211 from h.farahat/pair_truncate
5 年前
hesham
b9495a9ccc
Truncate Pair
5 年前
mindspore-ci-bot
a4048e192c
!2256 Rename Sampler::Reset() to Sampler::ResetSampler()
Merge pull request !2256 from JesseKLee/sampler
5 年前
mindspore-ci-bot
ea829e89c3
!2198 Add MaskOp to dataset
Merge pull request !2198 from h.farahat/mask_op
5 年前
Jesse Lee
dcfdff6021
Rename Sampler Reset
5 年前
qianlong
4f16f036be
Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
add CaseFold, NormalizeUTF8
add RegexReplace
add RegexTokenizer
add BasicTokenizer
add WordpieceTokenizer
add BertTokenizer
5 年前
hesham
f2462bb00d
Mask Op
5 年前
mindspore-ci-bot
625f2421b5
!1977 random walk in gnn node2vec
Merge pull request !1977 from JonathanY/randomwalk
5 年前
mindspore-ci-bot
a1f194c971
!2188 Remove B+ tree deadcode and add an additional output to Search function
Merge pull request !2188 from JesseKLee/deadcode
5 年前
Jesse Lee
287ca71260
Remove dead code
5 年前
hesham
e2012a1de9
Slice Op
5 年前
mindspore-ci-bot
dceb3c2be4
!2026 Change C++ behavior in RandomCropAndResize
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
5 年前
Mahdi
add29f95f5
resolved issues in the comments
5 年前
mindspore-ci-bot
2cab44a637
!2028 FillOp for BERT
Merge pull request !2028 from nhussain/fillOp_learning
5 年前
nhussain
dd9bf09f0a
added FillOp for #119 - special Ops
5 年前
Jonathan Yan
87d2c27c7f
random walk v1
5 年前
mindspore-ci-bot
a8cf83acf2
!1932 Add CLUE dataset
Merge pull request !1932 from jiangzhiwen/dataset/clue
5 年前
jiangzhiwen
e0e167a000
add CLUE dataset
5 年前
mindspore-ci-bot
c661087b99
!2029 Create TensorRow class that supports a row id
Merge pull request !2029 from lixiachen/lixia/tensorrow
5 年前
Lixia Chen
6ae88c3987
Create TensorRow class that supports a row id.
5 年前
hesham
0c5e47111b
- Move MutableBuffer to be protected
- Add new CreateTensors
5 年前
mindspore-ci-bot
beefb20c01
!1983 Remove inheritance of Sampler from DatasetOp
Merge pull request !1983 from JesseKLee/sampler
5 年前
mindspore-ci-bot
b3da41bd7a
!1913 CocoDataset implementation
Merge pull request !1913 from xiefangqi/xfq_support_coco
5 年前
xiefangqi
097cbcc0cb
CocoDataset implementation
5 年前
Jesse Lee
255adf7c6e
Remove inheritance of Sampler from DatasetOp
5 年前
heleiwang
3ece8dd090
1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API
2. mod cora and citeseer conversion script
5 年前
mindspore-ci-bot
5eb95599f6
!1874 Updates to string tensor
Merge pull request !1874 from h.farahat/string_tensor_updates
5 年前
hesham
f837ddc956
- Bug when empty strings sent to Python
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
5 年前
Jamie Nisbet
51bc0c0460
consistent design for num_samples
updates
more update
more work
more fixin
post rebase updates
clang formatting
code review recovery
ci fixes
updates
update
update
update
5 年前
Jesse Lee
3b80c10b1e
Fix some timing hole in these two testcases
5 年前
mindspore-ci-bot
e311473401
!1453 Raise mse threshold in RandomCropDecodeResizeOp
Merge pull request !1453 from Alexey_Shevlyakov/fix_random_crop_decode_resize_ut
5 年前
Jesse Lee
a8fa847556
Allow join_all to be blocking
5 年前
Alexey Shevlyakov
7a807cbff9
fix ut
5 年前
Jesse Lee
641112a40c
Initial Drop
5 年前
mindspore-ci-bot
964a757db2
!1378 Just want to debug this case in Jenkin environment
Merge pull request !1378 from JesseKLee/cond_var_debug
5 年前
Jesse Lee
06ae724261
Again
5 年前
mindspore-ci-bot
458436186c
!1365 Clean up work for text python sub-package
Merge pull request !1365 from h.farahat/text_namespace
5 年前
mindspore-ci-bot
6f733ec113
!1308 Stage 2 of adding support for string Tensor
Merge pull request !1308 from h.farahat/string_tensor2
5 年前
hesham
6c21e556c4
Clean up work for text python package
5 年前
heleiwang
599a449e0b
Support processing GNN data
5 年前
hesham
df361d1d26
Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
5 年前
mindspore-ci-bot
2e3d55ed87
!1281 Implementation of SplitOp
Merge pull request !1281 from Peilin/splitOp
5 年前
Peilin Wang
71e8bb1960
general split case done, chaining sampler (basic case) is working
implementation 99% complete
everything and tested except for repeatable shuffling
tested most basic/typical split usecases
cleanup
some more cleanup
fix CI
more ci fix
more ci fixes
more ci fix
more ci fix
more ci fix
added more tests, fixed some bugs
some more clean up and test cases
added shard/shuffle before split warning/error
addressed code review comments and ci
fixed ci
5 年前
qianlong
451c20a6f5
Add UnicodeCharTokenizer for nlp
5 年前
xulei2020
163b6b7ea7
add jieba c++ code
5 年前
hesham
e8ca243364
-Add DE_STRING
-replace switch'case by indexing
- Add test case
- Add constructors
- Add getItem string
- Fix bugs
- Add more tests
- Tensor iterator
- asNumpy
- TextFileDataset
- Tensor(Numpy)
- Super > 2D
- Add more test cases for GeneratorDataset
- Change StartAddr to GetBuffer and GetMutableNuffer
- Raise an error if batch is used with strings
Clean-up work
5 年前
mindspore-ci-bot
c680cfbf27
!1157 dataset: add concat operation for dataset
Merge pull request !1157 from ms_yan/concat_dataset
5 年前
mindspore-ci-bot
ab031ee9ea
!1126 VOCDataset support object detection function
Merge pull request !1126 from xiefangqi/voc_support_detection
5 年前