23 Commits (c24122bb552284bfe6e58e091b4910c9a6da6293)

Author SHA1 Message Date
  Zirui Wu 40ea84ae81 fix from_file validator minor error, 1 line change 5 years ago
  xulei2020 18b519ae0f add sentence piece 5 years ago
  mindspore-ci-bot a84092e89d !3102 [MD] Add additional parameter checks in RandomCropWithBBoxOp and RandomResizeWithBbox 5 years ago
  nhussain 5871ba8a05 more validator fixes 5 years ago
  YangLuo 4136892a3e add SlidingWindow Op 5 years ago
  Zirui Wu 63185cb20f fix some validators errors 5 years ago
  nhussain 05b2a57d2a fix validation errors, and fix try catch error tests 5 years ago
  Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 5 years ago
  mindspore-ci-bot 6284c42a76 !2941 MD tokenizer support output offsets 5 years ago
  xiefangqi 47060631e5 add offsets feature to tokenizer 5 years ago
  Zirui Wu 7b15e5a742 rework on lookup 5 years ago
  nhussain 6c37ea3be0 fix validators 5 years ago
  mindspore-ci-bot 1ea38eb60c !2375 Add Python Tokenizer 5 years ago
  hesham e981c67acd Python Tokenizer 5 years ago
  hesham 674415f7be Cleanup work for Concate, Mask, Slice, PadEnd and TruncatePair 5 years ago
  peilinwang 1e36b0649f remove graphengine changes 5 years ago
  Zirui Wu b6e9504b31 phase I of Vocab rework 5 years ago
  Zirui Wu 8f2674850b address API doc style and content 5 years ago
  hesham b9495a9ccc Truncate Pair 5 years ago
  Zirui Wu 880ce5ea26 implemented from_dataset 5 years ago
  Zirui Wu dbf9936ec4 Implemented n-gram for dataset TensorOp 5 years ago
  hesham 6c21e556c4 Clean up work for text python package 5 years ago
  Zirui Wu 25ab2ef303 Implemented lookup and vocab 5 years ago