Merge pull request !1590 from ms_yan/r0.3_format

Merge pull request !1559 from xiefangqi/xfq_voc_support_split

Cleanup dataset UT: restore config support

Merge pull request !1369 from ms_yan/del_storage

Merge pull request !1281 from Peilin/splitOp

implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci

Merge pull request !1306 from EricZ/master

Merge pull request !1157 from ms_yan/concat_dataset

Merge pull request !1126 from xiefangqi/voc_support_detection

change to use __add__ operation instead ds.concat

Merge pull request !1123 from pengyanjun/generator_dataset_np_copy_problem

support for 1 specific dimension to be None, added validator

fix various CI complains

another round of CI fixes

ci

refactor parts of the code

code refactor

ci fix

comments added, fix bugs

address review comments

address review comments

review cmts

added simple perf test script

update pad code

perf imprv

Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler

Merge pull request !872 from JunhanHu/generator_schema

Merge pull request !869 from JesseKLee/random_data_op

Merge pull request !671 from EricZ/master

Merge pull request !466 from h.farahat/deepcopy

Added new testcase for multi iterator

Addressing review

Fixed typo

Merge pull request !601 from xulei/filter_master

Merge pull request !606 from pengyanjun/fix_dataset_api_doc_change_line

Merge pull request !477 from xiefangqi/xfq_fix_voc

Merge pull request !508 from EricZ/master

Initial commit for dataset op python

Added signature to barrier

Adde compiling barrier code

Rebasing, fixed new compile errors

Final fix for make_unique

Added pybind API for barrier

Fixed pyfunc invocation

python interface - sync_wait

!1 sync_wait python interface
* python interface - sync_wait

fix test

update test

update test

Added new test case

add test case

test for shuffle + batch

Added two-sync test case

Restrited that no shuffle after sync

Added sync to pipeline info

block first databuffer as well

Intelligently get batch size

Fix default case

Lock Pair shares among all iterators

Added fix for empty character

Fixed up test case formatting

Fix end of epoch in sync_wait

Fixing CI

Merge pull request !506 from JunhanHu/multiprocess_pyfunc