Merge pull request !477 from xiefangqi/xfq_fix_voc

Merge pull request !508 from EricZ/master

Initial commit for dataset op python

Added signature to barrier

Adde compiling barrier code

Rebasing, fixed new compile errors

Final fix for make_unique

Added pybind API for barrier

Fixed pyfunc invocation

python interface - sync_wait

!1 sync_wait python interface
* python interface - sync_wait

fix test

update test

update test

Added new test case

add test case

test for shuffle + batch

Added two-sync test case

Restrited that no shuffle after sync

Added sync to pipeline info

block first databuffer as well

Intelligently get batch size

Fix default case

Lock Pair shares among all iterators

Added fix for empty character

Fixed up test case formatting

Fix end of epoch in sync_wait

Fixing CI

Merge pull request !506 from JunhanHu/multiprocess_pyfunc

Merge pull request !406 from Peilin/first-row-crc-check

Merge pull request !460 from xulei/filter_master

Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset

addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info

Merge pull request !427 from pengyanjun/fix_dataset_api_description

Merge pull request !422 from ms_yan/Generator_distri

Merge pull request !416 from xiefangqi/br_fix_apply_comment

Merge pull request !183 from JunhanHu/cpp_sampler

This reverts commit 5c2ded8d8e.

Merge pull request !243 from h.farahat/nested_repeat

Merge pull request !318 from pengyanjun/fix_get_cladd_indexing_warning

Merge pull request !273 from liyong126/mindrecord_subset_sampler_python

adjust internal api

Merge pull request !165 from ghzl/use-mindspore-instead-of-mstype-in-example

changes from yanpanhui 524009: added set_dataset_size and changed get_dataest_size according to ME requirements

CI fixes

Signed-off-by: leonwanghui <leon.wanghui@huawei.com>