|
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596 |
- mindspore.DatasetHelper
- ========================
-
- .. py:class:: mindspore.DatasetHelper(dataset, dataset_sink_mode=True, sink_size=-1, epoch_num=1)
-
- DatasetHelperһMindDataݼ࣬ṩݼϢ
-
- ݲͬģıݼĵڲͬʹͬĵ
-
- .. note::
- DatasetHelperĵṩһepochݡ
-
- ****
-
- - **dataset** (Dataset) - ѵݼݼݼAPI :class:`mindspore.dataset` ɣ :class:`mindspore.dataset.ImageFolderDataset`
- - **dataset_sink_mode** (bool) - ֵΪTrueʹ :class:`mindspore.ops.GetNext` 豸DeviceͨͨлȡݣֱӱݼȡݡĬֵTrue
- - **sink_size** (int) - ÿ³е `sink_size` Ϊ-1³ÿepochݼ `sink_size` 0³ÿepoch `sink_size` ݡĬֵ-1
- - **epoch_num** (int) - ƴ͵epochĬֵ1
-
- ****
-
- >>> from mindspore import DatasetHelper
- >>>
- >>> train_dataset = create_custom_dataset()
- >>> set_helper = DatasetHelper(train_dataset, dataset_sink_mode=False)
- >>> # DatasetHelperǿɵ
- >>> for next_element in set_helper:
- ... next_element
-
- .. py:method:: continue_send()
-
- epochʼʱ豸ݡ
-
- .. py:method:: dynamic_min_max_shapes()
-
- ض̬ݵ״(shape)ΧС״(shape)״(shape)
-
- ****
-
- >>>from mindspore import DatasetHelper
- >>>
- >>>train_dataset = create_custom_dataset()
- >>># config dynamic shape
- >>>dataset.set_dynamic_columns(columns={"data1": [16, None, 83], "data2": [None]})
- >>>dataset_helper = DatasetHelper(train_dataset, dataset_sink_mode=True)
- >>>
- >>>min_shapes, max_shapes = dataset_helper.dynamic_min_max_shapes()
-
-
- .. py:method:: get_data_info()
-
- ³ģʽ£ȡǰݵͺ״(shape)ͨ״(shape)̬仯ijʹá
-
- ****
-
- >>> from mindspore import DatasetHelper
- >>>
- >>> train_dataset = create_custom_dataset()
- >>> dataset_helper = DatasetHelper(train_dataset, dataset_sink_mode=True)
- >>>
- >>> types, shapes = dataset_helper.get_data_info()
-
- .. py:method:: release()
-
- ͷ³Դ
-
- .. py:method:: sink_size()
-
- ȡÿε `sink_size`
-
- ****
-
- >>>from mindspore import DatasetHelper
- >>>
- >>>train_dataset = create_custom_dataset()
- >>>dataset_helper = DatasetHelper(train_dataset, dataset_sink_mode=True, sink_size=-1)
- >>>
- >>># if sink_size==-1, then will return the full size of source dataset.
- >>>sink_size = dataset_helper.sink_size()
-
- .. py:method:: stop_send()
-
- ֹͣ³ݡ
-
- .. py:method:: types_shapes()
-
- ӵǰеݼȡͺ״(shape)
-
- ****
-
- >>>from mindspore import DatasetHelper
- >>>
- >>>train_dataset = create_custom_dataset()
- >>>dataset_helper = DatasetHelper(train_dataset, dataset_sink_mode=True)
- >>>
- >>>types, shapes = dataset_helper.types_shapes()
|