wangwei
/
community
Not watched
1
0
Fork 0
Code
Releases 0 Wiki Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
352 Commits
1 Branch
333 MB
1444 Download
 
 
 
 
 
 
Tree: 2106c9bc0f
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '2106c9bc0f'
${ noResults }
community/sigs/data
ms_yan 16694338f2 add document into sig/data 5 years ago
..
docs add document into sig/data 5 years ago
meetings add meeting 210414 5 years ago
README.md add document into sig/data 5 years ago

README.md

MindSpore Data Special Interest Group (SIG)

This is the working repo for the Data special interest group (SIG). This repo contains all the artifacts, materials, meeting notes and proposals regarding dataset - data processing and mindrecord - data format in MindSpore. Feedbacks and contributions are welcome.

  1. Data Processing: You can understand it as a Dataset, which is mainly responsible for reading the user's data into a Dataset, then performing related data enhancement operations (such as: resize, onehot, rotate, shuffle, batch ...), and finally provide the Dataset to the training process.
  2. Data Format: It can conveniently normalize the user's training data to a unified format (MindRecord). The specific operation steps are as follows: The user can easily convert the training data into MindRecord data by defining the training data schema and calling the Python API interface. The format is then read into a Dataset through MindDataset and provided to the training process.

SIG Leads

  • Liu Cunwei (Huawei)

Logistics

Discussion

Representative vedios

Main issue To be solved

Here we call for developer joining us to develop a better Dataset processing system, following is mainly issue in each season.

Comment in issue please if you have any quetions and for better communication.
Also you can find all the issue in gitee by filter with label comp/data

Meeting notes

Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

社区治理架构的内容详见governance.md，该提案处于初稿阶段，后期可能会在 技术指导委员会（TSC）的许可下进行刷新。除此之外，社区还提供了特别兴趣小组（SIG） 和工作组（Working Group）的资料介绍。

Markdown Python Jupyter Notebook Text Diff other