mindspore2022

35763 Commits

18 Branches

584 MB

121 Download

Tree: 2cd17bfdc6

Commit Graph

Author	SHA1	Message	Date
linqingke	acde7febef	update pangu reshape and softmax performance. Add layer norm judge Fix layer norm name error Fix input tyoe check Fix ut test Add 3d supports	4 years ago
huanghui	ba66c0d491	add security isolate for save_graphs	4 years ago
Xiaoda Zhang	5613c0b974	add a moe implementation: 1) extend the Liner cell for including BatchMatMul implementation, in which the first dimension indicates the expert number; 2) implement a Switch (top1) router; 3) implement a MoE cell, which extends the FeedForward cell.	4 years ago

Author

SHA1

Message

Date

linqingke

acde7febef

update pangu reshape and softmax performance.

Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports

4 years ago

huanghui

ba66c0d491

add security isolate for save_graphs

4 years ago

Xiaoda Zhang

5613c0b974

add a moe implementation:

1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.

4 years ago

3 Commits (2cd17bfdc6c1948d0d64b313ed23e014becc717c)