mindspore2022

33059 Commits

18 Branches

584 MB

67 Download

Tree: b6035cf1a1

Commit Graph

Author	SHA1	Message	Date
linqingke	acde7febef	update pangu reshape and softmax performance. Add layer norm judge Fix layer norm name error Fix input tyoe check Fix ut test Add 3d supports	4 years ago
huanghui	ba66c0d491	add security isolate for save_graphs	4 years ago
Xiaoda Zhang	5613c0b974	add a moe implementation: 1) extend the Liner cell for including BatchMatMul implementation, in which the first dimension indicates the expert number; 2) implement a Switch (top1) router; 3) implement a MoE cell, which extends the FeedForward cell.	4 years ago

Author

SHA1

Message

Date

linqingke

acde7febef

update pangu reshape and softmax performance.

Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports

4 years ago

huanghui

ba66c0d491

add security isolate for save_graphs

4 years ago

Xiaoda Zhang

5613c0b974

add a moe implementation:

1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.

4 years ago

3 Commits (b6035cf1a135d130a3d2cc229ffe449bbef4294a)