mindspore2022

31713 Commits

18 Branches

584 MB

240 Download

Tree: 1e15b00a31

Commit Graph

Author	SHA1	Message	Date
huanghui	ba66c0d491	add security isolate for save_graphs	4 years ago
Xiaoda Zhang	5613c0b974	add a moe implementation: 1) extend the Liner cell for including BatchMatMul implementation, in which the first dimension indicates the expert number; 2) implement a Switch (top1) router; 3) implement a MoE cell, which extends the FeedForward cell.	4 years ago

Author

SHA1

Message

Date

huanghui

ba66c0d491

add security isolate for save_graphs

4 years ago

Xiaoda Zhang

5613c0b974

add a moe implementation:

1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.

4 years ago

2 Commits (1e15b00a316cb6f6ea5fec95b7b3fb02fc234418)