2. Add virutal assign add to the operator

slice recompute activation

Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface

Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports

adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports

This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line

split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers