mindspore.nn.transformer
========================

.. note::
    Transformer Networks. This is an experimental interface that is subject to change or deletion.

.. include:: transformer/mindspore.nn.AttentionMask.rst
.. include:: transformer/mindspore.nn.VocabEmbedding.rst
.. include:: transformer/mindspore.nn.MultiHeadAttention.rst
.. include:: transformer/mindspore.nn.FeedForward.rst
.. include:: transformer/mindspore.nn.TransformerEncoder.rst
.. include:: transformer/mindspore.nn.TransformerDecoder.rst
.. include:: transformer/mindspore.nn.TransformerEncoderLayer.rst
.. include:: transformer/mindspore.nn.TransformerDecoderLayer.rst
.. include:: transformer/mindspore.nn.Transformer.rst
.. include:: transformer/mindspore.nn.TransformerOpParallelConfig.rst
.. include:: transformer/mindspore.nn.EmbeddingOpParallelConfig.rst
.. include:: transformer/mindspore.nn.CrossEntropyLoss.rst
.. include:: transformer/mindspore.nn.OpParallelConfig.rst
.. include:: transformer/mindspore.nn.FixedSparseAttention.rst
.. include:: transformer/mindspore.nn.MoEConfig.rst

.. automodule::  mindspore.nn.transformer
    :members: