split attention inputs from two into three Add input check and modify test case Fix check error and add check to transformer inputs add input check to the transformers