DataCanvas/Alaya-7B-Base
432
1from torch import nn2FC_CLASS_REGISTRY = {'torch': nn.Linear}3try:4 import transformer_engine.pytorch as te5 FC_CLASS_REGISTRY['te'] = te.Linear6except:7 pass1from torch import nn2FC_CLASS_REGISTRY = {'torch': nn.Linear}3try:4 import transformer_engine.pytorch as te5 FC_CLASS_REGISTRY['te'] = te.Linear6except:7 pass