TypeError: LayerNorm.__init__() got an unexpected keyword argument 'bias'

[Xuanfang1121]

When I run the demo code below I get an error，TypeError: LayerNorm.init() got an unexpected keyword argument 'bias'

from mamba_model import MambaModel
import torch

model = MambaModel.from_pretrained(pretrained_model_name="Zyphra/BlackMamba-2.8B")
model = model.cuda().half()
inputs = torch.tensor([1, 2]).cuda().long().unsqueeze(0)
out = model(inputs)

How to solve the above error？ I need your help

[yury-tokpanov]

This sounds like an environment configuration issue. Are you sure you installed everything correctly?

I've just followed our instructions in the fresh miniconda3 environment (in the container running Nvidia pytorch image: https://catalog.ngc.nvidia.com/orgs/nvidia/containers/pytorch), and it worked fine. Btw, in that container you don't actually need to install fresh Python environment, I just wanted to test if installing from scratch will work.

[zxx0809]

Hello, I also encountered this problem, may I ask you to solve it?