Skip to content

Latest commit

 

History

History
35 lines (26 loc) · 849 Bytes

File metadata and controls

35 lines (26 loc) · 849 Bytes
library_name kenotron

Mamba

Modeling code for Mamba to use with Kénotron

🚀 Quickstart

pip install -r requirements.txt
# Run training
./examples/mamba/train_mamba.sh

mamba

https://wandb.ai/bouteille/test/reports/Mamba-loss--Vmlldzo2OTgwNDM5

Bug related to Kénotron

Encountered the following issue when ran train_mamba.sh:

causal_conv1d_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c1017SymbolicShapeMeta18init_is_contiguousEv

Solved this by doing: pip uninstall mamba-ssm pip install causal_conv1d==1.1.1 pip install mamba-ssm --no-cache-dir state-spaces/mamba#169

Credits

Credits to the following repositories from which the code was adapted: