GitHub - octadion/dynamic-transformers: Implementation of Dynamic Transformers using Neural Ordinary Differential Equation and Policy Controlled Singular Value Modulation.

octadion / dynamic-transformers Public

Implementation of Dynamic Transformers using Neural Ordinary Differential Equation and Policy Controlled Singular Value Modulation.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 30 Commits
config		config
evaluation		evaluation
notebooks		notebooks
qkvflow		qkvflow
.gitignore		.gitignore
pyproject.toml		pyproject.toml
requirements.txt		requirements.txt

About

Implementation of Dynamic Transformers using Neural Ordinary Differential Equation and Policy Controlled Singular Value Modulation.

No releases published

No packages published