Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

Support tied positional weights in transformers #2184

Open
stephenroller opened this issue Nov 19, 2019 · 1 comment
Open

Support tied positional weights in transformers #2184

stephenroller opened this issue Nov 19, 2019 · 1 comment
Labels
donotreap Avoid automatically marking as stale. Enhancement H1 2020 Tasks to be completed in H1 2020 Help Wanted Medium
Milestone
H1 2020

Comments

@stephenroller
Copy link
Contributor

Add a flag to use tied positional embeddings in transformer/generator and transformer/retrieval, and implement the tied weights. Should be False by default for backwards compatibility, and upgrade_opt should be used to migrate old models.
@stephenroller stephenroller changed the title tied positional weights in transformer Support tied positional weights in transformers Nov 19, 2019
@stephenroller stephenroller added this to the H1 2020 milestone Nov 19, 2019
@stephenroller stephenroller added the H1 2020 Tasks to be completed in H1 2020 label Nov 25, 2019
@stephenroller stephenroller mentioned this issue Dec 20, 2019
Closed
@github-actions
Copy link

github-actions bot commented Jun 2, 2020

This issue has not had activity in 30 days. Marking as stale.

@github-actions github-actions bot closed this as completed Jun 2, 2020
@stephenroller stephenroller added donotreap Avoid automatically marking as stale. and removed stale-issue labels Jun 2, 2020
@stephenroller stephenroller reopened this Jun 2, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
donotreap Avoid automatically marking as stale. Enhancement H1 2020 Tasks to be completed in H1 2020 Help Wanted Medium
Projects
None yet
Milestone
H1 2020
Development

No branches or pull requests
2 participants
@stephenroller @klshuster