[Feature] Support CAE full checkpoint

[TinnyFlames]

What is the problem this feature will solve?

Adding full checkpoints will help users to pretrain the new datasets without expensive computational costs. It will make the model easier to adopt and use.

What is the feature?

Full checkpoint of CAE model including encoder and decoder

What alternatives have you considered?

No response

[fangyixiao18]

Hi, Thanks for your advice.
We have provided the full checkpoint in 1.x branch, here is the model zoo link: https://mmselfsup.readthedocs.io/en/dev-1.x/model_zoo.html, you could download the CAE pre-train model.

[TinnyFlames]

Hi, Thanks for your advice. We have provided the full checkpoint in 1.x branch, here is the model zoo link: https://mmselfsup.readthedocs.io/en/dev-1.x/model_zoo.html, you could download the CAE pre-train model.

@fangyixiao18 Hi! Thanks for your reply. I can't find the full pre-train model in the given link. And the given pre-train model seems to have different parameter names and the parameters are incomplete. Here is the log :

unexpected key in source state_dict: cls_token, pos_embed, patch_embed.projection.weight, patch_embed.projection.bias, layers.0.gamma_1, layers.0.gamma_2, layers.0.ln1.weight, layers.0.ln1.bias, layers.0.attn.q_bias, layers.0.attn.v_bias, layers.0.attn.qkv.weight, layers.0.attn.proj.weight, layers.0.attn.proj.bias, layers.0.ln2.weight, layers.0.ln2.bias, layers.0.ffn.layers.0.0.weight, layers.0.ffn.layers.0.0.bias, layers.0.ffn.layers.1.weight, layers.0.ffn.layers.1.bias, layers.1.gamma_1, layers.1.gamma_2, layers.1.ln1.weight, layers.1.ln1.bias, layers.1.attn.q_bias, layers.1.attn.v_bias, layers.1.attn.qkv.weight, layers.1.attn.proj.weight, layers.1.attn.proj.bias, layers.1.ln2.weight, layers.1.ln2.bias, layers.1.ffn.layers.0.0.weight, layers.1.ffn.layers.0.0.bias, layers.1.ffn.layers.1.weight, layers.1.ffn.layers.1.bias, layers.2.gamma_1, layers.2.gamma_2, layers.2.ln1.weight, layers.2.ln1.bias, layers.2.attn.q_bias, layers.2.attn.v_bias, layers.2.attn.qkv.weight, layers.2.attn.proj.weight, layers.2.attn.proj.bias, layers.2.ln2.weight, layers.2.ln2.bias, layers.2.ffn.layers.0.0.weight, layers.2.ffn.layers.0.0.bias, layers.2.ffn.layers.1.weight, layers.2.ffn.layers.1.bias, layers.3.gamma_1, layers.3.gamma_2, layers.3.ln1.weight, layers.3.ln1.bias, layers.3.attn.q_bias, layers.3.attn.v_bias, layers.3.attn.qkv.weight, layers.3.attn.proj.weight, layers.3.attn.proj.bias, layers.3.ln2.weight, layers.3.ln2.bias, layers.3.ffn.layers.0.0.weight, layers.3.ffn.layers.0.0.bias, layers.3.ffn.layers.1.weight, layers.3.ffn.layers.1.bias, layers.4.gamma_1, layers.4.gamma_2, layers.4.ln1.weight, layers.4.ln1.bias, layers.4.attn.q_bias, layers.4.attn.v_bias, layers.4.attn.qkv.weight, layers.4.attn.proj.weight, layers.4.attn.proj.bias, layers.4.ln2.weight, layers.4.ln2.bias, layers.4.ffn.layers.0.0.weight, layers.4.ffn.layers.0.0.bias, layers.4.ffn.layers.1.weight, layers.4.ffn.layers.1.bias, layers.5.gamma_1, layers.5.gamma_2, layers.5.ln1.weight, layers.5.ln1.bias, layers.5.attn.q_bias, layers.5.attn.v_bias, layers.5.attn.qkv.weight, layers.5.attn.proj.weight, layers.5.attn.proj.bias, layers.5.ln2.weight, layers.5.ln2.bias, layers.5.ffn.layers.0.0.weight, layers.5.ffn.layers.0.0.bias, layers.5.ffn.layers.1.weight, layers.5.ffn.layers.1.bias, layers.6.gamma_1, layers.6.gamma_2, layers.6.ln1.weight, layers.6.ln1.bias, layers.6.attn.q_bias, layers.6.attn.v_bias, layers.6.attn.qkv.weight, layers.6.attn.proj.weight, layers.6.attn.proj.bias, layers.6.ln2.weight, layers.6.ln2.bias, layers.6.ffn.layers.0.0.weight, layers.6.ffn.layers.0.0.bias, layers.6.ffn.layers.1.weight, layers.6.ffn.layers.1.bias, layers.7.gamma_1, layers.7.gamma_2, layers.7.ln1.weight, layers.7.ln1.bias, layers.7.attn.q_bias, layers.7.attn.v_bias, layers.7.attn.qkv.weight, layers.7.attn.proj.weight, layers.7.attn.proj.bias, layers.7.ln2.weight, layers.7.ln2.bias, layers.7.ffn.layers.0.0.weight, layers.7.ffn.layers.0.0.bias, layers.7.ffn.layers.1.weight, layers.7.ffn.layers.1.bias, layers.8.gamma_1, layers.8.gamma_2, layers.8.ln1.weight, layers.8.ln1.bias, layers.8.attn.q_bias, layers.8.attn.v_bias, layers.8.attn.qkv.weight, layers.8.attn.proj.weight, layers.8.attn.proj.bias, layers.8.ln2.weight, layers.8.ln2.bias, layers.8.ffn.layers.0.0.weight, layers.8.ffn.layers.0.0.bias, layers.8.ffn.layers.1.weight, layers.8.ffn.layers.1.bias, layers.9.gamma_1, layers.9.gamma_2, layers.9.ln1.weight, layers.9.ln1.bias, layers.9.attn.q_bias, layers.9.attn.v_bias, layers.9.attn.qkv.weight, layers.9.attn.proj.weight, layers.9.attn.proj.bias, layers.9.ln2.weight, layers.9.ln2.bias, layers.9.ffn.layers.0.0.weight, layers.9.ffn.layers.0.0.bias, layers.9.ffn.layers.1.weight, layers.9.ffn.layers.1.bias, layers.10.gamma_1, layers.10.gamma_2, layers.10.ln1.weight, layers.10.ln1.bias, layers.10.attn.q_bias, layers.10.attn.v_bias, layers.10.attn.qkv.weight, layers.10.attn.proj.weight, layers.10.attn.proj.bias, layers.10.ln2.weight, layers.10.ln2.bias, layers.10.ffn.layers.0.0.weight, layers.10.ffn.layers.0.0.bias, layers.10.ffn.layers.1.weight, layers.10.ffn.layers.1.bias, layers.11.gamma_1, layers.11.gamma_2, layers.11.ln1.weight, layers.11.ln1.bias, layers.11.attn.q_bias, layers.11.attn.v_bias, layers.11.attn.qkv.weight, layers.11.attn.proj.weight, layers.11.attn.proj.bias, layers.11.ln2.weight, layers.11.ln2.bias, layers.11.ffn.layers.0.0.weight, layers.11.ffn.layers.0.0.bias, layers.11.ffn.layers.1.weight, layers.11.ffn.layers.1.bias, ln1.weight, ln1.bias

missing keys in source state_dict: backbone.cls_token, backbone.pos_embed, backbone.patch_embed.projection.weight, backbone.patch_embed.projection.bias, backbone.layers.0.gamma_1, backbone.layers.0.gamma_2, backbone.layers.0.ln1.weight, backbone.layers.0.ln1.bias, backbone.layers.0.attn.q_bias, backbone.layers.0.attn.v_bias, backbone.layers.0.attn.qkv.weight, backbone.layers.0.attn.proj.weight, backbone.layers.0.attn.proj.bias, backbone.layers.0.ln2.weight, backbone.layers.0.ln2.bias, backbone.layers.0.ffn.layers.0.0.weight, backbone.layers.0.ffn.layers.0.0.bias, backbone.layers.0.ffn.layers.1.weight, backbone.layers.0.ffn.layers.1.bias, backbone.layers.1.gamma_1, backbone.layers.1.gamma_2, backbone.layers.1.ln1.weight, backbone.layers.1.ln1.bias, backbone.layers.1.attn.q_bias, backbone.layers.1.attn.v_bias, backbone.layers.1.attn.qkv.weight, backbone.layers.1.attn.proj.weight, backbone.layers.1.attn.proj.bias, backbone.layers.1.ln2.weight, backbone.layers.1.ln2.bias, backbone.layers.1.ffn.layers.0.0.weight, backbone.layers.1.ffn.layers.0.0.bias, backbone.layers.1.ffn.layers.1.weight, backbone.layers.1.ffn.layers.1.bias, backbone.layers.2.gamma_1, backbone.layers.2.gamma_2, backbone.layers.2.ln1.weight, backbone.layers.2.ln1.bias, backbone.layers.2.attn.q_bias, backbone.layers.2.attn.v_bias, backbone.layers.2.attn.qkv.weight, backbone.layers.2.attn.proj.weight, backbone.layers.2.attn.proj.bias, backbone.layers.2.ln2.weight, backbone.layers.2.ln2.bias, backbone.layers.2.ffn.layers.0.0.weight, backbone.layers.2.ffn.layers.0.0.bias, backbone.layers.2.ffn.layers.1.weight, backbone.layers.2.ffn.layers.1.bias, backbone.layers.3.gamma_1, backbone.layers.3.gamma_2, backbone.layers.3.ln1.weight, backbone.layers.3.ln1.bias, backbone.layers.3.attn.q_bias, backbone.layers.3.attn.v_bias, backbone.layers.3.attn.qkv.weight, backbone.layers.3.attn.proj.weight, backbone.layers.3.attn.proj.bias, backbone.layers.3.ln2.weight, backbone.layers.3.ln2.bias, backbone.layers.3.ffn.layers.0.0.weight, backbone.layers.3.ffn.layers.0.0.bias, backbone.layers.3.ffn.layers.1.weight, backbone.layers.3.ffn.layers.1.bias, backbone.layers.4.gamma_1, backbone.layers.4.gamma_2, backbone.layers.4.ln1.weight, backbone.layers.4.ln1.bias, backbone.layers.4.attn.q_bias, backbone.layers.4.attn.v_bias, backbone.layers.4.attn.qkv.weight, backbone.layers.4.attn.proj.weight, backbone.layers.4.attn.proj.bias, backbone.layers.4.ln2.weight, backbone.layers.4.ln2.bias, backbone.layers.4.ffn.layers.0.0.weight, backbone.layers.4.ffn.layers.0.0.bias, backbone.layers.4.ffn.layers.1.weight, backbone.layers.4.ffn.layers.1.bias, backbone.layers.5.gamma_1, backbone.layers.5.gamma_2, backbone.layers.5.ln1.weight, backbone.layers.5.ln1.bias, backbone.layers.5.attn.q_bias, backbone.layers.5.attn.v_bias, backbone.layers.5.attn.qkv.weight, backbone.layers.5.attn.proj.weight, backbone.layers.5.attn.proj.bias, backbone.layers.5.ln2.weight, backbone.layers.5.ln2.bias, backbone.layers.5.ffn.layers.0.0.weight, backbone.layers.5.ffn.layers.0.0.bias, backbone.layers.5.ffn.layers.1.weight, backbone.layers.5.ffn.layers.1.bias, backbone.layers.6.gamma_1, backbone.layers.6.gamma_2, backbone.layers.6.ln1.weight, backbone.layers.6.ln1.bias, backbone.layers.6.attn.q_bias, backbone.layers.6.attn.v_bias, backbone.layers.6.attn.qkv.weight, backbone.layers.6.attn.proj.weight, backbone.layers.6.attn.proj.bias, backbone.layers.6.ln2.weight, backbone.layers.6.ln2.bias, backbone.layers.6.ffn.layers.0.0.weight, backbone.layers.6.ffn.layers.0.0.bias, backbone.layers.6.ffn.layers.1.weight, backbone.layers.6.ffn.layers.1.bias, backbone.layers.7.gamma_1, backbone.layers.7.gamma_2, backbone.layers.7.ln1.weight, backbone.layers.7.ln1.bias, backbone.layers.7.attn.q_bias, backbone.layers.7.attn.v_bias, backbone.layers.7.attn.qkv.weight, backbone.layers.7.attn.proj.weight, backbone.layers.7.attn.proj.bias, backbone.layers.7.ln2.weight, backbone.layers.7.ln2.bias, backbone.layers.7.ffn.layers.0.0.weight, backbone.layers.7.ffn.layers.0.0.bias, backbone.layers.7.ffn.layers.1.weight, backbone.layers.7.ffn.layers.1.bias, backbone.layers.8.gamma_1, backbone.layers.8.gamma_2, backbone.layers.8.ln1.weight, backbone.layers.8.ln1.bias, backbone.layers.8.attn.q_bias, backbone.layers.8.attn.v_bias, backbone.layers.8.attn.qkv.weight, backbone.layers.8.attn.proj.weight, backbone.layers.8.attn.proj.bias, backbone.layers.8.ln2.weight, backbone.layers.8.ln2.bias, backbone.layers.8.ffn.layers.0.0.weight, backbone.layers.8.ffn.layers.0.0.bias, backbone.layers.8.ffn.layers.1.weight, backbone.layers.8.ffn.layers.1.bias, backbone.layers.9.gamma_1, backbone.layers.9.gamma_2, backbone.layers.9.ln1.weight, backbone.layers.9.ln1.bias, backbone.layers.9.attn.q_bias, backbone.layers.9.attn.v_bias, backbone.layers.9.attn.qkv.weight, backbone.layers.9.attn.proj.weight, backbone.layers.9.attn.proj.bias, backbone.layers.9.ln2.weight, backbone.layers.9.ln2.bias, backbone.layers.9.ffn.layers.0.0.weight, backbone.layers.9.ffn.layers.0.0.bias, backbone.layers.9.ffn.layers.1.weight, backbone.layers.9.ffn.layers.1.bias, backbone.layers.10.gamma_1, backbone.layers.10.gamma_2, backbone.layers.10.ln1.weight, backbone.layers.10.ln1.bias, backbone.layers.10.attn.q_bias, backbone.layers.10.attn.v_bias, backbone.layers.10.attn.qkv.weight, backbone.layers.10.attn.proj.weight, backbone.layers.10.attn.proj.bias, backbone.layers.10.ln2.weight, backbone.layers.10.ln2.bias, backbone.layers.10.ffn.layers.0.0.weight, backbone.layers.10.ffn.layers.0.0.bias, backbone.layers.10.ffn.layers.1.weight, backbone.layers.10.ffn.layers.1.bias, backbone.layers.11.gamma_1, backbone.layers.11.gamma_2, backbone.layers.11.ln1.weight, backbone.layers.11.ln1.bias, backbone.layers.11.attn.q_bias, backbone.layers.11.attn.v_bias, backbone.layers.11.attn.qkv.weight, backbone.layers.11.attn.proj.weight, backbone.layers.11.attn.proj.bias, backbone.layers.11.ln2.weight, backbone.layers.11.ln2.bias, backbone.layers.11.ffn.layers.0.0.weight, backbone.layers.11.ffn.layers.0.0.bias, backbone.layers.11.ffn.layers.1.weight, backbone.layers.11.ffn.layers.1.bias, backbone.ln1.weight, backbone.ln1.bias, teacher.cls_token, teacher.pos_embed, teacher.patch_embed.projection.weight, teacher.patch_embed.projection.bias, teacher.layers.0.gamma_1, teacher.layers.0.gamma_2, teacher.layers.0.ln1.weight, teacher.layers.0.ln1.bias, teacher.layers.0.attn.q_bias, teacher.layers.0.attn.v_bias, teacher.layers.0.attn.qkv.weight, teacher.layers.0.attn.proj.weight, teacher.layers.0.attn.proj.bias, teacher.layers.0.ln2.weight, teacher.layers.0.ln2.bias, teacher.layers.0.ffn.layers.0.0.weight, teacher.layers.0.ffn.layers.0.0.bias, teacher.layers.0.ffn.layers.1.weight, teacher.layers.0.ffn.layers.1.bias, teacher.layers.1.gamma_1, teacher.layers.1.gamma_2, teacher.layers.1.ln1.weight, teacher.layers.1.ln1.bias, teacher.layers.1.attn.q_bias, teacher.layers.1.attn.v_bias, teacher.layers.1.attn.qkv.weight, teacher.layers.1.attn.proj.weight, teacher.layers.1.attn.proj.bias, teacher.layers.1.ln2.weight, teacher.layers.1.ln2.bias, teacher.layers.1.ffn.layers.0.0.weight, teacher.layers.1.ffn.layers.0.0.bias, teacher.layers.1.ffn.layers.1.weight, teacher.layers.1.ffn.layers.1.bias, teacher.layers.2.gamma_1, teacher.layers.2.gamma_2, teacher.layers.2.ln1.weight, teacher.layers.2.ln1.bias, teacher.layers.2.attn.q_bias, teacher.layers.2.attn.v_bias, teacher.layers.2.attn.qkv.weight, teacher.layers.2.attn.proj.weight, teacher.layers.2.attn.proj.bias, teacher.layers.2.ln2.weight, teacher.layers.2.ln2.bias, teacher.layers.2.ffn.layers.0.0.weight, teacher.layers.2.ffn.layers.0.0.bias, teacher.layers.2.ffn.layers.1.weight, teacher.layers.2.ffn.layers.1.bias, teacher.layers.3.gamma_1, teacher.layers.3.gamma_2, teacher.layers.3.ln1.weight, teacher.layers.3.ln1.bias, teacher.layers.3.attn.q_bias, teacher.layers.3.attn.v_bias, teacher.layers.3.attn.qkv.weight, teacher.layers.3.attn.proj.weight, teacher.layers.3.attn.proj.bias, teacher.layers.3.ln2.weight, teacher.layers.3.ln2.bias, teacher.layers.3.ffn.layers.0.0.weight, teacher.layers.3.ffn.layers.0.0.bias, teacher.layers.3.ffn.layers.1.weight, teacher.layers.3.ffn.layers.1.bias, teacher.layers.4.gamma_1, teacher.layers.4.gamma_2, teacher.layers.4.ln1.weight, teacher.layers.4.ln1.bias, teacher.layers.4.attn.q_bias, teacher.layers.4.attn.v_bias, teacher.layers.4.attn.qkv.weight, teacher.layers.4.attn.proj.weight, teacher.layers.4.attn.proj.bias, teacher.layers.4.ln2.weight, teacher.layers.4.ln2.bias, teacher.layers.4.ffn.layers.0.0.weight, teacher.layers.4.ffn.layers.0.0.bias, teacher.layers.4.ffn.layers.1.weight, teacher.layers.4.ffn.layers.1.bias, teacher.layers.5.gamma_1, teacher.layers.5.gamma_2, teacher.layers.5.ln1.weight, teacher.layers.5.ln1.bias, teacher.layers.5.attn.q_bias, teacher.layers.5.attn.v_bias, teacher.layers.5.attn.qkv.weight, teacher.layers.5.attn.proj.weight, teacher.layers.5.attn.proj.bias, teacher.layers.5.ln2.weight, teacher.layers.5.ln2.bias, teacher.layers.5.ffn.layers.0.0.weight, teacher.layers.5.ffn.layers.0.0.bias, teacher.layers.5.ffn.layers.1.weight, teacher.layers.5.ffn.layers.1.bias, teacher.layers.6.gamma_1, teacher.layers.6.gamma_2, teacher.layers.6.ln1.weight, teacher.layers.6.ln1.bias, teacher.layers.6.attn.q_bias, teacher.layers.6.attn.v_bias, teacher.layers.6.attn.qkv.weight, teacher.layers.6.attn.proj.weight, teacher.layers.6.attn.proj.bias, teacher.layers.6.ln2.weight, teacher.layers.6.ln2.bias, teacher.layers.6.ffn.layers.0.0.weight, teacher.layers.6.ffn.layers.0.0.bias, teacher.layers.6.ffn.layers.1.weight, teacher.layers.6.ffn.layers.1.bias, teacher.layers.7.gamma_1, teacher.layers.7.gamma_2, teacher.layers.7.ln1.weight, teacher.layers.7.ln1.bias, teacher.layers.7.attn.q_bias, teacher.layers.7.attn.v_bias, teacher.layers.7.attn.qkv.weight, teacher.layers.7.attn.proj.weight, teacher.layers.7.attn.proj.bias, teacher.layers.7.ln2.weight, teacher.layers.7.ln2.bias, teacher.layers.7.ffn.layers.0.0.weight, teacher.layers.7.ffn.layers.0.0.bias, teacher.layers.7.ffn.layers.1.weight, teacher.layers.7.ffn.layers.1.bias, teacher.layers.8.gamma_1, teacher.layers.8.gamma_2, teacher.layers.8.ln1.weight, teacher.layers.8.ln1.bias, teacher.layers.8.attn.q_bias, teacher.layers.8.attn.v_bias, teacher.layers.8.attn.qkv.weight, teacher.layers.8.attn.proj.weight, teacher.layers.8.attn.proj.bias, teacher.layers.8.ln2.weight, teacher.layers.8.ln2.bias, teacher.layers.8.ffn.layers.0.0.weight, teacher.layers.8.ffn.layers.0.0.bias, teacher.layers.8.ffn.layers.1.weight, teacher.layers.8.ffn.layers.1.bias, teacher.layers.9.gamma_1, teacher.layers.9.gamma_2, teacher.layers.9.ln1.weight, teacher.layers.9.ln1.bias, teacher.layers.9.attn.q_bias, teacher.layers.9.attn.v_bias, teacher.layers.9.attn.qkv.weight, teacher.layers.9.attn.proj.weight, teacher.layers.9.attn.proj.bias, teacher.layers.9.ln2.weight, teacher.layers.9.ln2.bias, teacher.layers.9.ffn.layers.0.0.weight, teacher.layers.9.ffn.layers.0.0.bias, teacher.layers.9.ffn.layers.1.weight, teacher.layers.9.ffn.layers.1.bias, teacher.layers.10.gamma_1, teacher.layers.10.gamma_2, teacher.layers.10.ln1.weight, teacher.layers.10.ln1.bias, teacher.layers.10.attn.q_bias, teacher.layers.10.attn.v_bias, teacher.layers.10.attn.qkv.weight, teacher.layers.10.attn.proj.weight, teacher.layers.10.attn.proj.bias, teacher.layers.10.ln2.weight, teacher.layers.10.ln2.bias, teacher.layers.10.ffn.layers.0.0.weight, teacher.layers.10.ffn.layers.0.0.bias, teacher.layers.10.ffn.layers.1.weight, teacher.layers.10.ffn.layers.1.bias, teacher.layers.11.gamma_1, teacher.layers.11.gamma_2, teacher.layers.11.ln1.weight, teacher.layers.11.ln1.bias, teacher.layers.11.attn.q_bias, teacher.layers.11.attn.v_bias, teacher.layers.11.attn.qkv.weight, teacher.layers.11.attn.proj.weight, teacher.layers.11.attn.proj.bias, teacher.layers.11.ln2.weight, teacher.layers.11.ln2.bias, teacher.layers.11.ffn.layers.0.0.weight, teacher.layers.11.ffn.layers.0.0.bias, teacher.layers.11.ffn.layers.1.weight, teacher.layers.11.ffn.layers.1.bias, teacher.ln1.weight, teacher.ln1.bias, neck.mask_token, neck.regressors.0.gamma_1_cross, neck.regressors.0.gamma_2_cross, neck.regressors.0.norm1_q_cross.weight, neck.regressors.0.norm1_q_cross.bias, neck.regressors.0.norm1_k_cross.weight, neck.regressors.0.norm1_k_cross.bias, neck.regressors.0.norm1_v_cross.weight, neck.regressors.0.norm1_v_cross.bias, neck.regressors.0.norm2_cross.weight, neck.regressors.0.norm2_cross.bias, neck.regressors.0.cross_attn.q_bias, neck.regressors.0.cross_attn.v_bias, neck.regressors.0.cross_attn.q.weight, neck.regressors.0.cross_attn.k.weight, neck.regressors.0.cross_attn.v.weight, neck.regressors.0.cross_attn.proj.weight, neck.regressors.0.cross_attn.proj.bias, neck.regressors.0.ffn.layers.0.0.weight, neck.regressors.0.ffn.layers.0.0.bias, neck.regressors.0.ffn.layers.1.weight, neck.regressors.0.ffn.layers.1.bias, neck.regressors.1.gamma_1_cross, neck.regressors.1.gamma_2_cross, neck.regressors.1.norm1_q_cross.weight, neck.regressors.1.norm1_q_cross.bias, neck.regressors.1.norm1_k_cross.weight, neck.regressors.1.norm1_k_cross.bias, neck.regressors.1.norm1_v_cross.weight, neck.regressors.1.norm1_v_cross.bias, neck.regressors.1.norm2_cross.weight, neck.regressors.1.norm2_cross.bias, neck.regressors.1.cross_attn.q_bias, neck.regressors.1.cross_attn.v_bias, neck.regressors.1.cross_attn.q.weight, neck.regressors.1.cross_attn.k.weight, neck.regressors.1.cross_attn.v.weight, neck.regressors.1.cross_attn.proj.weight, neck.regressors.1.cross_attn.proj.bias, neck.regressors.1.ffn.layers.0.0.weight, neck.regressors.1.ffn.layers.0.0.bias, neck.regressors.1.ffn.layers.1.weight, neck.regressors.1.ffn.layers.1.bias, neck.regressors.2.gamma_1_cross, neck.regressors.2.gamma_2_cross, neck.regressors.2.norm1_q_cross.weight, neck.regressors.2.norm1_q_cross.bias, neck.regressors.2.norm1_k_cross.weight, neck.regressors.2.norm1_k_cross.bias, neck.regressors.2.norm1_v_cross.weight, neck.regressors.2.norm1_v_cross.bias, neck.regressors.2.norm2_cross.weight, neck.regressors.2.norm2_cross.bias, neck.regressors.2.cross_attn.q_bias, neck.regressors.2.cross_attn.v_bias, neck.regressors.2.cross_attn.q.weight, neck.regressors.2.cross_attn.k.weight, neck.regressors.2.cross_attn.v.weight, neck.regressors.2.cross_attn.proj.weight, neck.regressors.2.cross_attn.proj.bias, neck.regressors.2.ffn.layers.0.0.weight, neck.regressors.2.ffn.layers.0.0.bias, neck.regressors.2.ffn.layers.1.weight, neck.regressors.2.ffn.layers.1.bias, neck.regressors.3.gamma_1_cross, neck.regressors.3.gamma_2_cross, neck.regressors.3.norm1_q_cross.weight, neck.regressors.3.norm1_q_cross.bias, neck.regressors.3.norm1_k_cross.weight, neck.regressors.3.norm1_k_cross.bias, neck.regressors.3.norm1_v_cross.weight, neck.regressors.3.norm1_v_cross.bias, neck.regressors.3.norm2_cross.weight, neck.regressors.3.norm2_cross.bias, neck.regressors.3.cross_attn.q_bias, neck.regressors.3.cross_attn.v_bias, neck.regressors.3.cross_attn.q.weight, neck.regressors.3.cross_attn.k.weight, neck.regressors.3.cross_attn.v.weight, neck.regressors.3.cross_attn.proj.weight, neck.regressors.3.cross_attn.proj.bias, neck.regressors.3.ffn.layers.0.0.weight, neck.regressors.3.ffn.layers.0.0.bias, neck.regressors.3.ffn.layers.1.weight, neck.regressors.3.ffn.layers.1.bias, neck.decoders.0.gamma_1, neck.decoders.0.gamma_2, neck.decoders.0.ln1.weight, neck.decoders.0.ln1.bias, neck.decoders.0.attn.qkv.weight, neck.decoders.0.attn.qkv.bias, neck.decoders.0.attn.proj.weight, neck.decoders.0.attn.proj.bias, neck.decoders.0.ln2.weight, neck.decoders.0.ln2.bias, neck.decoders.0.ffn.layers.0.0.weight, neck.decoders.0.ffn.layers.0.0.bias, neck.decoders.0.ffn.layers.1.weight, neck.decoders.0.ffn.layers.1.bias, neck.decoders.1.gamma_1, neck.decoders.1.gamma_2, neck.decoders.1.ln1.weight, neck.decoders.1.ln1.bias, neck.decoders.1.attn.qkv.weight, neck.decoders.1.attn.qkv.bias, neck.decoders.1.attn.proj.weight, neck.decoders.1.attn.proj.bias, neck.decoders.1.ln2.weight, neck.decoders.1.ln2.bias, neck.decoders.1.ffn.layers.0.0.weight, neck.decoders.1.ffn.layers.0.0.bias, neck.decoders.1.ffn.layers.1.weight, neck.decoders.1.ffn.layers.1.bias, neck.decoders.2.gamma_1, neck.decoders.2.gamma_2, neck.decoders.2.ln1.weight, neck.decoders.2.ln1.bias, neck.decoders.2.attn.qkv.weight, neck.decoders.2.attn.qkv.bias, neck.decoders.2.attn.proj.weight, neck.decoders.2.attn.proj.bias, neck.decoders.2.ln2.weight, neck.decoders.2.ln2.bias, neck.decoders.2.ffn.layers.0.0.weight, neck.decoders.2.ffn.layers.0.0.bias, neck.decoders.2.ffn.layers.1.weight, neck.decoders.2.ffn.layers.1.bias, neck.decoders.3.gamma_1, neck.decoders.3.gamma_2, neck.decoders.3.ln1.weight, neck.decoders.3.ln1.bias, neck.decoders.3.attn.qkv.weight, neck.decoders.3.attn.qkv.bias, neck.decoders.3.attn.proj.weight, neck.decoders.3.attn.proj.bias, neck.decoders.3.ln2.weight, neck.decoders.3.ln2.bias, neck.decoders.3.ffn.layers.0.0.weight, neck.decoders.3.ffn.layers.0.0.bias, neck.decoders.3.ffn.layers.1.weight, neck.decoders.3.ffn.layers.1.bias, neck.norm_regressor.weight, neck.norm_regressor.bias, neck.norm_decoder.weight, neck.norm_decoder.bias, neck.head.weight, neck.head.bias, head.encoder.blocks.input.w, head.encoder.blocks.input.b, head.encoder.blocks.group_1.block_1.res_path.conv_1.w, head.encoder.blocks.group_1.block_1.res_path.conv_1.b, head.encoder.blocks.group_1.block_1.res_path.conv_2.w, head.encoder.blocks.group_1.block_1.res_path.conv_2.b, head.encoder.blocks.group_1.block_1.res_path.conv_3.w, head.encoder.blocks.group_1.block_1.res_path.conv_3.b, head.encoder.blocks.group_1.block_1.res_path.conv_4.w, head.encoder.blocks.group_1.block_1.res_path.conv_4.b, head.encoder.blocks.group_1.block_2.res_path.conv_1.w, head.encoder.blocks.group_1.block_2.res_path.conv_1.b, head.encoder.blocks.group_1.block_2.res_path.conv_2.w, head.encoder.blocks.group_1.block_2.res_path.conv_2.b, head.encoder.blocks.group_1.block_2.res_path.conv_3.w, head.encoder.blocks.group_1.block_2.res_path.conv_3.b, head.encoder.blocks.group_1.block_2.res_path.conv_4.w, head.encoder.blocks.group_1.block_2.res_path.conv_4.b, head.encoder.blocks.group_2.block_1.id_path.w, head.encoder.blocks.group_2.block_1.id_path.b, head.encoder.blocks.group_2.block_1.res_path.conv_1.w, head.encoder.blocks.group_2.block_1.res_path.conv_1.b, head.encoder.blocks.group_2.block_1.res_path.conv_2.w, head.encoder.blocks.group_2.block_1.res_path.conv_2.b, head.encoder.blocks.group_2.block_1.res_path.conv_3.w, head.encoder.blocks.group_2.block_1.res_path.conv_3.b, head.encoder.blocks.group_2.block_1.res_path.conv_4.w, head.encoder.blocks.group_2.block_1.res_path.conv_4.b, head.encoder.blocks.group_2.block_2.res_path.conv_1.w, head.encoder.blocks.group_2.block_2.res_path.conv_1.b, head.encoder.blocks.group_2.block_2.res_path.conv_2.w, head.encoder.blocks.group_2.block_2.res_path.conv_2.b, head.encoder.blocks.group_2.block_2.res_path.conv_3.w, head.encoder.blocks.group_2.block_2.res_path.conv_3.b, head.encoder.blocks.group_2.block_2.res_path.conv_4.w, head.encoder.blocks.group_2.block_2.res_path.conv_4.b, head.encoder.blocks.group_3.block_1.id_path.w, head.encoder.blocks.group_3.block_1.id_path.b, head.encoder.blocks.group_3.block_1.res_path.conv_1.w, head.encoder.blocks.group_3.block_1.res_path.conv_1.b, head.encoder.blocks.group_3.block_1.res_path.conv_2.w, head.encoder.blocks.group_3.block_1.res_path.conv_2.b, head.encoder.blocks.group_3.block_1.res_path.conv_3.w, head.encoder.blocks.group_3.block_1.res_path.conv_3.b, head.encoder.blocks.group_3.block_1.res_path.conv_4.w, head.encoder.blocks.group_3.block_1.res_path.conv_4.b, head.encoder.blocks.group_3.block_2.res_path.conv_1.w, head.encoder.blocks.group_3.block_2.res_path.conv_1.b, head.encoder.blocks.group_3.block_2.res_path.conv_2.w, head.encoder.blocks.group_3.block_2.res_path.conv_2.b, head.encoder.blocks.group_3.block_2.res_path.conv_3.w, head.encoder.blocks.group_3.block_2.res_path.conv_3.b, head.encoder.blocks.group_3.block_2.res_path.conv_4.w, head.encoder.blocks.group_3.block_2.res_path.conv_4.b, head.encoder.blocks.group_4.block_1.id_path.w, head.encoder.blocks.group_4.block_1.id_path.b, head.encoder.blocks.group_4.block_1.res_path.conv_1.w, head.encoder.blocks.group_4.block_1.res_path.conv_1.b, head.encoder.blocks.group_4.block_1.res_path.conv_2.w, head.encoder.blocks.group_4.block_1.res_path.conv_2.b, head.encoder.blocks.group_4.block_1.res_path.conv_3.w, head.encoder.blocks.group_4.block_1.res_path.conv_3.b, head.encoder.blocks.group_4.block_1.res_path.conv_4.w, head.encoder.blocks.group_4.block_1.res_path.conv_4.b, head.encoder.blocks.group_4.block_2.res_path.conv_1.w, head.encoder.blocks.group_4.block_2.res_path.conv_1.b, head.encoder.blocks.group_4.block_2.res_path.conv_2.w, head.encoder.blocks.group_4.block_2.res_path.conv_2.b, head.encoder.blocks.group_4.block_2.res_path.conv_3.w, head.encoder.blocks.group_4.block_2.res_path.conv_3.b, head.encoder.blocks.group_4.block_2.res_path.conv_4.w, head.encoder.blocks.group_4.block_2.res_path.conv_4.b, head.encoder.blocks.output.conv.w, head.encoder.blocks.output.conv.b

[YuanLiuuuuuu]

Hi, thank you for reporting this issue. This problem is mainly caused by the extra extracting process before we released this checkpoint. But here is a workaround for you: prepending each key in the checkpoint with backbone.. We will re-train the model and release the full checkpoint as soon as possible. You are also encouraged to re-train it.

[TinnyFlames]

Hi! @YuanLiuuuuuu . Thanks for your reply. The given checkpoint doesn't have parameters like neck.regressors. It seems that the only way is to re-train the whole model to get the whole parameters?

[YuanLiuuuuuu]

Yes, the only way is to re-train the whole model. Currently, we do not provide the ckpt, containing these weights for the neck.