Skip to content

Add InternImage-H Results#64

Open
praeclarumjj3 wants to merge 10 commits intomainfrom
internimage
Open

Add InternImage-H Results#64
praeclarumjj3 wants to merge 10 commits intomainfrom
internimage

Conversation

@praeclarumjj3
Copy link
Member

@praeclarumjj3 praeclarumjj3 commented Jun 8, 2023

This PR enables running OneFormer with the InternImage-H backbone.

TODO

  • Train on ADE20K with 896x896 image resolution and emb_dim=256.
  • Train on Cityscapes with emb_dim=256.
  • Train on COCO with emb_dim=1024.
  • Train on Mapillary with emb_dim=1024.
  • Finetune ADE20K and Cityscapes with emb_dim=1024.

@praeclarumjj3 praeclarumjj3 requested a review from honghuis June 8, 2023 11:21
@jhpauls
Copy link

jhpauls commented Dec 8, 2024

Awesome to see that OneFormer is improved even further! 🤩

When trying it out, I found that the new Mapillary weight file (https://shi-labs.com/projects/oneformer/mapillary/250_16_intern_image_h_oneformer_mapillary_300k_1024.pth) seems to be incomplete. I get the following error when loading it in pytorch:

torch.load('../250_16_intern_image_h_oneformer_mapillary_300k_1024.pth.1')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/pauls/anaconda3/envs/oneformer/lib/python3.8/site-packages/torch/serialization.py", line 600, in load
    with _open_zipfile_reader(opened_file) as opened_zipfile:
  File "/home/pauls/anaconda3/envs/oneformer/lib/python3.8/site-packages/torch/serialization.py", line 242, in __init__
    super(_open_zipfile_reader, self).__init__(torch._C.PyTorchFileReader(name_or_buffer))
RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory

I cross-checked by successfully using the other new weights (COCO, CS). Also, zip is reporting an incomplete file when listing/reparing:

zip -FF 250_16_intern_image_h_oneformer_mapillary_300k_1024.pth --out 250_16_intern_image_h_oneformer_mapillary_300k_1024_repaired.pth
[...]
 copying: archive/data/1236  (10240 bytes)
 copying: archive/data/1237 
	zip warning: no end of stream entry found: archive/data/1237
	zip warning: rewinding and scanning for later entries

Would you mind checking the file and, if necessary, reuploading it? Thanks a lot already!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants