Hi, thanks for the great work. I would like to integrate your model on my task. SoI have a question about doing inference with batch data. The pretrained model seems only to provide inference for one image, i.e., the shape of the input is [1, 3, 512, 512] instead of [?, 3, 512, 512]. It means that I cannot pass batch data to the model. As a result, it took 10s to have the result for a batch input, e.g., BATCH_SIZE=16. Is there any solution to fasten inference? Thanks in advance!
Hi, thanks for the great work. I would like to integrate your model on my task. SoI have a question about doing inference with batch data. The pretrained model seems only to provide inference for one image, i.e., the shape of the input is [1, 3, 512, 512] instead of [?, 3, 512, 512]. It means that I cannot pass batch data to the model. As a result, it took 10s to have the result for a batch input, e.g., BATCH_SIZE=16. Is there any solution to fasten inference? Thanks in advance!