Custom captions

[bdevnani3]

Is there an easy way to leverage attributes/descriptors to create custom captions? I would like all my captions to have a specific format like "There is a {color} {object}".

[AlexKuhnle]

Hi @bdevnani3, this is certainly possible, however, you would have to dig a bit into how the captioner modules work and datasets are composed. For your example of existential statements, here a few pointers for the "existential" dataset:

• You can see that the dataset mixes two "captioners" with a certain distribution.
• The first captioner produces statements of the form "There is a ...".
• The second captioner produces statements of the form "A ... is ...".
• RegularTypeCaptioner have a hypernym_rate argument, as e.g. here.

To only produce statements of the form "There is a [color] [shape].", something like this for a captioner should work: RegularTypeCaptioner(hypernym_rate=0.0, existing_attribute_rate=0.0). hypernym_rate=0.0 to specify that it should never under-specify (i.e. leave out) any attribute, and existing_attribute_rate is required for producing incorrect captions.