Skip to content

Configure file types to skip creating derivatives for (or: _only_ create for specific types) #577

@kerchner

Description

@kerchner

We are getting failed CreateDerivatives jobs for file types where we shouldn't be trying to create derivatives.

Here is an example where it tries to create a derivative for a .tsv file at /opt/scholarspace/scholarspace-hyrax/tmp/uploads/hyrax/uploaded_file/file/12005/S_Table10_SNV2_samples.tsv -- the resulting error is:

sidekiq-1     | 2025-02-11T17:36:41.716Z pid=240 tid=1fdcc WARN: {"context":"Job raised exception","job":{"retry":true,"queue":"default","class":"ActiveJob::QueueAdapters::SidekiqAdapter::JobWrapper","wrapped":"CreateDerivativesJob","args":[{"job_class":"CreateDerivativesJob","job_id":"bb988926-9f60-487a-afd9-79cf76e35e0b","provider_job_id":null,"queue_name":"default","priority":null,"arguments":[{"_aj_globalid":"gid://scholarspace/FileSet/vd66w0998"},"vd66w0998/files/275c4384-3c30-4109-bddb-e5bcf176bae7","/opt/scholarspace/scholarspace-hyrax/tmp/uploads/hyrax/uploaded_file/file/12005/S_Table10_SNV2_samples.tsv"],"executions":0,"locale":"en"}],"jid":"b42e33d85d531e8acd44819e","created_at":1739285963.3301108,"enqueued_at":1739295400.3839567,"error_message":"No such file or directory @ rb_sysopen - /opt/scholarspace/scholarspace-tmp/S_Table10_SNV2_samples.pdf","error_class":"Errno::ENOENT","failed_at":1739285964.1747117,"retry_count":8,"retried_at":1739291243.9921908}}

We get similar errors where it's trying to use ffmpeg to create a derivative for a .jmp file, which it should not.

Can the app be configured to ONLY try to create derivatives for certain file types? And/or to skip certain other file types?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions