Skip to content

Lots of "error during download" and "error in checksum"  #3

Description

@TuBui

I am receiving a number of errors when running download.sh. Here is the first lines of error.log:

Error during download of http://cdn.theatlanticwire.com/img/upload/2012/07/04/AP120702135050.jpg
Error in checksum for http://i.imgur.com/qTawHh.jpg, file originals/10pelz.jpg
Error in checksum for http://2.bp.blogspot.com/-FVnWBO2nNOw/TopR0q5ArEI/AAAAAAAABII/pfhkjw5p8sw/s1600/chris-christie-.jpg, file originals/11b6p2.jpg
Error in checksum for http://25.media.tumblr.com/tumblr_ma0dtxfF791qapiigo1_1280.jpg, file originals/11nh0m.jpg
Error in checksum for http://24.media.tumblr.com/tumblr_mc3urtDLLm1qa582ao1_500.jpg, file originals/11sfen.jpg
Error during download of http://www2.macleans.ca/wp-content/uploads/2010/09/rtr2hyee.jpg
Error in checksum for http://images.politico.com/global/2012/10/romney_fairfield_100812.jpeg, file originals/126c1h.jpg
Error in checksum for http://24.media.tumblr.com/tumblr_mcjsp8vmv21rjgvpvo1_1280.jpg, file originals/126ulx.jpg
Error in checksum for http://i.imgur.com/6BCKvh.jpg, file originals/12c9kq.jpg
Error in checksum for http://4.bp.blogspot.com/-wqtSie8DD2k/T6KQ-pyMsDI/AAAAAAAABQk/0JQJhq1VBSA/s1600/binky.jpg, file originals/131kco.jpg

For "Error during download", the url seems to be either invalid or corrupted. For example:

% wget http://cdn.theatlanticwire.com/img/upload/2012/07/04/AP120702135050.jpg
--2020-03-26 12:28:50-- http://cdn.theatlanticwire.com/img/upload/2012/07/04/AP120702135050.jpg
Resolving cdn.theatlanticwire.com (cdn.theatlanticwire.com)... 204.74.99.103
Connecting to cdn.theatlanticwire.com (cdn.theatlanticwire.com)|204.74.99.103|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: http://cdn.thewire.com/img/upload/2012/07/04/AP120702135050.jpg [following]
--2020-03-26 12:28:50-- http://cdn.thewire.com/img/upload/2012/07/04/AP120702135050.jpg
Resolving cdn.thewire.com (cdn.thewire.com)... failed: Name or service not known.
wget: unable to resolve host address ‘cdn.thewire.com’

For "Error in checksum", the sha256 checksum is different from the one reported in the .tsv files. For example:

% grep 10pelz originals.tsv
10pelz http://i.imgur.com/qTawHh.jpg jpg cd0e69a9b4c871c23803c74ee4ed9b67484bd5651e906f9f265c1f4b484e2b93 69560 50 [deleted] reddit.com/r/photoshopbattles/10pelz 1348996969 1024 768
% wget http://i.imgur.com/qTawHh.jpg && sha256sum qTawHh.jpg
--2020-03-26 12:45:19-- http://i.imgur.com/qTawHh.jpg
Resolving i.imgur.com (i.imgur.com)... 151.101.16.193
Connecting to i.imgur.com (i.imgur.com)|151.101.16.193|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 105758 (103K) [image/jpeg]
Saving to: ‘qTawHh.jpg’

qTawHh.jpg 100%[===================>] 103.28K --.-KB/s in 0.01s

2020-03-26 12:45:19 (7.17 MB/s) - ‘qTawHh.jpg’ saved [105758/105758]

cb6ed3b4e03bab66fed8701d60c3c81f5080efbe778894aa5aa7fd10184526dd qTawHh.jpg

I am using Ubuntu 16.04 64-bit, in UK.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions