AWS boto3 not working

[SatvikSri]

Hey Josh, I am not able to fetch the images from AWS using the streamlit. Can you please help me in opening the file, it's urgent? Thanks!

[Joshmantova]

I'm looking on the streamit app and it's loading fine for me. It looks like you may be trying to recreate the app locally - is this the case? I'm not sure I'll be able to help much debugging your local environment but as a first shot, I'd recommend making sure you're using the same package versions as I am in the web app. Make sure you're using a fresh venv and installing the required packages from my requirements file.

Just to be clear, this is not an issue with the production system.

[Joshmantova]

I'm actually removing public access to the S3 bucket. Publicly accessible S3 buckets are not secure and may result in me having a massive AWS bill if someone decides to be nefarious. Moving forward, this webapp will not be locally replicable but having said that, I could provide you the images to use locally or with your own bucket - it will just require you to make some changes on your end to access images from that location rather than the S3 location in the webapp.

[SatvikSri]

Thank you so much, So do I need to download the files again.

…

On Mon, Feb 20, 2023, 12:36 AM Joshmantova ***@***.***> wrote: I'm actually removing public access to the S3 bucket. Publicly accessible S3 buckets are not secure and may result in me having a massive AWS bill if someone decides to be nefarious. Moving forward, this webapp will not be locally replicable but having said that, I could provide you the images to use locally or with your own bucket - it will just require you to make some changes on your end to access images from that location rather than the S3 location in the webapp. — Reply to this email directly, view it on GitHub <#3 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ATV5KNEXTXGXONUGJKITRZTWYJVM3ANCNFSM6AAAAAAVBDAOZU> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[SatvikSri]

Can you pls provide me your WhatsApp number it will be much easier for me to contact you. On Mon, Feb 20, 2023, 1:05 AM Satvik Srivastav ***@***.***> wrote:

…

Thank you so much, So do I need to download the files again. On Mon, Feb 20, 2023, 12:36 AM Joshmantova ***@***.***> wrote: > I'm actually removing public access to the S3 bucket. Publicly accessible > S3 buckets are not secure and may result in me having a massive AWS bill if > someone decides to be nefarious. Moving forward, this webapp will not be > locally replicable but having said that, I could provide you the images to > use locally or with your own bucket - it will just require you to make some > changes on your end to access images from that location rather than the S3 > location in the webapp. > > — > Reply to this email directly, view it on GitHub > <#3 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ATV5KNEXTXGXONUGJKITRZTWYJVM3ANCNFSM6AAAAAAVBDAOZU> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >

[Joshmantova]

Can you pls provide me your WhatsApp number it will be much easier for me to contact you. On Mon, Feb 20, 2023, 1:05 AM Satvik Srivastav @.> wrote:
…
Thank you so much, So do I need to download the files again. On Mon, Feb 20, 2023, 12:36 AM Joshmantova @.> wrote: > I'm actually removing public access to the S3 bucket. Publicly accessible > S3 buckets are not secure and may result in me having a massive AWS bill if > someone decides to be nefarious. Moving forward, this webapp will not be > locally replicable but having said that, I could provide you the images to > use locally or with your own bucket - it will just require you to make some > changes on your end to access images from that location rather than the S3 > location in the webapp. > > — > Reply to this email directly, view it on GitHub > <#3 (comment)>, > or unsubscribe > https://github.com/notifications/unsubscribe-auth/ATV5KNEXTXGXONUGJKITRZTWYJVM3ANCNFSM6AAAAAAVBDAOZU > . > You are receiving this because you authored the thread.Message ID: > @.***> >

Sorry, I don't use WhatsApp. This project is not meant for replication - it requires assets like the bird images that I have made private. The only reason for doing that is to make sure nobody can abuse my AWS resources. If you'd like, I can share the bird images with you for you to download and use locally. It will require you to make some modifications to the source code to reference the new location of the images. If you'd like to explore that, I can provide you download access to the bird images - would you like me to do that?

[SatvikSri]

Yeah I would like to that, it will solve my most of the problem.

[SatvikSri]

While using the bird images locally, I think i might not use the aws boto package? So might have to remove the aws boto code from source code?

[Joshmantova]

Currently, all image references are pointing to S3. When you download this locally, you'll have to figure out what needs to change and you'll need to point it to your local image files. Alternatively, you can upload these images to your own S3 bucket and reference that instead. I can provide you the images but you'll have to be responsible for the storage of these images and any changes needed to use the webapp with your chosen asset location.

[Joshmantova]

It's still uploading the images but here are links for you to access them:
Test images: https://drive.google.com/drive/folders/1ztdKxjEt0iMug2YSpJpqwLBV5ACapbVr?usp=share_link
Train images: https://drive.google.com/drive/folders/1BMtetAAGsSQbFxCgMnvgKxEpPC9zM-bi?usp=share_link
Validation images: https://drive.google.com/drive/folders/1YBH_UP6ex3CAhjcny6HO5XkW4827IYWN?usp=share_link

All images should be available in about 5 hours. If you want to start downloading them and making the source code changes now, you can do so but you'll have to re-download them after the upload has completed to be able to access all files.