Attach document image to tweets

[Irio]

Following @talespaiva's suggestion in a tweet and recent replies to
@RosieDaSerenata.

Docs for Twitter API: https://python-twitter.readthedocs.io/en/latest/_modules/twitter/api.html?highlight=%22def%20PostUpdate%22

[cuducos]

A possible roadmap:

1. convert the receipt from PDF to PNG
2. crop the white paper areas (sometimes small receipts are in an A4 page size scanned image)
3. upload the PNG to someplace like Imgur
4. add the PNG URL to the tweet

[paulocezar]

I'll give this one a try.

[silviodc]

Hi @paulocezar

To convert the PDF to Image I suggest you to take a look in these notebooks from okfn-brasil/serenata-de-amor#238

This, you can speed up your work focusing on crop the image and uploading it. The necessary libraries are in the end of the docker file. "OpenCV, Wand..." . Try to look in segmentation techniques to crop the recipe :)
Looking forward to see your #PR ;)

[murilobsd]

Hi,
I do not know how the progress of this issue is? Maybe the trim function http://docs.wand-py.org/en/0.3-maintenance/wand/image.html#wand.image.Image.trim might help!

[silviodc]

Thanks for sharing it if us @murilobsd . ;)

In Addition, I would like to suggest who is implementing it to take a look in these libraries to upload the images :)

https://pypi.python.org/pypi/python-tumblpy/1.1.4
https://github.com/Imgur/imgurpython

[CauanCabral]

Why not upload image to twitter? Keeping only twitter as external service dependency.

https://developer.twitter.com/en/docs/media/upload-media/api-reference/post-media-upload

[cuducos]

Why not upload image to twitter?

I think this is better/easier/simpler than using a third-party service for hosting images (unless @silviodc has other usages for the storage in mind). What's is needed IMHO is an implementation sich as:

1. Get reimbursement data needed to build the receipt URL (applicant_id, year and document_id) to concatenate some string and get the receipt URL
2. Try to fetch the PDF
3. If it succeeded convert to PNG
4. Crop it
5. Add to the tweet with the API @CauanCabral linked

[rodolfolottin]

Hi! Does anyone need some help with this issue?

[cuducos]

AFAIK there's no one working on that, @rodolfolottin – make yourself at home : )

[rodolfolottin]

Ok @cuducos . I'll give it a try.

[rodolfolottin]

So, I have some doubts about how to test this functionally. First one is: how can I get some data, once that the tests are using mocks? I know that I can get the pdf directly in the camara’s web site, but I also want to see the data from each reimbursement tuple.

Another one is: what my tests should test? I get that I should test the tweet content that is going to be posted, but what about the fetched pdf? And the blank area that I have to crop, how can/should I test that? Should I use some example pdf as fixture?

Many thanks!

[cuducos]

Hi @rodolfolottin, let me recap road map drafted above:

1. Get reimbursement data needed to build the receipt URL (applicant_id, year and document_id) to concatenate some string and get the receipt URL
2. Try to fetch the PDF
3. If it succeeded convert to PNG
4. Crop it
5. Add to the tweet with the API @CauanCabral linked

Given these steps, this is my 2c:

In steps 1 and 5 we're responsible for generating the right calls to external services, but not responsible to manage the calls themselves. What I mean is that:

• In step 1 we must assert we're generating the proper URL to download the PDF and passing it to the download function (for example, urllib.request.urlretrieve)
• In step 5 we must assert we're properly calling the Twitter API with the image attached

That said, we I'd say that in step 1 we can mock the download method and:

1. Assert it's called with the proper URL
2. Use a fixture as it's response, so we have a real PDF file to test steps 2, 3 and 4

Then we must mock the Twitter API call and assert that we're calling it with the image as an attachement.

Does that make sense to you all?