Payments column showing "Unknown;" for certain types of purchases, and some of those orders cannot be json dumped

[FHNaber]

This is very similar to issue #341.
The problem occurs when the order is placed with Amazon Fresh or Whole Foods. The payment column shows "Unknown;".
Issue 341 was actually the opposite. The Amazon Fresh and Whole Foods showed correct entries, the others were "Unknown;".
I have attached a json file.

file: 114-0232842-2905059_2025-10-11.json (redacted for user privacy)

[philipmulcahy]

Thank you! I intend to look at this as part of the current backlog.

[philipmulcahy]

Hello @FHNaber!

I just sent v1.16.16 for release. It is all about fixing payment details for physical orders). In amazon.co.uk we're starting to see an obfuscated style of html in parts of the order detail page.

I thought that the problem you were observing was going to be the same: the information we seek is on the pages the extension is looking at, but it's not managing to find it.
Unfortunately, I was wrong.
To find payment details, azad looks at the order detail page, and (if it's accessible as html) the invoice page.
Your json file included snapshots of those pages' html and I've taken a look at both of them this evening.
Neither of them shows card details or a payment total.

I've also looked at the order list page - this does show totals, but has nothing about where the money came from.

It's possible that the order detail page and/or the invoice page html includes scripts that download the missing information and display it when the page is rendered on your browser (which has the necessary cookies/state to show it's you, and you're logged in - unlike my browser). Please can you take a look and send me screenshots of those two pages and the saved html over email to azadextension at gmail dot com. If the info is there, scraping "cooked" pages is entirely possible - it just slows scrapes down quite a lot because it takes time for the amazon scripts to run and azad can never quite be sure when they've finished.

Yours,

Philip

[FHNaber]

Thank you, Philip.
I will be out of town until mid-December so I will provide more than you asked for. I hope it helps.
I have attached 6 items:

1. AZAD Result
2. JSON file for that result
3. Corresponding Amazon Order
4. Order Details
5. Invoice
6. Related Transactions
   If you have more questions, I will respond after I return.

[114-6177945-4249828_2025-12-02.json] file redacted for user privacy
5 screenshot images redacted for user privacy
//Fred//

[FHNaber]

I should have added that although the total cost is now shown in the payments column, the individual payments (Related Transactions) are not shown.

[philipmulcahy]

Hi @FHNaber (Fred),

I've edited your posts to remove the json files and screenshots (after downloading them so I can look at them), because they contain stuff you almost certainly don't want everyone else on the internet knowing about you - while I cannot stop you posting it, I strongly suggest you don't.

Q: What's safe to post on github?

• screenshots that have personal identifiers blurred/blanked out (e.g. addresses, credit card info, email addresses)
• console log files

Q: What's definitely not a good idea?

• order json files
• unredacted screenshots

Q: How can I send the sensitive stuff?
A: email me at azadextension at gmail dot com, putting the ticket number (#367 in this case) somewhere in the subject, and post here to tell me you've done so (I don't look at that email account very often unless I know something's there - it receives a lot of proposals to buy the extension for nefarious purposes).

[philipmulcahy]

for 114-0232842-2905059, I'm still in the market for the "cooked" html for the order detail page - you can get this by navigating to the order detail page, and then doing File | Save Page As... | Format: Web Page, HTML Only, which should yield an html file. You should zip this up to conceal the embedded scripts from gmail's virus scanner and then email it me (see above post for the address).

[philipmulcahy]

@FHNaber the last post was intended for you - sorry for lack of clarity. I await your return.

[FHNaber]

Good morning. I emailed you the requested file. Let me know if you need anything else. //Fred//

[philipmulcahy]

Thanks @FHNaber.

I'm starting to face up to the ugliness that has reared its head on this ticket - doing cooked scraping inside the high-N loop (even only as a last chance strategy) could slow scrapes down considerably.