Save image

[MaxKarpyza]

I tried bt. save_image and the Driver download_file function. In the first case, the code returned is not 200, in the second case, it does not save anything at all. How else can I save the file? Site for testing https://www.sushifuji.ru/ufa

[EvilConsultant]

I am also having some trouble figuring out how to get a image file. I have:

@request(use_stealth=True)
def scrape_file(request: Request, url: str):
    response = request.get(url)
    logging.debug(f"Used Botasaurus Stealth Request to process {url} with {response.status_code}")
    file = response.raw
    return file

and when I

file = scrape_file("https://cdn.webshopapp.com/shops/7950/files/275354185/650x750x2/macnamara-blended-whisky-700ml-gift-box.jpg")

Response has a 200, but it throws a:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "c:\Users\vinou\anaconda3\envs\dev\lib\site-packages\botasaurus\request_decorator.py", line 214, in wrapper_requests
    write_output(
  File "c:\Users\vinou\anaconda3\envs\dev\lib\site-packages\botasaurus\decorators_common.py", line 202, in write_output
    write_json(result, filename, False)
  File "c:\Users\vinou\anaconda3\envs\dev\lib\site-packages\botasaurus\output.py", line 90, in write_json
    _write_json(data, filename)
  File "c:\Users\vinou\anaconda3\envs\dev\lib\site-packages\botasaurus\utils.py", line 52, in write_json
    json.dump(data, fp, indent=indent)
  File "c:\Users\vinou\anaconda3\envs\dev\lib\json\__init__.py", line 179, in dump
    for chunk in iterable:
  File "c:\Users\vinou\anaconda3\envs\dev\lib\json\encoder.py", line 438, in _iterencode
    o = _default(o)
  File "c:\Users\vinou\anaconda3\envs\dev\lib\json\encoder.py", line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type bytes is not JSON serializable

So looks like it doesn't know what to do with byte requests?

[EvilConsultant]

I didn't spend much time digging on this, but in botasaurus/utils.py write_json() it is failing if you have a bytes object.

I changed my version to skip on byte data.

def write_json(data, path, indent=4):
    # if data is a bytes object, just return
    if isinstance(data, bytes):
        return
    with open(path, "w", encoding="utf-8") as fp:
        json.dump(data, fp, indent=indent)

Haven't done any testing or digging to see what that might break, but in case anyone sees this.