Skip to content

ModuleNotFoundError: No module named 'requests' in scraper 0.4.0 #29

Open
@kostis-codefresh

Description

First of all many thanks for keeping the previous tags in Dockerhub

We run the Typesense Scanner in CI (EKS cluster in AWS with Amazon Linux nodes)

Up until 0.3.5 all our pipelines were working without any issue.

With 0.4.0 we get an error, without changing anything on our side

[2023-02-23T08:21:39.396Z] Pulling image typesense/docsearch-scraper:0.4.0
[2023-02-23T08:21:39.441Z] Layer '677076032cca' already exists
[2023-02-23T08:21:39.469Z] Pulled layer '3026efbcce37'
[2023-02-23T08:21:39.469Z] Pulled layer 'b83c999f3ae6'
[2023-02-23T08:21:39.720Z] Pulled layer 'a3ed95caeb02'
[2023-02-23T08:21:42.283Z] Pulled layer '4d02e570415e'
[2023-02-23T08:21:42.318Z] Pulled layer 'fe9dd39ad932'
[2023-02-23T08:21:42.318Z] Pulled layer '40bdd8cbcb60'
[2023-02-23T08:21:43.734Z] Pulled layer '330e95c637fc'
[2023-02-23T08:21:50.526Z] Pulled layer '1c4235bc81bd'
[2023-02-23T08:21:50.526Z] Pulled layer 'f636e29df4a6'
[2023-02-23T08:21:50.783Z] Pulled layer '2ee46e1d6efd'
[2023-02-23T08:21:55.074Z] Pulled layer 'f2a90558593e'
[2023-02-23T08:21:55.074Z] Pulled layer 'f7cb19d7ba62'
[2023-02-23T08:21:55.475Z] Pulled layer 'b51fd8a46836'
[2023-02-23T08:21:55.475Z] Pulled layer '72e3879aa441'
[2023-02-23T08:21:55.846Z] Pulled layer 'b656e2665916'
[2023-02-23T08:21:56.174Z] Pulled layer '95462c1394e2'
[2023-02-23T08:22:07.396Z] Pulled layer '0a6c9231c464'
[2023-02-23T08:22:07.462Z] Pulled layer '02b4a1743fdf'
[2023-02-23T08:22:07.509Z] Pulled layer 'fcb6abf81668'
[2023-02-23T08:22:07.509Z] Pulled layer '066a7661e7fb'
[2023-02-23T08:22:09.342Z] Pulled layer 'b1349c66a67d'
[2023-02-23T08:22:09.833Z] Pulled layer 'cb04953d313a'
[2023-02-23T08:22:11.157Z] Pulled layer '83cfbae1faa8'
[2023-02-23T08:22:11.157Z] Pulled layer '4aa2727acdc6'
[2023-02-23T08:22:11.161Z] Digest: sha256:fd23f602249dde3af147cb20160df4ee1306cfb95d8f8e310e861045e89fc846
[2023-02-23T08:22:11.221Z] Status: Downloaded newer image for typesense/docsearch-scraper:0.4.0
[2023-02-23T08:22:12.703Z] Creating a virtualenv for this project...
[2023-02-23T08:22:12.714Z] Pipfile: /home/seleuser/Pipfile
[2023-02-23T08:22:12.796Z] Using /usr/bin/python3 (3.10.6) to create virtualenv...
[2023-02-23T08:22:12.904Z]   Creating virtual environment...
  Creating virtual environment...
  Creating virtual environment...
  Creating virtual environment...created virtual environment CPython3.10.6.final.0-64 in 298ms
  creator CPython3Posix(dest=/root/.local/share/virtualenvs/seleuser-AdYDHarm, clear=False, no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/root/.local/share/virtualenv)
    added seed packages: pip==23.0, setuptools==67.1.0, wheel==0.38.4
[2023-02-23T08:22:13.112Z]   activators BashActivator,CShellActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator
[2023-02-23T08:22:13.112Z] 
[2023-02-23T08:22:13.112Z] Successfully created virtual environment!
[2023-02-23T08:22:13.137Z] 
  Creating virtual environment...
[2023-02-23T08:22:13.157Z] 
Virtualenv location: /root/.local/share/virtualenvs/seleuser-AdYDHarm
[2023-02-23T08:22:13.174Z] Traceback (most recent call last):
[2023-02-23T08:22:13.174Z]   File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[2023-02-23T08:22:13.174Z]     return _run_code(code, main_globals, None,
[2023-02-23T08:22:13.174Z]   File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
[2023-02-23T08:22:13.174Z]     exec(code, run_globals)
[2023-02-23T08:22:13.175Z]   File "/home/seleuser/src/index.py", line 6, in <module>
[2023-02-23T08:22:13.175Z]     import requests
[2023-02-23T08:22:13.325Z] ModuleNotFoundError: No module named 'requests'
[2023-02-23T08:22:13.670Z] Reading environment variable exporting file contents.
[2023-02-23T08:22:13.704Z] Reading environment variable exporting file contents.
[2023-02-23T08:22:14.788Z] [SYSTEM] 

I have pinned our pipelines to 0.3.5 and everything is back to normal

Might be related to #27 and #25

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions