problem about sw-django and sw-psycopg2 #8556

Esdsnqxz · 2022-02-17T07:11:17Z

Esdsnqxz
Feb 17, 2022

when i use django as web framework with legency setup script of SW ,i get the following error

Traceback (most recent call last):
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\threading.py", line 932, in _bootstrap_inner
    self.run()
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\utils\autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\core\management\commands\runserver.py", line 121, in inner_run
    self.check_migrations()
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\core\management\base.py", line 486, in check_migrations
    executor = MigrationExecutor(connections[DEFAULT_DB_ALIAS])
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\migrations\executor.py", line 18, in __init__
    self.loader = MigrationLoader(self.connection)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\migrations\loader.py", line 53, in __init__
    self.build_graph()
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\migrations\loader.py", line 220, in build_graph
    self.applied_migrations = recorder.applied_migrations()
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\migrations\recorder.py", line 77, in applied_migrations
    if self.has_table():
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\migrations\recorder.py", line 55, in has_table
    with self.connection.cursor() as cursor:
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\utils\asyncio.py", line 26, in inner
    return func(*args, **kwargs)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\backends\base\base.py", line 259, in cursor
    return self._cursor()
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\backends\base\base.py", line 235, in _cursor
    self.ensure_connection()
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\utils\asyncio.py", line 26, in inner
    return func(*args, **kwargs)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\backends\base\base.py", line 219, in ensure_connection
    self.connect()
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\utils\asyncio.py", line 26, in inner
    return func(*args, **kwargs)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\backends\base\base.py", line 200, in connect
    self.connection = self.get_new_connection(conn_params)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\utils\asyncio.py", line 26, in inner
    return func(*args, **kwargs)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\django\db\backends\postgresql\base.py", line 206, in get_new_connection
    psycopg2.extras.register_default_jsonb(conn_or_curs=connection, loads=lambda x: x)
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\psycopg2\_json.py", line 152, in register_default_jsonb
    return register_json(conn_or_curs=conn_or_curs, globally=globally,
  File "C:\apps\anaconda\anzhuang\envs\dj\lib\site-packages\psycopg2\_json.py", line 120, in register_json
    register_type(JSON, not globally and conn_or_curs or None)
TypeError: argument 2 must be a connection, cursor or None

my SW legency setup script in urls.py as follow:

from skywalking import agent,config
config.init(collector_address="127.0.0.1:12800",service_name='ninjaserviceA',protocol='http')
config.django_collect_http_params=True
config.logging_level='DEBUG'
agent.start()

and the version of all

python : 3.8
django ：3.2.5
psycopg2-binary : 2.9.3
SW-OAP: docker 8.9.0

if i don't use skywlking the server can boot success

Answered by tom-pytel

Jun 3, 2022

See apache/skywalking-python#211

View full answer

kezhenxu94 · 2022-02-17T07:17:32Z

kezhenxu94
Feb 17, 2022
Collaborator

@Esdsnqxz did your program works normally if you remove the SkyWalking Agent? From the logs there is nothing related to SkyWalking Agent. If so, please provide a reproducible demo program

13 replies

Superskyyy Apr 26, 2022
Collaborator

Hi guys, I'm having the same problem but using Flask with postgres and psycopg2. Any updates?

I haven't seen a report on flask with psycopg2 or psycopg3 so far. Can you report the specific versions of flask and psycopg?

If you are in urgent need to make things work. Please either try downgrade flask(not sure the version as this was not reported previously) or disable the psycopg plugin in skywalking Python by supplying the agent config for now.

I recently researched on the problem root solution but it's quite complicated, please bare with me until I implement the fix.

jonilsonds9 Apr 26, 2022

I'm using psycopg2-binary==2.9.3 and flask in version 2.1.1. I'm just starting to use python-agent. But I still haven't tried disabling plugin in skywalking Python.

But I'll wait for news here!

Superskyyy Apr 26, 2022
Collaborator

I'm using psycopg2-binary==2.9.3 and flask in version 2.1.1. I'm just starting to use python-agent. But I still haven't tried disabling plugin in skywalking Python.

But I'll wait for news here!

Thanks, please try either doable plugin or downgrade for the time being, whichever suits your needs. Then when I fix it you can start using the latest master branch.

Please anyone above or following this thread I will ping you guys when fix is applied.

bdronneau May 27, 2022

Hey,
Any news on this behavior ?
Best

EDIT

Environment

psycopg2==2.8.6
djangorestframework==3.13.1
python==3.6.13
gunicorn

When disable sw_psycopg2 the application working great but in trace of course DB statement missing

Esdsnqxz May 30, 2022
Author

Hey, Any news on this behavior ? Best

EDIT

Environment

psycopg2==2.8.6

djangorestframework==3.13.1

python==3.6.13

gunicorn

When disable sw_psycopg2 the application working great but in trace of course DB statement missing

hi，the cause of my problem is i use the wrong version of django.

tom-pytel · 2022-06-03T16:15:44Z

tom-pytel
Jun 3, 2022
Collaborator

See apache/skywalking-python#211

0 replies

Superskyyy · 2022-06-03T18:28:08Z

Superskyyy
Jun 3, 2022
Collaborator

@Esdsnqxz @sefaphlvn @jonilsonds9 @bdronneau FYI as you guys were troubled by this bug. ^

0 replies

bdronneau · 2022-06-04T08:12:35Z

bdronneau
Jun 4, 2022

Thank, I will try to test it. Le ven. 3 juin 2022 à 20:28, Superskyyy ***@***.***> a écrit :

…

@Esdsnqxz <https://github.com/Esdsnqxz> @sefaphlvn <https://github.com/sefaphlvn> @jonilsonds9 <https://github.com/jonilsonds9> @bdronneau <https://github.com/bdronneau> FYI as you guys were troubled by this bug. ^ — Reply to this email directly, view it on GitHub <#8556 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AA72DLXZ2BXDHORBUK3KICTVNJFEHANCNFSM5OTZQTZQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

1 reply

Superskyyy Jun 4, 2022
Collaborator

Thank, I will try to test it. Le ven. 3 juin 2022 à 20:28, Superskyyy @.> a écrit :
…
@Esdsnqxz <@Esdsnqxz> @sefaphlvn <@sefaphlvn> @jonilsonds9 <@jonilsonds9> @bdronneau <@bdronneau> FYI as you guys were troubled by this bug. ^ — Reply to this email directly, view it on GitHub <#8556 (comment)>, or unsubscribe <github.com/notifications/unsubscribe-auth/AA72DLXZ2BXDHORBUK3KICTVNJFEHANCNFSM5OTZQTZQ> . You are receiving this because you were mentioned.Message ID: @.>

There should be an official release this week, or you can directly use master, it's tested. Welcome to provide feedback.

ishallbethat · 2022-06-27T10:05:07Z

ishallbethat
Jun 27, 2022

I encounter the same error in flask "TypeError: argument 2 must be a connection, cursor or None".
If I set SW_AGENT_DISABLE_PLUGINS to sw_psycopg2 to disable the psycopg2 the error is gone and i don't see any database related trace reported to skywalking oap.

0 replies

Superskyyy · 2022-06-27T13:14:38Z

Superskyyy
Jun 27, 2022
Collaborator

I encounter the same error in flask "TypeError: argument 2 must be a connection, cursor or None".

If I set SW_AGENT_DISABLE_PLUGINS to sw_psycopg2 to disable the psycopg2 the error is gone and i don't see any database related trace reported to skywalking oap.

It's fixed in the latest master, did you give it a try?

2 replies

ishallbethat Jul 8, 2022

I do not see it's released in https://pypi.org/project/apache-skywalking/. Latest is 0.7.0.
I manually packaged and uploaded skywalking-python and used it in project. A error i got as below.

  File "/usr/local/lib/python3.7/site-packages/skywalking/agent/__init__.py", line 28, in <module>
    from skywalking.command import command_service
  File "/usr/local/lib/python3.7/site-packages/skywalking/command/__init__.py", line 18, in <module>
    from skywalking.command.command_service import CommandService
  File "/usr/local/lib/python3.7/site-packages/skywalking/command/command_service.py", line 21, in <module>
    from skywalking.protocol.common.Common_pb2 import Commands, Command
ModuleNotFoundError: No module named 'skywalking.protocol.common'

Can you enlighten me how to use the latest package properly ?

Superskyyy Jul 8, 2022
Collaborator

Reference in new issue

Reference in new issue

Repository
skywalking
Title

Body

Hi, a new release will come out within the week I suppose, before that to use it you will need to clone the repository submodule so we have the protocol to communicate with backend OAP.

After you initialized the submodule, simply run make install , or you can package it to a wheel by make package

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

problem about sw-django and sw-psycopg2 #8556

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 6 comments 16 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

EDIT

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Reference in new issue

Select a reply

problem about sw-django and sw-psycopg2 #8556

Esdsnqxz Feb 17, 2022

Replies: 6 comments · 16 replies

kezhenxu94 Feb 17, 2022 Collaborator

Superskyyy Apr 26, 2022 Collaborator

jonilsonds9 Apr 26, 2022

Superskyyy Apr 26, 2022 Collaborator

bdronneau May 27, 2022

EDIT

Esdsnqxz May 30, 2022 Author

EDIT

tom-pytel Jun 3, 2022 Collaborator

Superskyyy Jun 3, 2022 Collaborator

bdronneau Jun 4, 2022

Superskyyy Jun 4, 2022 Collaborator

ishallbethat Jun 27, 2022

Superskyyy Jun 27, 2022 Collaborator

ishallbethat Jul 8, 2022

Superskyyy Jul 8, 2022 Collaborator

Reference in new issue

Esdsnqxz
Feb 17, 2022

Replies: 6 comments 16 replies

kezhenxu94
Feb 17, 2022
Collaborator

Superskyyy Apr 26, 2022
Collaborator

Superskyyy Apr 26, 2022
Collaborator

Esdsnqxz May 30, 2022
Author

tom-pytel
Jun 3, 2022
Collaborator

Superskyyy
Jun 3, 2022
Collaborator

bdronneau
Jun 4, 2022

Superskyyy Jun 4, 2022
Collaborator

ishallbethat
Jun 27, 2022

Superskyyy
Jun 27, 2022
Collaborator

Superskyyy Jul 8, 2022
Collaborator