DOGE Indexer - TypeError("'NoneType' object is not subscriptable")

[ivan-ngchakming]

Running into this error frequently on DOGE indexer.

This error effectively crashes the worker, preventing the chain from being indexed further.

I suspect that this is due to the RPC returning invalid responses. Suggested solutions:

• introduce proper error handling and RPC response validation
• introduce health check on workers so they can be restarted on crash
• introduce health check on service, so container can be restarted if service is unresponsive

Exception in thread Thread-11268 (thread_worker):
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
    self.run()
  File "/usr/local/lib/python3.11/threading.py", line 982, in run
    self._target(*self._args, **self._kwargs)
  File "/app/utxo_indexer/indexer/doge.py", line 30, in thread_worker
    item(session, processed_block)
  File "/app/utxo_indexer/indexer/doge.py", line 58, in _process_pre_vout_transaction
    res = transaction_getter(txid, session)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/utxo_indexer/indexer/decorators.py", line 16, in inner
    raise Exception(errors)
Exception: [TypeError("'NoneType' object is not subscriptable"), TypeError("'NoneType' object is not subscriptable"), TypeError("'NoneType' object is not subscriptable"), TypeError("'NoneType' object is not subscriptable"), TypeError("'NoneType' object is not subscriptable")]

[AnimaTow]

I also know that a node problem is FULL for my repair

My ERROR:

[28/Apr/2025 21:29:59,000] INFO utxo_indexer.indexer.indexer_client: Extracting initial block height

[28/Apr/2025 21:29:59,000] INFO utxo_indexer.indexer.indexer_client: Number of active workeres: 10

[28/Apr/2025 21:29:59,017] INFO utxo_indexer.indexer.indexer_client: No blocks in the database, starting from the initial block height

[28/Apr/2025 21:29:59,068] INFO utxo_indexer.indexer.indexer_client: Starting from the initial block height set in config 5663758

[28/Apr/2025 21:29:59,068] INFO utxo_indexer.indexer.indexer_client: Starting the indexer

Traceback (most recent call last):

  File "/app/manage.py", line 22, in <module>

    main()

  File "/app/manage.py", line 18, in main

    execute_from_command_line(sys.argv)

  File "/usr/local/lib/python3.11/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line

    utility.execute()

  File "/usr/local/lib/python3.11/site-packages/django/core/management/__init__.py", line 436, in execute

    self.fetch_command(subcommand).run_from_argv(self.argv)

  File "/usr/local/lib/python3.11/site-packages/django/core/management/base.py", line 413, in run_from_argv

    self.execute(*args, **cmd_options)

  File "/usr/local/lib/python3.11/site-packages/django/core/management/base.py", line 459, in execute

    output = self.handle(*args, **options)

             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/app/utxo_indexer/management/commands/block_indexing.py", line 9, in handle

    indexer.run()

  File "/app/utxo_indexer/indexer/indexer_client.py", line 153, in run

    self.process_block(i)

  File "/app/utxo_indexer/indexer/doge.py", line 87, in process_block

    res_block = self._get_block_by_hash(block_hash, self.toplevel_worker)

                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/app/utxo_indexer/indexer/decorators.py", line 16, in inner

    raise Exception(errors)

Exception: [TypeError("'NoneType' object is not subscriptable"), TypeError("'NoneType' object is not subscriptable"), TypeError("'NoneType' object is not subscriptable"), TypeError("'NoneType' object is not subscriptable"), TypeError("'NoneType' object is not subscriptable")]

What I found out is that the problem in the

    def get_block_by_hash(self, session: Session, block_hash: str) -> BlockResponse:
        """Returns a block presented with class types."""
        block = self._post(
            session,
            {
                "jsonrpc": "1.0",
                "id": "rpc",
                "method": "getblock",
                "params": [block_hash, 2],
            },
        ).json(parse_float=str)["result"]

        # Handle address, reqSigs and prevout
        for tx in block["tx"]:
            tx = self._check_address_reqSigs_prevout(tx)
        return cattrs.structure(block, BlockResponse)

 "params": [block_hash, 2], 

flare@docker:~$  curl --user user:pass --data-binary '{
  "jsonrpc": "1.0",
  "id": "test",
  "method": "getblock",
  "params": ["dfb8029e99c0a2f36751455fc892be317e78cd80343466393dd68bea328062e8", 2]
}' -H 'content-type: text/plain;' http://65.108.196.99:22555/
{"result":null,"error":{"code":-1,"message":"JSON value is not a boolean as expected"},"id":"test"}

flare@docker:~$ curl --user user:pass  --data-binary '{
  "jsonrpc": "1.0",
  "id": "test",
  "method": "getblock",
  "params": ["dfb8029e99c0a2f36751455fc892be317e78cd80343466393dd68bea328062e8", true]
}' -H 'content-type: text/plain;' http://65.108.196.99:22555/
{"result":{"hash":"dfb8029e99c0a2f36751455fc892be317e78cd80343466393dd68bea328062e8","confirmations":35715,"strippedsize":3291,"size":3291,"weight":13164,"height":5651483,"version":6422788,"versionHex":"00620104","merkleroot":"78a16ca6d0047e831585025af6eeeeff7d66b1c2726e113d290781d64c54be9e","tx":["2f4ebb36a9c631109f50b50f323c5fff2fe36903945da8cf90fb436a14374851","eb826f07158e65f5c1af769cf548b505558021820a0d0945b70e627cdccc4699","fba8e56e46f48191e35d0f8be717fb82d294b767e29089bf2fdbdbf949e7d8b1","ac72d8a749e58304e88d0f6a96ef719e64e8bac7c5e25772f9b8f2af205b4e45","a09f65f3de40da3665f582bf16e1f39bab2875d4810fab310712f6475de9f621","ee7aae8d40eb557a6722bdccf8d495b168d3709f0bfb374d599010988696fdb0","43608500c08960a79e4e876f2ec73c41579375158e49b736785845ed5b8744d9"],"time":1743614476,"mediantime":1743614302,"nonce":0,"bits":"19679a02","difficulty":41455943.24279629,"chainwork":"0000000000000000000000000000000000000000000019a7005a8ceab3e36cfc","auxpow":{"tx":{"hex":"01000000010000000000000000000000000000000000000000000000000000000000000000ffffffff4f035fd52b082f5669614254432f2cfabe6d6d44390d59d59e01003d940de27f32d00e17aa14b303bd1d39999be7f0e879a05f200000000000000010703ad60042d068926bfb358c1501000000000000ffffffff0225295c25000000001976a91493e278b485679cfd2d21441a94bb29dd7c99d72088ac0000000000000000266a24aa21a9ed64e216b664195a5ef3d22f31eb98c30da4064dc099880e18b7134aee0a9518a700000000","txid":"1463cd76639b68c50db908c98e479623b1a963c6ccd5a994f3d1c1f151193971","hash":"1463cd76639b68c50db908c98e479623b1a963c6ccd5a994f3d1c1f151193971","size":211,"vsize":211,"version":1,"locktime":0,"vin":[{"coinbase":"035fd52b082f5669614254432f2cfabe6d6d44390d59d59e01003d940de27f32d00e17aa14b303bd1d39999be7f0e879a05f200000000000000010703ad60042d068926bfb358c1501000000000000","sequence":4294967295}],"vout":[{"value":6.26796837,"n":0,"scriptPubKey":{"asm":"OP_DUP OP_HASH160 93e278b485679cfd2d21441a94bb29dd7c99d720 OP_EQUALVERIFY OP_CHECKSIG","hex":"76a91493e278b485679cfd2d21441a94bb29dd7c99d72088ac","reqSigs":1,"type":"pubkeyhash","addresses":["DJd3AyR8ogq9Nd6ixWeT27zZLq5FNrbXRa"]}},{"value":0.00000000,"n":1,"scriptPubKey":{"asm":"OP_RETURN aa21a9ed64e216b664195a5ef3d22f31eb98c30da4064dc099880e18b7134aee0a9518a7","hex":"6a24aa21a9ed64e216b664195a5ef3d22f31eb98c30da4064dc099880e18b7134aee0a9518a7","type":"nulldata"}}],"blockhash":"7fbde2775eabadeedb8b531b67dc5f19e8a4d1aa9f269e0c64448c8daf517cae"},"index":0,"chainindex":24,"merklebranch":["e3e1ca6aed2bb333f087ee3d599319594d4b569ff8165ed62e066f637845dd79","05dfd2b742c8cf6e2616c0b46ad0b5d5341647594fcdc672cb8cc73fdabb26c0","24ba35e5632447416d867151f46820e09c46fe9c7c3a38b5a7daa7ec2e5d89cb","97ea532a4887a7a088a898ef8d833461e7e2729f6b03a2eeb7e1593f9a3b180e","327c6ba17f15dc6b5e85dfefdc5021741f1c1e2402ca1c1440dc1e3a550e6160","c5a7ec285260d4a8ac3f2deb555bc4db9f70973b01784e6b549cc1f99b8829d4","f9848a8fcc64da70bb5438f5701d4a8000464984b177e0549f127c87a85a559d","7312849a2814403a7c91e14da3eae1b9dd37586e061f3c985902c7addcff7963","6704609c9142bd024ed07fe14e7ddf0b6bf39a142a7528bb87dbe4c4deb9ccf8"],"chainmerklebranch":["0000000000000000000000000000000000000000000000000000000000000000","f98c4e9736d8eb8bb46299798906695c755369a3df99a93ffdded1713f1cf6e2","a5fac68f2eb525e13b846196e67990298dd71be858f5b4838374847d19a51fa1","457019b74d679ac5249419b57c9e19338fe0fe4febac18615613f2dcb4928097","00e580d8eb5fa5d191acf32ddfa791dc7a1f1f450cfdfcc0091248ace9799ce0"],"parentblock":"000000207f19d172a7371c66c685577a523990e49a192657a6422d6dbb6c543dd1be4477160c709bdc4e9ac509d691f9cdf5540fcfa607cdf331f54f678bd0976138c6b2e671ed67bc5c33192c325120"},"previousblockhash":"0ded08c73681ce133100d20823d00ac42be5f4bdacf2489e22d47aad4ca69ead","nextblockhash":"103d1b2967ca2e69c04b8039602d82291533d236910e2d5787fca0618d89f411"},"error":null,"id":"test"}