[Bug]: multiple clients connect to infinity, error raised

[shenzhangzhou]

Is there an existing issue for the same bug?

• I have checked the existing issues.

Version or Commit ID

v0.6.7

Other environment information

Actual behavior and How to reproduce it

我使用连接池connect_pool, 有多个client连接同一个db库进行插入和查询操作，一段时间后，就报错：
报错：
Traceback (most recent call last):
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/gunicorn/arbiter.py", line 609, in spawn_worker
worker.init_process()
File "/home/descfly/.local/lib/python3.10/site-packages/uvicorn/workers.py", line 75, in init_process
super().init_process()
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/gunicorn/workers/base.py", line 134, in init_process
self.load_wsgi()
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/gunicorn/workers/base.py", line 146, in load_wsgi
self.wsgi = self.app.wsgi()
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/gunicorn/app/base.py", line 67, in wsgi
self.callable = self.load()
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 58, in load
return self.load_wsgiapp()
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 48, in load_wsgiapp
return util.import_app(self.app_uri)
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/gunicorn/util.py", line 371, in import_app
mod = importlib.import_module(module)
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/data1/TUKA/web_search_server/web_search/server_web_search.py", line 4, in
from openai import OpenAI
File "/home/descfly/.local/lib/python3.10/site-packages/openai/init.py", line 9, in
from . import types
File "/home/descfly/.local/lib/python3.10/site-packages/openai/types/init.py", line 5, in
from .batch import Batch as Batch
File "/home/descfly/.local/lib/python3.10/site-packages/openai/types/batch.py", line 6, in
from .._models import BaseModel
File "/home/descfly/.local/lib/python3.10/site-packages/openai/_models.py", line 24, in
import pydantic
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/pydantic/init.py", line 5, in
from ._migration import getattr_migration
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/pydantic/_migration.py", line 4, in
from pydantic.warnings import PydanticDeprecatedSince20
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/pydantic/warnings.py", line 5, in
from .version import version_short
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/pydantic/version.py", line 7, in
from pydantic_core import version as pydantic_core_version
File "/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/pydantic_core/init.py", line 6, in
from typing_extensions import Sentinel
ImportError: cannot import name 'Sentinel' from 'typing_extensions' (/home/descfly/miniconda3/envs/tuka_py310/lib/python3.10/site-packages/typing_extensions.py)
[2025-12-07 17:15:16 +0800] [240764] [INFO] Worker exiting (pid: 240764)

同时，infinity的log显示大量的index丢失。 请问多个client的连接时，需要怎么做才能避免？
PS：之前使用的是v0.3.0.dev3，挺稳定，升级后有点不太稳定，麻烦帮忙看看。

Expected behavior

No response

Additional information

No response

[yingfeng]

Can you paste the log here from infinity's server console ?

[shenzhangzhou]

Can you paste the log here from infinity's server console ?

hello, This is infinity log:
[05:41:21.653] [1] [warning] Can't find unsealed segment id: 1, table: table: catalog|tbl|5|table_224|1518822:6
[05:41:21.653] [1] [warning] Can't find 'unsealed_segment_id' in table: table: catalog|tbl|5|table_229|1518828:7, use next segment id: 1
[05:41:21.653] [1] [warning] Can't find 'unsealed_segment_id' in table: table: catalog|tbl|5|table_229|1518828:7, use next segment id: 1
[05:41:21.653] [1] [warning] Can't find unsealed segment id: 1, table: table: catalog|tbl|5|table_229|1518828:7
[05:41:21.653] [1] [warning] Can't find 'unsealed_segment_id' in table: table: catalog|tbl|5|table_240|1518834:8, use next segment id: 1
[05:41:21.653] [1] [warning] Can't find 'unsealed_segment_id' in table: table: catalog|tbl|5|table_240|1518834:8, use next segment id: 1
[05:41:21.653] [1] [warning] Can't find unsealed segment id: 1, table: table: catalog|tbl|5|table_240|1518834:8
[05:41:21.653] [1] [warning] Can't find 'unsealed_segment_id' in table: table: catalog|tbl|5|table_243|1518840:9, use next segment id: 1
[05:41:21.653] [1] [warning] Can't find 'unsealed_segment_id' in table: table: catalog|tbl|5|table_243|1518840:9, use next segment id: 1
[05:41:21.653] [1] [warning] Can't find unsealed segment id: 1, table: table: catalog|tbl|5|table_243|1518840:9
[05:41:21.654] [1] [info] Periodic trigger start ...
[05:41:31.655] [339] [info] Optimize all indexes begin ts: 1519267
[05:41:41.655] [339] [info] Optimize all indexes begin ts: 1519267
[05:41:51.656] [339] [info] Optimize all indexes begin ts: 1519267
[05:41:59.647] [364] [critical] Txn ID: 913155, Text: checkpoint, Begin TS: 1519263, Commit TS: 1519266, KV Commit TS: 1519267, State: Committed

Txn ID: 913168, Text: Select Statement, Begin TS: 1519267, Commit TS: 18446744073709551615, KV Commit TS: 18446744073709551615, State: Started

[05:41:59.647] [364] [critical] Error: RoaringBitmap::SetFalse: row_index >= count_@src/storage/common/roaring_bitmap.cppm:114
[05:41:59.897] [342] [critical] Txn ID: 913155, Text: checkpoint, Begin TS: 1519263, Commit TS: 1519266, KV Commit TS: 1519267, State: Committed

Txn ID: 913168, Text: Select Statement, Begin TS: 1519267, Commit TS: 18446744073709551615, KV Commit TS: 18446744073709551615, State: Started

[05:41:59.897] [342] [critical] Error: RoaringBitmap::SetFalse: row_index >= count_@src/storage/common/roaring_bitmap.cppm:114
[05:42:00.769] [342] [critical] 0# infinity::PrintStacktrace@infinity_core(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&) at /infinity/src/common/utility/exception_impl.cpp:47
1# infinity::UnrecoverableError@infinity_core(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&, char const*, unsigned int) at /infinity/src/common/utility/exception_impl.cpp:81
2# infinity::RoaringBitmap@infinity_core::SetFalse(unsigned int) at /infinity/src/storage/common/roaring_bitmap.cppm:114
3# infinity::NewCatalog@infinity_core::SetBlockDeleteBitmask(infinity::BlockMeta@infinity_core&, unsigned long, unsigned long, infinity::RoaringBitmap@infinity_core&) at /infinity/src/storage/catalog/new_catalog_static_impl.cpp:1385
4# void infinity::PhysicalKnnScan@infinity_core::ExecuteInternalByColumnDataTypeAndQueryDataType<(infinity::LogicalType)23, float, infinity::CompareMin@infinity_core, float>(infinity::QueryContext@infinity_core*, infinity::KnnScanOperatorState@infinity_core*) at /infinity/src/executor/operator/physical_scan/physical_knn_scan_impl.cpp:567
5# void infinity::PhysicalKnnScan@infinity_core::ExecuteInternalByColumnDataType<(infinity::LogicalType)23, float>(infinity::QueryContext@infinity_core*, infinity::KnnScanOperatorState@infinity_core*) at /infinity/src/executor/operator/physical_scan/physical_knn_scan_impl.cpp:373
6# infinity::PhysicalKnnScan@infinity_core::Execute(infinity::QueryContext@infinity_core*, infinity::OperatorState@infinity_core*) at /infinity/src/executor/operator/physical_scan/physical_knn_scan_impl.cpp:273
7# infinity::FragmentTask@infinity_core::OnExecute() at /infinity/src/scheduler/fragment_task_impl.cpp:84
8# infinity::TaskScheduler@infinity_core::WorkerLoop(infinity::BlockingQueue@infinity_coreinfinity::FragmentTask@infinity_core**, long) at /infinity/src/scheduler/task_scheduler_impl.cpp:254
9# execute_native_thread_routine at ../../../../../libstdc++-v3/src/c++11/thread.cc:104
10# at :0
11# __clone at :0
12#

[05:42:00.769] [342] [critical] RoaringBitmap::SetFalse: row_index >= count_@src/storage/common/roaring_bitmap.cppm:114
[05:42:00.769] [342] [critical] Txn ID: 913155, Text: checkpoint, Begin TS: 1519263, Commit TS: 1519266, KV Commit TS: 1519267, State: Committed

Txn ID: 913168, Text: Select Statement, Begin TS: 1519267, Commit TS: 18446744073709551615, KV Commit TS: 18446744073709551615, State: Started

[05:42:00.769] [342] [critical] Error: TerminateHandler: Unhandled Exception: RoaringBitmap::SetFalse: row_index >= count_@src/storage/common/roaring_bitmap.cppm:114
[05:42:00.784] [342] [critical] 0# infinity::PrintStacktrace@infinity_core(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&) at /infinity/src/common/utility/exception_impl.cpp:47
1# (anonymous namespace)::TerminateHandler() at /infinity/src/bin/infinity_main.cpp:221
2# __cxxabiv1::__terminate(void ()()) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48
3# std::terminate() at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:58
4# __cxa_throw at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:98
5# infinity::FragmentTask@infinity_core::OnExecute() at /infinity/src/scheduler/fragment_task_impl.cpp:103
6# infinity::TaskScheduler@infinity_core::WorkerLoop(infinity::BlockingQueue@infinity_coreinfinity::FragmentTask@infinity_core*, long) at /infinity/src/scheduler/task_scheduler_impl.cpp:254
7# execute_native_thread_routine at ../../../../../libstdc++-v3/src/c++11/thread.cc:104
8# at :0
9# __clone at :0
10#

[05:42:00.784] [342] [critical] Txn ID: 913155, Text: checkpoint, Begin TS: 1519263, Commit TS: 1519266, KV Commit TS: 1519267, State: Committed

Txn ID: 913168, Text: Select Statement, Begin TS: 1519267, Commit TS: 18446744073709551615, KV Commit TS: 18446744073709551615, State: Started

[05:42:00.784] [342] [critical] Error: Aborted
[05:42:00.784] [342] [critical] 0# infinity::PrintStacktrace@infinity_core(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&) at /infinity/src/common/utility/exception_impl.cpp:47
1# (anonymous namespace)::SignalHandler(int, siginfo_t*, void*) at /infinity/src/bin/infinity_main.cpp:160
2# at :0
3# pthread_kill at :0
4# raise at :0
5# abort at :0
6# (anonymous namespace)::TerminateHandler() at /infinity/src/bin/infinity_main.cpp:222
7# __cxxabiv1::__terminate(void ()()) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48
8# std::terminate() at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:58
9# __cxa_throw at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:98
10# infinity::FragmentTask@infinity_core::OnExecute() at /infinity/src/scheduler/fragment_task_impl.cpp:103
11# infinity::TaskScheduler@infinity_core::WorkerLoop(infinity::BlockingQueue@infinity_coreinfinity::FragmentTask@infinity_core*, long) at /infinity/src/scheduler/task_scheduler_impl.cpp:254
12# execute_native_thread_routine at ../../../../../libstdc++-v3/src/c++11/thread.cc:104
13# at :0
14# __clone at :0
15#

[05:42:00.784] [342] [critical] Txn ID: 913155, Text: checkpoint, Begin TS: 1519263, Commit TS: 1519266, KV Commit TS: 1519267, State: Committed

Txn ID: 913168, Text: Select Statement, Begin TS: 1519267, Commit TS: 18446744073709551615, KV Commit TS: 18446744073709551615, State: Started

[05:42:00.784] [342] [critical] Error: Segmentation fault
[05:42:00.784] [342] [critical] 0# infinity::PrintStacktrace@infinity_core(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&) at /infinity/src/common/utility/exception_impl.cpp:47
1# (anonymous namespace)::SignalHandler(int, siginfo_t*, void*) at /infinity/src/bin/infinity_main.cpp:160
2# at :0
3# abort at :0
4# (anonymous namespace)::TerminateHandler() at /infinity/src/bin/infinity_main.cpp:222
5# __cxxabiv1::__terminate(void ()()) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48
6# std::terminate() at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:58
7# __cxa_throw at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:98
8# infinity::FragmentTask@infinity_core::OnExecute() at /infinity/src/scheduler/fragment_task_impl.cpp:103
9# infinity::TaskScheduler@infinity_core::WorkerLoop(infinity::BlockingQueue@infinity_coreinfinity::FragmentTask@infinity_core*, long) at /infinity/src/scheduler/task_scheduler_impl.cpp:254
10# execute_native_thread_routine at ../../../../../libstdc++-v3/src/c++11/thread.cc:104
11# at :0
12# __clone at :0

[qinling0210]

Hi @shenzhangzhou ,

From the infinity.log you provided, the issue occurs during processing the select statement.

I have delivered the fix, please use the latest infinity(released tonight) to test again tomorrow.
(Find the latest nightly release in https://github.com/infiniflow/infinity/releases/tag/nightly).

If there are still issues, please let me know.

Ling

[shenzhangzhou]

Can you paste the log here from infinity's server console ?

Hi @shenzhangzhou ,

From the infinity.log you provided, the issue occurs during processing the select statement.

I have delivered the fix, please use the latest infinity(released tonight) to test again tomorrow. (Find the latest nightly release in https://github.com/infiniflow/infinity/releases/tag/nightly).

If there are still issues, please let me know.

Ling

pull the latest dockers images：docker pull infiniflow/infinity:nightly，sha256:0ccc2ab9f5d34e9a5f34d879b93fea093b221d753c40b16a2d77fc5c117610fc。

Fint this problem. This is log:
Txn ID: 3788938, Text: clean up, Begin TS: 2081687, Commit TS: 2081688, KV Commit TS: 2081689, State: Committed

Txn ID: 3788952, Text: Select Statement, Begin TS: 2081689, Commit TS: 18446744073709551615, KV Commit TS: 18446744073709551615, State: Started

[05:48:57.461] [438] [critical] Error: Segmentation fault
[05:48:57.461] [438] [critical] 0# infinity::PrintStacktrace@infinity_core(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&) at /infinity/src/common/utility/exception_impl.cpp:47
1# (anonymous namespace)::SignalHandler(int, siginfo_t*, void*) at /infinity/src/bin/infinity_main.cpp:160
2# at :0
3# abort at :0
4# (anonymous namespace)::TerminateHandler() at /infinity/src/bin/infinity_main.cpp:222
5# __cxxabiv1::__terminate(void ()()) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48
6# std::terminate() at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:58
7# __cxa_throw at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:98
8# infinity::FragmentTask@infinity_core::OnExecute() at /infinity/src/scheduler/fragment_task_impl.cpp:103
9# infinity::TaskScheduler@infinity_core::WorkerLoop(infinity::BlockingQueue@infinity_coreinfinity::FragmentTask@infinity_core*, long) at /infinity/src/scheduler/task_scheduler_impl.cpp:254
10# execute_native_thread_routine at ../../../../../libstdc++-v3/src/c++11/thread.cc:104
11# at :0
12# __clone at :0
13#
infinity-sdk is 0.6.11,python 3.12。
We suspect that illegal characters were inserted; please help check this, thanks。

[qinling0210]

Hi @shenzhangzhou,

It is difficult to find out the issue from the log.
Could you set log level as trace and repro the issue again?
And provide table schema, SQL(or script) you are processing and complete infinity.log.

We suspect that illegal characters were inserted; please help check this, thanks。

Please provide the table schema and data you would like to insert.

Ling