throttle_test.test occasionally failed #2282
Description
throttle_test.test occasionally failed due to following error:
[ RUN ] throttle_test.test
create app failed: partition_count should >= 1
E2025-07-27 16:06:10.485 (1753632370485336158 3760) unknown.io-thrd.3760: pegasus_client_factory_impl.cpp:67:get_client(): invalid parameter 'cluster_name'
create app temp succeed, waiting for app ready
temp is ready now: (8/8)
temp is ready now!
sleep 31s to wait app_envs update
start test, on set test / throttle by size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by qps / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by qps, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
=============================
sleep 31s to wait app_envs update
start test, on multi_get test / throttle by size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on multi_set test / throttle by size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on set test / throttle by qps&size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on get test / throttle by qps&size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on set test / throttle by qps&size,loose size throttle / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on get test / throttle by qps&size,loose size throttle/normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on set test / throttle by qps&size,loose qps throttle / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on get test / throttle by qps&size,loose qps throttle/normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / 10kb value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / 10kb value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / 25kb value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / 25kb value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / 100b value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / 100b value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / 10b value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:563: Failure
The difference between result.total_size_per_sec and actual_value is 1804, which exceeds actual_value * 0.3, where
result.total_size_per_sec evaluates to 3696,
actual_value evaluates to 5500, and
actual_value * 0.3 evaluates to 1650.
[ FAILED ] throttle_test.test (969782 ms)
[----------] 1 test from throttle_test (969782 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (969783 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] throttle_test.test
1 FAILED TEST
dsn exit with code 1
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null
Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-27 16:22:20.293 (1753633340293995973 5221) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:22:20.294 (1753633340294022082 5221) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:22:20.299 (1753633340299410541 5257) mimic.io-thrd.5257: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:22:20.300 (1753633340300022691 5266) mimic.io-thrd.5266: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:22:20.300 (1753633340300448269 5221) unknown.io-thrd.5221: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
W2025-07-27 16:22:20.293 (1753633340293995973 5221) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
create app failed: partition_count should >= 1
E2025-07-27 16:22:20.300 (1753633340300482503 5221) unknown.io-thrd.5221: pegasus_client_factory_impl.cpp:67:get_client(): invalid parameter 'cluster_name'
W2025-07-27 16:22:20.294 (1753633340294022082 5221) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
log_dir is not set, use '/__w/incubator-pegasus/incubator-pegasus/build/latest/bin/throttle_test/data/log' instead
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from throttle_test
[ RUN ] throttle_test.test
create app temp succeed, waiting for app ready
temp is ready now: (8/8)
temp is ready now!
sleep 31s to wait app_envs update
start test, on set test / throttle by size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by qps / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by qps, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
=============================
sleep 31s to wait app_envs update
start test, on multi_get test / throttle by size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on multi_set test / throttle by size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on set test / throttle by qps&size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on get test / throttle by qps&size / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on set test / throttle by qps&size,loose size throttle / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on get test / throttle by qps&size,loose size throttle/normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on set test / throttle by qps&size,loose qps throttle / normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
sleep 31s to wait app_envs update
start test, on get test / throttle by qps&size,loose qps throttle/normal value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / 10kb value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / 10kb value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / 25kb value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / 25kb value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / 100b value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / 100b value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / 10b value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / 10b value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on multi_get test / throttle by size / random value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on multi_set test / throttle by size / random value size, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by qps / hotkey test, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by qps / hotkey test, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by size / hotkey test, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by size / hotkey test, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling_by_size
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by qps 500 / no delay throttle, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by qps 500 / no delay throttle, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.read_throttling
=============================
sleep 31s to wait app_envs update
start test, on set test / throttle by qps 500 / delay throttle, duration 10000 ms
del app envs succeed
=============================
deleted keys:
replica.write_throttling
=============================
sleep 31s to wait app_envs update
start test, on get test / throttle by qps 500 / delay throttle, duration 10000 ms
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:316: Failure
Value of: last_error == PERR_OK || last_error == PERR_APP_BUSY
Actual: false
Expected: true
-107
/__w/incubator-pegasus/incubator-pegasus/src/test_util/test_util.cpp:128: Failure
Failed
Timed out waiting for assertion to pass.
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:664: Failure
Expected: start_test(plan) doesn't generate new fatal failures in the current thread.
Actual: it does.
[ FAILED ] throttle_test.test (1443415 ms)
[----------] 1 test from throttle_test (1443415 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (1443415 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] throttle_test.test
1 FAILED TEST
dsn exit with code 1
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null
Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-27 16:46:23.733 (1753634783733680933 7762) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:46:23.733 (1753634783733708484 7762) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:46:23.739 (1753634783739042804 7798) mimic.io-thrd.7798: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:46:23.739 (1753634783739617250 7807) mimic.io-thrd.7807: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:46:23.740 (1753634783740011740 7762) unknown.io-thrd.7762: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
W2025-07-27 16:46:23.733 (1753634783733680933 7762) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:46:23.733 (1753634783733708484 7762) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
log_dir is not set, use '/__w/incubator-pegasus/incubator-pegasus/build/latest/bin/throttle_test/data/log' instead
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from throttle_test
[ RUN ] throttle_test.test
create app failed: partition_count should >= 1
E2025-07-27 16:46:23.740 (1753634783740056083 7762) unknown.io-thrd.7762: pegasus_client_factory_impl.cpp:67:get_client(): invalid parameter 'cluster_name'
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
create app temp succeed, waiting for app ready
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp is ready now!
sleep 31s to wait app_envs update
start test, on set test / throttle by size / normal value size, duration 10000 ms
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:316: Failure
Value of: last_error == PERR_OK || last_error == PERR_APP_BUSY
Actual: false
Expected: true
-2
/__w/incubator-pegasus/incubator-pegasus/src/test_util/test_util.cpp:128: Failure
Failed
Timed out waiting for assertion to pass.
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:332: Failure
Expected: start_test(plan) doesn't generate new fatal failures in the current thread.
Actual: it does.
[ FAILED ] throttle_test.test (186086 ms)
[----------] 1 test from throttle_test (186086 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (186086 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] throttle_test.test
1 FAILED TEST
dsn exit with code 1
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null
Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-27 16:49:29.849 (1753634969849414534 7813) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:49:29.849 (1753634969849440263 7813) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:49:29.854 (1753634969854800808 7849) mimic.io-thrd.7849: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:49:29.855 (1753634969855400803 7858) mimic.io-thrd.7858: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:49:29.855 (1753634969855751706 7813) unknown.io-thrd.7813: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
W2025-07-27 16:49:29.849 (1753634969849414534 7813) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:49:29.849 (1753634969849440263 7813) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
log_dir is not set, use '/__w/incubator-pegasus/incubator-pegasus/build/latest/bin/throttle_test/data/log' instead
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from throttle_test
create app failed: partition_count should >= 1
E2025-07-27 16:49:29.855 (1753634969855788395 7813) unknown.io-thrd.7813: pegasus_client_factory_impl.cpp:67:get_client(): invalid parameter 'cluster_name'
[ RUN ] throttle_test.test
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
create app temp succeed, waiting for app ready
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp is ready now!
sleep 31s to wait app_envs update
start test, on set test / throttle by size / normal value size, duration 10000 ms
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:316: Failure
Value of: last_error == PERR_OK || last_error == PERR_APP_BUSY
Actual: false
Expected: true
-2
/__w/incubator-pegasus/incubator-pegasus/src/test_util/test_util.cpp:128: Failure
Failed
Timed out waiting for assertion to pass.
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:332: Failure
Expected: start_test(plan) doesn't generate new fatal failures in the current thread.
Actual: it does.
[ FAILED ] throttle_test.test (186085 ms)
[----------] 1 test from throttle_test (186085 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (186085 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] throttle_test.test
1 FAILED TEST
dsn exit with code 1
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null
Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-27 16:52:35.964 (1753635155964405203 7864) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:52:35.964 (1753635155964432494 7864) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:52:35.969 (1753635155969659714 7900) mimic.io-thrd.7900: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:52:35.970 (1753635155970261202 7909) mimic.io-thrd.7909: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:52:35.970 (1753635155970641219 7864) unknown.io-thrd.7864: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
W2025-07-27 16:52:35.964 (1753635155964405203 7864) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:52:35.964 (1753635155964432494 7864) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
log_dir is not set, use '/__w/incubator-pegasus/incubator-pegasus/build/latest/bin/throttle_test/data/log' instead
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from throttle_test
create app failed: partition_count should >= 1
E2025-07-27 16:52:35.970 (1753635155970679711 7864) unknown.io-thrd.7864: pegasus_client_factory_impl.cpp:67:get_client(): invalid parameter 'cluster_name'
[ RUN ] throttle_test.test
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
create app temp succeed, waiting for app ready
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp is ready now!
sleep 31s to wait app_envs update
start test, on set test / throttle by size / normal value size, duration 10000 ms
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:316: Failure
Value of: last_error == PERR_OK || last_error == PERR_APP_BUSY
Actual: false
Expected: true
-2
/__w/incubator-pegasus/incubator-pegasus/src/test_util/test_util.cpp:128: Failure
Failed
Timed out waiting for assertion to pass.
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:332: Failure
Expected: start_test(plan) doesn't generate new fatal failures in the current thread.
Actual: it does.
[ FAILED ] throttle_test.test (186087 ms)
[----------] 1 test from throttle_test (186087 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (186088 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] throttle_test.test
1 FAILED TEST
dsn exit with code 1
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null
Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-27 16:55:42.081 (1753635342081160122 7915) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:55:42.081 (1753635342081231727 7915) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-27 16:55:42.086 (1753635342086568188 7951) mimic.io-thrd.7951: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:55:42.087 (1753635342087126234 7960) mimic.io-thrd.7960: task_worker.cpp:147:set_priority(): You may need priviledge to set thread priority: errno = 1, msg = Operation not permitted
W2025-07-27 16:55:42.087 (1753635342087507630 7915) unknown.io-thrd.7915: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
W2025-07-27 16:55:42.081 (1753635342081160122 7915) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
create app failed: partition_count should >= 1
E2025-07-27 16:55:42.087 (1753635342087543898 7915) unknown.io-thrd.7915: pegasus_client_factory_impl.cpp:67:get_client(): invalid parameter 'cluster_name'
W2025-07-27 16:55:42.081 (1753635342081231727 7915) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
log_dir is not set, use '/__w/incubator-pegasus/incubator-pegasus/build/latest/bin/throttle_test/data/log' instead
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from throttle_test
[ RUN ] throttle_test.test
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
create app temp succeed, waiting for app ready
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp not ready yet, still waiting... (0/8)
temp is ready now!
sleep 31s to wait app_envs update
start test, on set test / throttle by size / normal value size, duration 10000 ms
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:316: Failure
Value of: last_error == PERR_OK || last_error == PERR_APP_BUSY
Actual: false
Expected: true
-2
/__w/incubator-pegasus/incubator-pegasus/src/test_util/test_util.cpp:128: Failure
Failed
Timed out waiting for assertion to pass.
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/throttle/test_throttle.cpp:332: Failure
Expected: start_test(plan) doesn't generate new fatal failures in the current thread.
Actual: it does.
[ FAILED ] throttle_test.test (186085 ms)
[----------] 1 test from throttle_test (186085 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (186085 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] throttle_test.test
1 FAILED TEST
dsn exit with code 1
---- ls ----
total 3472
-rw-r--r-- 1 root root 10349 Jul 27 15:30 Makefile
-rw-r--r-- 1 root root 1659 Jul 27 15:30 cmake_install.cmake
-rw-r--r-- 1 root root 2390 Jul 27 16:06 config.ini
drwxr-xr-x 4 root root 4096 Jul 27 16:06 data
-rwxr-xr-x 1 root root 1829 Jul 27 15:29 run.sh
-rwxr-xr-x 1 root root 3524728 Jul 27 15:42 throttle_test
Error: Process completed with exit code 1.