Skip to content

Commit 56a8a39

Browse files
committed
Testing: populate Linux exclusion lists from the release/23.x CI run
Re-triaged from run 30147111711 (#231), now that the --daemonize and local-action-path fixes let the jobs actually execute: x86_64 functionalities, i686 commands + Python API, and aarch64 commands + Python API each ran to completion and their real FAIL/ERROR sets are recorded here. i686 and aarch64 functionalities both crashed lldb itself (Fatal Python error: Segmentation fault, in TestThreadJump and TestReturnValue.test_with_python respectively) before producing a usable failure list; those two classes are excluded outright so the rest of the suite can run, and the crashes themselves still need root-causing separately. Not yet covered: x86_64/i686 misc (job cancelled/not captured) and x86_64 commands (log expired before it could be fetched) -- still using the empty placeholder for those categories' contributions. Android is untouched here: its failures (missing libc++_static.a for the NDK sysroot at api level 28) are a build-environment problem, not per-test failures worth cataloging into an exclusion list -- that's part of the still-pending Android CI fix-up.
1 parent 94801c2 commit 56a8a39

3 files changed

Lines changed: 171 additions & 0 deletions

File tree

Lines changed: 76 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1 +1,77 @@
11
skip
2+
TestCommandScript.CmdPythonTestCase.test
3+
TestDetachResumes.DetachResumesTestCase.test_detach_resumes
4+
TestExprWithFork.ExprWithForkTestCase.test_expr_concurrent_fork_other_thread_follow_child
5+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_fork_stop_on_fork
6+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_fork_stop_on_fork_follow_child
7+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_vfork_stop_on_fork
8+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_vfork_stop_on_fork_breakpoints_work
9+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_vfork_stop_on_fork_follow_child
10+
TestFixIts.ExprCommandWithFixits.test_with_dummy_target_dwarf
11+
TestFrames.FrameAPITestCase.test_get_arg_vals_for_call_stack_dwarf
12+
TestFrames.FrameAPITestCase.test_get_arg_vals_for_call_stack_dwo
13+
TestHelloWorld.HelloWorldTestCase.test_with_attach_to_process_with_id_api
14+
TestHelloWorld.HelloWorldTestCase.test_with_attach_to_process_with_name_api
15+
TestMyFirstWatchpoint.HelloWatchpointTestCase.test_hello_watchpoint_using_watchpoint_set
16+
TestPlugin.TestFrameVar.test_plugin_list_enable_disable_commands
17+
TestProcessAPI.ProcessAPITestCase.test_get_process_info_arguments_dwarf
18+
TestProcessAPI.ProcessAPITestCase.test_get_process_info_arguments_dwo
19+
TestRegisters.RegisterCommandsTestCase.test_info_register
20+
TestRegisters.RegisterCommandsTestCase.test_register_read_fields
21+
TestRegistersIterator.RegistersIteratorTestCase.test_iter_registers_dwarf
22+
TestRegistersIterator.RegistersIteratorTestCase.test_iter_registers_dwo
23+
TestReturnValue.ReturnValueTestCase
24+
TestSVERegisters.RegisterCommandsTestCase.test_registers_expr_read_write_sve_sve
25+
TestSVERegisters.RegisterCommandsTestCase.test_sve_registers_configuration
26+
TestSVESIMDRegisters.SVESIMDRegistersTestCase.test_simd_registers_simd
27+
TestSVESIMDRegisters.SVESIMDRegistersTestCase.test_simd_registers_sve
28+
TestSVEThreadedDynamic.RegisterCommandsTestCase.test_sve_registers_dynamic_config
29+
TestSetWatchlocation.SetWatchlocationAPITestCase.test_watch_location
30+
TestSetWatchpoint.SetWatchpointAPITestCase.test_watch_val
31+
TestSetWatchpoint.SetWatchpointAPITestCase.test_watch_variable
32+
TestSettings.SettingsCommandTestCase.test_launchsimple_args_and_env_vars
33+
TestSettings.SettingsCommandTestCase.test_run_args_and_env_vars
34+
TestStepOverWatchpoint.TestStepOverWatchpoint.test_step_over_read_watchpoint
35+
TestStepOverWatchpoint.TestStepOverWatchpoint.test_step_over_write_watchpoint
36+
TestStopHookScripted.TestStopHooks.test_bad_handler
37+
TestStopHookScripted.TestStopHooks.test_self_deleting
38+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted
39+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_auto_continue
40+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_no_entry
41+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_return_false
42+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_right_func
43+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_right_lines
44+
TestTargetWatchAddress.TargetWatchpointCreateByAddressPITestCase.test_watch_address
45+
TestTargetWatchAddress.TargetWatchpointCreateByAddressPITestCase.test_watch_address_with_invalid_watch_size
46+
TestTargetWatchAddress.TargetWatchpointCreateByAddressPITestCase.test_watch_create_by_address
47+
TestUnalignedWatchpoint.UnalignedWatchpointTestCase.test_unaligned_watchpoint
48+
TestValueOfVectorVariable.TestValueOfVectorVariableTestCase.test_value_of_vector_variable_using_watchpoint_set
49+
TestWatchLocation.HelloWatchLocationTestCase.test_hello_watchlocation
50+
TestWatchTaggedAddress.TestWatchTaggedAddresses.test_watch_hit_tagged_ptr_access
51+
TestWatchTaggedAddress.TestWatchTaggedAddresses.test_watch_set_on_tagged_ptr
52+
TestWatchpointCommandLLDB.WatchpointLLDBCommandTestCase.test_watchpoint_command
53+
TestWatchpointCommandLLDB.WatchpointLLDBCommandTestCase.test_watchpoint_command_can_disable_a_watchpoint
54+
TestWatchpointCommandPython.WatchpointPythonCommandTestCase.test_continue_in_watchpoint_command
55+
TestWatchpointCommandPython.WatchpointPythonCommandTestCase.test_watchpoint_command
56+
TestWatchpointCommands.WatchpointCommandsTestCase.test_rw_disable_after_first_stop
57+
TestWatchpointCommands.WatchpointCommandsTestCase.test_rw_disable_then_enable
58+
TestWatchpointCommands.WatchpointCommandsTestCase.test_rw_watchpoint
59+
TestWatchpointCommands.WatchpointCommandsTestCase.test_rw_watchpoint_delete
60+
TestWatchpointCommands.WatchpointCommandsTestCase.test_rw_watchpoint_set_ignore_count
61+
TestWatchpointConditionAPI.WatchpointConditionAPITestCase.test_watchpoint_cond_api
62+
TestWatchpointConditionCmd.WatchpointConditionCmdTestCase.test_watchpoint_cond
63+
TestWatchpointDisable.TestWatchpointSetEnable.test_disable_enable_works
64+
TestWatchpointDisable.TestWatchpointSetEnable.test_disable_works
65+
TestWatchpointEvents.TestWatchpointEvents.test_with_python_api
66+
TestWatchpointIgnoreCount.WatchpointIgnoreCountTestCase.test_set_watch_ignore_count
67+
TestWatchpointIter.WatchpointIteratorTestCase.test_watch_iter
68+
TestWatchpointMultipleSlots.WatchpointSlotsTestCase.test_multiple_watchpoints_on_same_word
69+
TestWatchpointMultipleThreads.WatchpointForMultipleThreadsTestCase.test_watchpoint_after_thread_launch
70+
TestWatchpointMultipleThreads.WatchpointForMultipleThreadsTestCase.test_watchpoint_after_thread_start
71+
TestWatchpointMultipleThreads.WatchpointForMultipleThreadsTestCase.test_watchpoint_before_thread_start
72+
TestWatchpointMultipleThreads.WatchpointForMultipleThreadsTestCase.test_watchpoint_multiple_threads_wp_set_and_then_delete
73+
TestWatchpointRead.SetReadOnlyWatchpointTestCase.test_read_watchpoint_watch_address
74+
TestWatchpointRead.SetReadOnlyWatchpointTestCase.test_read_watchpoint_watch_create_by_address
75+
TestWatchpointSizes.WatchpointSizeTestCase.test_byte_size_watchpoints_with_byte_selection
76+
TestWatchpointSizes.WatchpointSizeTestCase.test_four_byte_watchpoints_with_dword_selection
77+
TestWatchpointSizes.WatchpointSizeTestCase.test_two_byte_watchpoints_with_word_selection
Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1 +1,41 @@
11
skip
2+
TestContainerCommands.TestCmdContainer.test_container_add
3+
TestDetachResumes.DetachResumesTestCase.test_detach_resumes
4+
TestExprWithFork.ExprWithForkTestCase.test_expr_concurrent_fork_other_thread_follow_child
5+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_fork_stop_on_fork
6+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_fork_stop_on_fork_follow_child
7+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_vfork_stop_on_fork
8+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_vfork_stop_on_fork_breakpoints_work
9+
TestExprWithFork.ExprWithForkTestCase.test_expr_with_vfork_stop_on_fork_follow_child
10+
TestExpressionInSyscall.ExprSyscallTestCase.test_setpgid_dwarf
11+
TestExpressionInSyscall.ExprSyscallTestCase.test_setpgid_dwo
12+
TestFindInMemory.FindInMemoryTestCase.test_memory_info_list_iterable
13+
TestFixIts.ExprCommandWithFixits.test_with_dummy_target_dwarf
14+
TestFrameRecognizer.FrameRecognizerTestCase.test_frame_recognizer_1
15+
TestFrameRecognizer.FrameRecognizerTestCase.test_frame_recognizer_not_only_first_instruction
16+
TestFrameRecognizer.FrameRecognizerTestCase.test_recognized_args_filtered_by_name
17+
TestFrames.FrameAPITestCase.test_get_arg_vals_for_call_stack_dwarf
18+
TestFrames.FrameAPITestCase.test_get_arg_vals_for_call_stack_dwo
19+
TestHelloWorld.HelloWorldTestCase.test_with_attach_to_process_with_id_api
20+
TestHelloWorld.HelloWorldTestCase.test_with_attach_to_process_with_name_api
21+
TestProcessAPI.ProcessAPITestCase.test_get_process_info_arguments_dwarf
22+
TestProcessAPI.ProcessAPITestCase.test_get_process_info_arguments_dwo
23+
TestRegistersIterator.RegistersIteratorTestCase.test_iter_registers_dwarf
24+
TestRegistersIterator.RegistersIteratorTestCase.test_iter_registers_dwo
25+
TestSBTypeBasicType.TestCase.test_dwarf
26+
TestSBTypeBasicType.TestCase.test_dwo
27+
TestSettings.SettingsCommandTestCase.test_launchsimple_args_and_env_vars
28+
TestSettings.SettingsCommandTestCase.test_run_args_and_env_vars
29+
TestStopHookScripted.TestStopHooks.test_bad_handler
30+
TestStopHookScripted.TestStopHooks.test_self_deleting
31+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted
32+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_auto_continue
33+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_no_entry
34+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_return_false
35+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_right_func
36+
TestStopHookScripted.TestStopHooks.test_stop_hooks_scripted_right_lines
37+
TestThreadJump.ThreadJumpTestCase
38+
TestWatchpointRead.SetReadOnlyWatchpointTestCase.test_read_watchpoint_watch_address
39+
TestWatchpointRead.SetReadOnlyWatchpointTestCase.test_read_watchpoint_watch_create_by_address
40+
lldbsuite.test.lldbtest.Test128BitsInteger.test_dwarf
41+
lldbsuite.test.lldbtest.Test128BitsInteger.test_dwo
Lines changed: 55 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1 +1,56 @@
11
skip
2+
TestBreakpointSerialization.BreakpointSerialization.test_scripted_extra_args
3+
TestConcurrentBatchedBreakpointStepOver.ConcurrentBatchedBreakpointStepOver.test
4+
TestConcurrentNWatchNBreak.ConcurrentNWatchNBreak.test
5+
TestDataFormatterSynthVal.DataFormatterSynthValueTestCase.test_with_run_command_dwarf
6+
TestDataFormatterSynthVal.DataFormatterSynthValueTestCase.test_with_run_command_dwo
7+
TestDebugIndexCache.DebugIndexCacheTestcase.test_with_caching_enabled
8+
TestDyldExecLinux.TestLinux64ExecViaDynamicLoader.test_with_svr4
9+
TestDyldExecLinux.TestLinux64ExecViaDynamicLoader.test_without_svr4
10+
TestDyldLaunchLinux.TestLinux64LaunchingViaDynamicLoader.test
11+
TestExec.ExecTestCase.test_correct_thread_plan_state_before_exec
12+
TestExec.ExecTestCase.test_hitting_exec
13+
TestExec.ExecTestCase.test_skipping_exec
14+
TestFrameProviderCircularDependency.FrameProviderCircularDependencyTestCase.test_circular_dependency_with_function_replacement
15+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_bt_provider_all_shows_all
16+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_bt_provider_multiple_providers
17+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_bt_provider_range
18+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_bt_provider_range_not_starting_at_zero
19+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_bt_provider_range_with_to_separator
20+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_bt_provider_shows_provider_frames
21+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_bt_provider_star_from_within_provider
22+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_bt_provider_star_shows_all
23+
TestFrameProviderPassThroughPrefix.FrameProviderPassThroughPrefixTestCase.test_pass_through_with_prefix
24+
TestFrameProviderThreadFilter.FrameProviderThreadFilterTestCase.test_bt_provider_star_with_thread_filter
25+
TestGDBRemoteClient.TestGDBRemoteClient.test_launch_A
26+
TestGDBRemoteClient.TestGDBRemoteClient.test_launch_lengthy_vRun
27+
TestGDBRemoteClient.TestGDBRemoteClient.test_launch_vRun
28+
TestIgnoreSuspendedThread.IgnoreSuspendedThreadTestCase.test
29+
TestInferiorCrashing.CrashingInferiorTestCase.test_inferior_crashing_dwarf
30+
TestInferiorCrashing.CrashingInferiorTestCase.test_inferior_crashing_dwo
31+
TestJitBreakPoint.TestJitBreakpoint.test_jit_breakpoints_dwarf
32+
TestJitBreakPoint.TestJitBreakpoint.test_jit_breakpoints_dwo
33+
TestLoadUnload.LoadUnloadTestCase.test_static_init_during_load
34+
TestMachCore.MachCoreTestCase.test_selected_thread
35+
TestMainThreadExit.ThreadExitTestCase.test
36+
TestMemoryHoles.MemoryHolesTestCase.test_memory_find
37+
TestModuleCacheSimple.ModuleCacheTestcaseSimple.test
38+
TestOSPluginStepping.TestOSPluginStepping.test_python_os_plugin
39+
TestOSPluginStepping.TestOSPluginStepping.test_python_os_plugin_prune
40+
TestOverridesResolver.TestOverridesResolver.test_overrides_resolver_resolver_cmd
41+
TestOverridesResolver.TestOverridesResolver.test_overrides_resolver_resolver_python
42+
TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_default_options_dwarf
43+
TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_default_options_dwo
44+
TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_dwarf
45+
TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_dwo
46+
TestPyObjSynthProvider.PyObjectSynthProviderTestCase.test_print_array
47+
TestPythonOSPlugin.PluginPythonOSPlugin.test_python_os_plugin
48+
TestRunLockReentrantDeadlock.TestRunLockReentrantDeadlock.test_runlock_reentrant_no_deadlock
49+
TestSendSignal.SendSignalTestCase.test_with_run_command_dwarf
50+
TestSendSignal.SendSignalTestCase.test_with_run_command_dwo
51+
TestStateAfterExpression.TestStopReasonAfterExpression.test_thread_state_after_expr_dwarf
52+
TestStateAfterExpression.TestStopReasonAfterExpression.test_thread_state_after_expr_dwo
53+
TestSyntheticCapping.SyntheticCappingTestCase.test_with_run_command_dwarf
54+
TestSyntheticCapping.SyntheticCappingTestCase.test_with_run_command_dwo
55+
TestUnalignedLargeWatchpoint.UnalignedLargeWatchpointTestCase.test_unaligned_large_watchpoint
56+
TestWasHitWithFrameProviderDeadlock.TestWasHitWithFrameProviderDeadlock.test_was_hit_with_frame_provider_no_deadlock

0 commit comments

Comments
 (0)