Skip to content

Revert "[lldb/test] Mark TestStepScripted.py as XFAIL temporarily (#96894)" #96942

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

medismailben
Copy link
Member

This tentatively reverts commit 204c403 to remove the XFAIL from the tests while also trying to fix them at the same time.

…vm#96894)"

This tentatively reverts commit 204c403 to
remove the XFAIL from the tests while also trying to fix them at the same time.

Signed-off-by: Med Ismail Bennani <[email protected]>
@llvmbot
Copy link
Member

llvmbot commented Jun 27, 2024

@llvm/pr-subscribers-lldb

Author: Med Ismail Bennani (medismailben)

Changes

This tentatively reverts commit 204c403 to remove the XFAIL from the tests while also trying to fix them at the same time.


Full diff: https://github.com/llvm/llvm-project/pull/96942.diff

2 Files Affected:

  • (modified) lldb/test/API/functionalities/step_scripted/Steps.py (+1)
  • (modified) lldb/test/API/functionalities/step_scripted/TestStepScripted.py (+1-4)
diff --git a/lldb/test/API/functionalities/step_scripted/Steps.py b/lldb/test/API/functionalities/step_scripted/Steps.py
index 3325dba753657..b121f71538ce4 100644
--- a/lldb/test/API/functionalities/step_scripted/Steps.py
+++ b/lldb/test/API/functionalities/step_scripted/Steps.py
@@ -92,6 +92,7 @@ def should_stop(self, event):
 
     def stop_description(self, stream):
         stream.Print(f"Stepped until {self.var_name} changed.")
+        return True
 
 
 # This plan does nothing, but sets stop_mode to the
diff --git a/lldb/test/API/functionalities/step_scripted/TestStepScripted.py b/lldb/test/API/functionalities/step_scripted/TestStepScripted.py
index bb7479414dbbb..53901718019f9 100644
--- a/lldb/test/API/functionalities/step_scripted/TestStepScripted.py
+++ b/lldb/test/API/functionalities/step_scripted/TestStepScripted.py
@@ -7,6 +7,7 @@
 from lldbsuite.test.decorators import *
 from lldbsuite.test.lldbtest import *
 
+
 class StepScriptedTestCase(TestBase):
     NO_DEBUG_INFO_TESTCASE = True
 
@@ -15,14 +16,12 @@ def setUp(self):
         self.main_source_file = lldb.SBFileSpec("main.c")
         self.runCmd("command script import Steps.py")
 
-    @expectedFailureAll()
     def test_standard_step_out(self):
         """Tests stepping with the scripted thread plan laying over a standard
         thread plan for stepping out."""
         self.build()
         self.step_out_with_scripted_plan("Steps.StepOut")
 
-    @expectedFailureAll()
     def test_scripted_step_out(self):
         """Tests stepping with the scripted thread plan laying over an another
         scripted thread plan for stepping out."""
@@ -63,12 +62,10 @@ def test_misspelled_plan_name(self):
         # Make sure we didn't let the process run:
         self.assertEqual(stop_id, process.GetStopID(), "Process didn't run")
 
-    @expectedFailureAll()
     def test_checking_variable(self):
         """Test that we can call SBValue API's from a scripted thread plan - using SBAPI's to step"""
         self.do_test_checking_variable(False)
 
-    @expectedFailureAll()
     def test_checking_variable_cli(self):
         """Test that we can call SBValue API's from a scripted thread plan - using cli to step"""
         self.do_test_checking_variable(True)

@medismailben medismailben merged commit b949b64 into llvm:main Jun 27, 2024
6 of 7 checks passed
@llvm-ci
Copy link
Collaborator

llvm-ci commented Jun 27, 2024

LLVM Buildbot has detected a new failure on builder lldb-x86_64-debian running on lldb-x86_64-debian while building lldb at step 6 "test".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/162/builds/899

Here is the relevant piece of the build log for the reference:

Step 6 (test) failure: build (failure)
...
PASS: lldb-api :: functionalities/thread/concurrent_events/TestConcurrentSignalDelayWatch.py (145 of 2619)
PASS: lldb-api :: functionalities/plugins/python_os_plugin/stepping_plugin_threads/TestOSPluginStepping.py (146 of 2619)
PASS: lldb-api :: functionalities/tail_call_frames/ambiguous_tail_call_seq2/TestAmbiguousTailCallSeq2.py (147 of 2619)
PASS: lldb-api :: functionalities/data-formatter/data-formatter-stl/generic/bitset/TestDataFormatterGenericBitset.py (148 of 2619)
PASS: lldb-shell :: Subprocess/vfork-follow-child-wp.test (149 of 2619)
PASS: lldb-shell :: SymbolFile/DWARF/x86/dwp-separate-debug-file.cpp (150 of 2619)
PASS: lldb-api :: python_api/file_handle/TestFileHandle.py (151 of 2619)
PASS: lldb-api :: lang/cpp/static_members/TestCPPStaticMembers.py (152 of 2619)
PASS: lldb-api :: functionalities/thread/concurrent_events/TestConcurrentWatchBreakDelay.py (153 of 2619)
XFAIL: lldb-api :: functionalities/longjmp/TestLongjmp.py (154 of 2619)
FAIL: lldb-api :: functionalities/step_scripted/TestStepScripted.py (155 of 2619)
******************** TEST 'lldb-api :: functionalities/step_scripted/TestStepScripted.py' FAILED ********************
Script:
--
/usr/bin/python3 /home/worker/2.0.1/lldb-x86_64-debian/llvm-project/lldb/test/API/dotest.py -u CXXFLAGS -u CFLAGS --env ARCHIVER=/usr/bin/ar --env OBJCOPY=/usr/bin/objcopy --env LLVM_LIBS_DIR=/home/worker/2.0.1/lldb-x86_64-debian/build/./lib --env LLVM_INCLUDE_DIR=/home/worker/2.0.1/lldb-x86_64-debian/build/include --env LLVM_TOOLS_DIR=/home/worker/2.0.1/lldb-x86_64-debian/build/./bin --arch x86_64 --build-dir /home/worker/2.0.1/lldb-x86_64-debian/build/lldb-test-build.noindex --lldb-module-cache-dir /home/worker/2.0.1/lldb-x86_64-debian/build/lldb-test-build.noindex/module-cache-lldb/lldb-api --clang-module-cache-dir /home/worker/2.0.1/lldb-x86_64-debian/build/lldb-test-build.noindex/module-cache-clang/lldb-api --executable /home/worker/2.0.1/lldb-x86_64-debian/build/./bin/lldb --compiler /home/worker/2.0.1/lldb-x86_64-debian/build/./bin/clang --dsymutil /home/worker/2.0.1/lldb-x86_64-debian/build/./bin/dsymutil --llvm-tools-dir /home/worker/2.0.1/lldb-x86_64-debian/build/./bin --lldb-obj-root /home/worker/2.0.1/lldb-x86_64-debian/build/tools/lldb --lldb-libs-dir /home/worker/2.0.1/lldb-x86_64-debian/build/./lib -t /home/worker/2.0.1/lldb-x86_64-debian/llvm-project/lldb/test/API/functionalities/step_scripted -p TestStepScripted.py
--
Exit Code: 1

Command Output (stdout):
--
lldb version 19.0.0git (https://github.com/llvm/llvm-project.git revision b949b6420775fe3466dc5a5bf34eab1d14e39e8f)
  clang revision b949b6420775fe3466dc5a5bf34eab1d14e39e8f
  llvm revision b949b6420775fe3466dc5a5bf34eab1d14e39e8f
Skipping the following test categories: ['libc++', 'dsym', 'gmodules', 'debugserver', 'objc']
thread step-scripted -C Steps.StepReportsStopOthers -k token -v 140691819938496 --run-mode all-threads
{'140691819938496': False}
thread step-scripted -C Steps.StepReportsStopOthers -k token -v 140691819938496 --run-mode this-thread
{'140691819938496': True}
thread step-scripted -C Steps.StepReportsStopOthers -k token -v 140691819938496
{'140691819938496': True}
thread step-scripted -C Steps.StepReportsStopOthers -k token -v 140691819938496
{'140691819938496': False}

--
Command Output (stderr):
--
Change dir to: /home/worker/2.0.1/lldb-x86_64-debian/llvm-project/lldb/test/API/functionalities/step_scripted
runCmd: settings clear -all

output: 

runCmd: settings set symbols.enable-external-lookup false

output: 

runCmd: settings set target.inherit-tcc true

output: 


@llvm-ci
Copy link
Collaborator

llvm-ci commented Jun 27, 2024

LLVM Buildbot has detected a new failure on builder lldb-aarch64-ubuntu running on linaro-lldb-aarch64-ubuntu while building lldb at step 6 "test".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/59/builds/678

Here is the relevant piece of the build log for the reference:

Step 6 (test) failure: build (failure)
...
PASS: lldb-api :: functionalities/signal/handle-abrt/TestHandleAbort.py (567 of 1981)
PASS: lldb-api :: functionalities/source-map/TestTargetSourceMap.py (568 of 1981)
PASS: lldb-api :: functionalities/signal/TestSendSignal.py (569 of 1981)
PASS: lldb-api :: functionalities/signal/handle-segv/TestHandleSegv.py (570 of 1981)
PASS: lldb-api :: functionalities/stats_api/TestStatisticsAPI.py (571 of 1981)
PASS: lldb-api :: functionalities/step-avoids-regexp/TestStepAvoidsRegexp.py (572 of 1981)
PASS: lldb-api :: commands/process/attach/TestProcessAttach.py (573 of 1981)
PASS: lldb-api :: functionalities/signal/raise/TestRaise.py (574 of 1981)
PASS: lldb-api :: functionalities/gdb_remote_client/TestPlatformClient.py (575 of 1981)
PASS: lldb-api :: functionalities/step-avoids-no-debug/TestStepNoDebug.py (576 of 1981)
FAIL: lldb-api :: functionalities/step_scripted/TestStepScripted.py (577 of 1981)
******************** TEST 'lldb-api :: functionalities/step_scripted/TestStepScripted.py' FAILED ********************
Script:
--
/usr/bin/python3.8 /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/llvm-project/lldb/test/API/dotest.py -u CXXFLAGS -u CFLAGS --env ARCHIVER=/usr/local/bin/llvm-ar --env OBJCOPY=/usr/bin/llvm-objcopy --env LLVM_LIBS_DIR=/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/./lib --env LLVM_INCLUDE_DIR=/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/include --env LLVM_TOOLS_DIR=/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/./bin --arch aarch64 --build-dir /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/lldb-test-build.noindex --lldb-module-cache-dir /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/lldb-test-build.noindex/module-cache-lldb/lldb-api --clang-module-cache-dir /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/lldb-test-build.noindex/module-cache-clang/lldb-api --executable /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/./bin/lldb --compiler /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/./bin/clang --dsymutil /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/./bin/dsymutil --llvm-tools-dir /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/./bin --lldb-obj-root /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/tools/lldb --lldb-libs-dir /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/./lib /home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/llvm-project/lldb/test/API/functionalities/step_scripted -p TestStepScripted.py
--
Exit Code: 1

Command Output (stdout):
--
lldb version 19.0.0git (https://github.com/llvm/llvm-project.git revision b949b6420775fe3466dc5a5bf34eab1d14e39e8f)
  clang revision b949b6420775fe3466dc5a5bf34eab1d14e39e8f
  llvm revision b949b6420775fe3466dc5a5bf34eab1d14e39e8f
Skipping the following test categories: ['libc++', 'dsym', 'gmodules', 'debugserver', 'objc']

--
Command Output (stderr):
--
FAIL: LLDB (/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/bin/clang-aarch64) :: test_checking_variable (TestStepScripted.StepScriptedTestCase)
FAIL: LLDB (/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/bin/clang-aarch64) :: test_checking_variable_cli (TestStepScripted.StepScriptedTestCase)
PASS: LLDB (/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/bin/clang-aarch64) :: test_misspelled_plan_name (TestStepScripted.StepScriptedTestCase)
FAIL: LLDB (/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/bin/clang-aarch64) :: test_scripted_step_out (TestStepScripted.StepScriptedTestCase)
FAIL: LLDB (/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/bin/clang-aarch64) :: test_standard_step_out (TestStepScripted.StepScriptedTestCase)
PASS: LLDB (/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/bin/clang-aarch64) :: test_stop_others_from_command (TestStepScripted.StepScriptedTestCase)
======================================================================
FAIL: test_checking_variable (TestStepScripted.StepScriptedTestCase)
   Test that we can call SBValue API's from a scripted thread plan - using SBAPI's to step
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/llvm-project/lldb/test/API/functionalities/step_scripted/TestStepScripted.py", line 67, in test_checking_variable
    self.do_test_checking_variable(False)
  File "/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/llvm-project/lldb/test/API/functionalities/step_scripted/TestStepScripted.py", line 113, in do_test_checking_variable
    self.assertIn("Stepped until foo changed", desc, "Got right stop description")
AssertionError: 'Stepped until foo changed' not found in 'Python thread plan implemented by class Steps.StepUntil.' : Got right stop description
Config=aarch64-/home/tcwg-buildbot/worker/lldb-aarch64-ubuntu/build/bin/clang
======================================================================
FAIL: test_checking_variable_cli (TestStepScripted.StepScriptedTestCase)
   Test that we can call SBValue API's from a scripted thread plan - using cli to step
----------------------------------------------------------------------

lravenclaw pushed a commit to lravenclaw/llvm-project that referenced this pull request Jul 3, 2024
…vm#96894)" (llvm#96942)

This tentatively reverts commit 204c403
to remove the XFAIL from the tests while also trying to fix them at the
same time.

Signed-off-by: Med Ismail Bennani <[email protected]>
lravenclaw pushed a commit to lravenclaw/llvm-project that referenced this pull request Jul 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants