Evaluation will not finish with CodeQL Bundle v2.21.0

[sasobadovinac]

Evaluation gets stuck with CodeQL Bundle v2.21.0 when using security-and-quality queries
https://github.com/sasobadovinac/FreeCAD/actions/runs/14549227291/job/40818435379

CodeQL Bundle v2.20.7 was working fine
https://github.com/sasobadovinac/FreeCAD/actions/runs/14281995311/job/40032617394

Testing CodeQL Bundle v2.21.1 is also not working
https://github.com/sasobadovinac/FreeCAD/actions/runs/14615985688/job/41004230514

Testing by reverting back to CodeQL Bundle v2.20.7 works
https://github.com/sasobadovinac/FreeCAD/actions/runs/14616489233/job/41005819525

[redsun82]

👋 @sasobadovinac thanks for letting us know!

Comparing started vs finished tests, it seems like the failed 2.21.0 run did not finish IterableStringOrSequence.ql, but the failed 2.21.1 did not finish UnusedExceptionObject.ql. I've looked at another timeout (https://github.com/sasobadovinac/FreeCAD/actions/runs/14549227291/job/40818435379), and there the query hanging was AssertOnTuple.ql. So, it's always a single query remaining, but not always the same one, which is kind of weird. I will call in the relevant team to see if they have any insight.

[redsun82]

Hmm, seems like I did too hasty of an analysis of the logs 😅: there indeed seems to be one query hanging which is FileNotAlwaysClosed.ql. We will investigate this further, but in the meantime, as a workaround you can exclude that query from analysis by adding

        config: |
          query-filters:
          - exclude:
              id: py/file-not-closed

to your github/codeql-action/init action with parameters.