TST/CI: Investigate numba=0.61 test segfaults on Ubuntu ARM jobs

[mroeschke]

In #60847, we're skipping tests that use numba=0.61 on Ubuntu ARM jobs because they are causing segfaults. We should come up with a minimum reproducible example that be reported to numba so ideally we won't have to skip these tests in future numba releases.