CI: Run `libtmux` without extra dep groups

[tony]

Fox cases like:

• py(deps[testing,lint]) Add typing-extensions for older python versions #564
• New libtmux update(0.44.1) is broken #571

We should have CI test for typing_extensions and conditional packages not available at runtime.

[tony]

@ppentchev Tried this:

Worked well