-
Notifications
You must be signed in to change notification settings - Fork 6.8k
build: add blocklist to disable individual tests in the project #16833
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
build: add blocklist to disable individual tests in the project #16833
Conversation
Similarly to what we had in the `ivy-2019` branch for disabling individual tests, we now need something similar that works with Bazel. This is necessary because there are still breaking changes that could land in the framework repository and break individual tests of the component repository. Framework now needs a way to disable those specific tests until the components repository migrated the broken tests (this can be delayed by weeks since the breaking change is not necessarily yet released)
4de4e3b
to
69999d7
Compare
Initially the blocklist has been removed because there were no remaining disabled tests that failed. Also the blocklist logic didn't work anymore because the `material-unit-tests` CI job now runs against `angular/components#master` with Bazel. 388578f tried to revert the removal of the blocklist in favor of a new upcoming breaking change with HammerJS, but the revert doesn't help since the blocklist still doesn't work with Bazel. In order to make the blocklist work with the unit tests running with Bazel, a PR has been submitted on the components repository. See: angular/components#16833. This commit updates the blocklist logic on the framework side to work with the new logic on the components repo side.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall LGTM, just one quick comment
* repository. It should be possible to disable these tests until the component repository | ||
* migrated the broken tests. | ||
*/ | ||
export const testBlocklist: {[testName: string]: Object} = {}; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should this be BlocklistEntry
like we have in Framework?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good question. I decided not to do that as on the components side we are not interested in notes or error message but rather just in the list of disabled tests.
Happy to change though. I don't feel too strong 😄
Also there would be no benefit for us on the components side and framework side. Just duplication IMO
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Whichever way is fine with me, we can leave it. Its a temporary piece anyway that we shouldn't need for a long time anyway.
Initially the blocklist has been removed because there were no remaining disabled tests that failed. Also the blocklist logic didn't work anymore because the `material-unit-tests` CI job now runs against `angular/components#master` with Bazel. 388578f tried to revert the removal of the blocklist in favor of a new upcoming breaking change with HammerJS, but the revert doesn't help since the blocklist still doesn't work with Bazel. In order to make the blocklist work with the unit tests running with Bazel, a PR has been submitted on the components repository. See: angular/components#16833. This commit updates the blocklist logic on the framework side to work with the new logic on the components repo side. PR Close #32239
Similarly to what we had in the `ivy-2019` branch for disabling individual tests, we now need something similar that works with Bazel. This is necessary because there are still breaking changes that could land in the framework repository and break individual tests of the component repository. Framework now needs a way to disable those specific tests until the components repository migrated the broken tests (this can be delayed by weeks since the breaking change is not necessarily yet released) (cherry picked from commit 18b9ef3)
Initially the blocklist has been removed because there were no remaining disabled tests that failed. Also the blocklist logic didn't work anymore because the `material-unit-tests` CI job now runs against `angular/components#master` with Bazel. 388578f tried to revert the removal of the blocklist in favor of a new upcoming breaking change with HammerJS, but the revert doesn't help since the blocklist still doesn't work with Bazel. In order to make the blocklist work with the unit tests running with Bazel, a PR has been submitted on the components repository. See: angular/components#16833. This commit updates the blocklist logic on the framework side to work with the new logic on the components repo side. PR Close angular#32239
This issue has been automatically locked due to inactivity. Read more about our automatic conversation locking policy. This action has been performed automatically by a bot. |
Similarly to what we had in the
ivy-2019
branch for disablingindividual tests, we now need something similar that works with
Bazel. This is necessary because there are still breaking changes
that could land in the framework repository and break individual
tests of the component repository.
Framework now needs a way to disable those specific tests until
the components repository migrated the broken tests (this can
be delayed by weeks since the breaking change is not necessarily
yet released)