Skip to content

build: add blocklist to disable individual tests in the project #16833

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

devversion
Copy link
Member

Similarly to what we had in the ivy-2019 branch for disabling
individual tests, we now need something similar that works with
Bazel. This is necessary because there are still breaking changes
that could land in the framework repository and break individual
tests of the component repository.

Framework now needs a way to disable those specific tests until
the components repository migrated the broken tests (this can
be delayed by weeks since the breaking change is not necessarily
yet released)

@devversion devversion added pr: merge safe target: patch This PR is targeted for the next patch release labels Aug 21, 2019
@devversion devversion requested a review from jelbourn as a code owner August 21, 2019 13:11
@googlebot googlebot added the cla: yes PR author has agreed to Google's Contributor License Agreement label Aug 21, 2019
Similarly to what we had in the `ivy-2019` branch for disabling
individual tests, we now need something similar that works with
Bazel. This is necessary because there are still breaking changes
that could land in the framework repository and break individual
tests of the component repository.

Framework now needs a way to disable those specific tests until
the components repository migrated the broken tests (this can
be delayed by weeks since the breaking change is not necessarily
yet released)
@devversion devversion force-pushed the build/blocklist-test-support branch from 4de4e3b to 69999d7 Compare August 21, 2019 13:31
devversion added a commit to devversion/angular that referenced this pull request Aug 21, 2019
Initially the blocklist has been removed because there were
no remaining disabled tests that failed. Also the blocklist
logic didn't work anymore because the `material-unit-tests` CI
job now runs against `angular/components#master` with Bazel.

388578f tried to revert the removal
of the blocklist in favor of a new upcoming breaking change with
HammerJS, but the revert doesn't help since the blocklist still
doesn't work with Bazel.

In order to make the blocklist work with the unit tests running
with Bazel, a PR has been submitted on the components repository.
See: angular/components#16833.

This commit updates the blocklist logic on the framework side to
work with the new logic on the components repo side.
@devversion devversion added the P2 The issue is important to a large percentage of users, with a workaround label Aug 21, 2019
Copy link
Member

@josephperrott josephperrott left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall LGTM, just one quick comment

* repository. It should be possible to disable these tests until the component repository
* migrated the broken tests.
*/
export const testBlocklist: {[testName: string]: Object} = {};
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be BlocklistEntry like we have in Framework?

Copy link
Member Author

@devversion devversion Aug 21, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question. I decided not to do that as on the components side we are not interested in notes or error message but rather just in the list of disabled tests.

Happy to change though. I don't feel too strong 😄

Also there would be no benefit for us on the components side and framework side. Just duplication IMO

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Whichever way is fine with me, we can leave it. Its a temporary piece anyway that we shouldn't need for a long time anyway.

@josephperrott josephperrott added pr: lgtm action: merge The PR is ready for merge by the caretaker labels Aug 21, 2019
@andrewseguin andrewseguin merged commit 18b9ef3 into angular:master Aug 21, 2019
AndrewKushnir pushed a commit to angular/angular that referenced this pull request Aug 21, 2019
Initially the blocklist has been removed because there were
no remaining disabled tests that failed. Also the blocklist
logic didn't work anymore because the `material-unit-tests` CI
job now runs against `angular/components#master` with Bazel.

388578f tried to revert the removal
of the blocklist in favor of a new upcoming breaking change with
HammerJS, but the revert doesn't help since the blocklist still
doesn't work with Bazel.

In order to make the blocklist work with the unit tests running
with Bazel, a PR has been submitted on the components repository.
See: angular/components#16833.

This commit updates the blocklist logic on the framework side to
work with the new logic on the components repo side.

PR Close #32239
andrewseguin pushed a commit that referenced this pull request Aug 26, 2019
Similarly to what we had in the `ivy-2019` branch for disabling
individual tests, we now need something similar that works with
Bazel. This is necessary because there are still breaking changes
that could land in the framework repository and break individual
tests of the component repository.

Framework now needs a way to disable those specific tests until
the components repository migrated the broken tests (this can
be delayed by weeks since the breaking change is not necessarily
yet released)

(cherry picked from commit 18b9ef3)
sabeersulaiman pushed a commit to sabeersulaiman/angular that referenced this pull request Sep 6, 2019
Initially the blocklist has been removed because there were
no remaining disabled tests that failed. Also the blocklist
logic didn't work anymore because the `material-unit-tests` CI
job now runs against `angular/components#master` with Bazel.

388578f tried to revert the removal
of the blocklist in favor of a new upcoming breaking change with
HammerJS, but the revert doesn't help since the blocklist still
doesn't work with Bazel.

In order to make the blocklist work with the unit tests running
with Bazel, a PR has been submitted on the components repository.
See: angular/components#16833.

This commit updates the blocklist logic on the framework side to
work with the new logic on the components repo side.

PR Close angular#32239
@angular-automatic-lock-bot
Copy link

This issue has been automatically locked due to inactivity.
Please file a new issue if you are encountering a similar or related problem.

Read more about our automatic conversation locking policy.

This action has been performed automatically by a bot.

@angular-automatic-lock-bot angular-automatic-lock-bot bot locked and limited conversation to collaborators Sep 21, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
action: merge The PR is ready for merge by the caretaker cla: yes PR author has agreed to Google's Contributor License Agreement P2 The issue is important to a large percentage of users, with a workaround target: patch This PR is targeted for the next patch release
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants