Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build: Test more browsers and jquery versions in pull requests #551

Merged
merged 1 commit into from
Oct 29, 2024

Conversation

mgol
Copy link
Member

@mgol mgol commented Oct 29, 2024

Improve the actions setup for PRs so that more issues are detected pre-merge.

Changes:

  1. Test on Edge in IE mode
  2. Test on more jQuery versions: git, 3.x-git, 3.7.1 & their slim versions as well as full versions of each 3.x jQuery minor.

This is still fewer tests than post-merge: we don't test all slim versions and Migrate dev, but this should cover the majority of cases.

This was triggered by me breaking main despite all my PRs being green when merging. Migrate often treats older Core versions differently so testing on at least all full minors is pretty important...

@mgol mgol added this to the 3.6.0 milestone Oct 29, 2024
@mgol mgol requested a review from timmywil October 29, 2024 09:21
@mgol mgol self-assigned this Oct 29, 2024
@mgol mgol force-pushed the pr-actions-improvements branch 6 times, most recently from 253de08 to d74b346 Compare October 29, 2024 09:56
@mgol
Copy link
Member Author

mgol commented Oct 29, 2024

Of course, this will fail now since main is broken. That's a good thing. This PR can be reviewed now, but should only be merged once main is fixed and this PR rebased & green.

Copy link
Member

@timmywil timmywil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Technically, we could run most tests on Safari or Windows instead of Ubuntu and shorten the config by 1/3.

Now that I think about it, we considered that before and it turned out Ubuntu was too fast to drop.

Please make your commit message more specific. For instance,

Build: Test more browsers and jquery versions in pull requests

@mgol mgol changed the title Build: Improve actions setup for PRs Build: Test more browsers and jquery versions in pull requests Oct 29, 2024
@mgol
Copy link
Member Author

mgol commented Oct 29, 2024

Technically, we could run most tests on Safari or Windows instead of Ubuntu and shorten the config by 1/3.

I was following what we have set up in Core.

I think Ubuntu actions run faster in CI than Windows - see this UI one for an example - so it's best to use them when Windows or macOS is not needed.

@timmywil
Copy link
Member

Indeed, I edited my comment. Ubuntu is worth keeping.

@mgol mgol force-pushed the pr-actions-improvements branch 3 times, most recently from b5f6958 to e6413ca Compare October 29, 2024 15:50
@mgol
Copy link
Member Author

mgol commented Oct 29, 2024

@timmywil updated, PTAL

@mgol mgol force-pushed the pr-actions-improvements branch from e6413ca to 76f8055 Compare October 29, 2024 15:54
--jquery 3.7.1 --jquery 3.7.1.slim \
--jquery 3.6.4 --jquery 3.5.1 --jquery 3.4.1 \
--jquery 3.3.1 --jquery 3.2.1 --jquery 3.1.1 --jquery 3.0.0 \
--retries 3 --hard-retries 1
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@timmywil I wonder if that's not too much for PRs and browsers running directly on the machines. What would you recommend?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mgol Agreed. That's a lot of retries for PRs. How about just one retry and no hard retries. We can leave those to browserstack.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated.

@mgol mgol requested a review from timmywil October 29, 2024 15:58
@mgol mgol force-pushed the pr-actions-improvements branch from 76f8055 to c4f42e9 Compare October 29, 2024 16:01
@mgol
Copy link
Member Author

mgol commented Oct 29, 2024

@timmywil this is now blocked on landing the fixes, i.e. PR #552, please review that one.

Improve the actions setup for PRs so that more issues are detected pre-merge.

Changes:
1. Test on Edge in IE mode
2. Test on more jQuery versions: `git`, `3.x-git`, `3.7.1` & their slim versions
   as well as full versions of each `3.x` jQuery minor.

This is still fewer tests than post-merge: we don't test all slim versions and
Migrate dev, but this should cover the majority of cases.
@mgol mgol force-pushed the pr-actions-improvements branch from c4f42e9 to 3371fa7 Compare October 29, 2024 16:16
@mgol mgol removed the Needs review label Oct 29, 2024
@mgol mgol merged commit 579e08e into jquery:main Oct 29, 2024
9 checks passed
@mgol mgol deleted the pr-actions-improvements branch October 29, 2024 16:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants