Skip to content

Add new benchmarks and benchmarker functionality (try 2) #509

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Jun 22, 2022

Conversation

rctcwyvrn
Copy link
Contributor

@rctcwyvrn rctcwyvrn commented Jun 21, 2022

Fixes since the last PR

  • Use ISO8601FormatStyle to fix the linux build failure It turns out that doesn't exist on corelibs-foundation either. It turns out the entire format function is missing so work around it with some #if
  • Remove diff filtering for comparison results (just make sure it's more than a picosecond to remove any diffs from floating point rounding)
  • Add a createBenchmark.py util script to create benchmarks + register them. After looking around at swift-collection-benchmark and the main swift repo's benchmarks, this seems to be the best way of doing things

@rctcwyvrn rctcwyvrn requested a review from milseman June 21, 2022 19:33
@rctcwyvrn
Copy link
Contributor Author

@swift-ci test

@rctcwyvrn
Copy link
Contributor Author

@swift-ci test

Copy link
Member

@milseman milseman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@@ -0,0 +1,61 @@
# python3 createBenchmark.py MyRegexBenchmark
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the benchmarks just added themselves to an array, would that simplify the registration process?

@rctcwyvrn
Copy link
Contributor Author

@swift-ci test

@rctcwyvrn rctcwyvrn merged commit 93b569d into swiftlang:main Jun 22, 2022
rctcwyvrn added a commit to rctcwyvrn/swift-experimental-string-processing that referenced this pull request Jun 30, 2022
- Adds benchmarks for html and email regexes
- Adds support to save and compare benchmarker runs

Co-authored-by: Michael Ilseman <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants