alex 245f74010c speed up playwright and add visual regression tests (#1638) ... This diff: - tweaks how playwright runs in CI to have it go a bit faster - uploads nice browsable reports to S3 for looking at playwright failures and traces - adds visual regression testing to playwright ### Change Type - [x] `tests` — Changes to any test code only[^2] ### Test Plan - [ ] Unit Tests - [x] End to end tests ### Release Notes -- --------- Co-authored-by: huppy-bot[bot] <128400622+huppy-bot[bot]@users.noreply.github.com>		2023-06-23 11:53:04 +00:00
..
Export-snapshots-Exports-with-arrow-fill-none-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-none-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-none-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-none-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-pattern-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-pattern-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-pattern-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-pattern-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-semi-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-semi-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-semi-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-semi-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-solid-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-solid-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-solid-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-fill-solid-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-draw-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-draw-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-draw-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-draw-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-mono-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-mono-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-mono-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-mono-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-sans-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-sans-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-sans-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-sans-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-serif-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-serif-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-serif-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-arrow-font-serif-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-none-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-none-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-none-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-none-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-pattern-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-pattern-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-pattern-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-pattern-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-semi-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-semi-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-semi-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-semi-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-solid-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-solid-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-solid-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-draw-fill-solid-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-none-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-none-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-none-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-none-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-pattern-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-pattern-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-pattern-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-pattern-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-semi-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-semi-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-semi-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-semi-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-solid-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-solid-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-solid-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-fill-solid-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-draw-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-draw-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-draw-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-draw-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-mono-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-mono-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-mono-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-mono-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-sans-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-sans-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-sans-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-sans-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-serif-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-serif-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-serif-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-geo-font-serif-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-draw-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-draw-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-draw-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-draw-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-mono-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-mono-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-mono-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-mono-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-sans-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-sans-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-sans-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-sans-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-serif-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-serif-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-serif-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-note-font-serif-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-draw-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-draw-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-draw-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-draw-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-mono-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-mono-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-mono-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-mono-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-sans-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-sans-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-sans-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-sans-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-serif-1-chromium-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-serif-1-chromium-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-serif-1-Mobile-Chrome-darwin.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00
Export-snapshots-Exports-with-text-font-serif-1-Mobile-Chrome-linux.png	speed up playwright and add visual regression tests (#1638)	2023-06-23 11:53:04 +00:00