2024.6.0

What's Changed

Breaking Changes 🛠

• Dropping Lighthouse and Yellow Lab Tools Service Support by @cockroacher in #491
• Convert SAMPLE-config.py and config.py to settings.json Configuration by @cockroacher in #492

Exciting New Features 🎉

• Temporarily Apply Configuration for Current Run from Command Line by @cockroacher in #489
• Make it possible to exclude tests by @7h3Rabbit in #500

Bug Fixes

• Lighthouse based test crashes when unable to connect to Chrome by @7h3Rabbit in #499
• Fixed broken software and useragent update by @7h3Rabbit in #507

Other Changes

• PyLint for Improved Code Quality - tests/software.py by @cockroacher in #484
• Change default setting REVIEW_SHOW_IMPROVEMENTS_ONLY to True by @cockroacher in #490
• Bump pylint from 3.1.0 to 3.2.2 by @dependabot in #495
• Bump selenium from 4.20.0 to 4.21.0 by @dependabot in #494
• Bump requests from 2.31.0 to 2.32.0 by @dependabot in #496
• Improved regression test for Docker Image by @7h3Rabbit in #497
• Bump requests from 2.32.0 to 2.32.2 by @dependabot in #501

Full Changelog: 2024.5.4...2024.6.0

2024.5.4

What's Changed

Exciting New Features 🎉

• Clear failures.log file on every new run by @7h3Rabbit in #476
• Change so tests return -1 in rating if Tests are unable to connect by @7h3Rabbit in #480

Bug Fixes

• Fix path to msgfmt.py so translations can be generated correctly by @7h3Rabbit in #477

Other Changes

• Bump cryptography from 42.0.6 to 42.0.7 by @dependabot in #474
• Bump lxml from 5.2.1 to 5.2.2 by @dependabot in #475

Full Changelog: 2024.5.3...2024.5.4

2024.5.3

What's Changed

Breaking Changes 🛠

• Cleanup root folder by creating defaults and tools folder by @cockroacher in #466
• Use version specific w3c validator for HTML/CSS Tests by @cockroacher in #469

Exciting New Features 🎉

• Keep default useragent up to date by @cockroacher in #467

Other Changes

• PyLint for Improved Code Quality - tests/http_validator.py by @cockroacher in #464

Full Changelog: 2024.5.2...2024.5.3

2024.5.2

What's Changed

Exciting New Features 🎉

• Added markdown output support by @7h3Rabbit in #458

Bug Fixes

• Fix bug where sitespeed ignored REVIEW_SHOW_IMPROVEMENTS_ONLY setting by @7h3Rabbit in #457

Other Changes

• Add funding for supporting projects by @7h3Rabbit in #451
• Added Templates to aid in better PR creation by @7h3Rabbit in #452
• Make it easier and faster to resolve issues by using issue templates by @7h3Rabbit in #453
• Bump cryptography from 42.0.5 to 42.0.6 by @dependabot in #456

Full Changelog: 2024.5.1...2024.5.2

2024.5.1

What's Changed

Exciting New Features 🎉

• Great number of Docker Improvements by @7h3Rabbit in #445

Other Changes

• Fixed corrupt pylint.yml by @7h3Rabbit in #442
• Changed description to english in package.json by @7h3Rabbit in #448
• Changed step order, build & release docker first, then release to github by @7h3Rabbit in #447
• Removed docker platform reference in create-release.yml by @7h3Rabbit in #449
• Allow us to manually trigger Create Release by @7h3Rabbit in #450

Full Changelog: 2024.5.0...2024.5.1

2024.5.0

What's Changed

Breaking Changes 🛠

• Bump lighthouse from 11.7.1 to 12.0.0 by @dependabot in #431

Bug Fixes

• Detailed issue info missing in Lighthouse based reports by @7h3Rabbit in #435

Other Changes

• Added change log to Prepare Relese PR message by @7h3Rabbit in #430
• Bump selenium from 4.19.0 to 4.20.0 by @dependabot in #432
• Update getting-started.md by @7h3Rabbit in #436
• Update README.md by @7h3Rabbit in #437
• Only run Pylint on python file changes by @7h3Rabbit in #438
• Update getting-started-docker.md by @7h3Rabbit in #439
• Update getting-started-docker.md by @7h3Rabbit in #440

Full Changelog: 2024.4.2...2024.5.0

2024.4.2

What's Changed

Exciting New Features 🎉

• webperf_core should not require config.py creation by @cockroacher in #421

Bug Fixes

• Bug - Html Test returned 5.0 in rating when cache was disabled by @7h3Rabbit in #420
• Bug - Update Software - fix unhandled error by @7h3Rabbit in #426

Other Changes

• PyLint for Improved Code Quality - tests/email_validator.py by @cockroacher in #422
• PyLint for Improved Code Quality - tests/email_validator.py by @cockroacher in #423
• PyLint for Improved Code Quality - tests/email_validator.py by @cockroacher in #424
• PyLint for Improved Code Quality - tests/http_validator.py by @cockroacher in #425

Full Changelog: 2024.4.1...2024.4.2

2024.4.1

What's Changed

Other Changes

• PyLint for Improved Code Quality - tests/sitespeed_base.py by @7h3Rabbit in #388
• Issue 390 by @7h3Rabbit in #391
• Update privacy_webbkollen.py by @7h3Rabbit in #389
• Issue 393 by @7h3Rabbit in #394
• Add Dockerfile and documentation on how to use it for running tests by @krompaco in #382
• PyLint for Improved Code Quality - tests/privacy_webbkollen.py by @cockroacher in #395
• PyLint for Improved Code Quality - tests/performance_sitespeed_io.py by @cockroacher in #396
• Requiring Python 3.12 instead of 3.10 when testing locally by @marcusosterberg in #397
• Fixed some translation issues by @7h3Rabbit in #399
• PyLint for Improved Code Quality - tests/sitespeed_base.py by @7h3Rabbit in #400
• Update README.md by @7h3Rabbit in #401
• PyLint for Improved Code Quality - tests/sitespeed_base.py by @7h3Rabbit in #402
• PyLint for Improved Code Quality - tests/frontend_quality_yellow_lab_tools.py by @7h3Rabbit in #403
• PyLint for Improved Code Quality - tests/page_not_found.py by @7h3Rabbit in #404
• PyLint for Improved Code Quality - tests/css_validator_w3c.py by @7h3Rabbit in #405
• PyLint for Improved Code Quality - tests/css_validator_w3c.py by @7h3Rabbit in #406
• PyLint for Improved Code Quality - tests/css_validator_w3c.py by @7h3Rabbit in #408
• GitHub Actions - Make it easier to test your own site by @7h3Rabbit in #410
• Update our Dockerfile when we update sitespeed.io version in package.json by @7h3Rabbit in #414
• Bump sitespeed.io from 33.5.0 to 33.6.0 by @dependabot in #407
• Restructuring w3c based tests to fix crash bugs and make them more similar by @7h3Rabbit in #416
• Create new releases by Semi Automatic PR:s by @7h3Rabbit in #417

Full Changelog: 2024.4.0...2024.4.1

Codename: The Spring is my Love

The Spring is my Love (2024.4.0)

Breaking Changes

• config.py has new format, needs to be updated from SAMPLE-config.py.
• Changed and updated dependencies see setup instructions
• Version specific dependencies (new way for installing dependencies)
• Upgraded to use Python 3.12 or above
• Upgraded to use node 20.x
• GitHub Actions now use sites.json as input for urls to test
• Mozilla Firefox AND Google Chrome are required for test to function

Changed:

• New Test: Accessibility statement
• New Test: Software being used
• SiteSpeed test now uses more params then SpeedIndex to calculate performance
• HTTP and Technology test changed
  • CSP validation was added
  • HTTP/2 and HTTP/3 can now be tested on internal urls (no public exposure needed)
  • Now uses sitespeed for a lot of logic in background
  • Quck validation was dropped
  • SSL validation was dropped
• Standard files now support validating sitemap structure and content
• Email Test now support validation DMARC
• And many small changes and bugfixes
• Started work on PEP8 and pylint refactoring and docstring

New Contributors

• @cockroacher made their first contribution in #287

Thanks to @marcusosterberg @cockroacher @7h3Rabbit for all great contributions

Full Changelog: 4.0...2024.4.0

Codename: White like Snow

Release 4.0

A new release by @7h3Rabbit with some support from the rest of our community 💪

Breaking Changes

• config.py needs to be updated from SAMPLE-config.py.
• Required Python packages has been updated to latest version
• Tracking & Integrity Test requires more to work
• HTTP and Network - Make sure we include topdomain when www. is present
• Translations has been updated (Don't forget to include them when upgrading)

Changed

• CSS Test - Include raw output of test when specifying -o param
• HTML Test - Include raw output of test when specifying -o param
• Energy efficiency - Update reference values to 2022-12-16
• Energy Efficiency - Make it easier to calculate new percentile
• HTTP and Network - Make sure we include topdomain when www. is present
• Added new accessibility test, using Pa11y (Issues: 103, 143)
• Documentation - New and hopefully easier to understand and navigate
• Tracking & Integrity Test- Add Fathom to the list of accepted analytics tools
• Allow to run tests local version/offline (Issues: 91, 93, 94, 96, 97, 103)
• Yellow Lab Tools Test - Make it possible to use the command line version
• Add regression tests (Issues: 81, 85, 88)
• Make it easier to use webperf-core by your own scripts
• Standard files Test - Add support for 'application/json+feed'
• Add support to only show reviews that needs improvement
• CSS Test - Make it easier to understand WHERE the errors are found

Bug Fixes

• Bug - Help command should use return code 0
• Bug - Tracking & Integrity Test - Unable to load disconnect-services.json in tracking_validator.py
  (Thanks @jonasboman for reporting)
• Bug - HTTP and Network - When http3check.net not respond, fail test
  (Thanks @marcusosterberg and Slack Community)
• Bug - Security, data-protecting & Integrity (Webbkoll) is not working
  (Thanks Slack Community for reporting)
• Bug - Tracking and Privacy (Beta) not working on windows
  (Thanks Slack Community for reporting)
• Bug - Rating is displayed incorrectly in review

Full Changelog: 3.0...4.0