Skip to content

Create a screenshot based set of tests for jMonkeyEngine  #2279

@richardTingle

Description

@richardTingle

As discussed at https://hub.jmonkeyengine.org/t/screenshot-based-jme-testing/47685/18 I will be creating a set of automated tests that can run as part of the build on standardised hardware. The purpose of this is to reduce the amount of human testing required to assure ourselves that a new JME version has not broken some graphics based behaviour (which is difficult to test under normal automated testing)

Objectives:

  • Human readable html report including before and after screenshots for manual review
  • Diff screenshot showing where in the image there is a change
  • Easy (documented) mechanism for accepting changes
  • Failed pipeline on test fail
  • Ability for some tests to be marked as "non deterministic" and only triggering manual human review, not a failed test
  • Ability for some tests to be marked as "known broken" and only triggering manual human review, not a failed test

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions