Test Suite

• Write use cases for test suites.
• Control which tests run, and which sources are used.
• Adapter HTML
• Organize metadata, make sure we don't overwrite metadata, so we store the library and encoder versions.
  • Store test results  for each encoder in their own track
  • All metadata about encoder version and library versions are stored under the track's metadata
  • Test results and encoder arguments are stored under each test's media reference 
• Create procedural way to extract ffmpeg commands from docs, to create test file (confirm everything in docs actually works).
• Test Exporting Metadata and comparing to baseline.

Basic Tasks

• Dockerfile for ffmpeg, VMAF, OIIO(?) and OTIO.
• Move Repo to ASWF
• Gather test media
• Organize test media from netflix chimera.
• Review media to confirm range of test media.

New codecs tests

• HDR Specs
• DNxHD

Long term goals

Define spec for Web Review Testing

Docker

Install https://jinja.palletsprojects.com/en/3.1.x/ 

Should we have more than one version in the same template, so that the testing app uses an older version.

Add the option of a second ffmpeg so its possible to test two versions.