Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Write use cases for test suites.
  • Control which tests run, and which sources are used.
  • Adapter HTML
  • Organize metadata, make sure we don't overwrite metadata, so we store the library and encoder versions.
    • Store test results  for each encoder in their own track
    • All metadata about encoder version and library versions are stored under the track's metadata
    • Test results and encoder arguments are stored under each test's media reference 
  • Create procedural way to extract ffmpeg commands from docs, to create test file (confirm everything in docs actually works).
  • Test Exporting Metadata and comparing to baseline.


Basic Tasks

  • Dockerfile for ffmpeg, VMAF, OIIO(?) and OTIO.
  • Move Repo to ASWF
  • Gather test media
  • Organize test media from netflix chimera.
  • Review media to confirm range of test media.

...

Define spec for Web Review Testing


Docker

Install https://jinja.palletsprojects.com/en/3.1.x/ 

Should we have more than one version in the same template, so that the testing app uses an older version.

Add the option of a second ffmpeg so its possible to test two versions.