Use cases
Exact Match
Comparing encoded results to original media for comparision of RGB 2 YCrCb conversion. For this case we want minimal encoding and want to compare exactly.
The source input would be a known set of still frames, and the tests would be limited number of conversions.
https://richardssam.github.io/ffmpeg-tests/tests/chip-chart-yuvconvert/compare.html is a example output.
Approximate match
Matching encoded results to original media, but results will not be exact. We want to use VMAF to help with approximate comparison.
Wedging results
Comparison to baseline.
Compare results of a test suite against historical results. The goal is to identify cases where ffmpeg may have changed, and encoding scheme may need to change.