Qualification tool: Document and automate generation of expected results files

[tgravescs]

Is your feature request related to a problem? Please describe.
since the qualification tool checks for certain unsupported features, if we ad support for those features the qualification tests can fail.

We should document how to update those files and perhaps have a way to automatically generate to make it easier for devs. It should not automatically commit as dev should verify changes are ok.

see #2946 (comment) for an example

[tgravescs]

Please note documentation wasn't added with just a script to run it... if we find documentation is needed we will file a followup