Yes, comparing FWHM seems like a good way to quantify the difference. Rapid changes in seeing might make it difficult to test properly. Any difference in results should be statistically confirmed over many samples and repeatable. The test would be:
Guided encoder off FWHM vs. 1 second FWHM
against
Guided encoder on for same duration vs. 1 second FWHM
