Hi Travis,
This discussion describes the equations on which the linear eye calibrator performs a fit. The actual fitting is done by the SGELSD function from LAPACK (via Apple’s Accelerate framework).
Thanks for sending the XML. I’ll take a look and let you know if I see any potential issues.
Cheers,
Chris