When upsampling there is a report that brightness and/or color changes.
To test the accuracy
1. write a unittest that implements a reference scaler
2. do a histogram of color errors and aim for low/zero error versus the 
reference.

Test solid colors with different scale factors and filters
Consider sharing color_test histogram function