unusually high delta values
Posted: Mon Aug 03, 2020 5:42 pm
i'm using the fifo delta image diagnostic system to help figure out why i was getting alarms on some areas that were essentially black.
looking at the delta images, i'm finding a large number of very consistent blocks of color with pixel values of 20. in general, they seem to show up in areas where the reference image is very bright or very dark. looking more closely at the ref image, it seems like it's perhaps just a matter of round off errors. the max value in the reference image is 240 -- and this is one area where i'm getting these high deltas. the ref image also has a weird plateau of values at 15 that represent most of the dark areas, then some areas do drop to 0. these plateaus are where i'm finding the abnormal deltas. probably obvious, but 240 is 11110000 binary and 15 is 00001111.
it would be interesting to put a simple gradient thru the process and see what happens. i'm guessing you'll find pools of values at different points depending on the blend percentage.
my blend % is 6.
is this just a known problem with the fast bit shifting blending mode?
looking at the delta images, i'm finding a large number of very consistent blocks of color with pixel values of 20. in general, they seem to show up in areas where the reference image is very bright or very dark. looking more closely at the ref image, it seems like it's perhaps just a matter of round off errors. the max value in the reference image is 240 -- and this is one area where i'm getting these high deltas. the ref image also has a weird plateau of values at 15 that represent most of the dark areas, then some areas do drop to 0. these plateaus are where i'm finding the abnormal deltas. probably obvious, but 240 is 11110000 binary and 15 is 00001111.
it would be interesting to put a simple gradient thru the process and see what happens. i'm guessing you'll find pools of values at different points depending on the blend percentage.
my blend % is 6.
is this just a known problem with the fast bit shifting blending mode?