Hello! Could the experts here can help with a strange Excel behavior related to graphing? The basic question: why do scatter plots appear rough or noisy for simple functions like y=sin(x) or y = mx+b when the ‘Smoothed Line’ option is OFF?
The screenshots show a few basic functions.. y = sin(x) and y = 0.8x + 0.5. The line width is set to 0 and markers removed for clarity. With that, the the roughness or ‘noise’ is easily visible. This roughness disappears completely when the Smoothed Line option is switched ON, but why is there such a high degree of roughness when the option is OFF?
At first I thought this was due to the IEE 754 floating point standard that limits Excel to 15 digits. But now I’m not so sure, because the degree of roughness in these graphs would represent error in the 5th, 6th, or 7th decimal place, not the 15th.
If interested, try this quick test. Create a column of x values 0, 0.02, 0.04 and another with sin(x). Then plot a scatter plot with Smoothed Line OFF and zoom in close. You should see this same jitter or noise.
Ideas?
Thanks!
sin(x) and mx+b
file:///Users/Michael/Documents/Screenshots/Screen%20Shot%202018-03-11%20at%208.51.20%20PM.png
two equations for circle → sin/cos and y=SQRT(100-x^2)
file:///Users/Michael/Documents/Screenshots/Screen%20Shot%202018-03-11%20at%2010.00.59%20PM.png
The screenshots show a few basic functions.. y = sin(x) and y = 0.8x + 0.5. The line width is set to 0 and markers removed for clarity. With that, the the roughness or ‘noise’ is easily visible. This roughness disappears completely when the Smoothed Line option is switched ON, but why is there such a high degree of roughness when the option is OFF?
At first I thought this was due to the IEE 754 floating point standard that limits Excel to 15 digits. But now I’m not so sure, because the degree of roughness in these graphs would represent error in the 5th, 6th, or 7th decimal place, not the 15th.
If interested, try this quick test. Create a column of x values 0, 0.02, 0.04 and another with sin(x). Then plot a scatter plot with Smoothed Line OFF and zoom in close. You should see this same jitter or noise.
Ideas?
Thanks!
sin(x) and mx+b
file:///Users/Michael/Documents/Screenshots/Screen%20Shot%202018-03-11%20at%208.51.20%20PM.png
two equations for circle → sin/cos and y=SQRT(100-x^2)
file:///Users/Michael/Documents/Screenshots/Screen%20Shot%202018-03-11%20at%2010.00.59%20PM.png