SOURCES OF ERROR (CHAPTER 01.03)

Effect of Carrying Significant Digits

By Autar Kaw

Learn the effect of carrying  limited number of significant digits for a real-life problem.  We regressed the data of coefficient of thermal expansion of steel as a function of temperature to a second order polynomial using Excel.  We found that the general format of the regression model provided by Excel creates large round-off errors because of carrying limited significant digits.  A solution to this issue is also presented.

Round-off Error: Definition and Examples [YOUTUBE 3:47] [TRANSCRIPT]

Effect of Carrying Significant Digits [YOUTUBE 7:48] [TRANSCRIPT]

Truncation Error: Definition [YOUTUBE 8:34] [TRANSCRIPT]

Truncation Error: Example: Series [YOUTUBE 6:44] [TRANSCRIPT]

Truncation Error: Example: Integration [YOUTUBE 6:12] [TRANSCRIPT]

Truncation Error: Example: Differentiation [YOUTUBE 10:14] [TRANSCRIPT]