... numerically checking 数值检验 numerical roundoff errors 数值舍入误差 significant digits 有效数字 ...
基于2个网页-相关网页
该转换表达式避免了数值积分法求解蠕变柔量值产生舍入误差和采用拉氏变换的繁琐计算。
This expression avoids rounding error brought by numerical integral method and complex calculation of Laplace transforms.
对计算机浮点数算术运算的舍入误差进行分析,是对数值计算方法作误差分析的基础。
To analyze the rounding error of calculator floating-point Numbers arithmetic operation is the foundation of numerical calculation method's error analysis.
介绍了数值计算中的误差类别,用数学表达式举例,说明了截断误差,根据IEEE754标准用数学表达式说明了舍入误差;
This paper introduced the classification of numerical calculation errors, and used math expressions as examples to illustrate truncation error.
应用推荐