To analyze the rounding error of calculator floating-point Numbers arithmetic operation is the foundation of numerical calculation method's error analysis.
对计算机浮点数算术运算的舍入误差进行分析,是对数值计算方法作误差分析的基础。
The results of verifying calculation show that the analytic formula has smaller computational error as compared with computer numerical arithmetic, and therefore it is practical.
验证计算结果表明:解析公式与计算机数值计算法结果相比较,计算误差小,具有实用价值。
The paper makes mathematical analysis on the causation of error in profile machining, and resolves the problem using altering the method in numerical calculation.
本文对这种加工误差产生的原因进行了数学分析,通过更改数值计算的方法解决这个问题。
The numerical calculation results demonstrate that the error resiliency of SVLC decreases with increasing shift symmetry.
数值计算结果显示同步变长码的抗误码扩散概率随其移位对称数的增加而减少。
The high - aspect-ratio grids were commonly used in numerical simulations of the viscous boundary layer flows and the main calculation error was always correlated to the aspect ratio of the grids.
在边界层内的计算网格一般都具有很大的长宽比,而计算误差与网格长宽比密切相关。
The influential factors of calculation error for groundwater table are discussed by using the iteration method to find solution of numerical model in the mine drainage forecast of deep drawdown.
本文讨论了大降深矿井排水预测中 ,利用迭代法求解数值模型时 ,地下水位计算误差的影响因素。
This paper introduced the classification of numerical calculation errors, and used math expressions as examples to illustrate truncation error.
介绍了数值计算中的误差类别,用数学表达式举例,说明了截断误差,根据IEEE754标准用数学表达式说明了舍入误差;
This paper introduced the classification of numerical calculation errors, and used math expressions as examples to illustrate truncation error.
介绍了数值计算中的误差类别,用数学表达式举例,说明了截断误差,根据IEEE754标准用数学表达式说明了舍入误差;
应用推荐