The non-ordered nature of NaN adds further opportunities for error when comparing floating point numbers.
NaN的无序性质使得在比较浮点数时更容易发生错误。
The floating-point unit integrated into the CPU chip has signaled an error condition, such as numeric overflow or division by 0.
集成到CPU芯片的浮点数单元产生一个错误条件，比如数字溢出或者除0。
To analyze the rounding error of calculator floating-point Numbers arithmetic operation is the foundation of numerical calculation method's error analysis.
对计算机浮点数算术运算的舍入误差进行分析，是对数值计算方法作误差分析的基础。
This rounding error is the characteristic feature of floating-point computation.
这舍入误差的特征是浮点计算。
However, since the fixed-point calculation maybe cause cumulative quantization error, the convergent performance of fixed-point equalizer is not better than that of floating-point equalizer.
但由于定点数运算会引起量化累积误差，均衡器的收敛速度比浮点数运算均衡器的收敛速度要慢，收敛后的稳定性也较差。
The upper bound of mean square error is given for the two algorithms of fixed and block floating point.
给出了定点与块浮点两种算法时的均方误差上限。
The upper bound of mean square error is given for the two algorithms of fixed and block floating point.
给出了定点与块浮点两种算法时的均方误差上限。
应用推荐