Please ensure Javascript is enabled for purposes of website accessibility
Powered by Zoomin Software. For more details please contactZoomin

AVEVA™ Engineering

Database Units

  • Last UpdatedNov 26, 2021
  • 1 minute read

The function 'Rounding to n decimal places' returns a value which is as close as possible to the original value without exceeding n digits after the decimal point. So for 2 decimal places, values less than .005 (e.g. .0049999) are rounded down to .00 and values greater than .005 are (for example: .0050001) are rounded up to .01.

Mathematically, .005 is equally close to .00 and .01, so both results are valid for the rounding function.

AVEVA relies on software compilers for numerical comparison, and compilers rely on operating system internal representations in binary of real values. It is these 3rd party capabilities which determine the result of rounding values like .005

If the value of the 3rd decimal place is significant for a customer, they should select a display option with greater than two decimal places.

Note:
That in E3D it is possible to use the 'number of Digits' precision to avoid long decimal strings on large values while having accuracy on small values:

PRECI 5 DIG

POS E123.456 N2.34567 U0.0345678

Q POS

Position E 123.46mm N 2.3457mm U0.03457mm

Note:
'0' before decimal point is not included in number of digits, but '0's after the decimal point are.

TitleResults for “How to create a CRG?”Also Available in