Knowledge Base
cancel
Showing results for 
Search instead for 
Did you mean: 

A floating-point value is displayed incorrectly in a TGML graphic.

Issue

A floating-point value is displayed incorrectly in a TGML graphic. The presentation field appears to show random numbers. The example shows how the value 11.60 is represented in a TGML graphic. 11.60 is actually stored as 11.600000381469727.

In format presentation mode:

In none presentation mode:

The last 6 digits of the stored floating-point value are seen!

Environment

TAC Vista 5.1.X

TGML editor 5.1.X

A presentation text bound to a floating-point value.

Cause

Vista use the PC's default settings for number of decimals, when presenting values in TGML graphics.

Resolution

To resolve the issue, either set the format property to "Presentation" for the binding object or change the PC's settings to view fewer decimal places eg. 2.

Tags (1)
Labels (1)
Version history
Revision #:
1 of 1
Last update:
a week ago
Updated by: