Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Report losing one hundredth
Message
From
23/01/2007 10:41:43
Dragan Nedeljkovich (Online)
Now officially retired
Zrenjanin, Serbia
 
 
General information
Forum:
Visual FoxPro
Category:
Reports & Report designer
Environment versions
Visual FoxPro:
VFP 9 SP1
OS:
Windows XP SP2
Database:
Visual FoxPro
Miscellaneous
Thread ID:
01188069
Message ID:
01188132
Views:
15
This message has been marked as a message which has helped to the initial question of the thread.
>Hello.
>i encountered a problem with a report.
>in order to replicate:
>1 create a table with one field (e.g. F1) type double;
>2 append blank;
>3 enter the following number 59249826188782
>4 create a report with one field in the detail band;
>5 the expression of the field is F1/100
>6 the format is 9 999 999 999 999.99
>7 get the print preview
>what you will see is 592 498 261 887.81
>note at the end 81 instead of 82
>A workaround is round(f1/100,2) as the field expression
>Should i report it as a bug?

Not a bug, it's a limitation of the IEEE binary representation of numbers. The report truncates instead of rounding, which is not really serious enough to be considered a bug.

At 14 digits, you're really close to the limit of 15.5 significant digits, which is the capacity of IEEE standard. If you are subtracting numbers which are longer than that, the result may lose lower digits (you get zeros there) even though the result is shorter than the limit.

Is the inflation that bad over there?

back to same old

the first online autobiography, unfinished by design
What, me reckless? I'm full of recks!
Balkans, eh? Count them.
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform