Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Problems with precision in numbers
Message
From
03/02/2000 13:53:59
Dragan Nedeljkovich (Online)
Now officially retired
Zrenjanin, Serbia
 
 
General information
Forum:
Visual FoxPro
Category:
Other
Miscellaneous
Thread ID:
00326555
Message ID:
00326831
Views:
23
>>I'm using:
>>
>>set decimals to 18
>>?5000.3 + 0.6
>>
>>The result is: 5000.900000000001000000 instead of simply 5000.900000000000000000
>>
>>Someone could explain me why?
>
>Fractional numbers with the exception of currency, which uses a fixed precision BCD format,

Wasn't the currency stored as a 8-byte integer, with decimal pointed shifted four places?

back to same old

the first online autobiography, unfinished by design
What, me reckless? I'm full of recks!
Balkans, eh? Count them.
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform