Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Large numbers with high decimal precision
Message
From
30/08/2011 16:42:10
Dragan Nedeljkovich (Online)
Now officially retired
Zrenjanin, Serbia
 
 
To
30/08/2011 13:58:02
General information
Forum:
Visual FoxPro
Category:
Other
Environment versions
Visual FoxPro:
VFP 9 SP2
OS:
Windows XP SP2
Miscellaneous
Thread ID:
01522171
Message ID:
01522327
Views:
57
>No, that can't be right. The "double" data type only have something like 56 bits, which is a maximum of about 16 or 17 significant digits (try 2**56)
>
>That means that only first 16 digits or so are significant, anything after that is garbage.

And some of those bits would have to be used for exponent as well.

back to same old

the first online autobiography, unfinished by design
What, me reckless? I'm full of recks!
Balkans, eh? Count them.
Previous
Reply
Map
View

Click here to load this message in the networking platform