Plateforme Level Extreme
Abonnement
Profil corporatif
Produits & Services
Support
Légal
English
Large numbers with high decimal precision
Message
De
30/08/2011 16:44:21
Dragan Nedeljkovich (En ligne)
Now officially retired
Zrenjanin, Serbia
 
 
À
30/08/2011 15:17:25
Information générale
Forum:
Visual FoxPro
Catégorie:
Autre
Versions des environnements
Visual FoxPro:
VFP 9 SP2
OS:
Windows XP SP2
Divers
Thread ID:
01522171
Message ID:
01522328
Vues:
36
>>Have you tried shifting the decimal point? You could multiply by 100000 to shift the decimal point left for storing and then when retrieving divide back by 100000 for calculations. The number that you multiply/divide is determined by the number of significant digits that you want to maintain.
>
>
>That won't change a thing. Double structure has an exponent and a mantissa which keeps 15.95 significant digits. Multiplying or dividing by a power of 10 has no impact on the mantissa, only on the exponent

Exponent is binary, i.e. in powers of two, so your 1/10 may actually be 0.999999999... something.

back to same old

the first online autobiography, unfinished by design
What, me reckless? I'm full of recks!
Balkans, eh? Count them.
Précédent
Suivant
Répondre
Fil
Voir

Click here to load this message in the networking platform