Plateforme Level Extreme
Abonnement
Profil corporatif
Produits & Services
Support
Légal
English
Will SET PRECISION fix odd math?
Message
De
24/02/2006 13:05:31
 
 
Information générale
Forum:
Visual FoxPro
Catégorie:
Problèmes
Versions des environnements
Visual FoxPro:
VFP 6 SP5
OS:
Windows XP SP2
Network:
Novell 4.x
Database:
Visual FoxPro
Divers
Thread ID:
01098837
Message ID:
01098984
Vues:
14
Hi David,
Yeah, I recognize that I'm asking a base two infrastructure to perform what would be considered one of the most basic base 10 matimatical functions. I guess I'm just voicing the frustration that the process can seem so tight on paper & then wind up being unreliable at best when applied.

>Paul,
>
>The binary computer isn't sitting there with a pencil and paper multiplying the values by longhand. Floating point numbers are always "approximations" of the actual number and you have to understand what that means when you are using them in iterative calculations.
>
>> Thanks for taking the time to respond. Is it too much to ask for mathematical function that I believe the schools are teaching around the 3rd grade to just 'work right'? 823.4721345000 * 10 = 8234.721345000 except when I situationally decide to tack a 1 on the end of it? I think that's not how they're teaching it <g>.
Paul A. Busbey
Victoria Insurance
Précédent
Répondre
Fil
Voir

Click here to load this message in the networking platform