Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Will SET PRECISION fix odd math?
Message
From
24/02/2006 12:32:58
 
 
To
24/02/2006 11:30:09
General information
Forum:
Visual FoxPro
Category:
Troubleshooting
Environment versions
Visual FoxPro:
VFP 6 SP5
OS:
Windows XP SP2
Network:
Novell 4.x
Database:
Visual FoxPro
Miscellaneous
Thread ID:
01098837
Message ID:
01098970
Views:
11
>Hi Fabio,
> Thanks for taking the time to respond. Is it too much to ask for mathematical function that I believe the schools are teaching around the 3rd grade to just 'work right'? 823.4721345000 * 10 = 8234.721345000 except when I situationally decide to tack a 1 on the end of it? I think that's not how they're teaching it <g>.
>
>Thanks again... I'll be toying w/ a few ideas & see what works best for me.
>

You cannot use school's math rules.
A simple example is this,
change the sum addendum order,and the result changes:
CLEAR

a= -1.0
? (a - 0.1 - a + 0.1)*10000000.00000000

* same addition but in revert order
* return a different value
? (0.1 - a - 0.1 + a)*10000000.00000000
Previous
Reply
Map
View

Click here to load this message in the networking platform