Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
What's wrong with VFP 5.0a's math (or is it me)?
Message
From
15/05/1997 16:27:45
Bill Gravell
Indoor Purification System
Menifee, California, United States
 
General information
Forum:
Visual FoxPro
Category:
Coding, syntax & commands
Miscellaneous
Thread ID:
00032141
Message ID:
00032498
Views:
40
>I have a program with the following line of code:
>
>lPayment_Amount = lpct * tpd_payments_lte.weekly_ttd_rt
>
>When I run my program and check the debugger, the following values are used:
>
>10.8539997 = 0.04998 * 217.18
>
>When I ROUND(lPayment_Amount,2) I get 10.85.
>
>But when I do the math using the Windows 95 calculator (0.04998 * 217.18) I get 10.8546564 which should round to 10.86.
>
>Any ideas on how I can fix this?
>
>Thanks!
>
>Jeff Rusch
>UW-Madison

Actually 10.8546564 rounded to 2 decimals does round to 10.85. if you round it to 3 decimals, it rounds to 10.855
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform