Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Incorrect rounging of 6 digits pecision
Message
 
To
22/04/2002 15:16:22
General information
Forum:
Visual FoxPro
Category:
Troubleshooting
Miscellaneous
Thread ID:
00647785
Message ID:
00647801
Views:
8
The product is 25.425. Why do you expect 25.43? It should be 25.42.


>I need to use 6 digits precision fields in my free tables.
>However, the FoxPro all versions round incorrectly those fields.
>
>How to get correct result from the following sample ?
>
>
>
>CREATE cursor t1 ( price n(9,6) )
>INSERT INTO t1 VALUES ( 16.95 )
>CREATE cursor t2 ( quantity n(8,6) )
>INSERT INTO t2 VALUES ( 1.5 )
>
>?ROUND( t1.price*t2.quantity,2)
>* Displayed result: 25.42
>* Expected result: 25.43
>
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform