Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Decimal bug
Message
From
13/03/2003 14:29:32
 
 
To
13/03/2003 14:23:00
Todd Cottengim
Alpine Land Information Services
Redding, California, United States
General information
Forum:
Visual FoxPro
Category:
Troubleshooting
Title:
Miscellaneous
Thread ID:
00765485
Message ID:
00765527
Views:
21
>>I tried the following lines:
>>m.lnValue = INT(nX / nY)
>>?m.lnValue
>>
>>If SET DECIMAL is less than or equal to 10 I get 4
>>If SET DECIMAL is greater than or equal to 11 I get 3.99999999996
>
>Sorry, I screwed up that last message.
>
>I have tried the following:
>m.lnValue = INT(nX / nY)
>?m.lnValue
>If SET DECIMAL is less than or equal to 10 I get 4
>If SET DECIMAL is greater than or equal to 11 I get 3
>
>I then tried the following - NOTE: No INT()
>m.lnValue = nX / nY
>?m.lnValue
>If SET DECIMAL is less than or equal to 10 I get 4
>If SET DECIMAL is greater than or equal to 11 I get 3.99999999996
>
>TC

i can not reproduce this behavior. i have tried all different variations - with and without variables, int(). i always get 4.
Previous
Reply
Map
View

Click here to load this message in the networking platform