Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
SET DECIMALS TO is used if SET FIXED is OFF ?
Message
From
22/11/2003 11:57:40
Hilmar Zonneveld
Independent Consultant
Cochabamba, Bolivia
 
General information
Forum:
Visual FoxPro
Category:
Other
Miscellaneous
Thread ID:
00850956
Message ID:
00852639
Views:
19
There is a rule that when multiplying and dividing numbers, the end-result has the same number of significant digits as the least precise number.

This should only be considered a rule-of-thumb; the actual combined error can be bigger.

You don't need books on calculus to confirm this (quick estimates of the combined error can be obtained through differentials); you only need to multiply the worst-case extremes, to get the maximum combined error.

Also note that "significant digits" is only a rough estimate of the percentage error, for instance, 98 (100 - 2) has 2 significant digits, wherease 102 (100 + 2) has 3!


>That's not what I was refering to. Are you sure that imlicit error in the result of following calculation is 0.00005 not bigger?
>
>3.1000 ± 0.00005 * 2.5567 ± 0.00005 is 7.9258 ± 0.00005
>
>P.S. I maybe mistaken but I'm to leazy to go and read books on the subject. :-)
Difference in opinions hath cost many millions of lives: for instance, whether flesh be bread, or bread be flesh; whether whistling be a vice or a virtue; whether it be better to kiss a post, or throw it into the fire... (from Gulliver's Travels)
Previous
Reply
Map
View

Click here to load this message in the networking platform