{"id":93,"date":"2010-07-20T03:37:35","date_gmt":"2010-07-20T08:37:35","guid":{"rendered":"http:\/\/www.amibroker.com\/kb\/?p=93"},"modified":"2017-07-01T11:50:56","modified_gmt":"2017-07-01T10:50:56","slug":"about-floating-point-arithmetic","status":"publish","type":"post","link":"https:\/\/www.amibroker.com\/wordpress\/kb\/2010\/07\/20\/about-floating-point-arithmetic\/","title":{"rendered":"About floating point arithmetic"},"content":{"rendered":"

http:\/\/en.wikipedia.org\/wiki\/Floating_point<\/a><\/p>

Floating point calculations are performed in hardware<\/strong> by FPU (Floating Point Unit), which today is a part of your computer’s processor (CPU). The calculations are performed according to IEEE754 standard (see below) that all CPU manufacturers follow.<\/p>

Internally in computers all numbers are represented in binary<\/strong> system.
This fact has some important consequences in practice. One of it is that some fractions that have finite representation in decimal system are not finite in binary.<\/p>

For example, 0.1 is endless<\/strong> (infinite) fraction in binary system, as 1\/3 or 2\/3 fractions are in decimal system.<\/p>

The mantissa of 0.1 fraction in binary system is cyclical:
1001 1001 1001 1001 1001 1001 1001 1001 1001 1001 1001 1001 1001 1001 1001 1001 1001 (1001)* …….<\/p>

* represents endless cycle.<\/p>

Since computers operate on limited word length, 32 bit binary representation of 0.1 is:
01111011 10011001100110011001100 (not rounded) (in decimal it is 0.09999999403953552)
or
01111011 10011001100110011001101 (rounded) (in decimal it is 0.10000000149011612)<\/p>

Later is used by FPU (floating point processor) in your CPU because it has smaller relative error. If you add it nine times you will end up with 0.9000000134110449 which is of course higher than 0.9.<\/p>

It will be easier for you to understand when explaining on decimal numbers. For example 2\/3 represented in decimal is:
0.666666667<\/p>

Now add THREE times this number (0.666666667 + 0.666666667 + 0.666666667) and what you will get?
2.000000001 and that is greater than 2.<\/p>

Therefore, it is rule in programming, NEVER use fractions for loop counters. For that reason you should not use fractions in Optimize(), or if you need to use them use them in WISE way by adding HALF of “step” value to the “max” value.<\/p>step <\/span>= <\/span>0.1<\/span>; <\/span>x <\/span>= <\/span>Optimize<\/span>(<\/span>"x"<\/span>, <\/span>0.5<\/span>, <\/span>0.1<\/span>, <\/span>0.9 <\/span>+ <\/span>step<\/span>\/<\/span>2<\/span>, <\/span>step<\/span>)<\/code>

Another thing to keep in mind is that 32-bit floating point number has only 7 significant digits (those digits that carry meaning contributing to its precision). So in 123.4567 all digits are significant and accurate, but in 123.456789, last two digits (‘8’ and ‘9’) are not significant and subject to floating point rounding – see links below).<\/p>

IEEE754 conversion calculators: http:\/\/babbage.cs.qc.edu\/IEEE-754\/Decimal.html<\/a> http:\/\/babbage.cs.qc.edu\/IEEE-754\/32bit.html<\/a><\/p>

IEEE754 standard description: http:\/\/en.wikipedia.org\/wiki\/IEEE_754-1985<\/a><\/p>

Essay about comparing floatin point numbers: http:\/\/www.cygnus-software.com\/papers\/comparingfloats\/comparingfloats.htm<\/a><\/p>

Microsoft Knowledge Base: “Precision and Accuracy in Floating-Point Calculations” http:\/\/support.microsoft.com\/kb\/125056<\/a><\/p>

Using 32-bit floating point (as opposed to 64-bit double precision) has two main advantages: a) consumes HALF of memory required for doubles (this *is* important, more important that you think, because if you have for example an array of 500000 elements, in floats it is 2MB and it fits into CPU cache, while in doubles it would be 4MB and may not fit into CPU cache). b) 32-bit floating point numbers can be computed much faster. It simply takes less processor cycles to compute 32-bit float than 64-bit float. 64-bit version of AmiBroker is going even further and is using SSE2 instructions. This means that vectors of 4 single-precision numbers are processed in parallel using single SSE2 instruction on SINGLE processor. This gives more speed on single core than achievable using multiple cores.<\/p>

Note also AmiBroker does use double precision (64bit\/SSE2) or extended precision (80bit\/x87) where it is necessary (for certain internal calculations).<\/p>

Note also that due to the architectural differences between compilers for 32-bit and 64-bit programs, small numerical differences may exist between 32-bit and 64-bit version of AmiBroker due to the fact that 32-bit version uses x87 FPU code while 64-bit version uses SSE2 code and the underlying floating point hardware is different and operate slightly differently. x87 FPU code internally offers more (80bit) precision than SSE2 (64-bit). For in-depth discussion see: https:\/\/randomascii.wordpress.com\/2012\/03\/21\/intermediate-floating-point-precision\/<\/a><\/p>","protected":false},"excerpt":{"rendered":"