Ad Widget

Collapse

Custom multiplier precision

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • yurtesen
    Senior Member
    • Aug 2008
    • 130

    #1

    Custom multiplier precision

    Hello

    I am trying to convert a float value by multiplying with 0.1
    But if the value is 232, the result is 23.200000000000003
    Click image for larger version

Name:	zabbix_rounding.png
Views:	720
Size:	27.2 KB
ID:	436395
    I need to get 23.2 as result. Is there any sane way to do it?

    Thanks!

    23.200000000000003
  • yurtesen
    Senior Member
    • Aug 2008
    • 130

    #2
    Hmm does anybody know how to convert values without strange numerical artifacts?

    Comment

    • yurtesen
      Senior Member
      • Aug 2008
      • 130

      #3
      Ended up using javascript
      Code:
      return (value*0.1).toFixed(1);

      Comment

      Working...