Need help understanding NetRexx and really small doubles

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Need help understanding NetRexx and really small doubles

Jason Martin
Sample program with digits set really high

numeric digits 648

dubmin = Double.MIN_VALUE

System.out.println(dubmin)

--outputs: 4.9E-324

say RexxUtil.doubleToRexx(Double.MIN_VALUE, 648)

--outputs: 1.0000000000000002220446049250313080847263336181640625

System.out.println(RexxUtil.doubleToRexx(Double.MIN_VALUE, 648).tostring())

--outputs: 1.0000000000000002220446049250313080847263336181640625

_______________________________________________
Ibm-netrexx mailing list
[hidden email]
Online Archive : http://ibm-netrexx.215625.n3.nabble.com/

Reply | Threaded
Open this post in threaded view
|

Re: Need help understanding NetRexx and really small doubles

Jason Martin
Reply | Threaded
Open this post in threaded view
|

Re: Need help understanding NetRexx and really small doubles

rvjansen
Reply | Threaded
Open this post in threaded view
|

Re: Need help understanding NetRexx and really smalldoubles

Mike Cowlishaw
In reply to this post by Jason Martin
Now I'm glad I wrote that page :-).

Mike

> Ok, got it.
>
>
https://urldefense.proofpoint.com/v2/url?u=http-3A__speleotrove.com_decimal_
decifaq6.html&d=DwICaQ&c=jf_iaSHvJObTbx->
siA1ZOg&r=_6rXNpPJ1fYV-3bV1za02NiR4PUelvicfHXwtnTXpXE&m=jJWyxC
oizlqoLWE-AHW9a0-b0IjpGt2dunZgp6MiY5A&s=>
4AQLAzOKN4DRupMH8FMRHB9bClePGt2iMpB3UWJf6qw&e=

_______________________________________________
Ibm-netrexx mailing list
[hidden email]
Online Archive : http://ibm-netrexx.215625.n3.nabble.com/