Skip to content
Discussion options

You must be logged in to vote

Hi! Calcpad uses the standard 64 bit floating point math functions as they are in the CPU and exposed via the Math class in C#. You will get the same results in any other language as C, C++, C#, Java, etc. The way they are computed in floating point environment is specified by the IEEE 754 standard.

The best way is to leave them like this. Adding some artificial corrections/rounding to the values can be dangerous. But If you want to see them rounded, you can apply the respective number formatting. The things are different for symbolic CAS and arbitrary precision calculation systems.

Replies: 1 comment 5 replies

Comment options

You must be logged in to vote
5 replies
@Proektsoftbg
Comment options

@javila
Comment options

@Proektsoftbg
Comment options

@javila
Comment options

@Proektsoftbg
Comment options

Answer selected by javila
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants