You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe
When we calculate SU and CU (integer values) we do some integer divisions which leads to some precision error.
Describe the solution you'd like
A better approach would be to deal with float divisions and round result to closest integer before converting back to integer.
With this we would get more accurate values.
Additional context
Example of precision error while calculating SU / CU for node 6705
Is your feature request related to a problem? Please describe
When we calculate SU and CU (integer values) we do some integer divisions which leads to some precision error.
Describe the solution you'd like
A better approach would be to deal with float divisions and round result to closest integer before converting back to integer.
With this we would get more accurate values.
Additional context
Example of precision error while calculating SU / CU for node
6705
Simulated calculation from rust tfchain code:
Copy past previous code in rust playground https://play.rust-lang.org/ and run gives:
While calculating using float would give:
The text was updated successfully, but these errors were encountered: