holm/nushell
1
1
Fork 0
forked from extern/nushell
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Do not allow precision interval to rach < epsilon

Browse Source
This commit is contained in:
Jakub Žádník 2021-09-12 14:55:11 +03:00
parent 2f04c172fe
commit 013b12a864
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
crates/nu-protocol/src/value/range.rs
View File

@ -153,11 +153,11 @@ impl RangeIterator {
}
// Compare two floating point numbers. The decision interval for equality is dynamically scaled
// based on the value being compared.
// as the value being compared increases in magnitude.
fn compare_floats(val: f64, other: f64) -> Option<Ordering> {
let prec = val * f64::EPSILON;
let prec = f64::EPSILON.max(val.abs() * f64::EPSILON);
if (other - val).abs() < prec.abs() {
if (other - val).abs() < prec {
return Some(Ordering::Equal);
}