-
Victor Yu authored
Memory was computed as `dim1 * dim2 * ... / MB`. In a large calculation `dim1 * dim2 * ...` can easily overflow. To avoid overflow, now we do `1.0 / MB * dim1 * dim2 * ...`.
83340393
Memory was computed as `dim1 * dim2 * ... / MB`. In a large calculation `dim1 * dim2 * ...` can easily overflow. To avoid overflow, now we do `1.0 / MB * dim1 * dim2 * ...`.