Module:Q-odd-limit intervals: Difference between revisions
ArrowHead294 (talk | contribs) No edit summary |
ArrowHead294 (talk | contribs) No edit summary |
||
| Line 102: | Line 102: | ||
true_size = monzo2cent(monzo_list[i], subgroup) | true_size = monzo2cent(monzo_list[i], subgroup) | ||
approx_size = step_size * inner_product(val, monzo_list[i]) | approx_size = step_size * inner_product(val, monzo_list[i]) | ||
error_abs_direct = math.abs( | error_abs_direct = math.abs(math.floor(val[1] * true_size + 0.5) - val[1] * true_size) | ||
error_abs_pval = math.abs(approx_size - true_size) | error_abs_pval = math.abs(approx_size - true_size) | ||
error_rel_direct = 100 * approx_size / step_size | error_rel_direct = 100 * approx_size / step_size | ||