Module:Q-odd-limit intervals: Difference between revisions
ArrowHead294 (talk | contribs) No edit summary |
ArrowHead294 (talk | contribs) No edit summary |
||
| Line 102: | Line 102: | ||
true_size = monzo2cent(monzo_list[i], subgroup) | true_size = monzo2cent(monzo_list[i], subgroup) | ||
approx_size = step_size * inner_product(val, monzo_list[i]) | approx_size = step_size * inner_product(val, monzo_list[i]) | ||
error_abs_direct = math.floor(1200 * ratio / step_size + 0.5) - 1200 * ratio / step_size | error_abs_direct = math.floor(1200 * ratio.num / (ratio.den * step_size) + 0.5) - 1200 * ratio.num / (ratio.den * step_size) | ||
error_abs_pval = math.abs(approx_size - true_size) | error_abs_pval = math.abs(approx_size - true_size) | ||
error_rel_direct = 100 * approx_size / step_size | error_rel_direct = 100 * approx_size / step_size | ||