compressor variants/gist_novel_D.py · md5 cefc98901eda · 24/60 runs graded · tasks: django__django-12419, django__django-13821, django__django-14373, sympy__sympy-15875, sympy__sympy-19637 · other arms: gistA
| Task | Base x/n | Arm y/n | W base | W arm | r | Zone | Steps b / a | Out/step b / a |
|---|---|---|---|---|---|---|---|---|
| django__django-12419 | 2/2 | 2/2 | 121K | 158K | -0.384 | maintain | 23 / 26 | 526 / 700 |
| django__django-13821 | 2/2 | 2/2 | 225K | 186K | +0.276 | maintain | 34 / 25 | 638 / 758 |
| django__django-14373 | 2/2 | 2/2 | 45K | 48K | -0.103 | maintain | 14 / 13 | 243 / 309 |
| sympy__sympy-15875 | 0/1 | 1/1 | 438K | 424K | +0.046 | maintain | 49 / 47 | 1173 / 960 |
| sympy__sympy-19637 | 1/1 | 1/1 | 41K | 47K | -0.218 | maintain | 13 / 13 | 183 / 264 |
| Task | Arm | Rep | Result | Steps | Fresh | Cached | Output | Weighted | Time | Cost |
|---|---|---|---|---|---|---|---|---|---|---|
| django__django-12419 | baseline | r1 | resolved | 21 | 26K | 577K | 10K | 113K | 357s | $0.023 |
| django__django-12419 | baseline | r2 | resolved | 25 | 20K | 655K | 15K | 129K | 298s | $0.027 |
| django__django-12419 | gistD | r1 | resolved | 29 | 30K | 703K | 14K | 142K | 378s | $0.030 |
| django__django-12419 | gistD | r2 | resolved | 23 | 40K | 712K | 21K | 175K | 350s | $0.042 |
| django__django-13821 | baseline | r1 | resolved | 40 | 39K | 1.73M | 26K | 289K | 387s | $0.053 |
| django__django-13821 | baseline | r2 | resolved | 27 | 26K | 835K | 17K | 161K | 349s | $0.033 |
| django__django-13821 | gistD | r1 | resolved | 24 | 50K | 901K | 21K | 203K | 321s | $0.046 |
| django__django-13821 | gistD | r2 | resolved | 26 | 38K | 799K | 17K | 168K | 313s | $0.036 |
| django__django-14373 | baseline | r1 | resolved | 14 | 13K | 227K | 3K | 46K | 237s | $0.009 |
| django__django-14373 | baseline | r2 | resolved | 13 | 13K | 213K | 3K | 43K | – | $0.009 |
| django__django-14373 | gistD | r1 | resolved | 12 | 16K | 206K | 5K | 51K | 216s | $0.012 |
| django__django-14373 | gistD | r2 | resolved | 14 | 14K | 221K | 3K | 45K | – | $0.009 |
| sympy__sympy-15875 | baseline | r1 | failed | 49 | 28K | 2.37M | 57K | 438K | 639s | $0.092 |
| sympy__sympy-15875 | gistD | r1 | resolved | 47 | 66K | 2.22M | 45K | 424K | 593s | $0.087 |
| sympy__sympy-19637 | baseline | r1 | resolved | 13 | 13K | 206K | 2K | 41K | 196s | $0.008 |
| sympy__sympy-19637 | gistD | r1 | resolved | 13 | 15K | 223K | 3K | 47K | 194s | $0.010 |