compressor variants/gist_novel_A.py · md5 a720c7fdb4b7 · 24/60 runs graded · tasks: django__django-12419, django__django-13821, django__django-14373, sympy__sympy-15875, sympy__sympy-19637 · other arms: gistD
| Task | Base x/n | Arm y/n | W base | W arm | r | Zone | Steps b / a | Out/step b / a |
|---|---|---|---|---|---|---|---|---|
| django__django-12419 | 2/2 | 2/2 | 121K | 309K | -1.350 | maintain | 23 / 42 | 526 / 825 |
| django__django-13821 | 2/2 | 2/2 | 225K | 265K | -0.235 | maintain | 34 / 30 | 638 / 1014 |
| django__django-14373 | 2/2 | 2/2 | 45K | 55K | -0.288 | maintain | 14 / 16 | 243 / 288 |
| sympy__sympy-15875 | 0/1 | 0/1 | 438K | 355K | +0.302 | none | 49 / 47 | 1173 / 934 |
| sympy__sympy-19637 | 1/1 | 1/1 | 41K | 48K | -0.242 | maintain | 13 / 14 | 183 / 241 |
| Task | Arm | Rep | Result | Steps | Fresh | Cached | Output | Weighted | Time | Cost |
|---|---|---|---|---|---|---|---|---|---|---|
| django__django-12419 | baseline | r1 | resolved | 21 | 26K | 577K | 10K | 113K | 357s | $0.023 |
| django__django-12419 | baseline | r2 | resolved | 25 | 20K | 655K | 15K | 129K | 298s | $0.027 |
| django__django-12419 | gistA | r1 | resolved | 36 | 52K | 1.32M | 28K | 269K | 467s | $0.057 |
| django__django-12419 | gistA | r2 | resolved | 48 | 55K | 1.70M | 41K | 349K | 460s | $0.076 |
| django__django-13821 | baseline | r1 | resolved | 40 | 39K | 1.73M | 26K | 289K | 387s | $0.053 |
| django__django-13821 | baseline | r2 | resolved | 27 | 26K | 835K | 17K | 161K | 349s | $0.033 |
| django__django-13821 | gistA | r1 | resolved | 37 | 65K | 1.67M | 45K | 366K | 446s | $0.083 |
| django__django-13821 | gistA | r2 | resolved | 23 | 39K | 682K | 19K | 163K | 298s | $0.038 |
| django__django-14373 | baseline | r1 | resolved | 14 | 13K | 227K | 3K | 46K | 237s | $0.009 |
| django__django-14373 | baseline | r2 | resolved | 13 | 13K | 213K | 3K | 43K | – | $0.009 |
| django__django-14373 | gistA | r1 | resolved | 17 | 15K | 280K | 4K | 55K | 241s | $0.011 |
| django__django-14373 | gistA | r2 | resolved | 15 | 15K | 243K | 5K | 54K | – | $0.012 |
| sympy__sympy-15875 | baseline | r1 | failed | 49 | 28K | 2.37M | 57K | 438K | 639s | $0.092 |
| sympy__sympy-15875 | gistA | r1 | failed | 47 | 51K | 1.73M | 44K | 355K | 482s | $0.078 |
| sympy__sympy-19637 | baseline | r1 | resolved | 13 | 13K | 206K | 2K | 41K | 196s | $0.008 |
| sympy__sympy-19637 | gistA | r1 | resolved | 14 | 15K | 232K | 3K | 48K | 180s | $0.010 |