compressor identity (no compression) · md5 2f366ecc33ee · 70/32 runs graded · tasks: 567-labs__instructor-2259, apify__crawlee-python-1976, conan-io__conan-20032, conan-io__conan-20078, conan-io__conan-20136, conan-io__conan-20146, conan-io__conan-20208, conan-io__conan-20217, dask__dask-12301, dask__dask-12430, falconry__falcon-2673, falconry__falcon-2682, getmoto__moto-10007, getmoto__moto-10012, getmoto__moto-10028, getmoto__moto-10041, getmoto__moto-10057, getmoto__moto-10067, getmoto__moto-10070, getmoto__moto-10093, getmoto__moto-10117, getmoto__moto-10127, getmoto__moto-10146, getmoto__moto-10170, jd__tenacity-606, jd__tenacity-615, jd__tenacity-640, jd__tenacity-653, keephq__keep-6611, keephq__keep-6638, livekit__agents-6625, mvt-project__mvt-815, nltk__nltk-3580, sktime__sktime-10583, vega__altair-4019
| Task | Arm | Rep | Result | Steps | Fresh | Cached | Output | Weighted | Time | Cost |
|---|---|---|---|---|---|---|---|---|---|---|
| 567-labs__instructor-2259 | baseline | r1 | resolved | 10 | 20K | 177K | 1K | 42K | 256s | $0.009 |
| 567-labs__instructor-2259 | baseline | r2 | resolved | 8 | 12K | 146K | 2K | 32K | 277s | $0.007 |
| apify__crawlee-python-1976 | baseline | r1 | resolved | 16 | 25K | 382K | 7K | 83K | 343s | $0.018 |
| apify__crawlee-python-1976 | baseline | r2 | resolved | 26 | 25K | 786K | 13K | 143K | 395s | $0.028 |
| conan-io__conan-20032 | baseline | r1 | failed | 40 | 36K | 1.51M | 19K | 246K | 930s | $0.043 |
| conan-io__conan-20032 | baseline | r2 | failed | 35 | 36K | 1.18M | 15K | 199K | 828s | $0.036 |
| conan-io__conan-20078 | baseline | r1 | resolved | 63 | 60K | 3.45M | 33K | 505K | 448s | $0.079 |
| conan-io__conan-20078 | baseline | r2 | resolved | 94 | 68K | 6.56M | 57K | 895K | 1197s | $0.128 |
| conan-io__conan-20136 | baseline | r1 | failed | 96 | 68K | 7.36M | 74K | 1.03M | 760s | $0.153 |
| conan-io__conan-20136 | baseline | r2 | resolved | 62 | 57K | 3.49M | 42K | 533K | 448s | $0.089 |
| conan-io__conan-20146 | baseline | r1 | resolved | 42 | 35K | 1.49M | 15K | 229K | 537s | $0.038 |
| conan-io__conan-20146 | baseline | r2 | resolved | 36 | 28K | 1.08M | 15K | 181K | 270s | $0.033 |
| conan-io__conan-20208 | baseline | r1 | failed | 66 | 39K | 3.44M | 48K | 526K | 498s | $0.090 |
| conan-io__conan-20208 | baseline | r2 | failed | 33 | 23K | 939K | 20K | 176K | 284s | $0.036 |
| conan-io__conan-20217 | baseline | r1 | resolved | 29 | 31K | 1.07M | 17K | 190K | 228s | $0.036 |
| conan-io__conan-20217 | baseline | r2 | resolved | 40 | 31K | 1.27M | 12K | 195K | 185s | $0.032 |
| dask__dask-12301 | baseline | r1 | failed | 99 | 61K | 6.52M | 60K | 893K | 1449s | $0.129 |
| dask__dask-12301 | baseline | r2 | resolved | 115 | 64K | 7.85M | 61K | 1.03M | 1457s | $0.140 |
| dask__dask-12430 | baseline | r1 | failed | 54 | 31K | 1.60M | 29K | 277K | 658s | $0.053 |
| dask__dask-12430 | baseline | r2 | failed | 70 | 34K | 2.91M | 44K | 459K | 1888s | $0.081 |
| falconry__falcon-2673 | baseline | r1 | failed | 66 | 51K | 3.65M | 45K | 551K | 423s | $0.091 |
| falconry__falcon-2673 | baseline | r2 | failed | 112 | 93K | 7.06M | 97K | 1.09M | 825s | $0.186 |
| falconry__falcon-2682 | baseline | r1 | resolved | 43 | 77K | 1.58M | 17K | 285K | 353s | $0.053 |
| falconry__falcon-2682 | baseline | r2 | resolved | 57 | 41K | 2.67M | 32K | 404K | 333s | $0.067 |
| getmoto__moto-10007 | baseline | r1 | resolved | 30 | 54K | 725K | 8K | 150K | 231s | $0.030 |
| getmoto__moto-10007 | baseline | r2 | resolved | 25 | 20K | 541K | 6K | 93K | 166s | $0.017 |
| getmoto__moto-10012 | baseline | r1 | resolved | 29 | 27K | 888K | 10K | 146K | 787s | $0.025 |
| getmoto__moto-10012 | baseline | r2 | resolved | 37 | 32K | 1.33M | 15K | 209K | 806s | $0.035 |
| getmoto__moto-10028 | baseline | r1 | resolved | 164 | 84K | 11.75M | 61K | 1.44M | 1677s | $0.168 |
| getmoto__moto-10028 | baseline | r2 | failed | 99 | 59K | 6.84M | 59K | 921K | 1686s | $0.130 |
| getmoto__moto-10041 | baseline | r1 | resolved | 42 | 24K | 1.05M | 12K | 163K | 952s | $0.027 |
| getmoto__moto-10041 | baseline | r2 | resolved | 37 | 24K | 945K | 8K | 143K | 222s | $0.023 |
| getmoto__moto-10057 | baseline | r1 | failed | 52 | 36K | 1.95M | 18K | 286K | 764s | $0.044 |
| getmoto__moto-10057 | baseline | r2 | resolved | 41 | 26K | 1.12M | 13K | 176K | 247s | $0.030 |
| getmoto__moto-10067 | baseline | r1 | resolved | 25 | 30K | 737K | 9K | 130K | 268s | $0.024 |
| getmoto__moto-10067 | baseline | r2 | resolved | 38 | 35K | 1.31M | 17K | 217K | 258s | $0.039 |
| getmoto__moto-10070 | baseline | r1 | failed | 42 | 36K | 1.54M | 25K | 266K | 346s | $0.050 |
| getmoto__moto-10070 | baseline | r2 | failed | 60 | 92K | 6.00M | 69K | 899K | 402s | $0.146 |
| getmoto__moto-10093 | baseline | r1 | resolved | 44 | 43K | 1.87M | 16K | 278K | 367s | $0.044 |
| getmoto__moto-10093 | baseline | r2 | resolved | 44 | 41K | 1.97M | 20K | 299K | 304s | $0.048 |
| getmoto__moto-10117 | baseline | r1 | resolved | 40 | 31K | 1.33M | 15K | 208K | 265s | $0.035 |
| getmoto__moto-10117 | baseline | r2 | resolved | 37 | 59K | 2.37M | 33K | 393K | 707s | $0.071 |
| getmoto__moto-10127 | baseline | r1 | resolved | 36 | 34K | 1.21M | 14K | 196K | 249s | $0.034 |
| getmoto__moto-10127 | baseline | r2 | resolved | 25 | 28K | 704K | 8K | 123K | 128s | $0.022 |
| getmoto__moto-10146 | baseline | r1 | resolved | 10 | 13K | 162K | 3K | 38K | 145s | $0.008 |
| getmoto__moto-10146 | baseline | r2 | resolved | 39 | 28K | 1.24M | 20K | 212K | 217s | $0.040 |
| getmoto__moto-10170 | baseline | r1 | resolved | 17 | 17K | 368K | 8K | 77K | 342s | $0.017 |
| getmoto__moto-10170 | baseline | r2 | resolved | 23 | 17K | 460K | 7K | 84K | 168s | $0.016 |
| jd__tenacity-606 | baseline | r1 | resolved | 20 | 23K | 462K | 9K | 96K | 154s | $0.021 |
| jd__tenacity-606 | baseline | r2 | resolved | 64 | 61K | 3.64M | 43K | 554K | 1251s | $0.092 |
| jd__tenacity-615 | baseline | r1 | resolved | 63 | 42K | 3.05M | 35K | 450K | 324s | $0.072 |
| jd__tenacity-615 | baseline | r2 | resolved | 63 | 37K | 2.80M | 33K | 416K | 293s | $0.068 |
| jd__tenacity-640 | baseline | r1 | resolved | 41 | 35K | 1.64M | 21K | 263K | 239s | $0.046 |
| jd__tenacity-640 | baseline | r2 | resolved | 50 | 31K | 1.70M | 15K | 246K | 208s | $0.038 |
| jd__tenacity-653 | baseline | r1 | failed | 48 | 32K | 1.38M | 21K | 234K | 453s | $0.044 |
| jd__tenacity-653 | baseline | r2 | failed | 58 | 34K | 2.14M | 41K | 371K | 679s | $0.072 |
| keephq__keep-6611 | baseline | r1 | resolved | 42 | 34K | 1.21M | 12K | 190K | 484s | $0.032 |
| keephq__keep-6611 | baseline | r2 | resolved | 91 | 52K | 4.58M | 31K | 604K | 612s | $0.081 |
| keephq__keep-6638 | baseline | r1 | resolved | 32 | 27K | 866K | 10K | 145K | 359s | $0.026 |
| keephq__keep-6638 | baseline | r2 | resolved | 48 | 31K | 1.44M | 13K | 216K | 346s | $0.034 |
| livekit__agents-6625 | baseline | r1 | failed | 25 | 27K | 638K | 8K | 115K | 303s | $0.022 |
| livekit__agents-6625 | baseline | r2 | failed | 33 | 23K | 1.09M | 16K | 181K | 261s | $0.033 |
| mvt-project__mvt-815 | baseline | r1 | resolved | 32 | 37K | 1.02M | 9K | 166K | 202s | $0.028 |
| mvt-project__mvt-815 | baseline | r2 | failed | 4 | 14K | 35K | 837 | 20K | 59s | $0.005 |
| nltk__nltk-3580 | baseline | r1 | failed | 82 | 54K | 3.91M | 42K | 572K | 533s | $0.090 |
| nltk__nltk-3580 | baseline | r2 | failed | 61 | 31K | 2.00M | 28K | 315K | 566s | $0.055 |
| sktime__sktime-10583 | baseline | r1 | failed | 57 | 33K | 1.83M | 33K | 314K | 962s | $0.060 |
| sktime__sktime-10583 | baseline | r2 | failed | 47 | 27K | 1.54M | 44K | 312K | 1063s | $0.070 |
| vega__altair-4019 | baseline | r1 | failed | 44 | 25K | 1.14M | 18K | 193K | 1538s | $0.036 |
| vega__altair-4019 | baseline | r2 | failed | 66 | 33K | 2.29M | 28K | 344K | 1949s | $0.057 |