ablA · bashother

stage-1 fail

compressor variants/ablation/ablate.py · md5 e105c3628c8c · 18/18 runs graded · tasks: dask__dask-12430, vega__altair-4019 · other arms: listing

Score

+0.000

90% CI +0.00 … +0.00

Weighted saving

-14.8%

pooled per run vs baseline

Resolved

0/6

baseline 0/6

Stage gates

S1 fail · S2 fail

tasks 0/2 (need 1)

Cost

$0.42

6 graded runs

Tokens per run vs baseline

bar = arm · tick = baseline · mean per graded run

Weighted376K of 328K↑ 14.8%

Fresh input32K of 30K↑ 4.9%

Cached input2.27M of 1.95M↑ 16.7%

Output39K of 34K↑ 14.1%

Steps60.7 of 54.2↑ 12.0%

x = baseline resolves · y = arm resolves · r = log2(W base / W arm)

Task	Base x/n	Arm y/n	W base	W arm	r	Zone	Steps b / a	Out/step b / a
dask__dask-12430	0/3	0/3	324K	477K	-0.558	none	56 / 71	638 / 717
vega__altair-4019	0/3	0/3	332K	276K	+0.266	none	53 / 51	614 / 525

12 runs incl. baseline

Task	Arm	Rep	Result	Steps	Fresh	Cached	Output	Weighted	Time	Cost
dask__dask-12430	baseline	r1	failed	63	32K	2.32M	42K	388K	1355s	$0.073
dask__dask-12430	baseline	r2	failed	38	22K	1.01M	27K	203K	354s	$0.045
dask__dask-12430	baseline	r3	failed	66	32K	2.39M	36K	381K	1065s	$0.068
dask__dask-12430	bashother	r1	failed	79	43K	4.07M	69K	655K	1271s	$0.120
dask__dask-12430	bashother	r2	failed	64	28K	2.39M	48K	412K	486s	$0.081
dask__dask-12430	bashother	r3	failed	69	28K	2.25M	37K	363K	746s	$0.066
vega__altair-4019	baseline	r1	failed	52	37K	1.84M	36K	327K	1153s	$0.065
vega__altair-4019	baseline	r2	failed	28	21K	634K	14K	127K	233s	$0.027
vega__altair-4019	baseline	r3	failed	78	39K	3.49M	51K	541K	1323s	$0.094
vega__altair-4019	bashother	r1	failed	50	37K	1.95M	34K	334K	719s	$0.064
vega__altair-4019	bashother	r2	failed	42	21K	1.04M	16K	172K	1165s	$0.031
vega__altair-4019	bashother	r3	failed	60	34K	1.92M	32K	321K	1167s	$0.060