← Subnet 114 · test bench

s1_gistoff · project

no baseline

compressor variants/base_miner_pre_tooluse.py · md5 0c39a996cf72 · 60/60 runs graded · tasks: django__django-12419, django__django-13821, django__django-14373, sympy__sympy-15875, sympy__sympy-19637

Score
–
–
Weighted saving
–
pooled per run vs baseline
Resolved
53/60
baseline –
Stage gates
–
Cost
$2.26
60 graded runs

Tokens per run vs baseline

bar = arm · tick = baseline · mean per graded run
Weightedno baseline
Fresh inputno baseline
Cached inputno baseline
Outputno baseline
Stepsno baseline

Runs

60 runs incl. baseline
TaskArmRepResultSteps FreshCachedOutputWeightedTimeCost
django__django-12419projectr1resolved2628K786K12K143K439s$0.028
django__django-12419projectr10resolved5029K1.66M21K257K1031s$0.044
django__django-12419projectr11resolved4733K2.53M60K466K636s$0.097
django__django-12419projectr12resolved2230K695K12K135K305s$0.028
django__django-12419projectr2resolved4833K2.32M45K399K553s$0.077
django__django-12419projectr3resolved3728K1.27M23K225K362s$0.044
django__django-12419projectr4resolved3631K1.36M23K235K328s$0.044
django__django-12419projectr5resolved2526K734K12K136K317s$0.027
django__django-12419projectr6resolved3730K1.35M27K244K1088s$0.049
django__django-12419projectr7resolved1723K453K10K99K291s$0.022
django__django-12419projectr8resolved4230K1.96M40K347K514s$0.069
django__django-12419projectr9resolved2122K574K13K119K296s$0.026
django__django-13821projectr1resolved4935K1.95M29K318K554s$0.057
django__django-13821projectr10resolved2323K677K17K143K340s$0.032
django__django-13821projectr11resolved3529K1.28M20K217K1378s$0.040
django__django-13821projectr12resolved5944K3.03M37K459K1154s$0.076
django__django-13821projectr2resolved3137K1.21M22K224K359s$0.045
django__django-13821projectr3resolved3128K1.08M32K233K372s$0.054
django__django-13821projectr4resolved3035K1.08M18K196K338s$0.038
django__django-13821projectr5resolved4036K1.60M30K286K480s$0.056
django__django-13821projectr6resolved3837K1.47M19K241K415s$0.043
django__django-13821projectr7resolved3534K1.36M23K239K380s$0.046
django__django-13821projectr8resolved2326K732K16K148K340s$0.032
django__django-13821projectr9resolved3034K1.13M25K221K417s$0.047
django__django-14373projectr1resolved1513K257K4K52K388s$0.011
django__django-14373projectr10resolved911K131K2K30K250s$0.007
django__django-14373projectr11resolved1413K233K4K47K238s$0.010
django__django-14373projectr12resolved1212K185K2K38K296s$0.008
django__django-14373projectr2resolved1112K170K2K36K231s$0.008
django__django-14373projectr3resolved1214K203K3K45K245s$0.010
django__django-14373projectr4resolved912K142K3K36K209s$0.008
django__django-14373projectr5resolved1012K150K2K33K262s$0.007
django__django-14373projectr6resolved1113K171K3K38K327s$0.008
django__django-14373projectr7resolved2115K371K5K66K310s$0.012
django__django-14373projectr8resolved911K133K3K32K235s$0.007
django__django-14373projectr9resolved1012K149K2K32K288s$0.006
sympy__sympy-15875projectr1failed3119K1.12M31K225K700s$0.050
sympy__sympy-15875projectr10failed3926K1.59M33K284K757s$0.057
sympy__sympy-15875projectr11resolved4828K2.45M48K417K576s$0.080
sympy__sympy-15875projectr12failed4225K1.64M35K294K461s$0.059
sympy__sympy-15875projectr2resolved4126K1.68M34K294K1236s$0.058
sympy__sympy-15875projectr3resolved4727K2.54M56K448K1139s$0.090
sympy__sympy-15875projectr4resolved6631K3.92M66K622K750s$0.113
sympy__sympy-15875projectr5failed5230K2.66M45K432K1959s$0.079
sympy__sympy-15875projectr6failed3222K1.27M34K252K577s$0.055
sympy__sympy-15875projectr7failed6936K3.93M63K616K1383s$0.109
sympy__sympy-15875projectr8failed5025K1.76M30K290K1307s$0.054
sympy__sympy-15875projectr9resolved7738K5.01M67K742K1802s$0.122
sympy__sympy-19637projectr1resolved1414K234K3K46K367s$0.009
sympy__sympy-19637projectr10resolved1414K233K3K46K285s$0.009
sympy__sympy-19637projectr11resolved1614K271K3K51K220s$0.010
sympy__sympy-19637projectr12resolved1313K212K3K44K223s$0.009
sympy__sympy-19637projectr2resolved1013K162K3K38K203s$0.008
sympy__sympy-19637projectr3resolved1214K199K3K41K216s$0.008
sympy__sympy-19637projectr4resolved1714K278K3K50K279s$0.009
sympy__sympy-19637projectr5resolved1614K290K5K58K303s$0.012
sympy__sympy-19637projectr6resolved1213K185K2K38K235s$0.007
sympy__sympy-19637projectr7resolved1414K225K2K43K272s$0.008
sympy__sympy-19637projectr8resolved1514K241K2K45K216s$0.008
sympy__sympy-19637projectr9resolved1213K197K4K44K258s$0.009