OpenBench

OpenBench Testing Framework

Finished
Jacque	Monty	plutuned-the-sequel	diff	N=5000	LLR: -2.51 (-2.25, 2.89) [0.00, 5.00] Games: 2214 W: 907 L: 1036 D: 271 Ptnml(0-2): 187, 116, 567, 113, 124
Jacque	Monty	old-policy	diff	8.0+0.08	Elo: -1.73 +- 12.72 (95%) [N=2000] Games: 2008 W: 728 L: 738 D: 542 Ptnml(0-2): 128, 199, 357, 195, 125
Jacque	Monty	old-policy	diff	N=5000	Elo: 33.76 +- 13.16 (95%) [N=2000] Games: 2168 W: 1023 L: 813 D: 332 Ptnml(0-2): 140, 121, 441, 153, 229
Jacque	Monty	main	diff	N=5000	Elo: 1154.37 +- 151.24 (95%) [N=2000] Games: 1540 W: 1538 L: 2 D: 0 Ptnml(0-2): 0, 0, 2, 0, 768
Jacque	Monty	main	diff	8.0+0.08	Elo: -88.37 +- 14.43 (95%) [N=2000] Games: 2012 W: 609 L: 1110 D: 293 Ptnml(0-2): 300, 166, 367, 81, 92
Jacque	Monty	plootuned	diff	40.0+0.40	LLR: 2.92 (-2.25, 2.89) [0.00, 5.00] Games: 712 W: 314 L: 152 D: 246 Ptnml(0-2): 10, 43, 131, 119, 53
Jacque	Monty	plootuned	diff	8.0+0.08	LLR: 2.89 (-2.25, 2.89) [0.00, 5.00] Games: 826 W: 402 L: 231 D: 193 Ptnml(0-2): 22, 46, 164, 101, 80
Jacque	Monty	plootuned	diff	N=5000	LLR: 3.12 (-2.25, 2.89) [0.00, 5.00] Games: 1984 W: 917 L: 726 D: 341 Ptnml(0-2): 97, 120, 442, 161, 172
Jacque	Monty	tuned	diff	40.0+0.40	LLR: 1.14 (-2.25, 2.89) [0.00, 5.00] Games: 1792 W: 600 L: 535 D: 657 Ptnml(0-2): 62, 166, 368, 245, 55
Jacque	Monty	tuned	diff	8.0+0.08	LLR: 2.92 (-2.25, 2.89) [0.00, 5.00] Games: 820 W: 382 L: 213 D: 225 Ptnml(0-2): 20, 48, 148, 131, 63
Jacque	Monty	tuned	diff	N=5000	LLR: 3.04 (-2.25, 2.89) [0.00, 5.00] Games: 558 W: 331 L: 124 D: 103 Ptnml(0-2): 12, 19, 87, 72, 89
Jacque	Monty	main	diff	N=5000	Tuning 3 Parameters 1468/25000 Iterations 23496/400000 Games Played
Jacque	Monty	root-pst	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 5.00] Games: 1716 W: 501 L: 604 D: 611 Ptnml(0-2): 80, 195, 372, 170, 41
Jacque	Akimbo	move-qs-alpha	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 35520 W: 8693 L: 8746 D: 18081 Ptnml(0-2): 107, 3902, 9807, 3825, 119
Jacque	Akimbo	saggy-cutoff	diff	8.0+0.08	LLR: -0.52 (-2.25, 2.89) [0.00, 3.00] Games: 5418 W: 1309 L: 1328 D: 2781 Ptnml(0-2): 21, 635, 1420, 608, 25
Jacque	Monty	main	diff	8.0+0.08	Elo: -154.14 +- 31.55 (95%) [N=2000] Games: 468 W: 94 L: 289 D: 85 Ptnml(0-2): 84, 63, 63, 12, 12
Jacque	Monty	scale-cpuct	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 5.00] Games: 2892 W: 889 L: 986 D: 1017 Ptnml(0-2): 118, 333, 609, 300, 86
Jacque	Akimbo	tuned	diff	40.0+0.40	LLR: 1.92 (-2.25, 2.89) [0.00, 3.00] Games: 9390 W: 2221 L: 2095 D: 5074 Ptnml(0-2): 4, 994, 2584, 1098, 15
Jacque	Monty	scale-cpuct	diff	8.0+0.08	LLR: -1.24 (-2.25, 2.89) [0.00, 5.00] Games: 1194 W: 382 L: 442 D: 370 Ptnml(0-2): 59, 150, 235, 98, 55
Jacque	Monty	scale-cpuct	diff	8.0+0.08	LLR: -1.37 (-2.25, 2.89) [0.00, 5.00] Games: 444 W: 131 L: 198 D: 115 Ptnml(0-2): 30, 53, 101, 30, 8
Jacque	Monty	monty008	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 5.00] Games: 4590 W: 1682 L: 1502 D: 1406 Ptnml(0-2): 199, 420, 908, 538, 230
Jacque	Monty	monty008	diff	N=5000	LLR: 2.93 (-2.25, 2.89) [0.00, 5.00] Games: 9418 W: 3907 L: 3681 D: 1830 Ptnml(0-2): 613, 650, 2009, 772, 665
Jacque	Monty	monty007	diff	8.0+0.08	LLR: -0.16 (-2.25, 2.89) [0.00, 5.00] Games: 2532 W: 851 L: 846 D: 835 Ptnml(0-2): 89, 295, 515, 256, 111
Jacque	Monty	monty007	diff	N=5000	LLR: 0.49 (-2.25, 2.89) [0.00, 5.00] Games: 5888 W: 2394 L: 2332 D: 1162 Ptnml(0-2): 363, 446, 1274, 488, 373
Jacque	Monty	stats	diff	8.0+0.08	LLR: -2.32 (-2.25, 2.89) [0.00, 5.00] Games: 272 W: 18 L: 205 D: 49 Ptnml(0-2): 78, 34, 21, 3, 0

1 2 3 9 10 11 12 13 36 37 38