The SNITCH has always relied on a set of Reference solvers to calculate the difficulty of the crossword. Updating this list over time has led me to look at different types of solver. In particular, it has been important to detect and remove "Neutrinos" from the data (see further below). Once this is done we can look at other types of solver more clearly.

What's a Neutrino?

Clusters of solvers

The chart below shows a way to separate Neutrinos from other solvers. It plots each solver's average solving time (in seconds) on the x-axis against an "alignment to SNITCH" factor on the y-axis. This alignment factor is 1 when, on average, a solver's personal NITCH rating for a crossword is proportional to the SNITCH rating for that crossword. It is 0 when there is no alignment. (For those interested, more detail on this is provided below).

The blue dots on this chart represent the Reference solvers for the SNITCH as of Oct 2018. (Note that you can hover over each point to see the name of the individual solver.) As you'd expect, these are clustered around an alignment factor of 1 (generally between 0.5 and 1.5) regardless of their average solving time.

The red dots represent solvers who have been around for some time but are not Reference solvers. A group of these is spread across the range of average solving times and also spread about the SNITCH alignment factor of 1. But there's a cluster of red dots in the lower left corner that has low solving times and is spread around an alignment factor of 0. These are the classic-style Neutrinos - those who are very fast on average, regardless of how hard the puzzles are.

This data suggests that any solver with a solving time of less than, say, 8.0 minutes and a SNITCH alignment factor of, say, less than 0.5 could be safely classified as a Neutrino.

The grey dots represent new solvers since the Reference solver list was baselined in Oct 2018>. We can now see that some of these are clearly Neutrinos (the ones in the cluster at the lower left, for example). Others with low solving times need further investigation, and we do this by checking the details of their alignment with the SNITCH.

Remaining Questions

We see that some solvers have alignment to the SNITCH figures well above 1, which would suggest that they seems to find harder puzzles especially hard. These solvers often have small data sets, including those with relatively high average solving times that don't always make the top 100 on the leaderboard. With the smaller amount of data, the alignment is likely to be less reflective of their true performance.

Blog Solvers: adding solving times from the blog

On the Times for the Times blog site, solvers regularly report their solving times. Where they have allowed it, we now add them to the list of solvers and track their progress. This is a new category of solver, the Blog Solver, for those who've reported solving times regularly over the last six months.

Notes to Blog Solvers:

• the most reliable format for reporting times is with format "mm:ss" or as "x minutes" in the title or at the start of the entry
• only the first main comment for each blogger is used; responses to other comments or a second comment is ignored.
• to report errors, include "n errors" just after the time
• If you just have a time it is assumed you have no errors unless you mention DNF or pink squares or giving up, etc, in the text
• Examples of good time notifications are "38:30, 0 errors" and "39 minutes, 0 errors" in the comment title or as the first part of your comment
• This info is also available using the "Blog Solver" button on the right hand side of the detailed crossword solving times for each crossword

Updating solver status

This analysis allows me to reclassify solvers, as shown in the chart below. One of my main motivations is to be able to update the list of Reference solvers reliably. I'd like to be able to include new solvers (especially good ones) without accidentally including Neutrinos. And I'd like to track other non-Reference and non-Neutrino solvers, even if their data isn't used for the SNITCH.

So I can now classify solvers as follows:

Neutrino

Those with fast solving times and low or inconsistent alignment to the SNITCH (shown in orange)

Reference Solvers

Those aligned to the SNITCH and having an average solving time of less than 45 mins (shown in blue)

Tracked Solvers

Those that don't meet the conditions for Reference Solvers but I can be fairly sure are not Neutrinos (shown in red)

Blog Solvers

Those that report their solving times in the Times for the Times site (shown in purple)

New solvers will come into the list over time and can be reclassified on my next update.

I've shown the old and new status in the full table to the right so that you can track the changes for each user.

So what's the SNITCH alignment factor?

This is actually pretty straightforward if you know a little maths. I plot the solver's individual NITCH scores agains the corresponding SNITCH for the same puzzle and measure the slope of the line of best fit. A slope of 1 indicates that the results are proportional, a slope of 0 means that there's no correlation.

For example, verlaine has results as shown in the chart below. Easier puzzles (according to the SNITCH) are on the left of the x-axis, harder ones on the right. verlaine's NITCH results vary, but are generally higher as we progress from left to right. The overall slope of the line of best fit is 1.37, showing good alignment with the SNITCH on average.

In contrast, lucyg43484 has results as shown in the chart below. There is no correlation with the hardness of the puzzle according to the SNITCH. In fact, the slope is negative, meaning that on average the harder puzzles are easier for lucyg43484 than the easier ones. This lack of correlation is exactly what you'd expect if the solver is just typing in known answers.

Nothing is simple and we have some solvers with a mix of results like the ones shown in the chart below. The correlation with the SNITCH is inconsistent - good on some solutions but not on others. On the latter, the solver looks just like a Neutrino, with short response times regardless of the SNITCH value. Presumably they type the answers in directly on these shorter puzzles. For this reason, where we detect this sort of solver, we will mark it manually as a Neutrino.

Solving times for club members

The table below shows crossword club solvers who have submitted more than 20 solutions in the last six months, with an average solving time of less than 60 minutes for an error-free crossword. They are ranked by that solving time. It also indicates their status, including whether they are Reference solvers for calculation of the daily SNITCH.

Rank	Solver	Status - Oct 2018	Current Status	Average Time	SNITCH Alignment
1	devlin	tracked	neutrino	00:41	-0.05
2	2 Down	tracked	neutrino	02:02	0.13
3	ysbwrielllwyr	new_solver	neutrino	02:17	0.47
4	Southern Cross	new_solver	neutrino	02:30	0.06
5	TimA	tracked	neutrino	02:48	0.0
6	niq.dow	new_solver	neutrino	02:54	-0.14
7	Stefan Szulc	tracked	neutrino	03:14	-0.07
8	Margaut	tracked	neutrino	03:17	0.11
9	robertsonjon	new_solver	neutrino	03:25	0.13
10	sarahsolomon	new_solver	neutrino	03:26	0.08
11	bmag	new_solver	neutrino	03:31	0.12
12	willperf	new_solver	neutrino	03:33	0.04
13	Henry Wyatt	tracked	neutrino	03:33	0.1
14	hazeltearne	new_solver	neutrino	03:41	-0.07
15	GolfDocAndy	tracked	neutrino	03:46	-0.09
16	seamus.butler	new_solver	neutrino	03:48	0.06
17	BrianS	tracked	neutrino	03:56	0.02
18	childshouse	new_solver	neutrino	03:57	0.07
19	chaffinch	new_solver	neutrino	03:57	-0.03
20	accessit	new_solver	neutrino	04:04	-0.08
21	C M Gilles	new_solver	neutrino	04:21	-0.09
22	ray lewis	tracked	neutrino	04:27	-0.02
23	mohn	reference	reference	04:31	1.08
24	Balbec	tracked	neutrino	04:43	-0.0
25	AlanRichens	new_solver	neutrino	05:08	0.06
26	chaswil	tracked	neutrino	05:13	0.05
27	Pontius	tracked	neutrino	05:14	0.09
28	kenhors	new_solver	neutrino	05:32	-0.06
29	antigone	new_solver	neutrino	05:36	-0.04
30	cliffyg	new_solver	neutrino	05:38	-0.44
31	johnr118	new_solver	neutrino	05:39	-0.33
32	Mikemon	tracked	neutrino	05:41	0.14
33	Pnmcg	new_solver	neutrino	05:49	0.01
34	Nathan Panning	new_solver	reference	05:59	0.97
35	Diskus	tracked	reference	06:01	1.08
36	lucyg43484	new_solver	neutrino	06:02	-0.98
37	Jason	reference	reference	06:02	0.9
38	lili	tracked	reference	06:23	0.73
39	mistigris	reference	reference	06:40	1.26
40	verlaine	reference	reference	06:44	1.37
41	PaulCooke	new_solver	neutrino	06:44	0.32
42	DaddyM	tracked	tracked	06:46	0.55
43	Magoo	reference	reference	06:48	1.5
44	mauefw	new_solver	reference	07:08	1.03
45	hilarym	tracked	reference	07:12	0.97
46	robertscottf	new_solver	neutrino	07:20	-0.89
47	Paul Gilbert	tracked	reference	07:20	1.27
48	aphis99	reference	reference	07:26	1.05
49	cmjhutton	new_solver	tracked	07:45	1.53
50	greggybell	tracked	neutrino	08:08	1.21
51	Dr Dolittle	new_solver	reference	08:13	1.51
52	Contrarian3	new_solver	reference	08:29	0.57
53	richard	reference	reference	08:35	0.91
54	boulemiche	tracked	reference	09:08	0.74
55	asaldanha	reference	reference	09:15	1.06
56	glheard	reference	reference	09:35	0.89
57	patrickcates	tracked	reference	09:48	1.04
58	markdobell	new_solver	reference	10:07	1.18
59	chindit	reference	reference	10:08	1.07
60	samgdavies	new_solver	reference	10:22	0.67
61	Kinghedger	tracked	reference	10:23	1.16
62	lickert	reference	reference	10:26	0.96
63	KenD51	tracked	tracked	10:40	-0.35
64	philjordan1147	new_solver	reference	10:41	1.09
65	Deane Short	new_solver	reference	10:42	1.05
66	keriothe_	reference	reference	10:45	1.13
67	tiggis	tracked	reference	10:51	1.23
68	scrabbler	new_solver	reference	10:57	1.24
69	Heyesey	tracked	reference	11:01	1.08
70	miked1961	tracked	reference	11:09	1.12
71	Umpire	new_solver	reference	11:10	0.97
72	AlanS	reference	reference	11:12	1.11
73	Topical Tim	reference	reference	11:27	1.3
74	xyster	reference	reference	11:31	0.75
75	andy	tracked	reference	11:31	0.89
76	Sheapey	reference	reference	11:38	1.13
77	David Crooks	reference	reference	11:52	0.98
78	Golvellius	tracked	reference	11:53	1.08
79	Tom Stubbs	reference	reference	11:53	1.31
80	SimonAnthony	reference	reference	11:54	1.96
81	chriswords	reference	reference	11:55	0.92
82	fuzz	tracked	tracked	11:58	0.2
83	HoneyBadger	new_solver	reference	12:08	1.06
84	fshephe	reference	reference	12:14	0.6
85	neilr	reference	reference	12:15	0.9
86	JimboFS	new_solver	reference	12:33	1.0
87	Stavros	reference	reference	12:34	1.23
88	ChuckB	tracked	reference	12:39	0.91
89	Henry White	new_solver	reference	12:41	1.05
90	d.middleton	new_solver	reference	12:42	0.92
91	edwards.robert1	tracked	tracked	12:50	-0.01
92	canismiser	new_solver	reference	12:53	1.27
93	John Walsh	tracked	reference	12:56	0.56
94	Silva	reference	reference	12:58	0.96
95	March	new_solver	reference	13:05	1.09
96	aphasic	tracked	reference	13:11	1.09
97	Paul Bacon	new_solver	reference	13:13	0.9
98	tilbee	new_solver	reference	13:14	1.16
99	BinLinerBob	new_solver	tracked	13:20	0.42
100	MikeOsborne	reference	reference	13:35	0.92
101	Jim Willis	new_solver	reference	13:36	1.37
102	Groucho	reference	reference	13:38	1.1
103	robertL	tracked	reference	13:39	1.52
104	Ed freshpot	reference	reference	13:40	0.91
105	7dPenguin	tracked	reference	13:42	1.31
106	Ben Staveley	reference	reference	13:43	1.0
107	Secondbass	new_solver	reference	13:47	0.91
108	Penfold_61	new_solver	reference	13:48	1.11
109	Derek Harrison	reference	tracked	13:59	-0.15
110	Tibthorpe	reference	reference	14:02	1.03
111	christopherclark4945	new_solver	reference	14:03	1.84
112	fishernick79	tracked	reference	14:12	0.93
113	franceslc11	new_solver	reference	14:13	0.93
114	alexh	tracked	reference	14:14	0.55
115	LouWeed	reference	reference	14:15	0.97
116	Eddddddd	tracked	reference	14:18	1.29
117	CentralLine	tracked	reference	14:26	1.28
118	chriss	new_solver	reference	14:32	1.6
119	Peponi13	new_solver	reference	14:36	0.91
120	Johninterred	new_solver	blog_solver	14:40	1.23
121	Semillon	tracked	reference	14:41	1.33
122	Mike Mansbridge	new_solver	tracked	14:46	2.53
123	myles	tracked	reference	14:49	0.87
124	Finzi	new_solver	reference	14:53	0.63
125	howardwilde1	new_solver	reference	15:02	0.98
126	BlackburnRover	new_solver	reference	15:03	0.47
127	Crucifer	tracked	reference	15:04	1.49
128	Aloysius	tracked	reference	15:04	0.63
129	Pootle	new_solver	reference	15:07	1.34
130	john.brassey	new_solver	tracked	15:08	0.23
131	njnclarke	tracked	reference	15:19	1.37
132	phthisis	reference	reference	15:25	1.0
133	AndyR	tracked	reference	15:28	0.86
134	JezWoolfrey	reference	reference	15:32	1.22
135	gabrojak	new_solver	reference	15:35	1.08
136	robinh	reference	reference	15:36	0.58
137	GeorgeTz	new_solver	reference	15:40	0.83
138	grape	tracked	reference	15:41	1.37
139	pitcaithlie	new_solver	reference	15:44	1.53
140	RobR	reference	reference	15:52	1.29
141	LJCN	new_solver	reference	15:54	1.21
142	Achernar	tracked	reference	15:55	0.64
143	john.marshall	new_solver	reference	15:58	0.99
144	tapbarker	tracked	reference	16:01	1.18
145	zinzan	new_solver	reference	16:01	1.1
146	Squallaby	reference	reference	16:05	1.92
147	Looch	reference	reference	16:07	1.06
148	Paul Hammond	new_solver	reference	16:11	0.77
149	Viscomte	tracked	reference	16:12	0.64
150	MK76	tracked	reference	16:13	1.12
151	andrewlake	tracked	reference	16:32	1.02
152	daulbs	tracked	reference	16:39	1.38
153	Crossiant	new_solver	reference	16:49	1.22
154	ajcauk1	new_solver	reference	16:57	0.59
155	ilan	new_solver	reference	17:03	0.64
156	jimwetzler	tracked	reference	17:04	0.64
157	Freemers	new_solver	reference	17:04	0.9
158	Blackbeard	tracked	reference	17:09	0.98
159	MrChumley	tracked	tracked	17:10	0.32
160	Galspray	tracked	reference	17:23	1.27
161	Craven	reference	reference	17:27	0.73
162	TB22	new_solver	tracked	17:30	2.4
163	rupes	new_solver	reference	17:31	1.59
164	PGooden	reference	reference	17:37	1.23
165	jeremy.kenyon	new_solver	reference	17:42	0.84
166	Encota	new_solver	reference	17:47	1.28
167	DunPangolin	new_solver	reference	17:53	0.9
168	MossDef	new_solver	reference	18:04	1.02
169	cmcnsmith	new_solver	reference	18:10	0.51
170	earlylight	tracked	reference	18:12	0.58
171	Jeremy S	new_solver	reference	18:14	1.08
172	jaraab	tracked	reference	18:19	1.16
173	Gallion Fish	new_solver	reference	18:24	0.99
174	GMcD	reference	reference	18:27	1.04
175	tds	new_solver	reference	18:31	0.95
176	benedick	reference	reference	18:31	0.83
177	Foozler	new_solver	reference	18:36	0.53
178	KET	tracked	reference	18:36	1.45
179	Andrew Whiffin	new_solver	reference	18:40	1.15
180	martinede	new_solver	reference	18:42	0.93
181	Dzhigit	tracked	reference	18:50	1.08
182	rrricharrrd	tracked	reference	18:51	0.81
183	pterodactyl	reference	reference	18:52	0.86
184	Swanny	tracked	reference	19:00	1.97
185	Upfisher	new_solver	reference	19:06	1.41
186	cath23	tracked	reference	19:07	1.38
187	Grestyman	tracked	reference	19:08	0.76
188	Colin2355	new_solver	reference	19:09	1.2
189	julian_w	tracked	reference	19:13	1.02
190	DanSolo	new_solver	reference	19:14	1.22
191	sue.cresswell	new_solver	reference	19:17	1.26
192	squark	new_solver	reference	19:18	1.03
193	Zander	tracked	reference	19:21	1.27
194	kath	tracked	reference	19:22	0.81
195	npweston	new_solver	reference	19:29	0.72
196	pc8	tracked	reference	19:31	1.17
197	Solver52	reference	tracked	19:32	0.27
198	Cookincats	tracked	reference	19:32	1.44
199	hopkinb	new_solver	reference	19:32	1.45
200	LuckOfLucien	tracked	reference	19:37	1.18
201	gsriordan52	new_solver	reference	19:44	1.19
202	Ease This Jam	new_solver	reference	19:52	1.53
203	Dvynys	new_solver	reference	20:00	1.16
204	kate.daly305	new_solver	reference	20:00	1.86
205	uvofiz	new_solver	reference	20:06	0.78
206	doublecross	tracked	reference	20:10	1.76
207	Pxspxs	new_solver	reference	20:13	1.17
208	chriswestontour	new_solver	reference	20:21	1.38
209	Riche	new_solver	reference	20:24	0.88
210	David Bourne	tracked	reference	20:25	1.33
211	UisceTe	new_solver	reference	20:26	1.23
212	Jeremy Weissmann	new_solver	reference	20:26	1.11
213	Jagsfan1971	tracked	reference	20:26	1.61
214	Zabadak3	new_solver	reference	20:30	1.08
215	Curarist	tracked	tracked	20:33	0.94
216	Hamish.S	new_solver	reference	20:36	1.16
217	hugh schofield	new_solver	reference	20:37	1.19
218	DianeRS	new_solver	reference	20:39	1.55
219	Mike C	new_solver	reference	20:40	1.4
220	James P	tracked	reference	20:43	1.45
221	monkfish	new_solver	reference	20:46	1.29
222	Nangle	tracked	reference	20:50	1.04
223	M Bennett	new_solver	reference	21:00	1.19
224	endafk	tracked	reference	21:08	0.77
225	valerian1967	tracked	reference	21:08	1.0
226	Kevin Gregg	reference	reference	21:08	1.27
227	dec	reference	reference	21:22	1.26
228	John Arnold	reference	reference	21:26	1.24
229	luxtonj61	new_solver	reference	21:30	1.03
230	frost	tracked	reference	21:31	1.36
231	Onelug	new_solver	reference	21:32	0.95
232	daniel.faith	new_solver	reference	21:33	0.92
233	Waterloo	new_solver	reference	21:35	1.07
234	Rod B	new_solver	reference	21:52	1.01
235	Leegoods	new_solver	reference	22:01	1.06
236	george.garlick	new_solver	reference	22:03	1.13
237	Corymbia	new_solver	reference	22:04	1.34
238	The Caffeine Kid	new_solver	reference	22:06	0.65
239	suethepotterer	new_solver	tracked	22:22	0.3
240	McBeak	new_solver	reference	22:26	1.15
241	crosswordian	reference	reference	22:31	0.91
242	cognominative	new_solver	reference	22:37	1.15
243	jimancliffe	new_solver	reference	22:43	0.58
244	goblin	tracked	reference	22:44	0.64
245	david_ch	new_solver	blog_solver	22:48	1.22
246	Brenk	tracked	reference	22:48	1.5
247	Tudds	reference	reference	22:59	1.07
248	richardCV22	tracked	reference	23:03	1.23
249	puzzled1	tracked	neutrino	23:14	0.85
250	stainl665	new_solver	reference	23:19	1.15
251	cyrillic	reference	reference	23:23	0.99
252	joe.mcgrane	new_solver	reference	23:28	1.5
253	1234	reference	reference	23:35	1.15
254	klamery4	new_solver	reference	23:43	0.51
255	docg	new_solver	reference	23:49	0.66
256	DamienKnapma	tracked	reference	23:51	0.92
257	Terrier	new_solver	reference	23:56	1.5
258	rjcassidy	reference	reference	24:25	0.92
259	chris661554	new_solver	reference	24:25	1.14
260	medodd	new_solver	reference	24:32	0.91
261	JohnDun	reference	reference	24:45	1.44
262	Crippens1	reference	reference	24:45	1.19
263	Beagler	tracked	reference	24:57	1.32
264	MichelinPoitiers	new_solver	reference	25:01	0.94
265	Mkgnao	reference	reference	25:07	0.84
266	tony the butcher montana	new_solver	reference	25:20	1.43
267	Edprof	reference	reference	25:20	1.14
268	Sheen	new_solver	reference	25:24	1.36
269	timbo	tracked	reference	25:28	0.99
270	crucihacker	new_solver	reference	25:28	1.35
271	hugapug	new_solver	reference	25:40	0.91
272	barracuda	reference	reference	25:55	1.1
273	Gussie	new_solver	reference	25:58	1.54
274	joekobi	new_solver	blog_solver	25:59	1.17
275	Fidelio	new_solver	reference	26:03	1.1
276	eniamretrauq	reference	reference	26:22	1.11
277	BoredAccountant	new_solver	reference	26:26	1.23
278	brian.mcnamara	new_solver	reference	26:29	1.35
279	Deezzaa	new_solver	reference	26:42	1.08
280	pvoller	new_solver	reference	26:59	1.11
281	ulaca	reference	reference	26:59	1.31
282	infinitejest	new_solver	reference	27:00	1.33
283	Yatton50	tracked	reference	27:03	1.2
284	Dr_Bob	new_solver	reference	27:22	1.03
285	Mike Harper	tracked	reference	27:36	1.23
286	nekabue	reference	reference	27:39	1.22
287	Pendrov	tracked	reference	27:42	1.82
288	JMbrow29	new_solver	reference	27:43	0.73
289	SlumdogEngineer	tracked	reference	27:49	1.65
290	JoeyC	tracked	reference	27:53	1.1
291	symbenall2	tracked	reference	28:41	0.55
292	RogerC	new_solver	reference	28:42	1.28
293	Rowlie26	new_solver	reference	28:50	1.2
294	NAPASAI	reference	reference	28:52	1.4
295	Winchelt	new_solver	tracked	28:54	0.12
296	6098mr	tracked	reference	29:01	0.53
297	phcbarnes	new_solver	tracked	29:38	0.34
298	Mudge	new_solver	reference	29:57	1.23
299	Manveru	reference	reference	30:19	1.23
300	annikins	new_solver	tracked	30:34	2.17
301	Grumpole	new_solver	reference	30:43	0.93
302	Speedcop2	new_solver	reference	30:52	1.16
303	Rookie	new_solver	reference	31:12	1.0
304	dosbarth	new_solver	reference	31:22	1.26
305	gothick	new_solver	reference	31:29	0.87
306	Jeeves	reference	reference	31:30	1.14
307	rosselliot	reference	reference	31:37	0.98
308	vinyl12345	new_solver	reference	31:46	1.55
309	hipponym	new_solver	reference	31:50	1.18
310	FelicityTT	reference	reference	32:05	0.88
311	gbestanley	reference	reference	32:06	0.68
312	koro	reference	reference	32:19	1.02
313	Maggot	tracked	tracked	32:31	0.93
314	alistair.boere	new_solver	tracked	33:07	0.4
315	marp	new_solver	reference	33:49	1.01
316	Nigel1953	tracked	reference	34:21	1.54
317	BertieVII	new_solver	reference	34:24	0.73
318	CoxBurglar	new_solver	reference	34:25	0.97
319	Vagans	tracked	reference	34:26	0.55
320	Winchelt618	new_solver	tracked	34:32	-0.19
321	SK42	tracked	reference	34:33	1.39
322	Lloyd	new_solver	reference	34:34	1.19
323	bruce.johnston22	new_solver	reference	34:36	0.86
324	simjt	new_solver	reference	34:40	0.93
325	WordPlodder	new_solver	reference	34:40	1.2
326	Cryptique	new_solver	reference	34:49	0.66
327	j.stanton734	new_solver	reference	34:49	1.64
328	Birdingbob	new_solver	reference	34:50	1.42
329	Michael S	new_solver	reference	35:04	1.01
330	VictoriaW	tracked	neutrino	35:49	0.11
331	tyrotim	new_solver	reference	35:59	0.88
332	starstruck	tracked	reference	36:03	1.23
333	Rozz	new_solver	reference	36:15	0.8
334	boltonwanderer	new_solver	blog_solver	36:40	1.32
335	Pleasuredome	tracked	reference	36:58	1.46
336	HanS	tracked	tracked	37:12	0.29
337	RaghuS	tracked	neutrino	37:40	0.92
338	Shushannah	tracked	reference	38:03	1.0
339	joss henry	tracked	reference	38:14	0.99
340	kapietro	new_solver	reference	38:25	1.13
341	maryht	tracked	reference	39:17	0.51
342	rv_1	new_solver	reference	39:18	1.24
343	jackk.larg	new_solver	reference	39:24	1.27
344	Dalai Farmer	new_solver	tracked	39:32	1.6
345	hydrochoos	tracked	reference	40:14	0.78
346	Dr. Venn	new_solver	reference	41:28	0.7
347	ofarrell	tracked	reference	41:38	1.2
348	baronrob	tracked	reference	42:49	1.12
349	empty	reference	reference	44:13	0.7
350	clivejharlow	new_solver	reference	44:45	1.14
351	phmfantom	reference	reference	44:49	1.74
352	Steve Wood	tracked	tracked	49:17	0.81
353	MartinP	tracked	tracked	51:45	1.18
354	kjbr	tracked	tracked	52:05	1.12
355	profsjpayne	new_solver	tracked	52:14	0.81
356	The Real Steve Snackman	new_solver	tracked	52:43	0.83
357	The Mighty Salmon	new_solver	tracked	55:31	1.33
358	Masha	tracked	tracked	57:08	1.29
359	intentional rounding	new_solver	tracked	57:50	0.8
360	KathH	new_solver	tracked	59:35	0.62
361	paulmcl	tracked	tracked	59:51	0.86