Neanderthals
As recent studies have shown signs of Neanderthal genetics in people with European backgrounds, at least some of us have Neanderthal ancestors.
Given #2, going back to the size of the Neanderthals may be a reasonable choice.
But brain and mind are very different things however closely related. Comparisons of brain size per se is a poor predictor of intelligence. There seems to be no strong correlation.
And there are people out there living normal lives with brain structures which differ drastically from the norm in both size and arrangement.