People who suffer from cardiovascular disease early in life are more likely to have cognitive and memory problems, and worse brain health during middle age.