If he starts negative and then goes positive, it counts as a Yes, such as "some people said he was a one-term failure, but I always thought he was a fine upstanding man". If he says something uncharacteristically neutral, that will remain a No.