Red Dead Redemption horses?

I've been playing RDR for a while and I just got a Hungarian horse, but the problem is I've had the Kentucky horse since the Bonnie mission and I'll feel bad if I just dump it for the white(and/or a black) one, and it folllowed me to Mexico. I know it's dumb but what should I do?