Banks may give you something called a retention offer, where you could earn points, miles or cash for keeping your card open ...