Rep. Kevin McCarthy, ousted from the House speakership earlier this year, will give up his Bakersfield seat after nearly two decades in Congress.