After getting both sides of the fret end to lift, I used the fret pullers and soldering gun to heat and pull the fret the rest of the way out.