Samsung Galaxy Note5 User Manual page 59

Remove a Speed Dial Number
You can remove an assigned Speed dial number.
1. From a Home screen, tap Phone.
2. Tap More options > Speed dial.
3. Find the contact to remove from the Speed dial.
4. Tap Remove.
Calling 50 Speed Dial