Quarter peeled potatoes and place in a large pot. Fill with cold water (1 inch over potatoes) and place over high heat to boil. Boil potatoes for about 15 minutes or until fork-tender.
While potatoes boil, make dressing by combining mayo and remaining dressing ingredients into a bowl. Whisk together until smooth, taste and adjust if needed.
Strain potatoes and allow to cool slightly so they can be handled. Divide potatoes in half. Dicing half the potatoes into 1/2 inch chunks and partially mashing the other half (still leaving them semi-chunky).
Sprinkle over 2 tablespoons of apple cider vinegar evenly over the potatoes. It's easiest to do this with your thumb partially covering the top of the bottle as you shake it over all the potatoes. Let the potatoes sit for a few minutes to absorb the vinegar.
Place all the potatoes in a large bowl. Add the celery, onion, green and orange peppers. Gently pour over the dressing, tossing until it coats the potatoes well. Garnish with paprika.
Cover tightly and refrigerate for at least 4 hours. If you have time to make it ahead, it tastes even better on day two! It lasts in the fridge for up to 5 days.