Combine the mayonnaise, lemon juice, and cayenne pepper in a bowl. Coarsely chop the shrimp and mix with the celery, onion, capers, and caper juice in a bowl. Add the mayonnaise mixture and stir until coated. Chill, covered, until serving time. Serve on a bed of lettuce or with crackers and/or French bread.