In large pot, boil water and potatoes. Cook until tender, drain and cool to room temperature.
Combine potatoes, olives, green onions and celery in a large mixing bowl and set aside.In medium bowl, whisk together red wine vinegar, mustard and capers.Gradually whisk in olive oil, then season with salt, pepper and parsley.
Pour dressing over potato mixture and toss until evenly coated.