The away fans had relatively little to encourage them during a low-key opening to the tie, although StefanHoffmann went close with a curling free-kick.
But Jelavic, who had scored Rapid's goal in the first leg, scored to put Rapid through on away goals, after keeper Brad Guzan had parried a StefanHoffmann shot.