Turn left and learn the rules.
A skater is said to have been assessed a penalty and sent to the penalty box when...
the skater has left the track
the action that warrants a penalty has been committed
the skater is seated in the Penalty Box
a referee has completed the verbal cue and hand signal for that penalty