Orioles infielder Jordan Westburg exited Baltimore's game against the New York Yankees in the third inning after jamming his left index finger while stealing a base.