With five hits, a walk and some big two-out RBIs from Robinson Cano and Nick Swisher in the first inning, the Yankees opened the game with four runs to give A.J. Burnett a solid lead to work with.
Burnett earned his ninth win, pitching seven innings and allowing two earned runs on six hits. He struck out six and walked three on 104 pitches to remain undefeated since June 20.
Jorge Posada homered for the 12th time this season as part of a 2-for-3 day at the plate that included a double, two RBIs and two runs scored. And Cano and Alex Rodriguez also enjoyed two-hits days.
Berken lasted six innings, but the four runs in the first and another in the third were too much for the offense to overcome as he received his eighth loss.
Leading 5-2 in the eighth, Phil Hughes pitched a scoreless frame to extend his scoreless innings streak to 17 2/3.
Brian Bruney came on in relief in the ninth inning with a four-run lead, but after striking out the first two hitters, Bruney allowed back-to-back home runs to Adam Jones and Nick Markakis.
With a 6-4 lead and one out away from the win, Joe Girardi called on Mariano Rivera to close out the Orioles. Rivera struck out Aubrey Huff to end the game for his 28th save.