Jose Bautista had two hits and collected his 800th RBI, J.A. Happ worked six innings for his first victory of the season and the Blue Jays beat the Yankees 7-2 on Wednesday night.
Ryan Goins had three hits and two RBIs for the Blue Jays, who had lost five of six. Six of Toronto's 10 hits were doubles.
Facing the Yankees for the first time since Aug. 31, 2014, Happ (1-0) allowed one run and seven hits in six innings. He walked three and struck out four.
Mark Teixeira hit a solo homer, his third, but New York failed to win its third straight.
Brett Cecil worked the seventh, Drew Storen allowed Teixeira's homer in the eighth and Pat Venditte finished.
Making his second start of the season, Yankees right-hander Michael Pineda (1-1) allowed three runs, two earned, and five hits in six innings.
The Blue Jays broke it open with a four-run, bat-around eighth against Ivan Nova. Bautista doubled home a run, Troy Tulowitzki and Goins each hit RBI singles and Russell Martin added a sacrifice fly.
Toronto opened the scoring on a two-out double by Goins in the second. New York tied it in the fifth on an RBI groundout by Aaron Hicks when Josh Donaldson bobbled what might have been an inning-ending double play.
Toronto got two in the fifth and then Teixeira's homer made it 3-2 Blue Jays before Toronto's breakout inning.
Pineda's three walks were the most he'd issued in 42 career starts with the Yankees, snapping his team record streak of starts with two or fewer walks. Mike Mussina walked two or fewer in his final 37 starts with New York.
Yankees: C Brian McCann (bruised left big toe) was held out of the starting lineup.
Yankees: RHP Nathan Eovaldi (0-0, 9.00) makes his second start of the season and his first career start at Rogers Centre in Thursday's series finale. Eovaldi allowed one run and five hits in 6 1/3 innings in his lone career start against Toronto last August.
Blue Jays: RHP Marcus Stroman (1-0, 5.40) is 9-2 with a 2.66 ERA in 18 career games at Rogers Centre, including 14 starts. He's 4-1 with a 2.43 ERA in five career starts against the Yankees.