Blackburn Rovers manager Graeme Souness did not enjoy his return to Middlesbrough where he first made his name as a midfield player.
Blackburn crashed to a last minute goal from Cameroon international Joseph Job after looking the more impressive side.
A stunned Souness said: "Football is a very cruel game and thats was one of the cruellest results possible.
"To say I am extremely disapointed would be the understatement of all time. We played Middlesbrough off the park and then lost in injury time.
"Middlesbrough, who had conceded two late goals in the previous game against Fulham, had a change of fortune on this occaion."
With virtually their last attack of the game Geremi slipped the ball across the penalty area to the unmarked job.
Job, who had only been on the field as substitute for 11 minutes, had the easiest of scoring chances.
Ironically, Middlesbrough manager Steve McClaren had been booed by the crowd when he replaced record club buy Massimo Maccarone with Job.
Yet the jeers turned to cheers as the Cameroon international earned Middlesbrough their first win of the season.
McClaren said: "I have always stressed that the game is so quick and fast that it is a 14 man game and not just about 11 players. We had quality players waiting on the bench and Joseph Job was in the right place at the right time.
"We rode our luck at times and the score at half time could have been 6-2 if Rovers had taken their chances. We changed our system at half time to stem their flow of attacks."
Republic of Ireland international Damien Duff was easily their most outstanding player on the field.
Blackburn are fortunate Duff has committed his fututre to the Lancashire club by signing a lucrative four-year contract.
Central defender Gareth Southgate and keeper Mark Schwarzer shared top billing for Middlesbrough