Joss Whedon says he expects to have Robert Downey, Jr. in Avengers 2, according to The Daily Beast.  "I have no intention of making Avengers 2 without him, nor do I think I’ll be called upon to do that," Whedon said according to the report.  "I don’t think it’s in my interest, Marvel’s interest, or his interest, and I think everything will be fine." 

There’s been a lot of speculation about Downey’s status for Avengers 2 and Phase 3 of the Marvel movies, centering around Downey’s $50 million paycheck for The Avengers and whether Marvel will be willing to show him similar generosity for the sequel (see "Will Robert Downey, Jr. Be in 'Avengers 2'?"). 

Whedon  acknowledges that it’s possible a deal won’t happen.  "I know that this is Hollywood and you roll with things," he said.  He also indirectly noted Marvel’s penuriousness in the same interview, saying he "took a big financial hit doing that movie."