To a question whether the Samajwadi Party can withdraw outside support to UPA, PM, who returned to New Delhi from Durban after wrapping up the four-day BRICS summit, said that possibility cannot be denied.