Minister of State for HRD Shashi Tharoor today avoided commenting on BJP's RS MP Chandan Mitra's criticism of Nobel laureate Amartya Sen, saying there is no question of taking back the 'Bharat Ratna' from the renowned economist.