Michael Fallon has told ITV News he was "rather careless" to claim some parts of the UK felt "under siege" from immigration.
But the Defence Secretary insisted there was an issue with large numbers of European migrants entering the UK and putting pressure on services.
Former home secretary David Blunkett has said defence secretary Michael Fallon was right to speak out about immigration, despite the outcry over his use of the term "swamped".
His comments come after the prime minister distanced himself from the words used by Mr Fallon, saying politicians need to choose their language carefully when it comes to immigration.
Blunkett caused controversy himself when he used the same term when speaking on the issue 12 years ago.
Writing in the Daily Mail, he said: "Yet for all such condemnation, I believe that both Michael Fallon and I were right to speak out on this issue and voice the concerns of ordinary voters.
"Just because immigration is deeply controversial, that cannot mean that we should avoid talking about it."
He added: "What we need from all politicians is honesty and openness, not a desire for political point-scoring or displays of self-righteous importance."
The Democratic presidential candidate may also have shown his cards on his choice of running mate.
The US president also shared a post on Twitter accusing Dr Anthony Fauci of misleading the public over hydroxychloroquine.
Fears over an impending second wave of coronavirus dominates Wednesday’s front pages.