The 30-year-old Liverpool player was called up for the Three Lions' Euro 2016 squad but barely participated, as his side endured a disappointing and early exit in France.
Speaking to the media, the Reds' midfielder thinks it's time to end his international career after James Ward-Prowse and Ruben Loftus-Cheek have impressed with England Under-21s.
"Over the last couple of years with the England team I have not really played too much.
"With the good young players we have coming through, it is pointless me taking up a spot just because I am reliable.
"I am fortunate to have been involved in international football since I was 17 or 18 without stopping. I was with the under-21s and went through so I have played more than 100 games.
"I've been to four tournaments, but if a younger guy had come in and maybe done the same job at Euro 2016, he would have taken a lot more from it than I (did)."
Milner, who has made 61 caps for his country, also spoke about England's new manager Sam Allardyce.
"I am happy it is Sam as I know I can have a good conversation with him and it will be honest. That is all I ever wanted."