He added that many consumers are finding that their connections are not living up to what they were promised, meaning many cannot enjoy activities including downloading films and watching TV.
"If you are a customer you are expecting your shiny new 8 MB download speed but the average customer receives only just over 3 MB," he said.
"The challenge is enormous and the government needs to take a lead in working with existing network providers."
Competitiveness minister Stephen Timms recently held a summit with experts in the field to discuss how the broadband speed of services can be improved.
He warned that the UK could face being left behind countries including France, Germany and the US by not updating its current systems.
Click here to run an energy price comparison, and see if you could be paying less for your gas and electricity.