Despite this, the panel stated that the future of the UK's gas and electric market is based on everyone using energy-saving measures.
Sarah Harrison, Ofgem's managing director for corporate affairs, said: "The panel report gives a good insight into likely consumer engagement with the future energy market as seen through the eyes of consumers today.
"This insight is valuable as it helps to shape Ofgem's current work to make sure the energy market meets household consumers' needs going forward."
It was also found that many consumers feel they need more information on energy efficiency to help them make the right choices.
Consumer Focus recently stated that the upcoming Budget needs to help families cope with energy bills.
Click here to run an energy price comparison, and see if you could be paying less for your gas and electricity.