PM demands accountability as he urges councils to get on with fixing potholes