Gravitational traces of broken gauge symmetries