Conformal field theory for inhomogeneous one-dimensional quantum systems: the example of non-interacting Fermi gases