We study intermittency for the Parabolic Anderson Model when the diffusion is driven by a constant κ and the branching is induced by a simple exclusion process with symmetric random walk kernel. We consider the annealed Lyapunov exponents and we show that they display an interesting dependence on κ, with qualitatively different behaviours in different dimensions