I'm really curious to see if this kind of diffusion works with "guided generation" / grammars as well. There's a lot of "structure" in code that you could use for minimising the low hanging fruit errors, and focus on the logic of the code instead.