I find it really interesting how these new large models (DALLE, GPT3, PaLM etc) are opening up new research areas that do not require the same massive resources required to actually train the models.

This may act as a counter balance to the trends of the last few years of all major research becoming concentrated in a few tech companies.