The developer can make a choice there. https://developer.apple.com/documentation/appkit/nswindow:

> var worksWhenModal: Bool

> A Boolean value that indicates whether the window is able to receive keyboard and mouse events even when some other window is being run modally.

I think there are flags for doing that for non-modal ‘other windows’, too.