> D3 is probably good for its domain, but intuition tells me you'll have a problem if you mainly use Javascript to handle a 20GB dataset. (I'm not dismissing this categorically; I am not very familiar with these tools).

You can use server side javascript which should handle 20GB dataset without problems.