Mapping mouse events to key shortcuts might be the only way forward that could realistically work. Something like moving the mouse where the cursor/selection is, and sending scrolling events from there.

The lenovo keyboard with its trackpoint and mouse buttons is a kind of solution to this, but IME scrolling is still a PITA as it needs two inputs (switching to scroll mode while moving the trackpoint)