All it means is who has the focus at a given time, the window the mouse cursor is hovering over currently or the window that was last clicked on. Both choices have their merits. When you want to scroll a window, the hover choice is more ergonomic.

edit: I just noticed a possible misunderstanding, the X windows behaviour is that scrolling the window is initiated by scrolling the scroll wheel, not by moving the cursor into the window.