I can see the row indicator. What I can see are the actual rows as I am scrolling with the scroll bar.
I presume you left the word "not" out of the second sentence above. In other words, you "... can not see the actual rows ...". I don't know where you got the notion that the body of the worksheet actually scrolls while you're dragging the scroll bar. Excel simply does not do that. But, if you drag the scroll bar and stop, the worksheet should jump to the row displayed in the row indicator when you stopped dragging.
I'd say you need to explore some other techniques. One thing you can do is name a range, then go directly to that range. Of course, you can also you the GoTo function to go to a specific cell address. As far as scrolling with a mouse, do you use auto-scroll? With my Logitech wheel mouse, if I click on the wheel, auto-scroll is activated. That's a much easier and faster way to do mouse scrolling that just scrolling by turning the mouse wheel. And, keep in mind other navigation key combinations such as Ctrl/End, Ctrl/Home, Ctrl in conjunction with the arrow keys, and PageUp and PageDown.