Created attachment 1918415 [details]
Screen recording of the issue

Description of problem:
In a directory with a lot of files, clicking a file that is almost out of sight disrupts multiple file selection. See attached video.

Version-Release number of selected component (if applicable):
43.0

How reproducible:
Always

Steps to Reproduce:
1. Go to a directory with enough files to enable scrolling, such as /home/youruser
2. Hold "Ctrl" and start clicking a few files to select them, then try to click one of the files at the bottom edge of the window.

Actual results:
The cursor will become a grabbing hand, as if you were dragging the file, and the existing selection will be lost.

Expected results:
The clicked file should become selected (old GTK3 behavior), or it should just move into view, without making us lose the current selection.

Additional info:
- Fedora Workstation 37 Beta
- GNOME on Wayland