If you selected files while holding the control key files get selected as expected.
However if you try to undo a select by, while still holding down the control key, the whole selection is undone instead of just the file you clicked.
control selecting
Control clicking shouldnt work at all actually , its not something Ive added and I dont know if things work properly if you select non-contiguous selection.