I have the same issue with Firefox, but only in normal mode and with non blank lines.
This
aaaa
aaaa
behaves correctly both in insert and normal mode;
while this
aaaa
a
aaaa
behaves correctly in insert mode, but doesn’t remember the position in normal mode (moving with j,k or with the arrow keys doesn’t make any difference).