weird driver side mirror issue
 

So every time I get into the car, unlocking the vehicle with the same keyless remote (2001 S80), the driver side mirror adjusts downward slightly. it'll keep adjusting downward, inch by inch, every time the car is unlocked, until the mirror starts "clicking" because it can't go down any further. For now, i disconnected the mirror wiring, but I'd like to know what the fix is. Any ideas?