Courtesy of this forum post I had to rebuild Mplayer to prevent crashes when jumping through files. As I am quite devoted to vdpau I didn’t test whether this is a general issue or not…
Fixing it is rather easy:
CFLAGS="-O2 -fomit-frame-pointer" ./configure ...