XBMC-PVR Freezes after changing Channel

FINALLY CAUGHT IT.
It has been bugging me now for a couple of days.

Steps to reproduce:
1) Watch every channel using the TVHeadEnd Backend Using GIT 661 (Compiled it yesterday)
2) Switch channel a couple of times using fullscreen
3) Go back to channel list (where you have the Live TV on a Little Rectangle)
4) Change channels
5) XBMC Freezes.

Log keeps showing:
18:59:16 T:139903421593344 DEBUG: CDVDPlayer::SetCaching - caching state 3
18:59:16 T:139903421593344 DEBUG: PVRManager - PerformChannelSwitch - switching to channel 'MTV'
18:59:16 T:139904112719616 DEBUG: CSoftAE::Run - Sink restart flagged
18:59:16 T:139904112719616 INFO: CSoftAE::InternalOpenSink - keeping old sink with : AE_FMT_FLOAT, FL,FR, 48000hz
18:59:16 T:139904112719616 DEBUG: CSoftAE::InternalOpenSink - Using speaker layout: 2.0
18:59:16 T:139904112719616 DEBUG: CSoftAE::InternalOpenSink - Internal Buffer Size: 4096
18:59:16 T:139903421593344 DEBUG: PVR - SaveCurrentChannelSettings - no custom channel settings for channel 'Channel 4 HD'
18:59:16 T:139903421593344 DEBUG: CAnnouncementManager - Announcement: OnStop from xbmc
18:59:16 T:139903421593344 DEBUG: GOT ANNOUNCEMENT, type: 1, from xbmc, message OnStop
18:59:16 T:139903421593344 DEBUG: AddOnLog: Tvheadend HTSP Client: SwitchChannel - changing to channel 'MTV'
18:59:16 T:139903421593344 NOTICE: PVRManager - PerformChannelSwitch - switched to channel 'MTV'
18:59:16 T:139903421593344 DEBUG: CAnnouncementManager - Announcement: OnPlay from xbmc
18:59:16 T:139903421593344 DEBUG: GOT ANNOUNCEMENT, type: 1, from xbmc, message OnPlay
18:59:22 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_wait) - underrun
18:59:23 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_writei(1)) - underrun
18:59:41 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_wait) - underrun
18:59:46 T:139903459358464 DEBUG: Thread Jobworker 139903459358464 terminating (autodelete)
18:59:46 T:139903476143872 DEBUG: Thread Jobworker 139903476143872 terminating (autodelete)
18:59:46 T:139904159057664 DEBUG: Thread Jobworker 139904159057664 terminating (autodelete)
18:59:47 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_wait) - underrun
19:00:10 T:139904112719616 ERROR: Previous line repeats 2 times.
19:00:10 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_writei(1)) - underrun
19:00:34 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_wait) - underrun
19:01:01 T:139904112719616 ERROR: Previous line repeats 1 times.
19:01:01 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_writei(1)) - underrun
19:02:40 T:139904112719616 ERROR: Previous line repeats 3 times.
19:02:40 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_wait) - underrun
19:03:13 T:139904112719616 ERROR: Previous line repeats 1 times.
19:03:13 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_writei(1)) - underrun
19:03:45 T:139904112719616 ERROR: Previous line repeats 2 times.
19:03:45 T:139904112719616 ERROR: CAESinkALSA::HandleError(snd_pcm_wait) - underrun

But the GUI is totally unresponsive.

I'm using sound over HDMI, Fedora 17.
Compile options:

./configure \
--prefix=%{_prefix} --bindir=%{_bindir} --includedir=%{_includedir} \
--libdir=%{_libdir} --datadir=%{_datadir} \
--enable-external-libraries \
--enable-vdpau \
--enable-rtmp \
--disable-dvdcss \
--disable-debug \
--disable-optimizations \
CPPFLAGS="-I/usr/include/ffmpeg" \
CFLAGS="$RPM_OPT_FLAGS -fPIC -I/usr/include/ffmpeg -D__STDC_CONSTANT_MACROS" \
CXXFLAGS="$RPM_OPT_FLAGS -fPIC -I/usr/include/ffmpeg -D__STDC_CONSTANT_MACROS" \
LDFLAGS="-fPIC" \
LIBS="-L%{_libdir}/mysql -lhdhomerun $LIBS" \
ASFLAGS=-fPIC

Attaching an strace basically shows nothing. I'm able to reproduce it now, so let me know if you need any more tests.