Ok I found a solution. Seems like the HDMI splitter before the external grabber will always send a signal. Resulting in permanent blue. And since the external has a higher priority, I will never see the internal grabber.
Solution was to give the internal grabber the higher prio, since it only sends a signal in kodi during playback. Hope this helps someone.