So finally i fixed this problem. Problem was the wrong setting of the LLC.
io_set 0x19 0x02 # normal LLC frequency, disable DLL on LLC
io_set 0x33 0x00 # bypass DLL on LLC
The only part that i still do not understand is that the spec say that DDR mode is only supported up to 50MHz.