Hi Toino,
I attempted to duplicate your issue using the ADAU1452MINIZ eval board. I could not get a 8192 FIR coefficient table to load properly, so I used four 4096-tap filters instead, as shown below. My test project self-booted in less than one second, suggesting that something is slowing down the transfer from your SPI E2PROM to your -1452..
Best regards,
Bob