@all, your responses have been very helpful, thank you!
A small update:
I’m currently looking into the possibility to ‘pre-process’ the FFT values. If I can get an array with the FFT values for every frame, I can just grab those and don’t need the AudioPlayer at all :).
Any thoughts?