What OS are you on? I’m not sure if Minim supports getting more than two channels from a JavaSound device, and on Windows there’s the added complexity that the soundcard gets split into multiple stereo devices which needs special handling.
Another option would be Beads with JACK.