I know a huge amount of work went into Sonic-Pi, and I don’t think I’m up to it, may’be Visor is interesting to you. kn1kn1 did something with ruby-processing and sonic-pi, but it seemed more like using sonic-pi as editor for ruby-processing albeit using the sonic-pi interface.