h2g2 The Hitchhiker's Guide to the Galaxy: Earth Edition

Hi! A couple of researchers have been discussing an idea I had for a music generation program. If anyone's interested I'd love to hear any ideas you have, to get this idea closer to reality. Essentially it would be like the feedback visualisation plugins you can get with music players like Winamp, which take the music and add a visual display based on the what the music sounds like. Except I want to do it in reverse; taking an interactive visual scene and producing music based on what it looks like. Primarily for use in computer games, but also with an eye to other areas such as interactive composition. Please check out the conversation we've had so far, at http://www.bbc.co.uk/dna/h2g2/classic/F1666374?thread=362066 and hopefully that will explain the concept better than I just did here. Basically I would love to have some of the trickier definitions explained to me so that I can code the ideas behind them... turning the emotive into the logical, perhaps? Who's up for the challenge?