With this project, I am trying to generate novel dance choreography using a recurrent neural network (RNN) and motion capture data.
The basic foundation of a phrase of choreography or a small sequence of human movement is the change of a position in 3D space. What did this remind me of? Vectors! (Really complicated ones...)
I wanted to see if machines can create choreography in ways that a human may not think of. To do this, I am using deep learning techniques by implementing RNNs and LSTMs. I define an RNN with output nodes of weights, biases, and tensor placeholders. With these, a n-element sequence of inputs is generated to be fed into the LSTM. While I am currently testing with motion capture data from the CMU Computer Graphics Project, I plan to gather enough motion capture data of myself dancing to train the network on my own movement.
Primary Research Topics/Keywords:
- Deep Learning
- Machine Learning
- Recurrent Neural Network
- Long Short-Term Memory Networks