Auto chart generator achieves 60% predicting accuracy on existing challenging+ charts

[Mourningfall]

Originally Posted by lurker

this is specifically about pad play (ddr/itg/etc) and definitely not ffr

ie, not relevant and never going to have any idea of charting techniques that actually require a level of skill on keyboard to play.

it seems like a time-sink in all honesty, they should do something more constructive with their skills rather than designing something thats never going to reach full potential

like actually just make the charts themselves

[DaBackpack]

The main take-away here, as stated in the paper, isn't so much that "hey guys this is actually going to help DDR developers/artists", but rather "hello fellow scientists, here is a huge fucking corpus of annotated data, use this for your research purposes in designing intelligent music information retrieval systems"

Originally Posted by Mourningfall

ie, not relevant and never going to have any idea of charting techniques that actually require a level of skill on keyboard to play.

it seems like a time-sink in all honesty, they should do something more constructive with their skills rather than designing something thats never going to reach full potential

like actually just make the charts themselves

there's no reason at all why this can't be applied to keyboard charts

the corpus they used was from ITG, so the techniques the LSTMs learned were about ITG. This research would theoretically be extensible to keyboard charts if they had a large enough corpus

and in the time it would take a human to produce a chart, the LSTM/CNN method would produce thousands of charts, if it had enough songs to work with

the tradeoff is that most of those charts would suck major ass, but this is far from useless tbh

EDIT: I don't really make FFR charts, and I'm assuming that there is no fundamental difference between charting for these different games, a difference that stops neural networks from learning patterns altogether

if there is, placing my foot in my mouth

Originally Posted by Untimely Friction

Are you one of the contributors? Wheres 60% from and how does one do suectivity accurately, I'm curious of a little more before I go clicking around more, such as where you got that info. Im no neural network expert but 60% is only 10% more than 50 at which Id assume its still random 50/50, with a sample size that happened to be 60% "accurate", where other sets could be 30, 40, 80, random is random

Edit: tl;dr more info?

There are two steps that are explored here:

1) Given a song, where do we place the notes? (on this quarter notes, eighth note, etc)
2) Given a spot in the song to place notes, what notes do we place there? (Left, right, up, down, etc)

For the first one, you can expect a baseline of 50%: either one time-step in the song gets a note, or it doesn't. The 60% might not seem that impressive, but it IS better than the baseline, which is still pretty good.

For the second one, you can expect a baseline of 100/(C(4, 4) + C(4, 3) + C(4, 2) + C(4, 1)) = 100/15 = 6.66% per placement. (After all, each placement can have Left, Right, Up, Down, Left and Up, Left and Down, etc)

I might be misinterpreting something here because tired, so somebody can correct me if I'm wrong, but 50% for this part is pretty damn good.

[choof]

Originally Posted by DaBackpack

there's no reason at all why this can't be applied to keyboard charts

the corpus they used was from ITG, so the techniques the LSTMs learned were about ITG. This research would theoretically be extensible to keyboard charts if they had a large enough corpus

and in the time it would take a human to produce a chart, the LSTM/CNN method would produce thousands of charts, if it had enough songs to work with

the tradeoff is that most of those charts would suck major ass, but this is far from useless tbh

EDIT: I don't really make FFR charts, and I'm assuming that there is no fundamental difference between charting for these different games, a difference that stops neural networks from learning patterns altogether

if there is, placing my foot in my mouth

there are pretty large differences in making charts for pad and kb play
1 - pad patterning is somewhat restricted due to the physical aspect of the playstyle, and kb patterning is not
2 - patterning approaches are extremely varied in kb play and a fully functional tool would not only need to be technically accurate, but would also need to be artistic as well

I'm sure someone else can expand on these points further, I'm busy atm

this is a really neat idea but it would probably only ever work for 4k pad play.