Alternately to the pure black/white solution, if you decide to go with the basic idea of "movement = faster", "opposite movement = slower" then let the two colors used be selected either by the map maker, or based off the combo color of the note in question (heightened saturation/lowered for a pattern)