There is a setting that allows you to view videos during editing. However, I need to check whether this works because I hadn't verified it.
When I had this issue, I can see the video play when I go to "Play Mode" (lack of better term) through the main Osu! screen.
I have only tried adding a video to a beatmap knce, so I am not sure how it all works