Hmm... looking at one of my cover videos right now. I did a quick and dirty cover of "Don't Take Me Alive" and it looks like YouTube added licensing and ownership info for the song; I'm assuming in order to correctly pay royalties from the... let's see... 167 views it received.
So I'm going with Barfany Shart on this. I do think these videos are educational in the sense that we tend to look them up to see how other players are doing something we're learning, even if they are not outright specified as "for educational use." I recorded mine as video auditions, mainly, but some of the verbiage talks about how much time I would spend learning the song note-for-note if it were a tribute band versus a dinky bar band, etc. So maybe that pushes it more toward educational territory, as well.
Anyway, I'm happy that someone's getting their little piece of a penny for their own work; no harm to me that they do.