Video site doesn't have to be expensive, the most expensive part will be the hosting, so the VPS.
As interface you could use the opensource script "PHP Motion" (free), you need to have an webserver with ffmpeg intergration, which may need you to hire someone to compile it for you...
So no licencing in this case, again, the VPS will probably be your only expense.