It's really quite simple!
To begin, simply click on Teaching then on Materials. Next, click + Add Materials. On the left, you will see YouTube, Vimeo, and Embed Link. Click on the one that pertains to the kind of file that you wish to upload.
Simply fill out the fields and hit Add Link at the bottom.