{"id":10548,"date":"2023-12-13T21:16:00","date_gmt":"2023-12-14T02:16:00","guid":{"rendered":"https:\/\/www.rushworth.us\/lisa\/?p=10548"},"modified":"2023-12-26T19:55:34","modified_gmt":"2023-12-27T00:55:34","slug":"bulk-download-of-youtube-videos-from-channel","status":"publish","type":"post","link":"https:\/\/www.rushworth.us\/lisa\/?p=10548","title":{"rendered":"Bulk Download of YouTube Videos from Channel"},"content":{"rendered":"\n

Several years ago, I started recording our Township meetings and posting them to YouTube. This was very helpful — even our government officials used the recordings to refresh their memory about what happened in a meeting. But it also led people to ask “why, exactly, are we relying on some random citizen to provide this service? What if they are busy? Or move?!” … and the Township created their own channel and posted their meeting recordings. This was a great way to promote transparency however<\/em> they’ve got retention policies. Since we have absolutely been at meetings where it would be very helpful to know what happened five, ten, forty!! years ago … my expectation is that these videos will be useful far beyond the allotted document retention period. <\/p>\n\n\n\n

We decided to keep our channel around with the historic archive of government meeting recordings. There’s no longer time criticality — anyone who wants to see a current meeting can just use the township’s channel. We have a script that lists all of the videos from the township’s channel and downloads them — once I complete back-filling our archive, I will modify the script to stop<\/em> once it reaches a video series we already have. But this quick script will list all videos published to a channel and download the highest quality MP4 file associated with that video. <\/p>\n\n\n

\n# API key for my Google Developer project\nstrAPIKey = '<CHANGEIT>'\n\n# Youtube account channel ID\nstrChannelID = '<CHANGEIT>'\n\nimport os\nfrom time import sleep\nimport urllib\nfrom urllib.request import urlopen\nimport json\nfrom pytube import YouTube\nimport datetime\n\nfrom config import dateLastDownloaded\n\nos.chdir(os.path.dirname(os.path.abspath(__file__)))\nprint(os.getcwd())\n\nstrBaseVideoURL = 'https:\/\/www.youtube.com\/watch?v='\nstrSearchAPIv3URL= 'https:\/\/www.googleapis.com\/youtube\/v3\/search?'\n\niStart = 0\t\t# Not used -- included to allow skipping first N files when batch fails midway\niProcessed = 0\t\t# Just a counter\n\nstrStartURL = f"{strSearchAPIv3URL}key={strAPIKey}&channelId={strChannelID}&part=snippet,id&order=date&maxResults=50"\nstrYoutubeURL = strStartURL\n\nwhile True:\n    inp = urllib.request.urlopen(strYoutubeURL)\n    resp = json.load(inp)\n\n    for i in resp['items']:\n        if i['id']['kind'] == "youtube#video":\n            iDaysSinceLastDownload = datetime.datetime.strptime(i['snippet']['publishTime'], "%Y-%m-%dT%H:%M:%SZ") - dateLastDownloaded\n            # If video was posted since last run time, download the video\n            if iDaysSinceLastDownload.days >= 0:\n                strFileName = (i['snippet']['title']).replace('\/','-').replace(' ','_')\n                print(f"{iProcessed}\\tDownloading file {strFileName} from {strBaseVideoURL}{i['id']['videoId']}")\n                # Need to retrieve a youtube object and filter for the *highest* resolution otherwise we get blurry videos\n                if iProcessed >= iStart:\n                    yt = YouTube(f"{strBaseVideoURL}{i['id']['videoId']}")\n                    yt.streams.filter(progressive=True, file_extension='mp4').order_by('resolution').desc().first().download(filename=f"{strFileName}.mp4")\n                    sleep(90)\n                iProcessed = iProcessed + 1\n    try:\n        next_page_token = resp['nextPageToken']\n        strYoutubeURL = strStartURL + '&pageToken={}'.format(next_page_token)\n        print(f"Now getting next page from {strYoutubeURL}")\n    except:\n        break\n\n# Update config.py with last run date\nf = open("config.py","w")\nf.write("import datetime\\n")\nf.write(f"dateLastDownloaded = datetime.datetime({datetime.datetime.now().year},{datetime.datetime.now().month},{datetime.datetime.now().day},0,0,0)")\nf.close\n\n<\/pre><\/div>","protected":false},"excerpt":{"rendered":"
Several years ago, I started recording our Township meetings and posting them to YouTube. This was very helpful — even our government officials used the recordings to refresh their memory about what happened in a meeting. But it also led people to ask “why, exactly, are we relying on some random citizen to provide this …<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1945],"tags":[664,1938,1939],"class_list":["post-10548","post","type-post","status-publish","format-standard","hentry","category-python","tag-python","tag-youtube","tag-youtube-api"],"_links":{"self":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/10548","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=10548"}],"version-history":[{"count":3,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/10548\/revisions"}],"predecessor-version":[{"id":10573,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/10548\/revisions\/10573"}],"wp:attachment":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=10548"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=10548"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=10548"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}