Retrieve all videos from youtube playlist using youtube v3 API
YouTube Data API v3 results are paginated. So you need to get the next page of results for the others.
Basically in the response you have nextPageToken.
To get the remaining results, do the same exact call but setting pageToken into that token you received.
There are three tokes
- pageToken
- nextPageToken
- prevPageToken
and also you can set max page size using
maxResults=50 {allowed Values 1 to 50 }
if you are on page 1 you won't get prevPageToken
but you get nextPageToken
pass this token to next request's
pageToken = {nextPageToken get from last request}
this way you can navigate to next page Try it Your Self
Edited
Ok, for other scenarios
If you are on First Page then
- pageToken = 'Some values'
- nextPageToken = 'Some values'
- prevPageToken = null
If you are on neither the first nor last page then
- pageToken = 'Some values'
- nextPageToken = 'Some values'
- prevPageToken = 'Some values'
@Manoj: you can find your answer below
if you are on the last page
- pageToken = 'Some values'
- nextPageToken = null
- prevPageToken = 'Some value'
Even the field may not be present.
This is a small example made in python using the Python Youtube Client Lib This also borrows boilerplate setup from the youtube API examples
""" Pull All Youtube Videos from a Playlist """
from apiclient.discovery import build
from apiclient.errors import HttpError
from oauth2client.tools import argparser
DEVELOPER_KEY = "YOURKEY HERE"
YOUTUBE_API_SERVICE_NAME = "youtube"
YOUTUBE_API_VERSION = "v3"
def fetch_all_youtube_videos(playlistId):
"""
Fetches a playlist of videos from youtube
We splice the results together in no particular order
Parameters:
parm1 - (string) playlistId
Returns:
playListItem Dict
"""
youtube = build(YOUTUBE_API_SERVICE_NAME,
YOUTUBE_API_VERSION,
developerKey=DEVELOPER_KEY)
res = youtube.playlistItems().list(
part="snippet",
playlistId=playlistId,
maxResults="50"
).execute()
nextPageToken = res.get('nextPageToken')
while ('nextPageToken' in res):
nextPage = youtube.playlistItems().list(
part="snippet",
playlistId=playlistId,
maxResults="50",
pageToken=nextPageToken
).execute()
res['items'] = res['items'] + nextPage['items']
if 'nextPageToken' not in nextPage:
res.pop('nextPageToken', None)
else:
nextPageToken = nextPage['nextPageToken']
return res
if __name__ == '__main__':
# comedy central playlist, has 332 video
# https://www.youtube.com/watch?v=tJDLdxYKh3k&list=PLD7nPL1U-R5rDpeH95XsK0qwJHLTS3tNT
videos = fetch_all_youtube_videos("PLD7nPL1U-R5rDpeH95XsK0qwJHLTS3tNT")
videos will be a list of all your videos concatenated to the first list. It will keep fetching until it has all the videos because of pagination by 50. A similar approach can be taken in other languages.
In the list there will be all the individual video meta data and order
In the JSON data sent to us by youtube data.pageInfo.totalResults is just the original total number of videos. After some months or years this number may be decreased because of video deleting, banning ... Actually youtube gives us only currently playable videos.
So we need to change the code to get the better one.
We shouldn’t use if(sum == data.pageInfo.toTalResults) as stop condition.
Instead let’s use the standard if(typeof nextPageToken == ‘undefined’).
In the case when the current total number is less than the original one. If we use old coding then the last function call is made with undefined nextPageToken. This cause Youtube to wrongly give us the first JSON page again. In the results, we have some duplicated videos.
Please try my new coding (it looks like the coding given by mister user3053204)
/* new coding. Please replace and use your api3 key */
function start(){
count = 0;
$('#area1').val('');
getVids();
}
function getVids(PageToken){
pid = $('#searchtext1').val();
$.get(
"https://www.googleapis.com/youtube/v3/playlistItems",{
part : 'snippet',
maxResults : 50,
playlistId : pid,
pageToken : PageToken,
key: 'AIz....................................zm4'
},
function(data){
myPlan(data);
}
);
}
count = 0;
str = '';
function myPlan(data){
nextPageToken=data.nextPageToken;
pageLen = data.items.length;
count += parseInt(pageLen);
for(i=0; i<pageLen; i++){
str += '"' + data.items[i].snippet.resourceId.videoId + '", ';
}
if(typeof nextPageToken == 'undefined'){
total = data.pageInfo.totalResults;
$('#all').html(count + '/' + total + ' videos');
ind = str.lastIndexOf(',');
str1 = str.substring(0, ind);
$('#area1').val('arr = [' + str1 + '];\n');
return;
}else{
getVids(nextPageToken);
}
}
<input type="text" value="PLTI6yRvQqlYq9KoU-NHu43uDmKON7Fsjv"
id="searchtext1" size="75">
<button onclick="start()">Get Items</button>
<br><br>
IDs for test: <br>
<br>
Ricky King playlist (92/103 videos):<br>
PLTI6yRvQqlYq9KoU-NHu43uDmKON7Fsjv<br>
Franck Pourcel playlist (425/425 videos):<br>
PLMGmDo5xNOgU7gerHMwEk6SmD_vbPyLe9<br>
Lobo playlist (25/41vids):<br>
PLFE095732AC64AD06
<br><br>
TOTAL: <span id="all"></span><br>
<textarea id="area1" style="width:600px;height:500px;;font-size:12pt"></textarea>
/* old coding - to be cleared */
sum = 0;
sumN = 1;
var nextPageToken;
function getVids(PageToken){
pid = $('#searchtext1').val();
$.get(
"https://www.googleapis.com/youtube/v3/playlistItems",{
part : 'snippet',
maxResults : 50,
playlistId : pid,
pageToken : PageToken,
key: 'YOUR API3 KEY'
},
function(data){
myPlan(data);
}
);
}
function myPlan(data){
total = data.pageInfo.totalResults;
nextPageToken=data.nextPageToken;
for(i=0;i<data.items.length;i++){
document.getElementById('area1').value +=
sumN + '-' + data.items[i].snippet.title+'\n'+
data.items[i].snippet.resourceId.videoId +'\n\n';
sum++ ; sumN++;
if(sum == (total-1) ){
sum = 0;
return;
}
}
if(sum <(total-1)){
getVids(nextPageToken);
}
}
function init(){
$('#area1').val('');
}<!- - old coding - to be cleared - ->
<meta http-equiv="content-type" content="text/html; charset=utf-8">
<script type="text/javascript" src="http://code.jquery.com/jquery-latest.js"></script>
<body onload="$('#area1').val('')">
<input type="text" value="PLTI6yRvQqlYq9KoU-NHu43uDmKON7Fsjv"
id="searchtext1" size="75">
<button onclick="getVids()">Get Items</button>
<br><br>
IDs for test: <br>PLTI6yRvQqlYq9KoU-NHu43uDmKON7Fsjv<br>
PL32C69B40337EF920
<br><br>
<textarea id="area1" style="width:600px;height:500px">
</textarea>The easiest way to get all the videos,
DEVELOPER_KEY = "REPLACE_ME" YOUTUBE_API_SERVICE_NAME = "youtube" YOUTUBE_API_VERSION = "v3"
youtube = build("youtube", "v3", developerKey=api_key)
def get_videos_from_playlist(youtube, items, playlistID):
response = items.list(part="snippet", playlistId=playlistID)
while response:
playlistitems_list_response = response.execute()
for playlist_item in playlistitems_list_response["items"]:
# title = playlist_item["snippet"]["title"]
video_id = playlist_item["snippet"]["resourceId"]["videoId"]
yield video_id
response = youtube.playlistItems().list_next(
response, playlistitems_list_response)
Pass the playlist id,
items = youtube.playlistItems()
playlist = get_videos_from_playlist(youtube, items, 'PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z')
and then parse through the list:
for videoID in playlist:
print(videoID)
additionally, you can use pages to scrape through multiple pages use something like:
nextPageToken = res.get('nextPageToken')
while ('nextPageToken' in res):
nextPage = youtube.playlistItems().list(
part="snippet",
playlistId=playlistId,
maxResults="50",
pageToken=nextPageToken
).execute()
res['items'] = res['items'] + nextPage['items']
if 'nextPageToken' not in nextPage:
res.pop('nextPageToken', None)
else:
nextPageToken = nextPage['nextPageToken']