Wednesday, 15 May 2013

web scraping - Parsing of multiple webpages using Python -



web scraping - Parsing of multiple webpages using Python -

i trying parse multiple web pages extract specific text , images. have far been able parse 1 page, looking way run script on of pages in next link: http://www.bbc.co.uk/food/recipes/search?cuisines[]=british (there's 108 of them).

i need images, along text next them.

i set way much effort in before realised needed loop.

here's url same page, time page number argument:

http://www.bbc.co.uk/food/recipes/search?page=1&cuisines[0]=british&sortby=lastmodified

change page number, , you'll able 108 of them.

for in range(1,109): url = "http://www.bbc.co.uk/food/recipes/search?page={pagenum}&cuisines[0]=british&sortby=lastmodified".format(pagenum = i) doyourthing(url)

python web-scraping

No comments:

Post a Comment