python - Moving scraped data using BeautifulSoup to csv -

-

it seems critical able move data you've scraped using beautifulsoup csv file. i'm close succeeding somehow each column in csv file 1 letter scraped info, , it's moving last item scrape.

here's code:

import urllib2 import csv bs4 import beautifulsoup url = "http://www.chicagoreader.com/chicago/bestof?category=4053660&year=2013" page = urllib2.urlopen(url) soup_package = beautifulsoup(page) page.close()  #find in div class="bestofitem). works. all_categories = soup_package.findall("div",class_="bestofitem") print(winner_category) #print out winner categories see if working  #grab text in tag: match_categories in all_categories:     winner_category = match_categories.a.string  #move csv file: f = file("file.csv", 'a') csv_writer = csv.writer(f) csv_writer.writerow(winner_category) print("check dropbox file")

the problem writerow() expects iterable. in case receives string , splits individual characters. put each value list.

besides, need in loop.

also, can pass urllib2.urlopen(url) directly beautifulsoup constructor.

also, should use with context manager while working files.

here's code modifications:

import urllib2 import csv bs4 import beautifulsoup   url = "http://www.chicagoreader.com/chicago/bestof?category=4053660&year=2013" soup_package = beautifulsoup(urllib2.urlopen(url)) all_categories = soup_package.find_all("div", class_="bestofitem")  open("file.csv", 'w') f:     csv_writer = csv.writer(f)     match_categories in all_categories:         value = match_categories.a.string         if value:             csv_writer.writerow([value.encode('utf-8')])

the contents of file.csv after running script is:

best view performance space best amateur hip-hop dancer who's professional wrestler best dance venue in new digs best outré dance best (and vocal) mime best performance in fat suit best theatrical use of unruly facial hair ...

besides, i'm not sure need csv module @ all.


Comments

Post a Comment

Popular posts from this blog

PHPMotion implementation - URL based videos (Hosted on separate location) -

-
i have implement video collection website users of specific isp. site hosted on public web-server movies hosted on local isp server. user of isp + general visitors can see available movies; isp's users able play them. player on site point url of local machine ( http://192.x.x.x/movies/mymovie.mov ) private class (192.x.x.x) accessible isp user. question: possible phpmotion script? or need custom work. if possible, can please suggest available mods? phpmotion require modifications able handle this. uploading, conversion, thumbnail generation, , playback pretty static in phpmotion. really though, rather modding entire upload , conversion process, if created quick custom form add entries phpmotion database (maybe include thumbnail upload), tweaked playback paths, should go on phpmotion side of things. assume had videos in format player handle (such flv or mp4).
Read more

javascript - Using Windows Media Player as video fallback for video tag -

-
getting video play cross platform using example video.js bit of fuss. in days when video should embedded use embed windows media player, work out of box on windows. since it's today old ie on windows doesn't support video tag experimented using windows media player fallback, , work well. what wonder here is, why haven't else solution? have missed something? code small, there's no flash files, cross domain issues or need of server working. works. so before develop further , add custom control , subtitles support wonder say. the code looks this: <video id="myvideo" style="width:640px; height: 360px;" autoplay data-wimpsource="http://esd.volvocars.com/dc/cdn/video/birds-on-a-wire.mp4"> <source src="http://esd.volvocars.com/dc/cdn/video/birds-on-a-wire.mp4" type="video/mp4" /> <source src="http://esd.volvocars.com/dc/cdn/video/birds-on-a-wire.webm" type="video/webm" />
Read more

c# - Unity IoC Lifetime per HttpRequest for UserStore -

-
i'm trying clean default implementation of accountcontroller.cs comes out of box in new mvc5/owin security implementation. have modified constructor this: private usermanager<applicationuser> usermanager; public accountcontroller(usermanager<applicationuser> usermanager) { this.usermanager = usermanager; } also, have created lifetime manager unity looks this: public class httpcontextlifetimemanager<t> : lifetimemanager, idisposable { private httpcontextbase _context = null; public httpcontextlifetimemanager() { _context = new httpcontextwrapper(httpcontext.current); } public httpcontextlifetimemanager(httpcontextbase context) { if (context == null) throw new argumentnullexception("context"); _context = context; } public void dispose() { this.removevalue(); } public override object get
Read more