html - Printing accents and foreign characters using beautiful soup and python -


i scraping artists discogs.com. unable artist names appear on page. e.g. artist andrés appears andr\xe9s when run code.

can explain i'm doing wrong?

    bs4 import beautifulsoup     import requests     import urllib2     itertools import chain     import codecs      headers = { 'user-agent': 'mozilla/5.0 (windows nt 6.0; wow64; rv:24.0) gecko/20100101 firefox/24.0' }      all_artists = []      result_pages = 1 #446      def load_artists():         page in xrange(1, result_pages+1):             url = url = 'https://www.discogs.com/search/?sort=have%2cdesc&style_exact=house&genre_exact=electronic&decade=2010&page=' + str(page)             r = requests.get(url, headers = headers)             soup = beautifulsoup(r.content.decode('utf-8'), 'html.parser')             [all_artists.append(tag["title"]) tag in soup.select('div#search_results h5 span')]      load_artists()      all_artists

you need use python3, , no longer suffer this


-

Comments

Post a Comment

Popular posts from this blog

jquery - uncaught exception: DataTables Editor - remote hosting of code not allowed -

i'm trying implement crud operation using datatableseditor using datatables.but i'm getting error messages: 1)uncaught exception: datatables editor - remote hosting of code not allowed. please see http://editor.datatables.net details on how purchase editor license 2)typeerror: a.editor undefined 3) $.fn.datatable.editor not constructor" what reason? here configuration: <%@ page language="java" contenttype="text/html; charset=iso-8859-1" pageencoding="iso-8859-1"%> <!doctype html public "-//w3c//dtd html 4.01 transitional//en" "http://www.w3.org/tr/html4/loose.dtd"> <html> <head> <meta http-equiv="content-type" content="text/html; charset=iso-8859-1"> <title>insert title here</title> <link rel="stylesheet" type="text/css" href="//cdn.datatables.net/1.10.12/css/jquery.datatables.min.css"> <link re...
Read more

python 2.7 - Lines in my code being skipped and I am not sure why -

i using python 2.7 , pretty new python. wanted ask why lines in code being skipped although don't see reason them be. my code seen below: def add_client: code adding client def check_clients: code listing out client info modes = {'add': add_client, 'check': check_clients} while true: while true: action = raw_input('input action: \n').lower() if action in modes or ['exit']: break print 'actions available:', in modes: print i.title() + ',', print 'exit' if action in modes: modes[mode](wb) if action == 'exit': break when run code , input action not in list of modes, not print out 'actions available: add, check, exit' , seems skip seen below. input action: k input action: if change code seen below works intended: modes = {'add': add_entries, 'check': check_stats} w...
Read more

python - multiprocessing pool with map -

i try multiprocess code this: param_seq = [] pool = pool(multiprocessing.cpu_count()-1) def work(param_set): (_, v) = experiment_sim(param_set[0], param_set[1]) v_dev = np.subtract(exp_v, v) return - np.sum(np.square(v_dev)) / (2 * noise_sigma ** 2) x in ra.values: y in gpas.values: param_seq.append((x, y)) likelihood = pool.map(work, param_seq) and looks working fine, work, in , stops , nothing , have stop program. following message occurs: process poolworker-8: process poolworker-10: process poolworker-13: process poolworker-14: process poolworker-11: process poolworker-12: traceback (most recent call last): traceback (most recent call last): traceback (most recent call last): traceback (most recent call last): traceback (most recent call last): traceback (most recent call last): file "/usr/local/cellar/python/2.7.11/frameworks/python.framework/versions/2.7/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap file ...
Read more