html - Printing accents and foreign characters using beautiful soup and python -


i scraping artists discogs.com. unable artist names appear on page. e.g. artist andrés appears andr\xe9s when run code.

can explain i'm doing wrong?

    bs4 import beautifulsoup     import requests     import urllib2     itertools import chain     import codecs      headers = { 'user-agent': 'mozilla/5.0 (windows nt 6.0; wow64; rv:24.0) gecko/20100101 firefox/24.0' }      all_artists = []      result_pages = 1 #446      def load_artists():         page in xrange(1, result_pages+1):             url = url = 'https://www.discogs.com/search/?sort=have%2cdesc&style_exact=house&genre_exact=electronic&decade=2010&page=' + str(page)             r = requests.get(url, headers = headers)             soup = beautifulsoup(r.content.decode('utf-8'), 'html.parser')             [all_artists.append(tag["title"]) tag in soup.select('div#search_results h5 span')]      load_artists()      all_artists

you need use python3, , no longer suffer this


-

Comments

Post a Comment

Popular posts from this blog

java - SSE Emitter : Manage timeouts and complete() -

i writing web app multiple listeners(evcentsource sse clients js) connected server . want store sse emitter per connected listener : can done in memory or other means assigning id each client able achieve far now question ; how send response/event specific client connected web app ? while doing sseemmiters stored either getting completed or timed out. how prevent ? how keep sseemmiter available open infinite time (till client closes) , send events selectively .
Read more

jquery - uncaught exception: DataTables Editor - remote hosting of code not allowed -

i'm trying implement crud operation using datatableseditor using datatables.but i'm getting error messages: 1)uncaught exception: datatables editor - remote hosting of code not allowed. please see http://editor.datatables.net details on how purchase editor license 2)typeerror: a.editor undefined 3) $.fn.datatable.editor not constructor" what reason? here configuration: <%@ page language="java" contenttype="text/html; charset=iso-8859-1" pageencoding="iso-8859-1"%> <!doctype html public "-//w3c//dtd html 4.01 transitional//en" "http://www.w3.org/tr/html4/loose.dtd"> <html> <head> <meta http-equiv="content-type" content="text/html; charset=iso-8859-1"> <title>insert title here</title> <link rel="stylesheet" type="text/css" href="//cdn.datatables.net/1.10.12/css/jquery.datatables.min.css"> <link re...
Read more

java - How to resolve error - package com.squareup.okhttp3 doesn't exist? -

i trying convert json java object use of gson in maven, following youtube video guidance - https://www.youtube.com/watch?v=vqgghm9pwe0 , theres error occurs when in main class error - package com.squareup.okhttp3 doesn't exist. code below: java package com.codebeasty.json; import com.squareup.okhttp3.okhttpclient; public class main { private static okhttpclient client = new okhttpclient(); public static void main (string [] args) { } } i put in dependency in pom.xml: <dependencies> <dependency> <groupid>com.squareup.okhttp3</groupid> <artifactid>okhttp</artifactid> <version>3.4.2</version> </dependency> <dependency> <groupid>com.google.code.gson</groupid> <artifactid>gson</artifactid> <version>2.8.0</version> </dependency> </dependencies> i dont understand why doesn't recognize com.squareup. there may need download? have downl...
Read more