簡單爬蟲腳本：178上data2比分扳

AnthonyHan 發(fā)布于2019-07-25 11:48 / 2386人閱讀

摘要：基輔特錦賽正在進行，上班時候又不能看比賽，打開游戲網(wǎng)站吧，也不太好，寫了個小腳本抓取上的比分扳，看下比賽結(jié)果，也是極好的吧。。。

Dota2基輔特錦賽正在進行，上班時候又不能看比賽，打開游戲網(wǎng)站吧，也不太好，寫了個小腳本抓取178上的比分扳，看下比賽結(jié)果，也是極好的吧。。。

比分扳的數(shù)據(jù)是js生成的，那就直接傳入?yún)?shù)，獲取內(nèi)容

仔細(xì)一看這參數(shù)還挺多，Headers中參數(shù)標(biāo)簽

再窗口中直接打開連接：

使用正則查找數(shù)據(jù)吧

from bs4 import BeautifulSoup
import re
import requests

data={
    "endpoint":"three",
    "ids":"100000282,100000930,100000924,100000918,100000843",
    "callback":"jQuery112408214716044557848_1493194419017",
    "_":"1493194419018"
      }

web_data = requests.get("http://wxapi.178.com/vpgame_proxy.php",params=data)
soup = BeautifulSoup(web_data.text,"lxml")
event_list = str(soup).split("}]}}")[:-1]


def get_events(strings):
    events_name = re.findall(r""tournamentName":"(.*?)"",strings)
    events_date = re.findall(r"(d{4}-d{2}-d{2})",strings)
    events_status = re.findall(r""status":"(w+)"",strings)
    l_teams = re.findall(r""leftTeam":"(.*?)"",strings)
    r_teams = re.findall(r""rightTeam":"(.*?)"",strings)
    l_scores = re.findall(r""leftTeamScore":"(d+)"",strings)
    r_scores = re.findall(r""rightTeamScore":"(d+)"",strings)
    print("|{0!s: ^37s}|{1!s: ^20s}|".format(events_name[0], events_date[0]))
    print("{:-^60}".format("-"))
    
    for events_statu,l_team,l_score,r_score,r_team in zip(events_status,l_teams,l_scores,r_scores,r_teams):
        print("|{0!s: ^8s}|{1!s: ^20}| {2!s: ^1s} - {3!s: ^1s} |{4!s: ^20s}|".format(events_statu,l_team,l_score,r_score, r_team))

for i in event_list:
    get_events(i)
    print("{:-^60}".format("-"))

執(zhí)行結(jié)果

寫的比較粗糙，也沒有進行排序，湊合用吧