絮叨一下

話說，最近從湖北開始汽車價格戰，全國人民都跑到湖北買車去了，搞得人家都出政策限制外地人購買了。

不過12W的C6是真香吶，二十多萬的C6一身毛病，12W的C6毛病在我！

這波價格戰直接蔓延到全國，全國的二手車商已原地哭暈。

今天我們就用Python來獲取一下全國二手車數據，看看二手車有沒有降價的。

環境、模塊

python 3.8
pycharm 2022.3專業版
requests >>> pip install requests
parsel >>> pip install parsel

實現步驟

1. 發送請求
2. 獲取數據
3. 解析數據
4. 保存數據

代碼展示

1. 發送請求

for page in range(1, 101):
    url = f'https://www.***.com/china/a0_0msdgscncgpi1ltocsp{page}exx0/'
    response = requests.get(url=url, headers=headers, proxies=get_proxies())

2. 獲取數據

html_data = response.text

3. 解析數據

    select = parsel.Selector(html_data)
    detail_url_list = select.xpath("//ul[@class='viewlist_ul']/li/a[@class='carinfo']/@href").getall()
    # Python學習交流群:872937351
    for detail_url in detail_url_list[:-1]:
        if detail_url[1] == '/':
            detail_url = 'https:' + detail_url
        else:
            detail_url = 'https://www.**.com' + detail_url
        detail_html = requests.get(detail_url, headers=headers, proxies=get_proxies()).text
        detail_select = parsel.Selector(detail_html)
        title = detail_select.xpath("string(//h3[@class='car-brand-name'])").get("").strip()
        licheng = detail_select.xpath("//ul[@class='brand-unit-item fn-clear']/li[1]/h4/text()").get("").strip()
        shangpai = detail_select.xpath("//ul[@class='brand-unit-item fn-clear']/li[2]/h4/text()").get("").strip()
        pailiang = detail_select.xpath("//ul[@class='brand-unit-item fn-clear']/li[3]/h4/text()").get("").strip()
        suozaidi = detail_select.xpath("//ul[@class='brand-unit-item fn-clear']/li[4]/h4/text()").get("").strip()
        guobiao = detail_select.xpath("//ul[@class='brand-unit-item fn-clear']/li[5]/h4/text()").get("").strip()
        price = detail_select.xpath("string(//span[@id='overlayPrice'])").get("").strip()
        print(title, licheng, shangpai, pailiang, suozaidi, guobiao, price, detail_url)

4. 保存數據

with open('汽車之家.csv', mode='a', encoding='utf-8', newline='') as f:
    csv_writer = csv.writer(f)
    csv_writer.writerow([card_name, cards_unit, price, img_url])

尾語

好了兄弟們，今天的分享就到這裡結束了，咱們下次再見！

大家趕緊去試試，看看二手車價格吧，說不定還能遇上心動的下個單！