爬虫爬取到标签内容有时为空有时正常，请问怎么解决？-灵析社区

个人觉得可以直接试试爬接口 import requests url = "https://liuyan.people.com.cn/v1/threads/list/df" payload = "{\r\n \"appCode\": \"PC42ce3bfa4980a9\",\r\n \"token\": \"\",\r\n \"signature\": \"74de794b99edb6acabc1ce088697504c\",\r\n \"param\": \"{\\\"fid\\\":\\\"539\\\",\\\"showUnAnswer\\\":1,\\\"typeId\\\":5,\\\"lastItem\\\":\\\"\\\",\\\"position\\\":0,\\\"rows\\\":10,\\\"orderType\\\":2}\"\r\n}" headers = { 'Accept': 'application/json, text/plain, */*', 'Accept-Language': 'zh-CN', 'Cache-Control': 'no-cache', 'Connection': 'keep-alive', 'Content-Type': 'application/json;charset=UTF-8', 'Cookie': 'wdcid=2cc467a9d1b73009; __jsluid_h=c785543073cdfb172a4615be09872320; sfr=1; __jsluid_s=52de5ba57ef501661168f96960f8d1c2; Hm_lvt_40ee6cb2aa47857d8ece9594220140f1=1698999857; language=zh-CN; deviceId=425032c4-6e87-46a8-8547-a85b050ea3c0; Hm_lpvt_40ee6cb2aa47857d8ece9594220140f1=1699000123; __jsluid_s=99d5863c7d4e9985a0ef216b715b00c1', 'Origin': 'https://liuyan.people.com.cn', 'Pragma': 'no-cache', 'Referer': 'https://liuyan.people.com.cn/threads/list?fid=539', 'Sec-Fetch-Dest': 'empty', 'Sec-Fetch-Mode': 'cors', 'Sec-Fetch-Site': 'same-origin', 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.0.0 Safari/537.36', 'sec-ch-ua': '"Chromium";v="118", "Google Chrome";v="118", "Not=A?Brand";v="99"', 'sec-ch-ua-mobile': '?0', 'sec-ch-ua-platform': '"Windows"', 'sec-gpc': '1', 'token': '' } response = requests.request("POST", url, headers=headers, data=payload) print(response.text)