掌握Cookie的处理方法
课程位置:06.爬虫模拟浏览器客户端.pdf - 6.2 Cookie
Cookie格式:name=value; name2=value2; ...
请先获取Cookie,然后携带Cookie访问本页面
步骤1:获取Cookie
import requests # 访问设置Cookie的接口 url = 'https://req.haleibc.com/practice6/set_cookie' response = requests.get(url) print(response.json())
步骤2:方式1 - 通过headers携带Cookie
import requests
url = 'https://req.haleibc.com/practice6'
headers = {
'User-Agent': 'Mozilla/5.0',
'Cookie': 'auth_token=practice_token_2024; user_id=10086'
}
response = requests.get(url, headers=headers)
print(response.text)
步骤2:方式2 - 通过cookies参数携带
import requests
url = 'https://req.haleibc.com/practice6'
cookies = {
'auth_token': 'practice_token_2024',
'user_id': '10086'
}
response = requests.get(url, cookies=cookies)
print(response.text)
Cookie字符串转字典
cookie_str = "auth_token=practice_token_2024; user_id=10086"
cookie_dict = {item.split("=")[0]: item.split("=")[1] for item in cookie_str.split("; ")}
print(cookie_dict)
1. 访问/practice6/set_cookie获取Cookie
2. 使用headers方式携带Cookie访问本页面
3. 使用cookies参数方式携带Cookie访问本页面
4. 练习Cookie字符串与字典的转换