爬虫二之Requests
2024-09-22 01:28:52
requests
实例引入
import requests
response = requests.get('https://www.baidu.com')
response.status_code
response.text
response.cookies
请求方式
post()
put()
delete()
head()
options()
请求
基本get请求
带参数get请求
data = {'name':'germey', 'age':'22}
response = request.get('http://httpbin.org/get', params=data)
print(respones.text)
解析json
response.json()
获取二进制数据
response.content
response=request.get('https://github.com/favicon.ico')
f = open('favicon.ico', 'wb')
f.write(response.content)
f.close()
添加headers
headers={
'User-Agent':'Mozilla/5.0 (Macintosh; intel Mac OS X 10_11_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36'
}
response = request.get('https://www.zhihu.com/explore'. headers=headers_
POST请求
data = {}
headers = {}
response = request.post('http://httpbin.org/post', data=data, headers=headers)
response属性
status_code
headers
cookies
url
history
高级操作
文件上传
files = {'file':open('favicon.ico','rb')}
response = request.get('http://httpbin.org/post', files=files)
获取cookie
for key,value in response.cookies.items():
print(key + '=' + value)
会话维持
requests.get('http://httpbin.org/cookies/set/number/123456789)
response = requests.get('http://httpbin.org/cookies')
上述方法无法得到想要的cookie
s = requests.Session()
s.get(...)
response = s.get(...)
证书验证
暂时不看。如果发生情况则添加参数 verify=False
代理设置
proxies={}
response = requests.get(' ', proxies=proxies)
超时设置
from requests.exceptions import ReadTimeout
try:
#some codes
except ReadTimeout:
print('Timeout')
认证设置
request.get(...,auth={'user','123'})
异常处理
最新文章
- mysql之旅【第二篇】
- main函数的简介
- oracle查询表的索引
- 按钮/文本框 disabled
- PC游戏编程(入门篇)（前言写的很不错）
- Shell 学习笔记之变量
- MyBatis Generator配置示例
- CSS Modules In Webpack
- js --"说声爱你不容易"
- ReactNative 学习笔记
- （分治法 快速幂）51nod1046 A^B Mod C
- ERROR 1215 (HY000): Cannot add foreign key constraint
- _npc
- 一、集合框架（HashMap和Hashtable的区别）
- golang 文件服务器
- 传说中的纯CSS圆角代码
- am335x内核初始化路径
- C++ 引用本质的详解
- octomap相关
- loadFileSystems error & ExceptionUtils错误原因分析