Python爬取金山词霸每日一句,存储到MySQL中
2024-10-11 23:22:06
#!/usr/bin/env python
# -*- coding: utf-8 -*-
# @Time : 2018/7/3 20:25
# @Author : baoshan
# @Site :
# @File : iciba.py.py
# @Software: PyCharm Community Edition
# 爬取金山词霸每日一句放到数据库中存储 import json
import requests
import pymysql host = '10.10.1.10'
port = 3306
user = 'root'
passwd = 'root'
dbme = 'information_storage'
table = 'iciba_daily_sentence' conn = pymysql.connect(host=host, user=user, passwd=passwd, db=dbme, port=port, charset="utf8")
cur = conn.cursor() data = requests.get("http://open.iciba.com/dsapi/").text
jdata = json.loads(data)
dateline = jdata.get("dateline")
caption = jdata.get("caption")
content = jdata.get("content")
fenxiang_img = jdata.get("fenxiang_img")
note = jdata.get("note")
picture = jdata.get("picture")
picture2 = jdata.get("picture2")
translation = jdata.get("translation")
tts = jdata.get("tts") sql = 'insert into %s (dateline,caption,content,fenxiang_img,note,picture,picture2,translation,tts) ' \
'values ("%s", "%s", "%s", "%s", "%s", "%s", "%s", "%s","%s")' \
% (table, dateline,caption,content,fenxiang_img,note,picture,picture2,translation,tts)
print(sql)
try:
cur.execute(sql)
except:
print("error") print(json.dumps(jdata, ensure_ascii=False))
conn.commit() conn.close()
数据库表结构如下
CREATE TABLE `iciba_daily_sentence` (
`id` int(11) unsigned NOT NULL AUTO_INCREMENT,
`dateline` char(10) DEFAULT NULL,
`caption` varchar(20) DEFAULT NULL,
`content` varchar(255) DEFAULT NULL,
`fenxiang_img` varchar(255) DEFAULT NULL,
`note` varchar(255) DEFAULT NULL,
`picture` varchar(255) DEFAULT NULL,
`picture2` varchar(255) DEFAULT NULL,
`translation` varchar(255) DEFAULT NULL,
`tts` varchar(255) DEFAULT NULL,
`gmt_create` timestamp NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
PRIMARY KEY (`id`),
UNIQUE KEY `uniq_dateline` (`dateline`)
) ENGINE=InnoDB AUTO_INCREMENT=16 DEFAULT CHARSET=utf8mb4;
谢谢!
最新文章
- Centos 安装 MySql
- js闭包理解
- LinearRegressionWithRegularization
- python 内建函数 type() 和 isinstance() 介绍
- HDU1856More is better(并查集)
- MCI音乐播放
- linux diff具体解释
- poj 2309
- Mybatis 构造resultMap 搜sql
- Struts2简介以及初步搭建配置
- mysql表加锁、全表加锁、查看加锁、解锁
- 博客里的第一篇随笔!QWQ
- note 3 变量与简单I/O
- Linux下apache2及模块mod_deflate等安装和配置
- hdu 5032 不易发觉的树状数组
- sql查询数据库中所有表名
- 洛谷P2024 食物链 [NOI2001] 并查集
- JQuery语法 JQuery对象与原生对象互转 文档就绪函数与window.onload的区别
- 【BZOJ2589】[SPOJ10707]Count on a tree II
- Android 分Dex (MultiDex)
热门文章
- Python打包方法——Pyinstaller (转)
- 002.Heartbeat部署及httpd高可用
- 使用 git clone 的时候出现 fatal: Unable to find remote helper for 'https' 解决办法
- kolla之docker私有仓库创建
- LOJ.6062.[2017山东一轮集训]Pair(Hall定理 线段树)
- FlarumChina SQL injection Vulnerability
- python 字符串的一些方法
- spring源码分析系列 (1) spring拓展接口BeanFactoryPostProcessor、BeanDefinitionRegistryPostProcessor
- nginx编译安装on mac
- 【BZOJ3036】绿豆蛙的归宿 概率DP