Redis高级实践之————Redis短连接性能优化
摘要: 对于Redis服务,通常我们推荐用户使用长连接来访问Redis,但是由于某些用户在连接池失效的时候还是会建立大量的短连接或者用户由于客户端限制还是只能使用短连接来访问Redis,而原生的Redis在频繁建立短连接的时候有一定性能损耗,本文从源码角度对Redis短连接的性能进行了优化。
1. 问题
通过历史监控我们可以发现用户在频繁使用短连接的时候Redis的cpu使用率有显著的上升
2. 排查
通过扁鹊查看但是Redis的cpu运行情况如下
从扁鹊我们可以看到Redis在freeClient的时候会频繁调用listSearchKey,并且该函数占用了百分30左右的调用量,如果我们可以优化降低该调用,短连接性能将得到具体提升。
3. 优化
通过以上分析我们可以知道Redis在释放链接的时候频繁调用了listSearchKey,通过查看Redis关闭客户端源码如下:
void freeClient(redisClient *c) {
listNode *ln; /* If this is marked as current client unset it */
if (server.current_client == c) server.current_client = NULL; /* If it is our master that's beging disconnected we should make sure
* to cache the state to try a partial resynchronization later.
*
* Note that before doing this we make sure that the client is not in
* some unexpected state, by checking its flags. */
if (server.master && c->flags & REDIS_MASTER) {
redisLog(REDIS_WARNING,"Connection with master lost.");
if (!(c->flags & (REDIS_CLOSE_AFTER_REPLY|
REDIS_CLOSE_ASAP|
REDIS_BLOCKED| REDIS_UNBLOCKED)))
{
replicationCacheMaster(c);
return;
}
} /* Log link disconnection with slave */
if ((c->flags & REDIS_SLAVE) && !(c->flags & REDIS_MONITOR)) {
redisLog(REDIS_WARNING,"Connection with slave %s lost.",
replicationGetSlaveName(c));
} /* Free the query buffer */
sdsfree(c->querybuf);
c->querybuf = NULL; /* Deallocate structures used to block on blocking ops. */
if (c->flags & REDIS_BLOCKED)
unblockClientWaitingData(c);
dictRelease(c->bpop.keys); freeClientArgv(c); /* Remove from the list of clients */
if (c->fd != -) {
ln = listSearchKey(server.clients,c);
redisAssert(ln != NULL);
listDelNode(server.clients,ln);
} /* When client was just unblocked because of a blocking operation,
* remove it from the list of unblocked clients. */
if (c->flags & REDIS_UNBLOCKED) {
ln = listSearchKey(server.unblocked_clients,c);
redisAssert(ln != NULL);
listDelNode(server.unblocked_clients,ln);
}
...
...
...
/* Release other dynamically allocated client structure fields,
* and finally release the client structure itself. */
if (c->name) decrRefCount(c->name);
zfree(c->argv);
freeClientMultiState(c);
sdsfree(c->peerid);
if (c->pause_event > ) aeDeleteTimeEvent(server.el, c->pause_event);
zfree(c);
}
从源码我们可以看到Redis在释放链接的时候遍历server.clients查找到对应的redisClient对象然后调用listDelNode把该redisClient对象从server.clients删除,代码如下:
/* Remove from the list of clients */
if (c->fd != -) {
ln = listSearchKey(server.clients,c);
redisAssert(ln != NULL);
listDelNode(server.clients,ln);
}
查看server.clients为List结构,而redis定义的List为双端链表,我们可以在createClient的时候将redisClient的指针地址保留再freeClient的时候直接删除对应的listNode即可,无需再次遍历server.clients,代码优化如下:
3.1 createClient修改
redisClient *createClient(int fd) {
redisClient *c = zmalloc(sizeof(redisClient)); /* passing -1 as fd it is possible to create a non connected client.
* This is useful since all the Redis commands needs to be executed
* in the context of a client. When commands are executed in other
* contexts (for instance a Lua script) we need a non connected client. */
if (fd != -) {
anetNonBlock(NULL,fd);
anetEnableTcpNoDelay(NULL,fd);
if (server.tcpkeepalive)
anetKeepAlive(NULL,fd,server.tcpkeepalive);
if (aeCreateFileEvent(server.el,fd,AE_READABLE,
readQueryFromClient, c) == AE_ERR)
{
close(fd);
zfree(c);
return NULL;
}
}
...
if (fd != -) {
c->client_list_node = listAddNodeTailReturnNode(server.clients,c);
}
return c;
}
3.2 freeClient修改
freeClient修改如下:
/* Remove from the list of clients */
if (c->fd != -) {
if (c->client_list_node != NULL) listDelNode(server.clients,c->client_list_node);
}
3.3 优化结果
在同一台物理机上启动优化前后的Redis,分别进行压测,压测命令如下:
redis-benchmark -h host -p port -k -t get -n -c
其中-k 代表使用短连接进行测试
原生Redis-server结果:
99.74% <= milliseconds
99.78% <= milliseconds
99.84% <= milliseconds
99.90% <= milliseconds
99.92% <= milliseconds
99.94% <= milliseconds
99.99% <= milliseconds
100.00% <= milliseconds
10065.42 requests per second
优化后Redis-server结果
99.69% <= milliseconds
99.72% <= milliseconds
99.80% <= milliseconds
99.82% <= milliseconds
99.86% <= milliseconds
99.89% <= milliseconds
99.94% <= milliseconds
99.96% <= milliseconds
99.97% <= milliseconds
100.00% <= milliseconds
13823.61 requests per second
我们可以看到优化之后的Redis-server性能在短连接多的场景下提升了百分30%以上。
最新文章
- python学习笔记系列----(五)输入和输出
- 总结一下响应式设计的核心CSS技术Media(媒体查询器)的用法。(转)
- (二)我的Makefile学习冲动&;&;编译过程概述
- PL/0编译器(java version) - MainFrame.java
- Symfony电子商务
- JS 去除字符串中的空格
- ext3grep 恢复删除
- phpcms 源码分析六:index文件
- Geodatabase - 修改字段别名(Field Alias)
- wamp在win7下64位系统memcache/memcached安装教程
- C Runtime Library来历, API, MFC, ATL关系
- 读论文系列:Object Detection SPP-net
- python进行各类API的使用
- C语言实现邻接矩阵创建无向图&;图的深度优先遍历
- 深刻了解jQuery对象和普通DOM对象的区别
- Selenium基础知识(九)验证码
- Oracle 11g dataguard check RTA(real time apply)
- STM 软件事务内存——本质是为提高并发,通过事务来管理内存的读写访问以避免锁的使用
- linux命令总结之dig命令
- hbase中的缓存的计算与使用
热门文章
- 【jQuery UI 1.8 The User Interface Library for jQuery】.学习笔记.5.Accordion控件
- A Mysql backup script
- C#:隔离点击任务栏上的图标时的“最小化或者恢复”的效果
- Oracle触发器使用介绍
- 主线程中创建不同的handler实例,接收消息会不会冲突
- python 补充-decode和encode
- Tautology 分类: POJ 2015-06-28 18:40 10人阅读 评论(0) 收藏
- 浅谈算法和数据结构: 七 二叉查找树 八 平衡查找树之2-3树 九 平衡查找树之红黑树 十 平衡查找树之B树
- Python学习笔记-Day3-python关键字
- select resharper shortcuts scheme