CVPR 2016 paper reading (2)
1. Sketch me that shoe, Qian Yu, Feng Liu, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales, Cheng Change Loy, in CVPR 2016.
A unique characteristic of sketches in the context of image retrieval is that they offer inherently fine-grained visual description - a sketch speaks for a 'hundred' words.
fine-grained sketch-based image retrieval (SBIR)面临三个挑战:
1) visual comparisons not only need to be fine-grained but also executed cross-domain; (sketch和photo是两个不同的domains)
2) free-hand (finger) sketches are highly abstract, making free-grained matching harder, and most importantly;
3) annotated cross-domain sketch-photo datasets required for training are scarce.
this paper introduces two instance-level SBIR datasets consisting of 1432 sketch-photo pairs in two categories (shoes and chairs), collected by asking participants to finger-sketch an object after observing a photo. Besides, a total of 32,000 ground-truth triplet ranking annotations are provided for both model development and performance evaluation.
this paper uses the annotated triplets as supervision to train triplet CNNs. The goal is to learn a feature mapping f that maps photos and sketches to a common feature embedding space, in which photos similar to pariticular sketches are closer than those dissimilar ones.
--> Triplet loss:
实验做得比较周密,考虑了4个步骤的pretrain和fine-tune阶段,并加入了data augmentation(包括stroke removal和stroke deformulation),每一种改进都获得了性能提升。
最新文章
- getter &; setter
- Mac上安装django
- Stopwatch 类
- Socket实现仿QQ聊天(可部署于广域网)附源码(2)-服务器搭建
- SpringMVC 部署项目静态资源文件访问问题
- ios开发函数(数学函数应用)
- 【opencv学习笔记】SetImageROI函数设置ROI区域的作用及用法
- 在win7系统下使用TortoiseGit(乌龟git)简单操作Git@OSC
- plsql developer导入导出数据库方法
- 我也来学着写写WINDOWS服务-解析xml抓取数据并插入数据库
- 当append里面的标签显示不出来的时候,用下面的方式做
- HDU 3046Pleasant sheep and big big wolf(切最小网络流)
- Python复习笔记(三)函数进阶
- 微信小程序toast框的使用
- roject ..\appcompat_v7 is missing. Needed by eclipse 转AS项目时遇到的问题
- python学习笔记5.1-核心类型-集合set类型[转]
- Ajax-ajax实例4-多级联动菜单
- 全面解析C#中参数传递
- S数据导入
- Atitit.文件搜索工具 attilax 总结