配置nutch
2024-10-08 01:33:50
配置nutch
(nutch文件夹已在/home目录下)
1. 修改系统环境变量
sudo gedit /etc/profile
//增加
#set nutch
export PATH=/home/nutch/runtime/local/bin:$PATH
2. 测试(nutch/runtime/local/bin中./nutch & ./crawl)
nutch
//结果如下:
Usage: nutch COMMAND
where COMMAND is one of:
inject inject new urls into the database
hostinject creates or updates an existing host table from a text file
generate generate new batches to fetch from crawl db
fetch fetch URLs marked during generate
parse parse URLs marked during fetch
updatedb update web table after parsing
updatehostdb update host table after parsing
readdb read/dump records from page database
readhostdb display entries from the hostDB
elasticindex run the elasticsearch indexer
solrindex run the solr indexer on parsed batches
solrdedup remove duplicates from solr
parsechecker check the parser for a given url
indexchecker check the indexing filters for a given url
plugin load a plugin and run one of its classes main()
nutchserver run a (local) Nutch server on a user defined port
junit runs the given JUnit test
or
CLASSNAME run the class named CLASSNAME
Most commands print help when invoked w/o parameters.
crawl
//结果如下:
Missing seedDir : crawl <seedDir> <crawlID> <solrURL> <numberOfRounds>
最新文章
- JSP中编译指令include与动作指令include的区别
- ios coreData使用
- loadView, viewDidLoad 快速使用
- Mysql 的MYISAM引擎拷贝出现异常——Incorrect information in file &#39;xxx.frm&#39;
- 您需要来自administrators的权限才能对此文件进行更改
- Linux 根文件系统的制作
- 热键HotKeys
- HDU4525+公式
- XMLHttpRequest发送请求
- js中Date对象
- css精灵(css script 技术)
- Shell 文字 顶替tomcat星团war包裹
- Tomcat如何实现Comet
- java基础语法(一)
- Windows下建立FTP服务器站点
- Ext.net MessageBox提示
- 转载:使用Tornado+Redis维护ADSL拨号服务器代理池
- 学习笔记DL007:Moore-Penrose伪逆,迹运算,行列式,主成分分析PCA
- wpf 寻找TreeView的子元素,并对其进行操作
- 【下一代核心技术DevOps】:(三)私有代码库阿里云Git使用