搜索await page.waitForSelector(allResultsSelector);
2024-09-07 02:40:20
/**
* Copyright 2017 Google Inc. All rights reserved.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/ /**
* @fileoverview Search developers.google.com/web for articles tagged
* "Headless Chrome" and scrape results from the results page.
*/ 'use strict'; const puppeteer = require('puppeteer'); (async() => {
const browser = await puppeteer.launch();
const page = await browser.newPage(); await page.goto('https://developers.google.com/web/');
// Type into search box.---输入文字 还有提换方法
//await page.focus('#kw');
//await page.keyboard.sendCharacter('狗');
await page.type('#searchbox input', 'Headless Chrome'); // Wait for suggest overlay to appear and click "show all results".
const allResultsSelector = '.devsite-suggest-all-results';
//等待元素加载
await page.waitForSelector(allResultsSelector);
await page.click(allResultsSelector); // Wait for the results page to load and display the results.
const resultsSelector = '.gsc-results .gsc-thumbnail-inside a.gs-title';
await page.waitForSelector(resultsSelector); // Extract the results from the page.
const links = await page.evaluate(resultsSelector => {
const anchors = Array.from(document.querySelectorAll(resultsSelector));
return anchors.map(anchor => {
const title = anchor.textContent.split('|')[0].trim();
return `${title} - ${anchor.href}`;
});
}, resultsSelector);
console.log(links.join('\n')); await browser.close();
})();
最新文章
- C++02.访问控制
- java中文乱码解决之道(五)-----java是如何编码解码的
- JVM内存模型
- ubifs总体设计分析
- Winform中调用js函数
- 2014-10 u-boot 顶层config.mk分析
- PowerDesigner 物理数据模型(PDM)
- Apache ActiveMQ消息中间件的基本使用
- web-请求无缓存
- struts2基本介绍
- delphi edit编辑框使用
- linux连接mysql 出现Access denied for user 'root'@'localhost'(using password: YES)错误解决方案
- href的理解
- BZOJ_1266_[AHOI2006]上学路线route_最小割
- PdfReader按页将PDF切割成多个PDF
- sqlserver 2012 分页
- zombodb 数据类型映射
- hdu 1728 迷宫 给定最大转弯次数 (BFS)
- mysql字段添加修改删除
- Java_4 引用类型变量 Scanner与Random的使用