extern/se-scraper
1
0
Fork 1
mirror of https://github.com/NikolaiT/se-scraper.git synced 2024-11-22 07:33:07 +01:00
Code Issues Packages Projects Releases Wiki Activity

need to edit readme

Browse Source
This commit is contained in:
Nikolai Tschacher 2019-06-11 18:34:51 +02:00
parent 35943e7449
commit d4d06f7d67
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@ -74,6 +74,8 @@ export PUPPETEER_SKIP_CHROMIUM_DOWNLOAD=1
Create a file named `minimal.js` with the following contents
```js
const se_scraper = require('se-scraper');
(async () => {
let scrape_job = {
search_engine: 'google',
@ -94,6 +96,8 @@ Start scraping by firing up the command `node minimal.js`
Create a file named `run.js` with the following contents
```js
const se_scraper = require('se-scraper');
(async () => {
let browser_config = {
debug_level: 1,
@ -125,6 +129,8 @@ Start scraping by firing up the command `node run.js`
**se-scraper** will create one browser instance per proxy. So the maximal amount of concurrency is equivalent to the number of proxies plus one (your own IP).
```js
const se_scraper = require('se-scraper');
(async () => {
let browser_config = {
debug_level: 1,