extern/se-scraper
1
0
Fork 1
mirror of https://github.com/NikolaiT/se-scraper.git synced 2025-06-20 17:47:49 +02:00
Code Issues Packages Projects Releases Wiki Activity

readme in static tests

Browse Source
This commit is contained in:
Nikolai Tschacher 2019-08-12 00:01:02 +02:00
parent 4ca50ab2b9
commit 87fcdd35d5
2 changed files with 10 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
package.json
View File

@ -1,6 +1,6 @@
{ {
"name": "se-scraper", "name": "se-scraper",
"version": "1.4.1", "version": "1.4.2",
"description": "A module using puppeteer to scrape several search engines such as Google, Duckduckgo, Bing or Baidu", "description": "A module using puppeteer to scrape several search engines such as Google, Duckduckgo, Bing or Baidu",
"homepage": "https://scrapeulous.com/", "homepage": "https://scrapeulous.com/",
"main": "index.js", "main": "index.js",

12
test/static_tests/README.md
View File

@ -1,9 +1,15 @@
## Test with static HTML ## Test with static HTML
dynamic testing of se-scraper takes too much fucking time. Dynamic testing of se-scraper takes too much time.
Save some html and initialize google scraper with the saved html. Save some html and initialize se-scraper by loading the search from disk.
### Disadvantage ### Disadvantage
static html gets outdated static html gets outdated after some time
### Advantages
1. Let's us test corner cases that are missed easily
2. Testing is not reliable, since search engines do not always return the same results for the same query
3. As said, much faster