extern/se-scraper
1
0
Fork 1
mirror of https://github.com/NikolaiT/se-scraper.git synced 2025-08-06 12:49:16 +02:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 1593759556 passing chrome flags directly now possible Nikolai Tschacher 2019-04-01 15:33:26 +02:00
  • 775dcfa077 proxy mgmt better Nikolai Tschacher 2019-03-22 18:55:17 +01:00
  • b82c769bb1 google_news_old supports google_news_old_settings now Nikolai Tschacher 2019-03-20 15:28:04 +01:00
  • 1bed9c5854 fixed issue 12 Nikolai Tschacher 2019-03-20 11:50:43 +01:00
  • 7a8c6f13f0 fixed #11 by improving baidu a lot in speed and quality Nikolai Tschacher 2019-03-14 23:33:46 +01:00
  • 51d617442d added support for amazon Nikolai Tschacher 2019-03-10 20:02:42 +01:00
  • dd1f36076e can now parse args from string to json Nikolai Tschacher 2019-03-07 15:50:36 +01:00
  • 62b3b688b4 minor fixes Nikolai Tschacher 2019-03-07 13:16:12 +01:00
  • 7b52b4e62f added suport for custom query string parameters Nikolai Tschacher 2019-03-06 00:08:25 +01:00
  • 7239e23cba fixed pluggable Nikolai Tschacher 2019-03-03 16:46:10 +01:00
  • 8cbf37eaba minor improvements Nikolai Tschacher 2019-03-02 22:32:26 +01:00
  • abf4458e46 fixed quotes in user agent. this lead to cloudflare detecting the scraper. very bad. Nikolai Tschacher 2019-03-01 16:02:30 +01:00
  • 79d32a315a fixed some errors and way better README Nikolai Tschacher 2019-02-28 15:34:25 +01:00
  • 089e410ec6 support for multible browsers and proxies Nikolai Tschacher 2019-02-27 20:58:13 +01:00
  • 393b9c0450 Merge pull request #8 from NikolaiT/add-license-1 Nikolai Tschacher 2019-02-08 00:58:27 +01:00
  • fb3f2836e4 Create LICENSE add-license-1 Nikolai Tschacher 2019-02-08 00:58:15 +01:00
  • 53c9ebf467 Merge pull request #7 from NikolaiT/add-code-of-conduct-1 Nikolai Tschacher 2019-02-08 00:54:28 +01:00
  • 9521c54c77 Create CODE_OF_CONDUCT.md add-code-of-conduct-1 Nikolai Tschacher 2019-02-08 00:54:10 +01:00
  • 77c332d7c8 updated readme Nikolai Tschacher 2019-02-07 16:26:11 +01:00
  • 7b5048b8ee num_keywords are counted now. added to pluggable Nikolai Tschacher 2019-02-07 16:21:56 +01:00
  • 7572ebd314 added chrome detection evasion techniques Nikolai Tschacher 2019-02-07 16:09:38 +01:00
  • d5b147296e ticker search OOP now and added tests Nikolai Tschacher 2019-01-31 22:13:22 +01:00
  • d35a602994 added clean test cases for bing and duckduckgo Nikolai Tschacher 2019-01-31 15:36:27 +01:00
  • 7441c57a43 removed generic tests. too complicated Nikolai Tschacher 2019-01-31 14:58:07 +01:00
  • c60d0f3528 clean test case for google is passing Nikolai Tschacher 2019-01-31 14:57:34 +01:00
  • 987e3d7342 tested and works Nikolai Tschacher 2019-01-30 23:53:09 +01:00
  • 581568ff18 cleaned up google scrapers. All scrapers are classes now. from 600 LOC to 400 LOC. HIGH IQ MOVE Nikolai Tschacher 2019-01-30 20:24:03 +01:00
  • 4306848657 implemented generic scraping class Nikolai Tschacher 2019-01-30 16:05:08 +01:00
  • 9e62f23451 resolved some issues. proxy possible now. scraping for more than one page possible now Nikolai Tschacher 2019-01-29 22:48:08 +01:00
  • 89441070cd before_keyword_scraped() hook supported Nikolai Tschacher 2019-01-29 13:29:24 +01:00
  • c5e3e84e1d minor changes Nikolai Tschacher 2019-01-27 22:11:41 +01:00
  • a20b6c79a9 added handle_results Nikolai Tschacher 2019-01-27 20:08:09 +01:00
  • 86a66a09fd pluggable is now class Nikolai Tschacher 2019-01-27 19:08:07 +01:00
  • 8e695626b6 added pluggable functionality Nikolai Tschacher 2019-01-27 15:54:56 +01:00
  • e78d7145b5 faster scraping, added ticker search engines Nikolai Tschacher 2019-01-27 01:27:52 +01:00
  • b0e588f916 removed file Nikolai Tschacher 2019-01-26 20:15:40 +01:00
  • b354e6918d . Nikolai Tschacher 2019-01-26 20:15:19 +01:00
  • bab902e80a supporting yahoo ticker search for news Nikolai Tschacher 2019-01-24 15:50:03 +01:00
  • 9cfa502851 removed idea stuff Nikolai Tschacher 2018-12-24 14:30:36 +01:00
  • a96f14a4f8 second Nikolai Tschacher 2018-12-24 14:26:58 +01:00
  • 9af1630e19 initial Nikolai Tschacher 2018-12-24 14:25:02 +01:00