项目作者: MohammedAl-Rowad

项目描述 :
A simple web scrapper that visualizes the DOM.
高级语言: HTML
项目地址: git://github.com/MohammedAl-Rowad/Yedua.git
创建时间: 2019-10-26T23:06:12Z
项目社区:https://github.com/MohammedAl-Rowad/Yedua

开源协议:

下载


Yedua

A very simple web scrapper that visualizes the DOM.

https://rowadz.github.io/Yedua/

  • if you go to the code branch then these two files => Yedua-api/src/composers/DomScraper.ts & Yedua-api/src/routes/scrap.ts
    you will see the logic behind recursive scrapper (ps: press t then search for the file name).

  • The front-end just visualizes the DOM

  • if you choose ∞ levels the website might be really laggy for some websites

  • you can test on this one https://www.infinitysymbol.net/ or this https://motherfuckingwebsite.com.

Install

  1. $ git clone https://github.com/MohammedAl-Rowad/Yedua.git
  2. $ cd Yedua
  3. $ git checkout code
  4. # there is an api and client
  5. $ cd Yedua-api
  6. $ npm i
  7. $ npm run start-dev
  8. $ cd ..
  9. $ cd Yedua-client
  10. $ npm i
  11. $ ng s