Python Scraping

  1. Study the web page you want to scrap
    find the data elements(divs, text, span…etc)
    extract these with “id”, “classname”..etc
    study HTML tags.
  2. write python scripts to request the page data,
    requests, lxml, beautifulsoup4, scrapy..etc
  3. save your data