scrapy的学习笔记

A side note taken when learning Udemy - Scrapy Powerful Web Scraping & Crawling with Python

Installation

The Official Site is here.

You can just pip install scrapy

To Start With

Create Project

scrapy startproject example example.com can help you start with your first project.

As we can see, after we enter the command, the corresponding project folder is already automatically made in our current directory, with all the auxiliary .py files generated at your disposal.

Scrapy Shell

Open terminal and type scrapy shell to enter the interactive .