Hacker News Web Scraper

This Python script scraps the top 30 ranked news threads of the previous day and their comments from the infamous news forum Hacker News.

Installation

Clone the repo by running the following command:

git clone https://github.com/tsuAquila/Hacker-News-Webscrap.git

Install the necessary dependencies by running the following command:

pip install -r requirements.txt

Usage

Run the python script scrapper.py to scrape the news

Linux:

python3 scrapper.py

Windows:

python scrapper.py

Output

The scraped news and comments will be outputted as output.json