• Stars
    star
    125
  • Rank 285,305 (Top 6 %)
  • Language
    Python
  • Created over 4 years ago
  • Updated 6 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Django project to scrape a news website using Beautiful soup and display in our template.

Website Live Link

https://news-aggregator-ku26.onrender.com/

News Aggregator



Description

News aggregator is a Django project to scrape a news website using Beautiful soup and request module and hence combination of web crawlers and web applications. Both of these technologies have their implementation in Python.

Features

Our news aggregator works in 3 steps:
1.It scrapes the news website for the articles.In this Django project, we are scraping a website 'www.theonion.com'
(We have scraped news articles from 'latest' section of 'www.theonion.com' for demonstration)
2.Then it stores the articleโ€™s images, links, and title.
3.The stored objects in the database are served to the client. The client gets information in a nice template by clicking the 'Load news' button and select the different options available to you.The options are: Latest,Entertainment,Sports,Politics,Opinion,Breaking-News

    ----------------------------------------------------------------------------------------

Screenshots

Latest

Entertainment

Sports

Politics

Breaking News

Opinion News

Facebook share

Whatsapp share

Telegram share

Copy to clipboard

How To Use

Software Requirements

Python3

Installation

Install the dependencies by running:

    pip install bs4
    pip install requests
    pip install django-social-share

Run using Command Prompt

Navigate to the News-Aggregator folder which has manage.py file then run the following command on cmd

python manage.py runserver

Tech stack

Backend : Python3,Beautiful soup
Framework : Django
Database : Sqlite3
Frontend : Html,CSS,Bootstrap