tirthajyoti/Web-Database-Analytics

Stars
269
Rank 152,662 (Top 4 %)
Language
Jupyter Notebook
License
MIT License
Created over 6 years ago
Updated over 4 years ago

tirthajyoti/Web-Database-Analytics

tirthajyoti

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Web scrapping and related analytics using Python tools

Web scraping, database and related analytics

Dr. Tirthajyoti Sarkar (You can connect with me on LinkedIn)

Requirements

Python 3.5+
NumPy ($ pip install numpy)
Pandas ($ pip install pandas)
requests ($ pip install requests)
BeautifulSoup4 ($ pip install beautifulsoup4)
MatplotLib ($ pip install matplotlib)

My new book on Data wrangling with Python

What type of Notebooks are here?

Web scraping and related analytics using Python tools
Fundamentals of Regular expressions (Regex)
Application of urllib
Application of BeautifulSoup for HTML parsing
Application of ElementTree for XML parsing
Application of Python json library for JSON parsing
Application of Python sqlite library (building a personal movie database)

How to design your own mini-IMDB movie database by scraping web?

Check out this article I wrote on Medium about this topic

How to scrape data from CIA website (this is harmless, I promise) about simple facts on various nations?

Check out this article I wrote on Medium about this topic

How to build a Yelp crawler which can generate interesting word cloud based on a particular city's food cuisine and taste?

How to crawl the Project Gutenberg portal and download 100 most popular books automatically?

How to use a free API to download basic information about countries around the world and build a database?

Machine-Learning-with-Python

Practice and tutorial-style notebooks covering wide variety of machine learning techniques

Jupyter Notebook

Data-science-best-resources

Carefully curated resource links for data science in one place

Papers-Literature-ML-DL-RL-AI

Highly cited and useful papers related to machine learning, deep learning, AI, game theory, reinforcement learning

Stats-Maths-with-Python

General statistics, mathematical programming, and numerical/scientific computing scripts and notebooks in Python

Jupyter Notebook

Deep-learning-with-Python

Deep learning codes and projects using Python

Jupyter Notebook

Spark-with-Python

Fundamentals of Spark with Python (using PySpark), code examples

Jupyter Notebook

pydbgen

Random dataframe and database table generator

UCI-ML-API

Simple API for UCI Machine Learning Dataset Repository (search, download, analyze)

Design-of-experiment-Python

Design-of-experiment (DOE) generator for science, engineering, and statistics

Jupyter Notebook

Optimization-Python

General optimization (LP, MIP, QP, continuous and discrete optimization etc.) using Python

Jupyter Notebook

DS-with-PySimpleGUI

Data science and Machine Learning GUI programs/ desktop apps with PySimpleGUI package

Jupyter Notebook

Interactive_Machine_Learning

IPython widgets, interactive plots, interactive machine learning

Jupyter Notebook

doepy

Design of Experiment Generator. Read the docs at: https://doepy.readthedocs.io/en/latest/

PyTorch_Machine_Learning

Machine learning, Deep Learning, CNN with PyTorch

Jupyter Notebook

Synthetic-data-gen

Various methods for generating synthetic data for data science and ML

Jupyter Notebook

Finance-with-Python

Financial data analytics with Python

Jupyter Notebook

Covid-19-analysis

Analysis with Covid-19 data

Jupyter Notebook

Julia-data-science

Data science and numerical computing with Julia

Jupyter Notebook

R-stats-machine-learning

Misc Statistics and Machine Learning codes in R

Algorithm-Data-Structures-Python

Various useful data structures in Python

Jupyter Notebook

TensorFlow_Basics

Basic TensorFlow mechanics, operations, class definitions, and neural networks building. Examples from deeplearning.ai Tensorflow course using Google Colab platform.

Jupyter Notebook

Scikit-image-processing

Image processing examples with Numpy, Scipy, and Scikit-image

Jupyter Notebook

Digital-Twin

Digital twin with Python

Jupyter Notebook

mlr

Multiple linear regression with statistical inference, residual analysis, direct CSV loading, and other features

Packt-Data_Wrangling

Code repo for Packt course I developed, "Beginning Data Wrangling with Python"

Jupyter Notebook

ML-apps-with-Streamlit

Building simple ML apps with Streamlit

PyScript-examples

Examples of web pages developed with PyScript framework

tirthajyoti.github.io

Tirthajyoti's Home Page about machine learning, statistics, analytics

Algorithm_Maths_Python

General math scripts and important algorithms' implementation in Python 3

Jupyter Notebook

Symbolic-computation-Python

Symbolic computation using SymPy and various applications

Jupyter Notebook

RL_basics

Basic Reinforcement Learning algorithms

Jupyter Notebook

GradDescent

MATLAB implementation of Gradient Descent algorithm for Multivariate Linear Regression

Convolutional-Networks

Various conv nets using TensorFlow, Keras, or other tools

Jupyter Notebook

Dask-analytics-ML

Data science and ML with Dask

Jupyter Notebook

Magnimind-Stats-Bootcamp-Jan-2020

Magnimind Bootcamp Stats for Data Science

Jupyter Notebook

PyWebIO

Web apps generated by pure Python script using PyWebIO

Scikit-image-book

Scikit-image-book-built-with-Jupyter-book

Jupyter Notebook

Stats_data_science_ValleyML

Notebooks for the ValleyML Bootcamp (Aug 2019) "Statistical methods for data science"

Jupyter Notebook

Randomized_Optimization

Randomized optimization techniques for NN and other problems

HyperparameterLearningTF

Learning the impact of Hyperparameters in a deep learning model

Jupyter Notebook

D3.js-examples

Simple D3.js code examples

MNIST_digit_recognition

MNIST hand-written digit recognition by fully-connected and convolutional neural networks - boiler plate code for easy reproduction and tutorial purpose.

Jupyter Notebook

tirthajyoti

DeepNetworksR

Multi-layer neural networks code examples in R

Random_Function_Generator

Random function generator, with generation by symbolic input

Jupyter Notebook

Stanford-SCI-52

Jupyter Notebook

Gradio-apps

Python web apps built with Gradio

mldsutils

My own ml and ds utils package

Jupyter Notebook

ghPage-test

test for gh pages

FunnyWordGen

Funny word (random) generator using Python 3

Saturn-cloud

Write-ups for Saturn-cloud