easonlai/pii-data-scrubber easonlai/pii-data-scrubber

  • Stars
    star
    1
  • Language
    Jupyter Notebook
  • Created over 3 years ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
easonlai/pii-data-scrubber
github

easonlai

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

This is demo repo to demonstrate how to leverage Azure Text Analytics to perform Personally identifiable information (PII) data scrubbing by Python (Jupyter Notebook). This is important part of data wrangling/data cleaning.

More Repositories

1

facebook_post_scraping_and_text_analytics

This is demo repo to demostrate how to scrape post data from Facebook by Python with library facebook_scraper. And then use Azure Text Analytics to perform sentiment analysis for post text content.
Jupyter Notebook
10
star
2

Power_Transformers_Failure_Prediction

This is a sample code repository of the power transformer's health state (index) analysis or prediction by the regression model for experiment and learning purposes.
Jupyter Notebook
8
star
3

playstore_reviews_scraping_and_text_analytics

This is demo repo to demostrate how to scrape apps review data from Google Play Store by Python with library Google-Play-Scraper. And then use Azure Text Analytics to perform sentiment analysis for reviews content (aka comments).
Jupyter Notebook
7
star
4

ms-speech-services-demo-web-tts

Microsoft Azure Speech Services (Text-to-Speech, TTS) Web Demo with Node.JS + Express.JS server
HTML
6
star
5

InsuranceClaimPredictionSample01

Insurance Claim Prediction Sample 01
Jupyter Notebook
5
star
6

online_retail_product_recommendation_samples

This is a code sample repository for online retail product recommendations using Collaborative Filtering (Memory-Based, aka History-Based). The source data used the famous Online Retail Data Set from UCI Machine Learning Repository.
Jupyter Notebook
5
star
7

Samples_for_Azure_Databricks_Orientation

Samples for Azure Databricks Orientation
HTML
4
star
8

Demo_for_Azure_Cognitive_Services

Demo repository for Azure Cognitive Services
HTML
3
star
9

robo_minion_gpt35turbo

This demo repository demonstrates how to create ChatGPT infused chatbot with Azure OpenAI Service (AOAI)'s GPT-3.5-Turbo model.
Python
3
star
10

Databricks_ODBC_Connection_to_Azure_SQL_DB_with_Azure_AD_User_Access_Token

Making ODBC connection from Databricks (Azure Databricks) to Azure SQL Database with Azure AD User Access Token.
HTML
3
star
11

pneumonia_classification_challenge_databricks

This is sample repos for how to use Keras Tuner to perform hyper-parameter tuning in Databricks.
Jupyter Notebook
3
star
12

analyze_customer_reviews_with_aoai

This demo repository demonstrates how to analyze customer reviews with Azure OpenAI Service (AOAI). I leveraged "ASOS Customer Review" from Kaggle to obtain valuable insight from the customer review content.
Jupyter Notebook
3
star
13

scraping_data_from_pdf

Code repository sample to demonstrate how to scrape table data from PDF file.
Jupyter Notebook
2
star
14

tensorflow_minions_spongebob_classification

Tensorflow Minions Spongebob Classification
Jupyter Notebook
2
star
15

ADB_AML_MLOps_Sample

Jupyter Notebook
2
star
16

yahoo_news_searching_and_text_analytics

This is a demo repo to demonstrate how to use Python Requests and Beautiful Soup 4 libraries to search and scrape result data. And save scraping results into Pandas dataframe.
Jupyter Notebook
2
star
17

google_news_content_scrape_and_analyze_with_gpt

This demo repository illustrates how to use Python to scrape news articles from Google based on a given keyword. The scraped articles are then processed by Azure OpenAI Service (AOAI)'s GPT-3 model, which generates concise summaries of the main points. The summaries are then formatted and sent via email using MailJet API.
Jupyter Notebook
2
star
18

databricks_delta_table_samples

This is a code sample repository for demonstrating how to perform Databricks Delta Table operations.
HTML
2
star
19

images_synthesizer

The sample code repository in Python synthesizes multiple resource images into the background image and adds header text into the image.
Python
1
star
20

fb-prophet-stock-prediction-v1

Using Facebook Prophet model to predict HK stock price
Jupyter Notebook
1
star
21

Tensorflow_COVID-19_Classification_by_Chest_X-Ray

Tensorflow COVID-19 Classification by Chest X-Ray
Jupyter Notebook
1
star
22

go_json_to_csv

This is a demo repo to demonstrate how to use Golang to parse JSON files into CSV file. I also used Golang to generate the volume of JSON files (10,000).
Go
1
star
23

tensorflow_hand_gesture_recognition

Hand Gesture Recognition with Tensorflow
Jupyter Notebook
1
star
24

jira-on-azure

Shell
1
star
25

azure-face-service-landmarks-git

Face Landmarks Analysis with Azure Face Service andย OpenCV
Jupyter Notebook
1
star
26

sb-web-sample-01-docker

Java Spring Boot Sample Web App with Containerization
Java
1
star
27

news-scraping-and-text-analytics

Jupyter Notebook
1
star
28

face_mask_detection

Power App sample for Face Mask Detection. This app is an infused AI model trained with a tool called "Lobe".
1
star
29

anomaly_detector_api_to_analyze_stock_perf

Azure Anomaly Detector API to Analyze Stock Performance Data
Jupyter Notebook
1
star
30

google_news_searching_and_text_analytics

This is a demo repo to demonstrate how to use Python GoogleNews library to search and scrape result data. And save scraping results into Pandas dataframe.
Jupyter Notebook
1
star
31

azure-databricks-cicd-notebook

Powershell Model for Azure Databricks CI/CD with Jupyter Notebooks
PowerShell
1
star
32

javawebappsample

Java
1
star
33

correctly_face_masked_recognition

This is a code sample repository for using Convolutional Neural Network (CNN) to build an image classification model to recognition people are correctly wearing the face mask or not.
Jupyter Notebook
1
star
34

diabetes_prediction_lr_xgb

This is a sample code repository to leverage classic "Pima Indians Diabetes" from UCI to perform diabetes classification by Logistic Regression & Gradient Boosting algorithms.
Jupyter Notebook
1
star