WhatsApp-Analyzer
Analyze WhatsApp chat
The script reads an exported WhatsApp chat and then extracts the data. You may need to install some packages before running it.
Supported Analysis
- Chat Count
- Chat Average
- Member/Sender Rank
- Website/URL/Link Domain Rank
- Word Count and Rank
- Most Used Word by Sender
- Emoji Usage Rank
- Most Used Emoji by Sender
- Timestamp Heatmap
- Attachment Classification (In Android, there is no difference pattern for attachment. But in iOS we can actually classify between Image, Video, Audio, GIF, Sticker, Document and Contact Card)
Preview
- Sender Rank
- Domain rank
- Word Rank
- Most used word by sender
- Emoji rank
- Most used emoji by sender
- Chat activity heatmap
Requirements
- Python 3.6+
pip install -r requirements.txt
Usage
$ git clone https://github.com/PetengDedet/WhatsApp-Analyzer.git
$ cd WhatsApp-Analyzer
$ python whatsapp_analyzer.py chat_example.txt --stopword indonesian
usage: python whatsapp_analyzer.py FILE [-h] [-d] [-s] [-c]
Read and analyze whatsapp chat
positional arguments:
FILE Chat file path
optional arguments:
-h, --help show this help message and exit
-d, --debug Debug mode. Shows details for every parsed line.
-s , --stopword Stop Words: A stop word is a commonly used word (such
as 'the', 'a', 'an', 'in'). In order to get insightful
most common word mentioned in the chat, we need to
skip these type of word. The Allowed values are:
arabic, bulgarian, catalan, czech, danish, dutch,
english, finnish, french, german, hebrew, hindi,
hungarian, indonesian, italian, malaysian, norwegian,
polish, portuguese, romanian, russian, slovak,
spanish, swedish, turkish, ukrainian, vietnamese
-c , --customstopword
Custom Stop Words. File path to stop word. File must a
raw text. One word for every line
Stop Words
I've included stop words for several languages from https://github.com/Alir3z4/stop-words.
You can use your own stop word file.
Just use -c
argument followed by filepath.
One word for each file like below
able
ableabout
about
above
abroad
abst
Notes
- This script uses regex to extract the data.
- Currently supports the chat pattern below:
"14/10/18, 11:16 - Contact Name: this is a message"
"2/30/18, 2:07 AM - Contact Name: Test๐"
"[30/12/18 4.59.25 PM] Nama User: ๐test"
"[06/07/17 13.23.30] โช+62ย 123-456-78910โฌ: image omitted"
- Some date formats may not be supported
Flowchart
Describe how the script identify and classify the chat
+------------------+
+----+ Empty line? +----+
| +------------------+ |
| |
| |
+---v---+ +----v---+
| Yes | +-----------------+ No |
+-------+ | +---+----+
| |
+---------+-+ +-----v-----+
| Event Log | +----+ Chat +----+
+-----------+ | +-----------+ |
| |
+------v-----+ +-----v------+ +--------------------+
+-----+Regular Chat+----+ | Attachment +-->+ Clasify Attachment |
| +------------+ | +------------+ +-------+------------+
v v |
+---------+---------+ +---------+----------+ |
| Starting Line | | Following Line | |
+------+------------+ +-+------------------+ |
| | |
| | |
| +------v-------+ |
| | COUNTER | |
| | 1 Chat | |
+---------->+ 2 Timestamp +<----------------------------+
| 3 Sender |
| 4 Domain |
| 5 Words |
| 6 Attachment |
| 7 Emoji |
+-----+--------+
|
|
|
v
+----------+----------------+
| Visualize |
+---------------------------+
Getting chat source
Android:
- Open a chat/group chat
- Tap on three dots on the top right
- Tap "More"
- Choose "Export chat"
- Choose "Without Media"
iOS
- Open a chat/group chat
- Tap on contact name/group name on the top to see the details
- Scroll down to find "Export Chat" menu
- Choose "Without Media"
Other Tech Port
- Web: Coming soon
- Jupyter Notebook: Coming soon
- NodeJS: Coming soon
Help Needed
- Need contributor to rearrange directory structure to match python best practice.
- iOS exported example needed