• Stars
    star
    186
  • Rank 207,316 (Top 5 %)
  • Language
    Python
  • License
    MIT License
  • Created almost 6 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Analyze Whatsapp chat

WhatsApp-Analyzer

Analyze WhatsApp chat

The script reads an exported WhatsApp chat and then extracts the data. You may need to install some packages before running it.

Supported Analysis

  • Chat Count
  • Chat Average
  • Member/Sender Rank
  • Website/URL/Link Domain Rank
  • Word Count and Rank
  • Most Used Word by Sender
  • Emoji Usage Rank
  • Most Used Emoji by Sender
  • Timestamp Heatmap
  • Attachment Classification (In Android, there is no difference pattern for attachment. But in iOS we can actually classify between Image, Video, Audio, GIF, Sticker, Document and Contact Card)

Preview


  • Sender Rank Sender rank
  • Domain rank Domain rank
  • Word Rank Word rank
  • Most used word by sender Most used word by sender
  • Emoji rank Emoji rank
  • Most used emoji by sender Most used emoji by sender
  • Chat activity heatmap Heatmap

Requirements


  • Python 3.6+
pip install -r requirements.txt

Usage


$ git clone https://github.com/PetengDedet/WhatsApp-Analyzer.git

$ cd WhatsApp-Analyzer
$ python whatsapp_analyzer.py chat_example.txt --stopword indonesian 
usage: python whatsapp_analyzer.py FILE [-h] [-d] [-s] [-c]

Read and analyze whatsapp chat

positional arguments:
  FILE                  Chat file path

optional arguments:
  -h, --help            show this help message and exit
  -d, --debug           Debug mode. Shows details for every parsed line.
  -s , --stopword       Stop Words: A stop word is a commonly used word (such
                        as 'the', 'a', 'an', 'in'). In order to get insightful
                        most common word mentioned in the chat, we need to
                        skip these type of word. The Allowed values are:
                        arabic, bulgarian, catalan, czech, danish, dutch,
                        english, finnish, french, german, hebrew, hindi,
                        hungarian, indonesian, italian, malaysian, norwegian,
                        polish, portuguese, romanian, russian, slovak,
                        spanish, swedish, turkish, ukrainian, vietnamese
  -c , --customstopword 
                        Custom Stop Words. File path to stop word. File must a
                        raw text. One word for every line

Stop Words


I've included stop words for several languages from https://github.com/Alir3z4/stop-words. You can use your own stop word file. Just use -c argument followed by filepath. One word for each file like below

able
ableabout
about
above
abroad
abst

Notes


  • This script uses regex to extract the data.
  • Currently supports the chat pattern below:
   "14/10/18, 11:16 - Contact Name: this is a message"
   "2/30/18, 2:07 AM - Contact Name:  Test๐Ÿ‘Œ"
   "[30/12/18 4.59.25 PM] Nama User: ๐Ÿ™test"
   "[06/07/17 13.23.30] โ€ช+62ย 123-456-78910โ€ฌ: image omitted"
  • Some date formats may not be supported

Flowchart


Describe how the script identify and classify the chat

           +------------------+
      +----+    Empty line?   +----+
      |    +------------------+    |
      |                            |
      |                            |
  +---v---+                   +----v---+
  |  Yes  | +-----------------+   No   |
  +-------+ |                 +---+----+
            |                     |
  +---------+-+             +-----v-----+
  | Event Log |        +----+    Chat   +----+
  +-----------+        |    +-----------+    |
                       |                     |
                +------v-----+         +-----v------+   +--------------------+
          +-----+Regular Chat+----+    | Attachment +-->+ Clasify Attachment |
          |     +------------+    |    +------------+   +-------+------------+
          v                       v                             |
+---------+---------+   +---------+----------+                  |
|   Starting Line   |   |   Following Line   |                  |
+------+------------+   +-+------------------+                  |
       |                  |                                     |
       |                  |                                     |
       |           +------v-------+                             |
       |           | COUNTER      |                             |
       |           | 1 Chat       |                             |
       +---------->+ 2 Timestamp  +<----------------------------+
                   | 3 Sender     |
                   | 4 Domain     |
                   | 5 Words      |
                   | 6 Attachment |
                   | 7 Emoji      |
                   +-----+--------+
                         |
                         |
                         |
                         v
              +----------+----------------+
              |          Visualize        |
              +---------------------------+

Getting chat source

Android:

  • Open a chat/group chat
  • Tap on three dots on the top right
  • Tap "More"
  • Choose "Export chat"
  • Choose "Without Media"

iOS

  • Open a chat/group chat
  • Tap on contact name/group name on the top to see the details
  • Scroll down to find "Export Chat" menu
  • Choose "Without Media"

Other Tech Port


  • Web: Coming soon
  • Jupyter Notebook: Coming soon
  • NodeJS: Coming soon

Help Needed


  • Need contributor to rearrange directory structure to match python best practice.
  • iOS exported example needed

Buy me a coffee

Buy Me A Coffee