• Stars
    star
    98
  • Rank 344,865 (Top 7 %)
  • Language
    Jupyter Notebook
  • License
    MIT License
  • Created about 6 years ago
  • Updated about 3 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Spotify API to BigQuery serverless pipeline

🎧 Spotify Data Project

A serverless solution for getting the audio features data from the Spotify Web API into a BigQuery database.

💻 Installation

  1. Clone this repo
  2. Initialize gcloud gcloud init
  3. Deploy Cloud Function
gcloud functions deploy get_spotify_audio_features_data_to_bigquery --runtime python38 --trigger-topic spotify_topic --set-env-vars CID='YOUR_SPOTIFY_CID',SECRET='YOUR_SPOTIFY_SECRET',PROJECT_ID=YOUR_GCP_PROJECT_ID,DATASET_ID=YOUR_BIGQUERY_DATASET_NAME,TABLE_ID=YOUR_BIGQUERY_TABLE_NAME
  1. Create a Cloud Scheduler job to run automatically (optional)

🛠️ Built With

🖥️ APIs

🐍 Python libraries:

  • Spotipy - Python wrapper for Spotify Web API

☁️ Google Cloud Platform services

🌱 Notebooks, Datasets, Blogs