• Stars
    star
    269
  • Rank 152,662 (Top 4 %)
  • Language
    C++
  • License
    GNU Affero Genera...
  • Created over 11 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

C++ library to apply similarity measures and classifications on the results of audio analysis, including Python bindings. Together with Essentia it can be used to compute high-level descriptions of music.

Gaia 2

ABOUT

Gaia is a C++ library with python bindings which implements similarity measures and classifications on the results of audio analysis, and generates classification models that Essentia can use to compute high-level description of music.

Licence: Affero GPLv3 license

Documentation: http://essentia.upf.edu/documentation/gaia

Dependencies:

  • Qt >= 4.5
  • libYAML >= 0.1.1
  • Python >= 2.4
  • SWIG >= 1.3.31
  • Eigen >= 3.3.4

INSTALL

Linux

  • Install dependencies (Ubuntu/Debian)

    apt-get install build-essential libqt4-dev libyaml-dev swig python-dev pkg-config libeigen3-dev
    

    Note that Gaia build will fail if you are using swig 3.0.8. Install either a previous or later version. You will encounter this problem if you are using swig package distributed with Ubuntu 16.04. In this case install the newest swig version from source (https://github.com/swig/swig).

  • Online help for WAF (build system)

    ./waf --help
    
  • Configure with the desired options:

    ./waf configure --download [--with-python-bindings] [--with-stlfacade] [--with-asserts]
    

    NOTE: in order to link Essentia library with Gaia, do not use the --with-stlfacade option

  • Compile libgaia.a:

    ./waf
    
  • Install (to install system-wide you might need sudo)

    ./waf install [--destdir=/where/ever/]
    
  • Build documentation (optional), it will be located at build/doc/ folder

    python src/doc/regenerate_docstring.py
    

MacOS

Build from command-line using Homebrew (recommended):

  • Install Qt4:

    brew install cartr/qt4/qt
    
  • Install homebrew tap:

    brew tap MTG/essentia
    
  • Build Gaia (this will also install all the dependencies)

    brew install gaia --HEAD
    

Build from command-line:

  • Install python, qt libraries 4.8, libYAML and swig dependencies using Homebrew:

    brew install python
    
    brew install swig libyaml cartr/qt4/qt@4
    
  • Install pyyaml pip package in case you want to build with python bindings:

    pip install pyyaml
    
  • Configure and build similarly to Linux (see above).

Build with QtCreator (alternative):

Gaia2lib

  • Install qt libraries 4.8 (including debug libraries) and QtCreator from the Qt download archives.

  • Install libYAML and swig dependencies using Homebrew (we assume you already have a python installation, otherwise you can also install it using Homebrew):

    brew install swig libyaml
    
  • Use QtCreator to open the project file 'Gaia2lib.pro' in packaging/darwin/Gaia2lib/

  • Compile the project (you will probably need to configure QtCreator to work with your Qt installation and also to set up the build folder for the project)

Gaia2Python - python bindings

  • Use swig to generate the file 'gaia_wrap.cxx' that will be needed to compile 'Gaia2Python':

    swig -c++ -python -w451 /path_to_gaia_source/src/bindings/gaia.swig
    
  • Copy the generated 'gaia_wrap.cxx' to the Gaia2Python project folder:

    cp /path_to_gaia_source/src/bindings/gaia_wrap.cxx /path_to_gaia_source/packaging/darwin/Gaia2Python/
    
  • Use QtCreator to open the project file 'Gaia2Python.pro' in packaging/darwin/Gaia2Python/ and compile

  • Run ./make_release_tarball in packaging/darwin:

    ./make_release_tarball
    
  • Copy the folder packaging/darwin/tmp/gaia2/python/gaia2 (created when running make_release_tarball.sh) to the site-packages directory of your python distribution. You can now import gaia2 from python.

Windows

  • Use the QtCreator projects inside the packaging/win32 directory.

3RD PARTY

This library contains source code from the LibSVM project, which is distributed under the revised BSD license. Please refer to the src/3rdparty/libsvm/COPYRIGHT file for more information.

This library contains the Mersenne Twister random number generator, which is distributed under the BSD license.

This library contains source code from the Alglib project, which is distributed under the 3-clause BSD license.

This library contains source code from FrogLogic command line parser which is distributed under the BSD license.

More Repositories

1

essentia

C++ library for audio and music analysis, description and synthesis, including Python bindings
C++
2,775
star
2

sms-tools

Sound analysis/synthesis tools for music applications
Python
1,620
star
3

essentia.js

JavaScript library for music/audio analysis and processing powered by Essentia WebAssembly
TypeScript
632
star
4

DeepConvSep

Deep Convolutional Neural Networks for Musical Source Separation
Python
469
star
5

freesound

The Freesound website
Python
309
star
6

mtg-jamendo-dataset

Metadata, scripts and baselines for the MTG-Jamendo dataset
Python
259
star
7

WGANSing

Multi-voice singing voice synthesis
Python
235
star
8

freesound-datasets

A platform for the collaborative creation of open audio collections labeled by humans and based on Freesound content.
Python
135
star
9

freesound-python

python client for the freesound API
Python
130
star
10

dunya-desktop

A modular, customizable and open-source desktop application for accessing and visualizing music data.
Python
89
star
11

SymbTr

Turkish Makam Music Symbolic Data Collection
Python
82
star
12

MIRCourse

python notebooks used in the MIR course of the SMC Master of the MTG-UPF
Jupyter Notebook
61
star
13

conferences

Music Technology / MIR conference and journal calls
SCSS
60
star
14

da-tacos

A Dataset for Cover Song Identification and Understanding
Python
56
star
15

miredu

A C++ Vamp plugin implementing basic audio descriptors for educational purposes
C++
49
star
16

DCASE-models

Python library for rapid prototyping of environmental sound analysis systems
Jupyter Notebook
42
star
17

ArabicTransliterator

A code for transliterating (romanizing) Arabic text using the American Library Association - Library of Congress (ALA-LC) standard
Python
42
star
18

essentia-replicate-demos

Demos of Essentia models hosted on Replicate.com
Python
37
star
19

homebrew-essentia

Homebrew build scripts for Essentia
Ruby
34
star
20

music-explore

App to explore latent spaces of music collections
Python
32
star
21

pycompmusic

Tools to help researchers work with Dunya and CompMusic
Python
31
star
22

JAAH

Python
31
star
23

PodcastMix-inference

Python
31
star
24

dunya

The Dunya music browser
Python
29
star
25

acousticbrainz-client

A client to upload data to an acousticbrainz server
Python
29
star
26

essentia-docker

Docker images for Essentia
Roff
28
star
27

freesound-juce

A JUCE client for accessing the Freesound API
C++
28
star
28

acousticbrainz-labs

Cool hacks using acousticbrainz
Jupyter Notebook
25
star
29

acousticbrainz-genre-dataset

The AcousticBrainz Genre Dataset
TeX
24
star
30

essentia-tutorial

A tutorial for using Essentia in Python
Jupyter Notebook
23
star
31

singing-synthesis-demos

Sound examples for the Neural Parametric Singing Synthesizer (NPSS)
HTML
22
star
32

MIR-toolbox-docker

This project provides a docker image to run a jupyter notebook server with essentia, freesound-python and a set of python dependencies commonly used in Music Information Retrieval (MIR).
Dockerfile
22
star
33

github-traffic

Save information about traffic to a GitHub repository
Python
21
star
34

violin-transcription

High-Resolution Violin Transcription using Weak Labels
Jupyter Notebook
20
star
35

tape

TAPE: An End-to-End Timbre-Aware Pitch Estimator
Jupyter Notebook
18
star
36

jingjuPhonemeAnnotation

Hierarchical annotation - line (phrase), syllable, phoneme annotations of the jingju (Beijing opera) a-cappella singing dataset
Python
17
star
37

compIAM

Common tools for the computational analysis of Indian Art Music
Jupyter Notebook
16
star
38

otmm_makam_recognition_dataset

A dataset of Ottoman-Turkish makam music to test makam recognition (and tonic identification) methodologies
Jupyter Notebook
13
star
39

musav-dataset

MusAV: a dataset of relative arousal-valence annotations for validation of audio models
Python
13
star
40

Ismir2018TutorialNotebooks

Jupyter notebooks for Ismir-2018 tutorial titled "Computational approaches for analysis of non-Western music traditions" by Serra, Clayton and Bozkurt
Jupyter Notebook
13
star
41

turkish-makam-acapella-sections-dataset

Clean singing voice with no accompaniment. Semiprofessional singers. Semiprofessional quality. Songs from classical turkish makam in şarkı form. Recorded in studios in Istanbul in June 2014. Annotated on word and phoneme level.
12
star
42

acousticbrainz-gui

C++
12
star
43

similarity-annotator

An annotation tool for sound segmentation and similarity
Python
11
star
44

content_choral_separation

Python
11
star
45

otmm_tonic_dataset

The tonic test dataset for classical Ottoman-Turkish makam music
Jupyter Notebook
10
star
46

otmm_audio_score_alignment_dataset

The Audio Score Alignment Test dataset for Ottoman-Turkish makam music
MATLAB
10
star
47

carnatic-separation-ismir23

Carnatic singing voice separation trained with in-domain data with leakage
Python
10
star
48

SLVision

Developed in c++ with the OpenCV libraries, SLVision is a vision tracking software developed for SecondLight. It tracks 6DoF Markers, hands and fingers and sends the tracked data by using TUIO2 Messages trough a TCP socket to a client application.
C++
9
star
49

freesound-labs

Source code repository for the Freesound Labs. Freesound Labs lists projects and activities related to Freesound.
JavaScript
9
star
50

playlists-stat-analysis

Tools for Analyzing Popularity and Semantic Diversity of a Playlist Dataset
Python
9
star
51

SingWithExpressions

This is the accompanying repository to the paper - Automatic Estimation of Singing Voice Musical Dynamics
9
star
52

echonest-backup

A backup of EchoNest data exposed in the Million Song Dataset
Python
8
star
53

matlab-c-tools

Tools and tutorials for calling C and C++ code from Matlab
C++
8
star
54

essentia.js-tutorial-wac2021

Essentia.js tutorial at Web Audio Conference 2021
8
star
55

metadb

A simple database containing metadata linked to musicbrainz ids
Python
8
star
56

saraga

The companion repository of Saraga collections, with a companion website, a dump of the dataset, documentation, utility scripts and python notebooks to access and interact with the dataset
Jupyter Notebook
7
star
57

pymtg

Python research utils that some of us use at the MTG and eventually everyone will use :)
Python
7
star
58

hands-free-sound-machine

Demo application for the MusicBricks project, combining Ircam's RIoT sensor with MTG's Freesound API.
Python
7
star
59

smc-2016

Beijing opera singing intonation analysis
Python
6
star
60

ChoralSynth

Jupyter Notebook
5
star
61

melon-playlist-dataset

5
star
62

essentia-models-extraction

Batch extractor for melspectrograms, embeddings, and activations for the Essentia models.
Python
5
star
63

IAM-tutorial-ismir22

Webbook source code for ISMIR 2022 Tutorial: Computational Methods for Supporting Corpus-Based Research on Indian Art Music
Jupyter Notebook
5
star
64

andalusian-corpus-notebooks

Python
4
star
65

mtg-jamendo-annotator

A web app for annotating the MTG Jamendo dataset
HTML
4
star
66

CIPI

Python
4
star
67

SymbTr-extras

Basic tools to manipulate the SymbTr-scores
Jupyter Notebook
4
star
68

kaldi

Kaldi installation
Shell
4
star
69

phonos-music-explorer

Web real-time application for interactively exploring a collection of music
Python
4
star
70

SingingChoralSepAnalyzeSynthRemix

Python
4
star
71

SymbTr-pdf

The symbTr-scores in pdf format
4
star
72

makam-symbolic-phrase-segmentation

Automatic Phrase Segmentation on symbolic scores for Ottoman-Turkish makam music
MATLAB
4
star
73

metaverse1-soundscape-rendering

This repository contains code and documentation for the soundscape rendering application developed at the Music Technology Group for a virtual tourism use case within the Metaverse1 project.
SuperCollider
3
star
74

essentia-builds

Docker images for building Essentia
Shell
3
star
75

essentia.js-benchmarks

Web app and scripts for benchmarking Essentia.js
JavaScript
3
star
76

otmm_symbolic_phrase_dataset

A training dataset of scores of Turkish makam music withphrase boundary annotations
Jupyter Notebook
3
star
77

autotagging-qa-playlists

Playlists for evaluation of auto-tagging models
Python
3
star
78

musav-annotator

A web app for annotating relative arousal/valence data
HTML
3
star
79

mtg-logos

Logos for projects by the MTG
3
star
80

otmm_section_dataset

The section test dataset for classical Ottoman-Turkish makam music
TeX
3
star
81

carnatikit

Common tools for the computational analysis of Carnatic Music
Python
3
star
82

essentia-models

Machine learning models used for the Essentia unit tests
PureBasic
3
star
83

melon-music-dataset

2
star
84

arab-andalusian-music

Jupyter Notebook
2
star
85

otmm_composition_identification_dataset

Composition Identification dataset for Ottoman-Turkish Makam Music
2
star
86

essentia-models-benchmark

Scripts to benchmark the Essentia Models
Python
2
star
87

Jingju-Scores-Analysis

A collection of tools for extracting statistical information from the Jingju Music Scores Collection
Python
2
star
88

carnatic-pitch-patterns

Python
1
star
89

beijing-opera-intonation

Python
1
star
90

content_based_singing_extraction

Python
1
star
91

Jingju-Lyrics-Collection

Python
1
star
92

searching_for_sancaras

Python
1
star
93

cmbrowser-orig

The original version of the CompMusic browser
JavaScript
1
star
94

music-ner

Musical Named Entity Recognition System for Twitter
Python
1
star
95

otmm_tuning_intonation_dataset

A dataset of Turkish makam music to test tuning and intonation analysis methodologies
Jupyter Notebook
1
star
96

dunya-makam-demo

The binaries and example recordings picked for Dunya-makam demo
MATLAB
1
star
97

amplab-jamendo-notebook

Notebook + Essentia for AMPLab 2020-2022 projects
Dockerfile
1
star
98

essentia-audio

Audio and other binary assets used for the Essentia unit tests
ChucK
1
star
99

acousticbrainz-mediaeval-baselines

Baselines for MediaEval AcousticBrainz Genre Task
Python
1
star
100

essentia-robustness-ismir2014

Scripts to evaluate the robustness of descriptors to different encodings and analysis parameters
R
1
star