• Stars
    star
    232
  • Rank 172,847 (Top 4 %)
  • Language
    Ruby
  • Created over 9 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

data for national legislatures worldwide

The EveryPolitician project is currently on hold. See this blog post for more information.

everypolitician-data

This is the data repo for EveryPolitician. It contains the data powering EveryPolitician.org, and other sites such as Gender-Balance.org.

Want to use the data?

Want to contribute data?

This repo is where we store the data, but we have a process for adding it β€” please don't submit Pull Requests with data. Instead, if you know of data or data sources we are not using, please get in touch: here's how to contribute. The bottom line is: we use multiple online sources, and we regularly retrieve data from those sources so we can automatically keep up-to-date if and when they change. If you can help us by providing more sources, great!

This document is for developers actively working on the project, rather than consuming data from it.

Building the data for a legislature

  1. From within the directory for the legislature it should usually be enough to run bundle exec rake clean default.

    • To re-refetch the data from a given source first, set the REBUILD_SOURCE environment variable to something matching the filename of the required source: e.g. REBUILD_SOURCE=official bundle exec rake clean default

    • If you want to fetch fresh data from all existing sources, you can use bundle exec rake clobber default instead.

    • Note that if you're fetching any data from Morph, you'll also need to specify your morph.io API key in the environment variable MORPH_API_KEY, e.g. MORPH_API_KEY=my_secret_key bundle exec rake clean default

  2. Make sure that the changes look sensible, and then commit the new/refreshed data. Please commit human-edited files separately to data fetched from a remote source or generated as part of the build.

More Repositories

1

everypolitician-python

Python package for easy access to EveryPolitician data
Python
35
star
2

everypolitician

Data about every national legislature in the world, freely available for you to use
21
star
3

gender-balance

Crowdsourcing platform for gathering gender information about politicians to improve the data in EveryPolitician
HTML
15
star
4

everypolitician-ruby

Ruby gem for easy access to EveryPolitician data
Ruby
14
star
5

everypolitician-popolo-python

Parse Popolo JSON data and navigate it with Python
Python
14
star
6

everypolitician-names

Generate names.csv (all the politicians' names from everypolitician.org's data)
Ruby
8
star
7

scraped

Write declarative scrapers in Ruby
Ruby
8
star
8

everypolitician-popolo

Ruby gem for interacting with EveryPolitician data for a legislature
Ruby
7
star
9

viewer-sinatra

Sinatra app for (pre)viewing EveryPolitician website dynamically
HTML
5
star
10

wikidata-fetcher

Fetch information useful to EveryPolitician from Wikidata
Ruby
4
star
11

wikisnakker

Ruby gem to help with bulk lookups of Wikidata items (currently for internal EveryPolitician use)
Ruby
3
star
12

compare_with_wikidata

Library for diffing Wikidata and CSVs
Ruby
2
star
13

proto-commons-taiwan

A basic Democratic Commons repository for Taiwan
Python
1
star
14

scraped_page_archive

Create an archive of HTML pages scraped by a Ruby scraper
Ruby
1
star
15

field_serializer

Field Serializer
Ruby
1
star
16

commons-builder

Build scripts for Democratic Commons repositories
Ruby
1
star
17

proto-commons-brazil

A basic Democratic Commons repository for Brazil
Ruby
1
star
18

everypolitician-docs

Source for EveryPolitician website's documentation pages
HTML
1
star
19

twitter_list

Ruby gem to facilitate collecting data from Twitter Lists
Ruby
1
star
20

webhook-manager

Notifies other apps whenever EveryPolitician data changes, in style of GitHub's webhooks
Ruby
1
star
21

vcr-archive

Split your VCR cassettes into multiple files, one per request/response interaction
Ruby
1
star
22

viewer-static

EveryPolitician website source (gh-pages, from an automated build)
HTML
1
star