Discover datasciencecampus/DSCA_data_wrangling_with

Archive of data extracted from the google community mobility reports

117

google-mobility-reports-data

pygrams

Extracts key terminology (n-grams) from any large collection of documents (>1000) and forecasts emergence

Scripts to extract data from the COVID-19 Google Community Mobility Reports

mobius

A set of community visualisations for Google Data Studio created by the Data Science Campus

community-visualizations

JavaScript

off-course

Analysing port and shipping operations using big data

A simple dash application that shows users how to deploy dash using Google Cloud Platform (GCP)

deploy-dash-with-gcp

CSS

synthgauge

Code to get reviews from the Apple App Store and Google Play APIs

app_review

A resource repo for coffee-and-coding sessions in ONS

coffee-and-coding

Prototype search engine for ONS bulletins

statschat-app

A repository for nowcasting with signature methods

SigNow_ONS_Turing

Measuring the performance of transport networks around urban centres

transport-network-performance

Learning materials describing Reproducible Analytical Pipeline

gov-uk-rap-materials

Cloud hosted traffic camera image analysis and related time series creation, providing scalable data collection and processing

chrono_lens

Coding standards for Government Data Science Projects

coding-standards

Shell

proper

A repository for the R tool propeR, which analyses travel time and cost using an OTP graph (see datasciencecampus/graphite)

A text processing pipeline for turning unstructured text data into hierarchical datasets

optimus

Render GeoJSON polygons over aerial imagery and analyse pixels covered by vegetation; used to calculate green spaces in residential gardens

green-spaces

Predicting energy efficiency from Energy Performance Certificates (EPC) using machine learning

energy-efficiency

Repository for the Data Science Campus Access to Services project (linked to datasciencecampus/graphite and datasciencecampus/propeR)

access-to-services

sic-soc-llm

Distributed Google street view image processing

street-view-pipeline

A compendium of open-source guidance which aims to share the benefits, risks and a summarised strategy for open-source coding.

coding-in-the-open

TeX

woffle

NLP template for dummies, by dummies

A repository for building an OTP network graph

graphite

Shell

DSCA_Intro-R

Repo on generating synthetic data using GAN

synthetic-data

Construct sample points at equidistant points from OpenStreetMap road network data

openstreetmap-network-sampling

Java

pprl_toolkit

The privacy-preserving record linkage toolkit: a proof-of-concept public demo of next-gen data linkage techniques.

accessrmd is a package with functions intended to improve the accessibility of Rmarkdown documents.

accessrmd

Tools for analysing parliamentary transcripts (hansard data)

uk-parliament-stats

Toolkit for extracting relevant lines from receipts or similar image data.

readpyne

Preliminary analysis for 2023 population transformation consultation

consultation_nlp

Repo for National Assembly for Wales consultation analysis

consultation-analysis-nafw

Bus coverage and punctuality metrics for all public services across England

bus-metrics-england

A machine learning approach to detecting large vehicles in Sentinel-2 Earth observation satellite imagery. This experimental project, developed by the International Development squad, was concerned with exploring whether the number of trucks on roads could be used as an economic indicator.

detecting-trucks

anomaly-detection

ft-hackathon-python-team

Introduction to Python Programming

DSCA_intropython

Prototype tool for visualising urban forest data

gRoot

kamino

DSC visualisation app for the UK fishing industry

trendr

An R package to extracts the trend and first derivative using a local linear model in state-space form and the Diffuse Kalman Filter

govtools

An R package to help set up government R packages

DSCA_intermediate-python

Repo for intermediate python course materials

Open-source tool for reporting SDG indicator 6.6.1

sdg_661_analysis_and_reporting

A Python translation of the Office for Budget Responsiblity's (OBR's) UK macroeconomic model

obr-macro-model

A text classification app

ace2

A repository containing an index of our projects and tools that we have published.

awesome-campus

jtstats-py

Code to download all England road traffic data once per month

road-data-dump

A Python wrapper for the England & Wales Census 2021 "Create a Custom Dataset" API

census21api

Synthetic data generation pipeline with differential privacy

finbins

FinBins project

Scala

syn-data-gen

Interactive visual of bus reliability metrics by LSOA for England (February - April 2024, based on daily BODS data from 7-10am)

bus-metrics-england-visual

A demonstration of propeR

propeR-viz

JavaScript

nlp-for-health

a place to share analysis and code for Natural Language Processing (NLP) techniques, using publicly available health and social care datasets.

A public repository to hold resources and notes from ONS Coffee & Coding sessions in London

coffee-and-coding-ldn

iati-partner-search

Search IATI descriptions using different methods

The Data Science Campus' journal club for Natural Language Processing (NLP)

nlp-club

rail_reporter

Generate statistics and visualisations describing scheduled train movements (GB)

A Slack App for posting tea break groups using Google Cloud Platform

mx-tea

A simple script for parsing geojson files and converting them to CSV files ready to upload to GCP BigQuery.

geojson_to_csv

DSCA_Version-controlled-RStudio-projects

DSCA_Version-control-with-Git-Github

Evaluating CaLorie Intake for Population Statistical Estimates

eclipse

Stata

jtstats-r

jtstats

mst-demo

A demonstration of the MST method using the 1% 2011 Census Teaching File

Useful generic code to interact with Cloud Native tools on Google Cloud Platform, includes Cloud Functions, BigQuery, GCS, Pub/Sub, Cloud Run and FireStore

gcp_utilities

Using Generative AI to filter parliamentary debate

parliai-public

Inspect, validate & filter General Transit Feed Specification.

assess_gtfs