datasciencecampus/gcp_utilities

Stars
1
Language
Python
License
MIT License
Created about 4 years ago
Updated almost 4 years ago

datasciencecampus/gcp_utilities

datasciencecampus

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Useful generic code to interact with Cloud Native tools on Google Cloud Platform, includes Cloud Functions, BigQuery, GCS, Pub/Sub, Cloud Run and FireStore

laika

Experiments with satellite image data

Jupyter Notebook

google-mobility-reports-data

Archive of data extracted from the google community mobility reports

pygrams

Extracts key terminology (n-grams) from any large collection of documents (>1000) and forecasts emergence

mobius

Scripts to extract data from the COVID-19 Google Community Mobility Reports

community-visualizations

A set of community visualisations for Google Data Studio created by the Data Science Campus

off-course

Analysing port and shipping operations using big data

Jupyter Notebook

deploy-dash-with-gcp

A simple dash application that shows users how to deploy dash using Google Cloud Platform (GCP)

synthgauge

app_review

Code to get reviews from the Apple App Store and Google Play APIs

coffee-and-coding

A resource repo for coffee-and-coding sessions in ONS

statschat-app

Prototype search engine for ONS bulletins

SigNow_ONS_Turing

A repository for nowcasting with signature methods

Jupyter Notebook

transport-network-performance

Measuring the performance of transport networks around urban centres

gov-uk-rap-materials

Learning materials describing Reproducible Analytical Pipeline

chrono_lens

Cloud hosted traffic camera image analysis and related time series creation, providing scalable data collection and processing

coding-standards

Coding standards for Government Data Science Projects

proper

A repository for the R tool propeR, which analyses travel time and cost using an OTP graph (see datasciencecampus/graphite)

optimus

A text processing pipeline for turning unstructured text data into hierarchical datasets

green-spaces

Render GeoJSON polygons over aerial imagery and analyse pixels covered by vegetation; used to calculate green spaces in residential gardens

energy-efficiency

Predicting energy efficiency from Energy Performance Certificates (EPC) using machine learning

Jupyter Notebook

access-to-services

Repository for the Data Science Campus Access to Services project (linked to datasciencecampus/graphite and datasciencecampus/propeR)

sic-soc-llm

street-view-pipeline

Distributed Google street view image processing

coding-in-the-open

A compendium of open-source guidance which aims to share the benefits, risks and a summarised strategy for open-source coding.

woffle

NLP template for dummies, by dummies

graphite

A repository for building an OTP network graph

DSCA_Intro-R

synthetic-data

Repo on generating synthetic data using GAN

Jupyter Notebook

openstreetmap-network-sampling

Construct sample points at equidistant points from OpenStreetMap road network data

pprl_toolkit

The privacy-preserving record linkage toolkit: a proof-of-concept public demo of next-gen data linkage techniques.

accessrmd

accessrmd is a package with functions intended to improve the accessibility of Rmarkdown documents.

uk-parliament-stats

Tools for analysing parliamentary transcripts (hansard data)

readpyne

Toolkit for extracting relevant lines from receipts or similar image data.

consultation_nlp

Preliminary analysis for 2023 population transformation consultation

consultation-analysis-nafw

Repo for National Assembly for Wales consultation analysis

Jupyter Notebook

bus-metrics-england

Bus coverage and punctuality metrics for all public services across England

detecting-trucks

A machine learning approach to detecting large vehicles in Sentinel-2 Earth observation satellite imagery. This experimental project, developed by the International Development squad, was concerned with exploring whether the number of trucks on roads could be used as an economic indicator.

anomaly-detection

Jupyter Notebook

ft-hackathon-python-team

DSCA_intropython

Introduction to Python Programming

Jupyter Notebook

gRoot

Prototype tool for visualising urban forest data

kamino

DSC visualisation app for the UK fishing industry

trendr

An R package to extracts the trend and first derivative using a local linear model in state-space form and the Diffuse Kalman Filter

govtools

An R package to help set up government R packages

DSCA_intermediate-python

Repo for intermediate python course materials

Jupyter Notebook

sdg_661_analysis_and_reporting

Open-source tool for reporting SDG indicator 6.6.1

Jupyter Notebook

obr-macro-model

A Python translation of the Office for Budget Responsiblity's (OBR's) UK macroeconomic model

ace2

A text classification app

awesome-campus

A repository containing an index of our projects and tools that we have published.

jtstats-py

road-data-dump

Code to download all England road traffic data once per month

Jupyter Notebook

census21api

A Python wrapper for the England & Wales Census 2021 "Create a Custom Dataset" API

finbins

FinBins project

syn-data-gen

Synthetic data generation pipeline with differential privacy

Jupyter Notebook

bus-metrics-england-visual

Interactive visual of bus reliability metrics by LSOA for England (February - April 2024, based on daily BODS data from 7-10am)

natural_spaces

Measuring engagement with nature project. Work completed in collaboration with DEFRA

Jupyter Notebook

nlp-for-health

a place to share analysis and code for Natural Language Processing (NLP) techniques, using publicly available health and social care datasets.

Jupyter Notebook

propeR-viz

A demonstration of propeR

coffee-and-coding-ldn

A public repository to hold resources and notes from ONS Coffee & Coding sessions in London

iati-partner-search

Search IATI descriptions using different methods

nlp-club

The Data Science Campus' journal club for Natural Language Processing (NLP)

rail_reporter

Generate statistics and visualisations describing scheduled train movements (GB)

mx-tea

A Slack App for posting tea break groups using Google Cloud Platform

geojson_to_csv

A simple script for parsing geojson files and converting them to CSV files ready to upload to GCP BigQuery.

DSCA_Version-controlled-RStudio-projects

DSCA_Version-control-with-Git-Github

DSCA_data_wrangling_with_r

Course on data wrangling with R (pending review)

eclipse

Evaluating CaLorie Intake for Population Statistical Estimates

jtstats-r

jtstats

mst-demo

A demonstration of the MST method using the 1% 2011 Census Teaching File

parliai-public

Using Generative AI to filter parliamentary debate

assess_gtfs

Inspect, validate & filter General Transit Feed Specification.

centhesus

Synthesising the 2021 England and Wales Census from publicly available data