• Stars
    star
    2
  • Language
    Python
  • License
    MIT License
  • Created almost 2 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Python functions and CLI to mirror git repositories to S3

More Repositories

1

stream-unzip

Python function to stream unzip all the files in a ZIP archive on the fly
Python
251
star
2

cypress-image-diff

Visual regression test with cypress
Handlebars
233
star
3

mbtiles-s3-server

Python server to on-the-fly extract and serve vector tiles from an mbtiles file on S3
Python
136
star
4

sqlite-s3vfs

Python writable virtual filesystem for SQLite on S3
Python
112
star
5

stream-zip

Python function to construct a ZIP archive on the fly
Python
86
star
6

mobius3

Continuously sync folder to S3, using inotify under the hood
Python
42
star
7

data-workspace-frontend

An open source data analysis platform with features for users with a range of technical skills
Python
42
star
8

fargatespawner

Spawns JupyterHub single user servers in Docker containers running in AWS Fargate
Python
38
star
9

pg-bulk-ingest

Python utility function to ingest data into a SQLAlchemy-defined PostgreSQL table
Python
34
star
10

dns-rewrite-proxy

A DNS proxy server that conditionally rewrites and filters A record requests
Python
28
star
11

stream-sqlite

Python function to extract rows from a SQLite file while iterating over its bytes
Python
23
star
12

tidy-json-to-csv

Convert JSON to a set of tidy CSV files
Python
20
star
13

tamato

The Tariff Management Tool (TaMaTo) stores and manages the tariffs and controls that are applied on imports and exports at the UK border. 🍅
Python
18
star
14

jupyters3

Jupyter Notebook Contents Manager for AWS S3
Python
17
star
15

dit-clamav-rest

A minimal ClamD REST interface
Python
15
star
16

great-cms

great.gov.uk CMS
Python
15
star
17

django-workflow-engine

Configurable Django workflow engine
Python
13
star
18

stream-read-xbrl

Python package to parse Companies House accounts data in a streaming way
Python
13
star
19

mock-sso

A mock SSO server to test an applications SSO integration
JavaScript
12
star
20

data-hub-api

Django API for Data Hub frontend
Python
12
star
21

data-hub-frontend

The frontend rendering application for Data Hub
JavaScript
10
star
22

streampq

Python PostgreSQL adapter to stream results of multi-statement queries without a server-side cursor
Python
8
star
23

export-opportunities

UK - Great.gov - Export Opportunities - Find and apply for overseas opportunities from businesses looking for products or services like yours.
HTML
7
star
24

pii-secret-check-hooks

PII (Personal Identifiable Information) and secret check hooks for pre-commit
Python
7
star
25

iterable-subprocess

Python context manager to communicate with a subprocess using iterables: for when data is too big to fit in memory and has to be streamed
Python
7
star
26

market-access-python-frontend

Python
7
star
27

to-file-like-obj

Python utility function to convert an iterable of bytes or str to a readable file-like object
Python
7
star
28

directory-cms

Content Management System service for directory apps
Python
6
star
29

django-chunk-s3-av-upload-handlers

Chunking Django file handlers for S3 and ClamAV service uploads
Python
6
star
30

platform-tools

Tooling to assist with setting up and managing AWS copilot infrastructure
Python
6
star
31

tariff-data-manual

Technical documentation about how the UK tariff data works.
Ruby
6
star
32

s3chunkuploader

A multi threaded S3 file chunk uploader which bypasses local file system and pipes the file directly to S3
Python
6
star
33

trade-elements

Front end pattern library for Department of International Trade
HTML
5
star
34

streamlit-gov-uk-components

A collection of Streamlit components that use or are inspired by the GOV.UK Design System
Shell
5
star
35

data-hub-components

Collection of React Components used by DIT's Data Hub.
JavaScript
5
star
36

digital-workspace-v2

DBT's intranet Django/Wagtail
Python
5
star
37

django-log-formatter-ecs

An ECS formatter for Django logs
Python
5
star
38

jwt-postgresql-proxy

Stateless JWT authentication in front of PostgreSQL
Python
5
star
39

trade-tariff-api

Taric file API for Trade Tariff Management application
Python
5
star
40

data-engineering

A collection of information and learning material relating to data engineering at the Department for International Trade
5
star
41

data-hub-prototype

JavaScript
4
star
42

pg-force-execute

Context manager to run PostgreSQL queries with SQLAlchemy, terminating any other clients that block it
Python
4
star
43

terraform-module-eks-base

HCL
4
star
44

directory-tests

Smoke, integration and functional tests for DIT's services
Python
4
star
45

trade-tariff-management

Ruby
4
star
46

countries-of-interest-service

Lightweight API service for querying for companies that have expressed interest in exporting to specific countries
Python
4
star
47

icms

Import Case Management System - Python/Django port on PostgreSQL database
Python
4
star
48

govuk-frontend-django

GOV.UK Frontend Django
Python
4
star
49

directory-ui-buyer

Python
3
star
50

help-desk-service

Python
3
star
51

terraform-prometheus-module

HCL
3
star
52

terraform-modules

HCL
3
star
53

data-hub-api-spec

Swagger files and test server for the Data Hub CRM project
Python
3
star
54

great-international-ui

Python
3
star
55

stream-write-ods

Python function to construct an ODS spreadsheet on the fly - without having to store the entire file in memory or disk
Python
3
star
56

directory-api

Directory of Exporters API
Python
3
star
57

dnb-service

A Dunn & Bradstreet microservice
Python
3
star
58

export-support

Python
3
star
59

data-workspace-tools

HTML
3
star
60

dit-thumber

A simple django app for soliciting user feedback on django views
Python
3
star
61

lite-api

Service for handling backend calls in LITE.
Python
3
star
62

infrastructure

Vagrant, Docker and Ansible configuration repository for DIT Digital
Shell
3
star
63

clamav-s3-mirror

Python
3
star
64

legal-basis-api

Legal Basis for Consent Service API Server
Python
3
star
65

dit-helpdesk

HTML
3
star
66

django-zenslackchat

A bot which synchronises support requests from Slack to Zendesk and back.
Python
3
star
67

docker-overlay-network-benchmark

Shell
3
star
68

data-hub-helpcentre

Central point for articles, advice and how-tos for the Data Hub
CSS
3
star
69

market-access-api

The API for Market Access
Python
3
star
70

selling-online-overseas

Department of International Trade marketplace navigator.
Python
3
star
71

flower-runner

Celery Flower runner for GOV.UK PaaS
Python
3
star
72

django-staff-sso-client

A client for staff-sso
Python
3
star
73

vulnerability-priority-list

A command line report on a GitHub organisation's repositories, ordered by priority, and including time-to-SLA for each severity level
Python
3
star
74

global-uk-tariff

GOV.UK service displaying tariffs to trade with the UK from 1 January 2021
CSS
3
star
75

ci-pipeline

DIT CD pipeline
Ruby
2
star
76

investment-opps

JavaScript
2
star
77

aioftps3

FTP in front of AWS S3, powered by asyncio and aiohttp
Python
2
star
78

django-ga-measurement-protocol

Python
2
star
79

copilot-poc

Co Pilot PoC
Python
2
star
80

public-data-api

The source for the Department for International Trade's Public Data API
HTML
2
star
81

directory-form-data

Python
2
star
82

company-matching-service

Python
2
star
83

dit-contact-forms

DIT Contact Forms
HTML
2
star
84

great-styles

Styles for great.gov.uk
SCSS
2
star
85

markdown-gds

Python
2
star
86

directory-ui-supplier

deprecated. Incorporated into https://github.com/uktrade/great-international-ui
Python
2
star
87

data-workspace-visualisation

Template repository for Data Workspace visualisations
R
2
star
88

terraform-module-openshift

HCL
2
star
89

directory-sso

Python
2
star
90

prototypes-on-paas

HTML
2
star
91

invest-pir-api

Personalised Investment Report
Python
2
star
92

terraform-module-aws_account

HCL
2
star
93

directory-companies-house-search

Python
2
star
94

iigb-beta-content

Content for IIGB website
2
star
95

great-pattern-library

Great Pattern library
CSS
2
star
96

gds-technical-documentation-template

mkdocs template using GOV.UK Design System styles
JavaScript
2
star
97

statement-of-works

Automatic generation for SOW forms
Python
2
star
98

dit-ip

Python
2
star
99

lite-internal-frontend

Application for handling internal information in LITE.
Python
2
star
100

dit-classification-matcher

A microservice developed in Python + Flask to map between CPV <-> HS <-> TARIC codes
Python
2
star