• Stars
    star
    732
  • Rank 61,915 (Top 2 %)
  • Language
    Shell
  • Created almost 9 years ago
  • Updated over 4 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Various popular python libraries, pre-compiled to be compatible with AWS Lambda

Logo

lambda-packages

Build Status PyPI Slack

Various popular libraries, pre-compiled to be compatible with AWS Lambda.

Currently includes (at least Python 2.7) support for:

  • bcrypt
  • cffi
  • cryptography
  • datrie_extended
  • LXML
  • misaka
  • MySQL-Python
  • mysqlclient
  • numpy
  • OpenCV
  • Pillow (PIL)
  • psycopg2
  • PyCrypto
  • PyNaCl
  • pyproj
  • python-ldap
  • python-Levenshtein
  • regex
  • SQLite
  • xmlsec

This project is intended for use by Zappa, but could also be used by any Python/Lambda project.

Installation

pip install lambda-packages

Usage

The best way to use these packages is with Zappa, which will automatically install the right packages during deployment, and do a million other useful things. Whatever you're currently trying to do on Lambda, it'll be way easier for you if you just use Zappa right now. Trust me. It's awesome. As a bonus, Zappa now also provides support for manylinux wheels, which adds support for hundreds of other packages.

But, if you want to use this project the other (wrong) way, just put the contents of the .tar.gz archive into your lambda .zip.

lambda-packages also includes a manifest with information about the included packages and the paths to their binaries.

from lambda_packages import lambda_packages

print lambda_packages['psycopg2']

#{
#    'python2.7': {
#        'version': '2.6.1',
#        'path': '<absolute-local-path>/lambda_packages/psycopg2/python2.7-psycopg2-2.6.1.tar.gz'
#    }
#}

Contributing

To add support for more packages, send a pull request containing a gzipped tarball (tar -zcvf <package-name>.tar.gz <list-of-files>) of the package (built on Amazon Linux and tested on AWS Lambda) in the appropriate directory, an updated manifest, and deterministic build instructions for creating the archive.

You may find the build.sh script useful as a starting point.

Before contributing, you should also make sure that there is no manylinux wheel on PyPI for your package, as Zappa will automatically use those in addition to lambda-packages.

You may also be interested in this guide on deploying with Zappa and Docker.

Useful targets which don't have manylinux wheels versions include:

  • MongoEngine

Support / Development / Training / Consulting

Do you need help with..

  • Porting existing Python applications to AWS Lambda?
  • Building new applications and services that scale infinitely?
  • Reducing your operations and hosting costs?
  • Training your team to use AWS and other server-less paradigms?

Good news! We're currently available for remote and on-site consulting for small, large and enterprise teams. Please contact [email protected] with your needs and let's work together!


Made by Gun.io

More Repositories

1

Zappa

Serverless Python
Python
11,887
star
2

Glance-Bookmarklet

A Speed Reading Bookmarklet
JavaScript
1,557
star
3

SoundScrape

SoundCloud (and Bandcamp and Mixcloud) downloader in Python.
Python
1,393
star
4

Loop

UNIX's missing `loop` command
Rust
674
star
5

dnd-tldr

Dungeons and Dragons - Too Long; Didn't Read
625
star
6

DirtyShare

Peer to Peer Filesharing in Pure Javascript With Node.js and Socket.io
JavaScript
487
star
7

django-zappa

THIS PROJECT IS DEPRECATED, GO HERE INSTEAD:
Python
470
star
8

NoDB

NoDB isn't a database.. but it sort of looks like one.
Python
380
star
9

chords2midi

Create MIDI files from numerical chord progressions!
Python
352
star
10

Android-SDK-Samples

GitHub mirror of the Android SDK Samples. API version 17.
Java
300
star
11

omnihash

Hash files, strings, input streams and network resources in various common algorithms simultaneously
Python
251
star
12

Glance

Good reads, extremely fucking fast.
JavaScript
241
star
13

Minicraft

Minicraft and Minicraft for Android
220
star
14

django-easy-timezones

Easy timezones for Django based on GeoIP
Python
203
star
15

Mackenzie

AWS Lambda Infection Toolkit // Persistent Lambda Malware PoC
160
star
16

zappa-django-utils

A handy Django application to supercharge your Zappa deployments.
Python
144
star
17

live_json

LiveJSON - LiveView for JSON
JavaScript
131
star
18

NodeDeploy

Example scripts for deploying a Node.js application behind a Node proxy alongside Apache/Nginx, as a demon which restarts automatically upon crashing.
JavaScript
130
star
19

Helix

Engineering Consciousness
JavaScript
127
star
20

RJModules

Various modules for VCV Rack
C++
99
star
21

flask-zappa

Serverless Flask on AWS Lambda + API Gateway
Python
86
star
22

WhitespaceBot

Making GitHub Better.. With Robots
Python
79
star
23

UltimateTemplate

Ultimate Ableton Live Starter Template(s)
73
star
24

ADGMaker

Create Ableton Live Instruments from Philharmonia Samples
Smarty
73
star
25

django-knockout-modeler

Super simple knockout.js ModelView templates for you Django models
Python
50
star
26

zappa-bittorrent-tracker

An experimental server-less BitTorrent tracker. Powered by Zappa, Flask and (DynamoDB or S3).
Python
45
star
27

Zappa-CMS

A tiny serverless CMS for busy hackers.
HTML
42
star
28

FriendlyID

FriendlyID is an Elixir package that creates unique(-ish) friendly, human-readable identifiers for your objects.
Elixir
42
star
29

Hash-Identifier

GitHub Mirror of Hash-Identifier
Python
35
star
30

XSS-Harvest

XSS Weaponization
Perl
34
star
31

LightWrite

Online WriteRoom Clone
JavaScript
33
star
32

Fashion

Pythonic OpenFaaS. aka `python-openfaas`.
Python
33
star
33

OnionCloud

OnionCloud - An Anonymous Heroku-like PaaS
33
star
34

HitStarter

Anonymous Crowdfunding. BitCoin. Tor. You figure it out.
Python
32
star
35

zappa-slack-inviter

A server-less Slack inviter
HTML
32
star
36

Emo

Command line emoji search. 🙏 🔥
Python
29
star
37

JonesComplexity

Per-line complexity for Flake8
Python
29
star
38

VitalPresets

My Vital Presets for Vital Synth. Bass music, trap, drum and bass, IDM, wubs, wobbles, swooshes, fizzles, stomps and woops.
27
star
39

easy-expressions

Easy Regular Expressions for Python
Python
24
star
40

OpenWatch---Android

OpenWatch Client for Android
Java
20
star
41

Seek

Search the internet from your terminal. Speed read your results. Terminal nirvana.
Python
20
star
42

HerokuFreeProxy

A very very very very simple web proxy that runs on the Heroku free tier. Written in 2 minutes.
Python
20
star
43

Vape

COMMAND LINE AESTHETIC GENERATOR
Python
18
star
44

zappa-blog

A blog about Zappa, powered by Zappa. Zappa zappa zappa. Zappa.
HTML
17
star
45

WebP2P.org

The static pages from WebP2P.org
JavaScript
16
star
46

Zalgo

Ç͍̝͍͍͍͙͍͕͍͍͍̈́ͣͩo̴̵̧̧͍͍͍͍͍͈͍͍͍͍͍͍̻͍͍͍͍͍͍͍͍͍͍͍͍͍͕͍͍͂̈̾̀͐̌ͤ̈ͪ̌ͦͪ̚͢͝͠͡ͅm̵̶̢͍͍͍͍͍͍̪͍͍͍͍͍͍̤͍̬͍͍̯͍̳͍͍͍͍͙͍͍͍͍ͮ̃̂ͨͯ͑͂ͭ̏͌́̕҉̢̨͍͍̱͍͍͍͍͍͎͍͍͍͍̣͍͍͍͍̤͍͍͍̫͍̜͍̿̊͒ͤ̏͌ͧ͝͝m͍͚͍͍͍͍͍͍̂ͧ̾ͬ͡a͍͏͍͍͋n͍̣͍͙͍͍̣͍͍̫͍̠͍̯͍͍͍͍ͦ̃̄̚̕d͍͍͍̣͍͍͍͍ͥͮ͊ͯ͠ ̡͍̖͍͍͍̝͍͍̺͍͍̺͍͍̞͍̟͍͍͍͍̳͍̭͍͍ͪ̾̉ͨ͂̂͘ͅ҈̸̧͍̝͍͍̰͍̬͍͍͍͍͍ͯ͟͡l̵͍̯͍͍͍͍̩͍͍̥͍͍͍̰͍̠͍͍͚͍͍͍͍̥͍͍̻͍͍͍͍͍͍̄ͯ́͒̒ͭ͂̏̽͞͠ i̴̷͍͍͍͍͍͍̰͍ͫ͑͝҈̴͍͍͍͍͍͍͍̜͍̘͍͍͍͍͍͆̿ͯ͋̆ͦ͋ͣ̆n͍͕͍̦͍͍ͅ͏̴͍̱͍͍͍͍̲͍͚͍͗̀e̢̧̡͍̖͍͍͍̟͍͕͍͍͍͍͍͍͍̱͍̟͍͍͍͍͍͍̻͍͍͍̠͍͍̖͍̅̓̊̅̂ͣ̀̽͆̅͘͜͠҉̴̷̶͍͍͍͙͍͍͍͍͍̰͍̫͍͍̜͍̱͍͍̘͍͍̙͍͍̫͍͇͍͍͍͍͍̲͍́̅͛̏̃̏ͥ̅ͨ́͝ ̴͍͍͍͍͍͍͍̯͍͍̜͍͍̙͍͍͍͍͍͓͍̹͍͍͍͍͍̲͍͍͍͉͍͍͍͍͍͍͍͍̦͍͚͍̣͍͍͍͍͍͉͍̦͍̰͍͍͍͍͍͍̃ͬͣ͋̾ͦͤ́ͦ̈̄͋̑ͪ̌ͫ̎̄͋̈ͨ̆ͩͥ̍͘̚̚̕͢͟͜͠z͍͍̠͍͍͍̥͍͍̠͍̀̉ͬ̕ą̴̸̴̡̛͍̜͍͍͍͍͎͍͍͍͍͍͍͍͍͍̗͍͍͍͍͍͍͍͍͍̠͍͈͍͍͍͍͍͍͍͍̮͍͍͍͍͍͍͍͍͍͍͍͍̮͍̪͍̍͐̇ͨͤ̈ͦ͋̽̋ͦͦ͋̍̒ͥ̉͂̿̑͊̇͂͢͟͟͢͜͡͠͝҉͍̬͍l̴̶̨̢̧̧͍̭͍͍͍͍͈͍͍͍͍͉͍̞͍͍͍͍͍͍͍͍͍̘͍͉͍̙͍͍̜͍͍͍͍͍̞͍͓͍͍̘͍͍͍͍͍͍͍͍̳͍͍͍͍͍̲͍͍̺͍͆̋ͧͣ͊̒̽͆ͬ̀͌ͥ́̈́̒ͭ̔̽̽̚͜͢͝ͅ҉͍͍̣͍͍̓͋ĝ͍͍͍̬͍͍͍̱͍ͭ̾͛҈̡͍̤͍͍͍͍͇͍͓͍͍͍̼͍͍̼͍͕͍͍̋̀̒ͪ͟͡o̶͍͍͍͍̖͍͍͍͍͍̙͍̰͍͍͍̘͍͍͍̤͍͇͍͖͍͍͋ͯͦ́̆̾̑ͮ̏̆͝.͍͍͋҉͍͍͍͍̱͍͍͍͆͐͒͐͢͏̡͍͍͈͍͍̩͍͍͍͍͍͍̥͍̯͍̺͍̣͍͍͍͍͍̠͍̗͍͍͍͍͍͍̘͍͍͍̅̔̋ͧ͂ͫ̒ͭ͊ͫ̓͊͌͆̔̕͝ͅ
Python
16
star
47

nogoogle

An easy way to remove Google from your life.
Python
15
star
48

Blaccupy

Black out your website to protest SOPA/PIPA
JavaScript
15
star
49

OpenWatch

OpenWatch.net code - Code for the client-side applications is available in my other repositories.
Python
15
star
50

django-aws-billing

Django AWS Usage/Billing Package.
Python
15
star
51

SynthRecipies

Random Serum Patches
14
star
52

django-easy-split

Easy split testing for Django.
Python
14
star
53

Exploitable

A Django application full of security holes for instructional purposes
JavaScript
14
star
54

Talks

A random, incomplete assortment of presentations
HTML
13
star
55

Poop

The internet is covered in 💩. Avoid it.
JavaScript
12
star
56

Youtube-Upload

GitHub Mirror of youtube-upload
12
star
57

CitizenMediaNotary

Citizen Media Notary creates notarized temporal records for citizen media.
JavaScript
12
star
58

django-easy-api

Give your website an API by changing a single line of code!
Python
11
star
59

ClickFraudBot

"If It's Digital, It Can Be Automated" ~ Tim Hwang
Python
11
star
60

django-welcome

Send welcome emails to new users and send notifications about new users to admins.
Python
11
star
61

b64img

Command line Base-64 image converter.
Python
10
star
62

Kaikai

Kaikai is like Bootstrap for WebVR projects. Let's have a Kaikai!
HTML
10
star
63

serverless-imagehost

Serverless thumbnailing service with Zappa and Flask
Python
10
star
64

Anomos

Anomos Github Mirror
Python
10
star
65

Trapify

KЄЄⱣ ΫØṲЯ ϾØMM∆ИƉ ⱢỊИЄ ₮ЯỊⱢⱢ, ₣∆M
Python
10
star
66

FreeScrub

A F/OSS metadata scrubber supporting PNG, PDF, TIFF, and JPEG files (with more to come!)
Python
9
star
67

stund

GitHub Mirror of stund
C++
8
star
68

LucidDreamBot

A Twitter bot to remind you to question reality. #onehourproject
Python
7
star
69

Cop-Recorder-2

Audio only version of the OpenWatch Android client. Sequel to Cop Recorder app
Java
7
star
70

ableton-backup

Backups of my Ableton Doodles. Not for you.
7
star
71

GrooveMac

A GrooveDown package for OSX
6
star
72

Tsunami

An Experimental BitTorrent Client. Ignore this for now.
JavaScript
6
star
73

progress.js

Towards an effort into making the internet into a progressive activist force. Simple, embeddable open source tools for progressive webmasters.
6
star
74

Karla

A Pen and Paper Game of Espionage
6
star
75

LaunchBoard

Guitar Mapping for the Novatation LaunchPad in Ableton Live
6
star
76

Voice-Dropbox

Asterisk Configuration to make a VoIP/PSTN Dropbox which integrates with OpenWatch.net
Python
6
star
77

kademlia.js

A Pure JavaScript Implementation of Kademlia. Towards a Decentralized WebDHT!
5
star
78

Spry

Spry is a slightly enhanced `pry` for Elixir
Elixir
5
star
79

Detour

GitHub mirror of Jann Horn's Detour
C
5
star
80

UniShare

UniShare - the engine behind NotesHub.org. A product of Students for Free Culture (freeculture.org)
JavaScript
5
star
81

pyglance

A Glance client and library for python for terminal speed reading.
Python
5
star
82

Spheres

Online Photosphere viewer and host.
HTML
5
star
83

gitlog

Show nicely formatted Git histories for multiple repositories for any given author.
Python
4
star
84

Android-Pay-What-You-Want

A library that lets you add Pay-What-You-Want donations to your project.
Java
4
star
85

simpleaws

A simpler way to create multi-user access on AWS. Built with Boto.
Python
4
star
86

LectureLeaks---Android

LectureLeaks Android Client
Java
4
star
87

Gunio-Android-Client

An Android app for Gun.io
Java
4
star
88

Autopan

BX$$ Autopan is a VST that automatically pans a signal back and forth between left and right channels.
4
star
89

RELIC

Regular Expressions Legislative Information Council
Python
4
star
90

django-devsafe

Safely work with a production database in an insecure environment
Python
4
star
91

Krasha

Crash Generation for Android. I made this in because I needed it. I don't know why anybody else would ever need this but what the hell, here it is.
Java
4
star
92

Stretches

Imagine one instant of a song, expanded to the size of the universe.
4
star
93

EOP945

Python Audio Squisher and Cut-up Maker
Python
3
star
94

DJMichael5000Botts

Auto-chopper and screwer in Python
Python
3
star
95

UppercaseMaker

Part of a Python Tutorial
Python
3
star
96

aDose

Brain Entrainment for Android. (Legacy Code)
Java
3
star
97

CrowdMap

A project to geospatially map the IP address space of international telecommunication companies
Java
3
star
98

OnionRTC

Experiments in using WebRTC over Tor. Nothing to see here yet.
Python
3
star
99

Chrominance

MIDI Visualizer
Python
3
star
100

Crusher

Inline PNG Crushing
Shell
3
star