• Stars
    star
    170
  • Rank 216,475 (Top 5 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created about 9 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A tool to install, configure and manage Presto installations

presto-admin Build Status

presto-admin installs, configures, and manages Presto installations.

Comprehensive documentation can be found here.

Requirements

  1. Python 2.6 or 2.7
  2. Docker. (Only required for development, if you want to run the system tests)
    • If you DO NOT have Docker already installed, you can run the install-docker.sh script in the bin directory of this project. That script has only been tested on Ubuntu 14.04.

    • If you have Docker already installed, you need to make sure that your user has been added to the docker group. This will enable you to run commands without sudo, which is a requirement for some of the unit tests. To enable sudoless docker access run the following:

        $ sudo groupadd docker
        $ sudo gpasswd -a ${USER} docker
        $ sudo service docker restart
      

      If the user you added to the docker group is the same one you're logged in as, you will need to log out and back in so that the changes can take effect.

Building

Presto-admin makes use of make as its build tool. make in turn calls out to various utilities (e.g. tox, flake8, sphinx-apidoc, python) in order to perform the requested actions.

In order to get started with presto-admin,

  1. Fork the presto-admin repo on GitHub, https://github.com/prestodb/presto-admin.

  2. Clone your fork locally ::

     $ git clone [email protected]:your_name_here/presto-admin.git
    
  3. Install your local copy into a virtualenv. Assuming you have virtualenvwrapper installed, this is how you set up your fork for local development ::

     $ mkvirtualenv prestoadmin
     $ cd prestoadmin/
     $ python setup.py develop
    
  4. Create a branch for local development ::

     $ git checkout -b name-of-your-bugfix-or-feature
    

    Now you can make your changes locally.

  5. When you're done making changes, check that your changes pass make clean lint test, which runs flake8 and the unit tests (which test both Python 2.6 and 2.7). To run the product tests tests (make test-all), you need docker installed. You may also need to run pip install wheel in your virtualenv. To install and start docker use ::

     $ wget -qO- https://get.docker.com/ | sh
    
     # Add current user to Docker group to run without sudo
     $ sudo gpasswd -a ${USER} docker
     $ sudo service docker restart
    

Building the installer

The two tasks used to build the presto-admin installer are dist and dist-offline. The dist task builds an installer that requires internet connectivity during installation. The dist-offline task builds an installer that does not require internet connectivity during installation. Instead the offline installer downloads all dependencies at build time and points pip to those dependencies during installation.

License

Free software: Apache License Version 2.0 (APLv2).

More Repositories

1

presto

The official home of the Presto distributed SQL query engine for big data
Java
15,571
star
2

presto-python-client

Python DB-API client for Presto
Python
233
star
3

presto-go-client

A Presto client for the Go programming language.
Go
223
star
4

RPresto

DBI-based adapter for Presto for the statistical programming language R.
R
129
star
5

tempto

A testing framework for Presto
Java
61
star
6

presto-yarn

Java
57
star
7

f8-2019-demo

A tutorial on how to get started with Presto.
Jupyter Notebook
56
star
8

ambari-presto-service

Ambari service for Presto
Python
44
star
9

docker-images

Docker images for Presto integration testing
Dockerfile
35
star
10

presto-kubernetes-operator

Go
31
star
11

benchto

Framework for running macro benchmarks in a clustered environment
JavaScript
23
star
12

presto-hive-apache

Shaded version of Apache Hive for Presto
Java
19
star
13

presto-jdbc-java6

Presto JDBC driver compatible with Java 6
Java
18
star
14

prestorials

Tutorials and examples of how to deploy Presto and connect it to different data sources
14
star
15

presto-hadoop-apache2

Shaded version of Apache Hadoop 2.x for Presto
Java
13
star
16

presto-query-predictor

A query predictor pipeline and service to predict resource usages of Presto queries
Python
13
star
17

presto-landscape

Presto Landscape
10
star
18

sql

A Modern SQL frontend based on SQL16 with extensions for streaming, graph, rich types, etc, including parser, resolver, rewriters, etc.
Java
10
star
19

presto-js-client

Monorepo for Presto JavaScript packages
TypeScript
9
star
20

presto-helm-charts

Presto Helm Charts
8
star
21

presto-hadoop-cdh4

Shaded version of CDH4 Hadoop for Presto
Java
7
star
22

prestodb.github.io

Presto website
6
star
23

tsc

Presto Foundation TSC
6
star
24

presto-maven-plugin

Maven packaging and lifecycle for Presto plugins
Java
6
star
25

orc-protobuf

Compiled ORC protobuf definitions
4
star
26

foundation

Presto Foundation
3
star
27

presto-hive-jdbc

Shaded version of Apache Hive JDBC driver for Presto
3
star
28

presto-hadoop-apache1

Shaded version of Apache Hadoop 1.x for Presto
Java
3
star
29

presto-release-tools

Standard utilities to release Presto
Java
2
star
30

testing-mysql-server

Embedded MySQL server for use in tests
Java
1
star
31

artwork

Presto artwork assets. Please adhere to the Linux Foundation trademark policy.
1
star
32

presto-hive-dwrf

Presto Hive DWRF
Java
1
star
33

presto-cassandra-driver

Shaded version of DataStax Java Driver for Apache Cassandra
Java
1
star