• Stars
    star
    210
  • Rank 187,585 (Top 4 %)
  • Language
    Python
  • License
    MIT License
  • Created over 4 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Ready to run docker-compose configuration for ML Flow with Mysql and Minio S3

MLFlow Docker Setup Actions Status

If you want to boot up mlflow project with one-liner - this repo is for you. The only requirement is docker installed on your system and we are going to use Bash on linux/windows.

πŸš€ 1-2-3! Setup guide

  1. Configure .env file for your choice. You can put there anything you like, it will be used to configure you services
  2. Run docker compose up
  3. Open up http://localhost:5000 for MlFlow, and http://localhost:9001/ to browse your files in S3 artifact store

πŸ‘‡Video tutorial how to set it up + BONUS with Microsoft Azure πŸ‘‡

Youtube tutorial

Features

  • One file setup (.env)
  • Minio S3 artifact store with GUI
  • MySql mlflow storage
  • Ready to use bash scripts for python development!
  • Automatically-created s3 buckets

How to use in ML development in python

Click to show
  1. Configure your client-side

For running mlflow files you need various environment variables set on the client side. To generate them user the convienience script ./bashrc_install.sh, which installs it on your system or ./bashrc_generate.sh, which just displays the config to copy & paste.

$ ./bashrc_install.sh
[ OK ] Successfully installed environment variables into your .bashrc!

The script installs this variables: AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, MLFLOW_S3_ENDPOINT_URL, MLFLOW_TRACKING_URI. All of them are needed to use mlflow from the client-side.

  1. Test the pipeline with below command with conda. If you dont have conda installed run with --no-conda
mlflow run [email protected]:databricks/mlflow-example.git -P alpha=0.5
# or
python ./quickstart/mlflow_tracking.py
  1. (Optional) If you are constantly switching your environment you can use this environment variable syntax
MLFLOW_S3_ENDPOINT_URL=http://localhost:9000 MLFLOW_TRACKING_URI=http://localhost:5000 mlflow run [email protected]:databricks/mlflow-example.git -P alpha=0.5

Licensing

Copyright (c) 2021 Tomasz DΕ‚uski

Licensed under the MIT License (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License by reviewing the file LICENSE in the repository.

More Repositories

1

daily-status

Windows App that shows your current over/under time at work (ignores holidays). Depends on a free toggl account
C#
3
star
2

git-workshop

Tutorial do korzystania z gita zrobiony na potrzeby data science pg
Python
3
star
3

zen-aware

Software intended to collect mood data throughout the month and make your aware of the trends in your head.
Java
2
star
4

webcon-wrapper

.NET Standard tested library to simplify usage of Webcon Api (2018 - they have still 8.2 version of the api)
C#
2
star
5

react-bank

Application that will enable you to get more free money from bank's promotions
JavaScript
2
star
6

ruuster

Rusty Guys Project. RabbitMQ killer 🐰πŸ’₯πŸ”«
Rust
2
star
7

bird-alert

1
star
8

spfx-office-fabric

Simple demo of sharepoint spfx webpart using office fabric ui (the default install isnt working)
TypeScript
1
star
9

react-todo-aspnetcore

My own kubernetes app (front, back, database) for demo pourposes
JavaScript
1
star
10

mevo-apiproxy

Program used to collect data from 3city bikes rental application
C#
1
star
11

vault-demo

This demo shows how easy it is to setup vault container with dotnet core application to use for development
C#
1
star
12

rabbitmq-demo

RabbitMq and SignalR connection demo
C#
1
star
13

win-remote-tool

C#
1
star
14

2d-color-game

Simple 2d game with various enemies created just for fun
Java
1
star
15

webpush-demo

Simple demo showing an implementation sample of web-push with nodejs
JavaScript
1
star
16

vat-white-list

Azure blob trigger that checks if a given company is a valid vat payer or not
C#
1
star
17

chrome-manifest-v3-webpack-hotreload-template-example

JavaScript
1
star
18

traficar-query

Traficar is an amazing carsharing company in Poland. Recently they introduced electric cars Renault ZOE, and everybody needs to ride this one. This app will help you find it
JavaScript
1
star
19

hearty

Hearty is an app for lovers. It tells the significant other, that you think about her/him.
HTML
1
star