rebremer/devopsai_databricks

Stars
16
Rank 1,311,288 (Top 26 %)
Language
Python
Created almost 6 years ago
Updated over 3 years ago

rebremer/devopsai_databricks

rebremer

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

DevOps for AI project using Azure Databricks, Azure DevOps and Azure Machine Learning Service

azure-function-selenium

Azure Function running selenium webdriver using a custom docker image

azure-synapseserverless-python-rest-api

Creating a REST API with Python on Synapse Serverless pools using external tables

ms-identity-python-webapp-backend

Python web app using delegated permissions from signed-in user or application permissions to authenticate to backend. Backend can be Azure Function or SQLDB.

blog-datapipeline-cicd

Data pipeline project using Data Factory, Databricks and Cosmosdb Graph, deployed using Azure DevOps, secured using firewalls and Azure AD

realtime_video_processing

Realtime video processing project using IoT Hub, Azure Functions, Cognitive Services and Power BI

adfv2_cdm_metadata

Azure Data Factory (ADFv2) copy pipeline adding metadata using Common Data Model (CDM) structure

blog-adfv2unittest-git

Data Factory unit test using Azure DevOps. ARM is used to deploy ADFv2, BACPAC SQLDB to standardize input/output data and pytest to run tests

expose-deltatable-via-restapi

azure_function_mi_sqldb

Project to secure Azure Functions with Azure AD, Key Vault and VNETs. Then connect to Azure SQL using firewall rules and Managed Identity of Function.

azure-functions-datalake-recovery-pitr

Scalable point-in-time recovery solution for an ADLSgen2 account with hierarchical namespace enabled using Azure Durable Functions

databricks-mlflow-azureml-moe-vnet

Develop models in Databricks, use MLFlow to register models in AzureML with public access disabled, deploy models as private managed online endpoints

Jupyter Notebook

blog-snapshotbackup-azuredatalake

Datalake snapshots and incremental backups to different storage account

data-factory-managed-identity-connection-aws-s3

Repository that uses ADF MI to connect to AWS S3 without need of storing credentials in key vault

blog-databrickshubspoke-git

Private link connectivity of 1 central ADLSgen2 account to multiple decentral Databricks workspaces

blog-sqldbalwaysencrypted-git

Azure DevOps yml pipeline that deploys a dacpac to a SQLDB using always encrypted

Rich Text Format

managed_identity_authentication

Authentication from Azure Data Factory to Azure Function using Managed Identity

python_swiss_army_knife

python_swiss_army_knife

Jupyter Notebook

pareto-distribution-calculator

Hobby statistics Python project that computes expected value E[x], variation Var[x] and kurtosis Kur[x] of fat tailed Pareto distribution

application-gateway-aadauth

How to set up an Application Gateway in front of Web App that has Azure AD authentication enabled

azure-miscellaneous-scripts

Miscellaneous scripts to get things done on azure

Jupyter Notebook

azure-functions-scrapy

Azure Functions in Python that uses Scrapy to crawl websites

blog-mlopsapim-git

Jupyter Notebook

sqlmi_linkedserver_synapse_sqldb

PowerShell script that creates linked server in SQLMI. Linked server can either point to Synapse on demand or SQLDB

databricks_aad_token

Azure Databricks client script in Python using Service Principals