aws-samples/emr-bootstrap-actions

Stars
612
Rank 73,287 (Top 2 %)
Language
Shell
License
Other
Created about 11 years ago
Updated over 1 year ago

aws-samples/emr-bootstrap-actions

aws-samples

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

This repository hold the Amazon Elastic MapReduce sample bootstrap actions

EMR bootstrap actions

Warning: This repository is undergoing updating and modernization – please bear with us.

A bootstrap action is a shell script stored in Amazon S3 that Amazon EMR executes on every node of your cluster after boot and prior to application provisioning. Bootstrap actions execute as the hadoop user by default; commands can be executed with root privileges if you use sudo.

From the AWS CLI EMR create-cluster command you can reference a bootstrap action as follows:

--bootstrap-actions Name=action-name,Path=s3://myawsbucket/FileName,Args=arg1,arg2

For more information about EMR Bootstrap actions see DeveloperGuide

The code samples in this repository are meant to illustrate how to setup popular applications on Amazon EMR using bootstrap actions. They are not meant to be run in production and all users should carefully inspect code samples before running them.

Use at your own risk.

aws-cdk-examples

Example projects using the AWS CDK

aws-serverless-workshops

Code and walkthrough labs to set up serverless applications for Wild Rydes workshops

aws-workshop-for-kubernetes

AWS Workshop for Kubernetes

aws-machine-learning-university-accelerated-nlp

Machine Learning University: Accelerated Natural Language Processing Class

Jupyter Notebook

aws-serverless-airline-booking

Airline Booking is a sample web application that provides Flight Search, Flight Payment, Flight Booking and Loyalty points including end-to-end testing, GraphQL and CI/CD. This web application was the theme of Build on Serverless Season 2 on AWS Twitch running from April 24th until end of August in 2019.

ecs-refarch-cloudformation

A reference architecture for deploying containerized microservices with Amazon ECS and AWS CloudFormation (YAML)

lambda-refarch-webapp

The Web Application reference architecture is a general-purpose, event-driven, web application back-end that uses AWS Lambda, Amazon API Gateway for its business logic. It also uses Amazon DynamoDB as its database and Amazon Cognito for user management. All static content is hosted using AWS Amplify Console.

serverless-patterns

Serverless patterns. Learn more at the website: https://serverlessland.com/patterns.

aws-modern-application-workshop

A tutorial for developers that want to learn about how to build modern applications on top of AWS. You will build a sample website that leverages infrastructure as code, containers, serverless code functions, CI/CD, and more.

amazon-bedrock-workshop

This is a workshop designed for Amazon Bedrock a foundational model service.

Jupyter Notebook

aws-machine-learning-university-accelerated-cv

Machine Learning University: Accelerated Computer Vision Class

Jupyter Notebook

aws-glue-samples

AWS Glue code samples

aws-deepracer-workshops

DeepRacer workshop content

Jupyter Notebook

aws-genai-llm-chatbot

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

aws-refarch-wordpress

This reference architecture provides best practices and a set of YAML CloudFormation templates for deploying WordPress on AWS.

aws-machine-learning-university-accelerated-tab

Machine Learning University: Accelerated Tabular Data Class

Jupyter Notebook

aws-serverless-ecommerce-platform

Serverless Ecommerce Platform is a sample implementation of a serverless backend for an e-commerce website. This sample is not meant to be used as an e-commerce platform as-is, but as an inspiration on how to build event-driven serverless microservices on AWS.

aws-big-data-blog

machine-learning-samples

Sample applications built using AWS' Amazon Machine Learning.

eks-workshop

AWS Workshop for Learning EKS

startup-kit-templates

CloudFormation templates to accelerate getting started on AWS.

aws-incident-response-playbooks

aws-security-reference-architecture-examples

Example solutions demonstrating how to implement patterns within the AWS Security Reference Architecture guide using CloudFormation and Customizations for AWS Control Tower.

retail-demo-store

AWS Retail Demo Store is a sample retail web application and workshop platform demonstrating how AWS infrastructure and services can be used to build compelling customer experiences for eCommerce, retail, and digital marketing use-cases

Jupyter Notebook

lambda-refarch-imagerecognition

The Image Recognition and Processing Backend reference architecture demonstrates how to use AWS Step Functions to orchestrate a serverless processing workflow using AWS Lambda, Amazon S3, Amazon DynamoDB and Amazon Rekognition.

aws-secure-environment-accelerator

The AWS Secure Environment Accelerator is a tool designed to help deploy and operate secure multi-account, multi-region AWS environments on an ongoing basis. The power of the solution is the configuration file which enables the completely automated deployment of customizable architectures within AWS without changing a single line of code.

simple-websockets-chat-app

This SAM application provides the Lambda functions, DynamoDB table, and roles to allow you to build a simple chat application based on API Gateway's new WebSocket-based API feature.

aws-codedeploy-samples

Samples and template scenarios for AWS CodeDeploy

aws-bookstore-demo-app

AWS Bookstore Demo App is a full-stack sample web application that creates a storefront (and backend) for customers to shop for fictitious books. The entire application can be created with a single template. Built on AWS Full-Stack Template.

generative-ai-use-cases-jp

すぐに業務活用できるビジネスユースケース集付きの安全な生成AIアプリ実装

aws-lex-web-ui

Sample Amazon Lex chat bot web interface

hardeneks

Runs checks to see if an EKS cluster follows EKS Best Practices.

lambda-refarch-mobilebackend

Serverless Reference Architecture for creating a Mobile Backend

amazon-personalize-samples

Notebooks and examples on how to onboard and use various features of Amazon Personalize

Jupyter Notebook

aws-serverless-workshop-innovator-island

Welcome to the Innovator Island serverless workshop! This repo contains all the instructions and code you need to complete the workshop.

kubernetes-for-java-developers

A Day in Java Developer’s Life, with a taste of Kubernetes

aws-iot-chat-example

💬 Chat application using AWS IoT platform via MQTT over the WebSocket protocol

aws-dynamodb-examples

DynamoDB Examples

aws-amplify-graphql

Sample using AWS Amplify and AWS AppSync together for user login and authorization when making GraphQL queries and mutations. Also includes complex objects for uploading and downloading data to and from S3 with a React app.

aws-mobile-appsync-chat-starter-angular

GraphQL starter progressive web application (PWA) with Realtime and Offline functionality using AWS AppSync

aws-serverless-security-workshop

In this workshop, you will learn techniques to secure a serverless application built with AWS Lambda, Amazon API Gateway and RDS Aurora. We will cover AWS services and features you can leverage to improve the security of a serverless applications in 5 domains: identity & access management, code, data, infrastructure, logging & monitoring.

amazon-forecast-samples

Notebooks and examples on how to onboard and use various features of Amazon Forecast.

Jupyter Notebook

lambda-refarch-fileprocessing

Serverless Reference Architecture for Real-time File Processing

ecs-blue-green-deployment

Reference architecture for doing blue green deployments on ECS.

cloudfront-authorization-at-edge

Protect downloads of your content hosted on CloudFront with Cognito authentication using cookies and Lambda@Edge

aws-service-catalog-reference-architectures

Sample CloudFormation templates and architecture for AWS Service Catalog

amazon-bedrock-samples

This repository contains examples for customers to get started using the Amazon Bedrock Service. This contains examples for all available foundational models

Jupyter Notebook

siem-on-amazon-opensearch-service

A solution for collecting, correlating and visualizing multiple types of logs to help investigate security incidents.

aws-microservices-deploy-options

This repo contains a simple application that consists of three microservices. Each application is deployed using different Compute options on AWS.

aws-cost-explorer-report

Python SAM Lambda module for generating an Excel cost report with graphs, including month on month cost changes. Uses the AWS Cost Explorer API for data.

aws-security-workshops

A collection of the latest AWS Security workshops

Jupyter Notebook

aws-sam-java-rest

A sample REST application built on SAM and DynamoDB that demonstrates testing with DynamoDB Local.

amazon-elasticsearch-lambda-samples

Data ingestion for Amazon Elasticsearch Service from S3 and Amazon Kinesis, using AWS Lambda: Sample code

amazon-textract-textractor

Analyze documents with Amazon Textract and generate output in multiple formats.

Jupyter Notebook

amazon-cloudfront-functions

aws-saas-factory-bootcamp

SaaS on AWS Bootcamp - Building SaaS Solutions on AWS

aws-lambda-extensions

A collection of sample extensions to help you get started with AWS Lambda Extensions

amazon-sagemaker-notebook-instance-lifecycle-config-samples

A collection of sample scripts to customize Amazon SageMaker Notebook Instances using Lifecycle Configurations

non-profit-blockchain

Builds a blockchain network and application to track donations to non-profit organizations, using Amazon Managed Blockchain

amazon-textract-code-samples

Amazon Textract Code Samples

Jupyter Notebook

amazon-neptune-samples

Samples and documentation for using the Amazon Neptune graph database service

lambda-refarch-streamprocessing

Serverless Reference Architecture for Real-time Stream Processing

amazon-ecs-java-microservices

This is a reference architecture for java microservice on Amazon ECS

sessions-with-aws-sam

This repo contains all the SAM templates created in the Twitch series #SessionsWithSAM. The show is every Thursday on Twitch at 10 AM PDT.

amazon-rekognition-video-analyzer

A working prototype for capturing frames off of a live MJPEG video stream, identifying objects in near real-time using deep learning, and triggering actions based on an objects watch list.

aws-eks-accelerator-for-terraform

The AWS EKS Accelerator for Terraform is a framework designed to help deploy and operate secure multi-account, multi-region AWS environments. The power of the solution is the configuration file which enables the users to provide a unique terraform state for each cluster and manage multiple clusters from one repository. This code base allows users to deploy EKS add-ons using Helm charts.

aws-deepcomposer-samples

Jupyter Notebook

amazon-ecs-mythicalmysfits-workshop

A tutorial for developers who want to learn about how to containerized applications on top of AWS using AWS Fargate. You will build a sample website that leverages infrastructure as code, containers, CI/CD, and more! If you're planning on running this, let us know @ [email protected]. At re:Invent 2018, these sessions were run as CON214/CON321/CON322.

aws-iot-examples

Examples using AWS IoT (Internet of Things). Deprecated. See README for updated guidance.

aws-media-services-simple-vod-workflow

Lab that covers video conversion workflow for Video On Demand using AWS MediaConvert.

php-examples-for-aws-lambda

Demo serverless applications, examples code snippets and resources for PHP

aws-serverless-cicd-workshop

Learn how to build a CI/CD pipeline for SAM-based applications

create-react-app-auth-amplify

Implements a basic authentication flow for signing up/signing in users as well as protected client side routing using AWS Amplify.

api-gateway-secure-pet-store

Amazon API Gateway sample using Amazon Cognito credentials through AWS Lambda

aws-etl-orchestrator

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

amazon-textract-serverless-large-scale-document-processing

Process documents at scale using Amazon Textract

lambda-go-samples

An example of using AWS Lambda with Go

amazon-cloudfront-secure-static-site

Create a secure static website with CloudFront for your registered domain.

amazon-ecs-firelens-examples

Sample logging architectures for FireLens on Amazon ECS and AWS Fargate.

aws-nodejs-sample

Sample project to demonstrate usage of the AWS SDK for Node.js

aws-cognito-apigw-angular-auth

A simple/sample AngularV4-based web app that demonstrates different API authentication options using Amazon Cognito and API Gateway with an AWS Lambda and Amazon DynamoDB backend that stores user details in a complete end to end Serverless fashion.

lambda-ecs-worker-pattern

This example code illustrates how to extend AWS Lambda functionality using Amazon SQS and the Amazon EC2 Container Service (ECS).

aws-lambda-fanout

A sample AWS Lambda function that accepts messages from an Amazon Kinesis Stream and transfers the messages to another data transport.

aws-saas-factory-ref-solution-serverless-saas

aws-mlu-explain

Visual, Interactive Articles About Machine Learning: https://mlu-explain.github.io/

aws-serverless-shopping-cart

Serverless Shopping Cart is a sample implementation of a serverless shopping cart for an e-commerce website.

aws-serverless-samfarm

This repo is full CI/CD Serverless example which was used in the What's New with AWS Lambda presentation at Re:Invent 2016.

eb-node-express-sample

Sample Express application for AWS Elastic Beanstalk

eb-py-flask-signup

codepipeline-nested-cfn

CloudFormation templates, CodeBuild build specification & Python scripts to perform unit tests of a nested CloudFormation template.

aws-amplify-auth-starters

Starter projects for developers looking to build web & mobile applications that have Authentication & protected routing

aws-containers-task-definitions

Task Definitions for running common applications Amazon ECS

aws-proton-cloudformation-sample-templates

Sample templates for AWS Proton

aws2tf

aws2tf - automates the importing of existing AWS resources into Terraform and outputs the Terraform HCL code.

aws-cdk-changelogs-demo

This is a demo application that uses modern serverless architecture to crawl changelogs from open source projects, parse them, and provide an API and website for viewing them.

designing-cloud-native-microservices-on-aws

Introduce a fluent way to design cloud native microservices via EventStorming workshop, this is a hands-on workshop. Contains such topics: DDD, Event storming, Specification by example. Including the AWS product : Serverless Lambda , DynamoDB, Fargate, CloudWatch.

aws-secrets-manager-rotation-lambdas

Contains Lambda functions to be used for automatic rotation of secrets stored in AWS Secrets Manager

lambda-refarch-iotbackend

Serverless Reference Architecture for creating an IoT Backend

aws-health-aware

AHA is an incident management & communication framework to provide real-time alert customers when there are active AWS event(s). For customers with AWS Organizations, customers can get aggregated active account level events of all the accounts in the Organization. Customers not using AWS Organizations still benefit alerting at the account level.

Intelli-Agent

Chatbot Portal with Agent: Streamlined Workflow for Building Agent-Based Applications