turbot/steampipe turbot/steampipe

  • Stars
    star
    4,660
  • Rank 8,605 (Top 0.2 %)
  • Language
    Go
  • License
    GNU Affero Genera...
  • Created over 3 years ago
  • Updated about 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
turbot/steampipe
github

turbot

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Use SQL to instantly query your cloud services (AWS, Azure, GCP and more). Open source CLI. No DB required.

Steampipe Logo

plugins   benchmarks   dashboards   slack   maintained by

Steampipe is the universal interface to APIs. Use SQL to query cloud infrastructure, SaaS, code, logs, and more.

With Steampipe you can:

Steampipe CLI: The SQL console for API queries

The Steampipe community has grown a suite of plugins that map APIs to tables.

Cloud AWS, Alibaba, Azure, GCP, IBM, Oracle …
SaaS Airtable, Jira, GitHub, Google Workspace, Microsoft 365, Salesforce, Slack, Stripe, Zoom …
Security CrowdStrike, GitGuardian, Have I Been Pwned, PAN-OS, Shodan, Trivy, VirusTotal …
Identity Azure AD, Duo, Keycloak, Google Directory, LDAP …
DevOps Docker, Grafana, Kubernetes, Prometheus …
Net Baleen, Cloudflare, crt.sh, Gandi, IMAP, ipstack, Tailscale, updown.io, WHOIS …
IaC CloudFormation, Terraform …
Logs Algolia, AWS CloudWatch, Datadog, Splunk …
Social HackerNews, Twitter, Reddit, RSS …
Your API Build your own custom plugins

The interactive query shell is one way you can query those tables.

You can also use psql, pgcli, Metabase, Tableau, or any client that can connect to Postgres.

Get started with the CLI

Install Steampipe

The downloads page shows you how but tl;dr:

Linux or WSL

sudo /bin/sh -c "$(curl -fsSL https://raw.githubusercontent.com/turbot/steampipe/main/install.sh)"

MacOS

brew tap turbot/tap
brew install steampipe
Add a plugin

Choose a plugin from the hub, for example: Net.

Run the steampipe plugin command to install it.

steampipe plugin install net
Run steampipe query
Launch the interactive shell. 
steampipe query

Run your first query!

select
  *
from
  net_certificate
where
  domain = 'google.com';
Learn more about the CLI
Build and develop the CLI

Prerequisites:

  • Golang Version 1.19 or higher.

Clone:

git clone [email protected]:turbot/steampipe
cd steampipe

Build, which automatically installs the new version to your /usr/local/bin/steampipe directory:

make

Check the verison

$ steampipe -v
steampipe version 0.18.1

Install a plugin

$ steampipe plugin install steampipe

Try it!

steampipe query
> .inspect steampipe
+-----------------------------------+-----------------------------------+
| TABLE                             | DESCRIPTION                       |
+-----------------------------------+-----------------------------------+
| steampipe_registry_plugin         | Steampipe Registry Plugins        |
| steampipe_registry_plugin_version | Steampipe Registry Plugin Version |
+-----------------------------------+-----------------------------------+

> select * from steampipe_registry_plugin;

Steampipe Mods: Dashboards and benchmarks

The Steampipe community has also grown a suite of mods which are sets of dashboards that visualize your resources and benchmarks that check your cloud resources for compliance.

Compliance Check AWS, Azure, GCP, etc for compliance with HIPAA, PCI, etc
Cost Review what AWS, Azure, GCP, and other clouds are costing you
Insights Visualize cloud resources with charts, tables, and interactive widgets
Security Use CIS, NIST, FedRAMP etc to assess the security of AWS, Azure, GCP, etc
Tags Verify the consistency of tags applied to AWS, Azure, and GCP resources
Your mod Build your own benchmarks and dashboards

Running dashboards and benchmarks

benchmarks-and-dashboards

Dashboards and benchmarks use SQL to gather data and HCL to flow the data into dashboard widgets and benchmark controls. You can use the existing suites of benchmarks and dashboards, or build derivative versions, or create your own.

Get started with dashboards and benchmarks

Install the Net Insights mod
The Net Insights mod works with the Net plugin shown above. To run it, first clone its repo and change to that directory. 
git clone https://github.com/turbot/steampipe-mod-net-insights
cd steampipe-mod-net-insights

Run benchmarks in the CLI

All the benchmarks:

steampipe check all

A single benchmark:

steampipe check benchmark.dns_best_practices

A single control:

steampipe check control.dns_ns_name_valid

Available formats include JSON, CSV, HTML, and ASFF. You can use custom output templates to create new output formats.

Run benchmarks as dashboards
Launch the dashboard server: `steampipe dashboard`, then open `http://localhost:9194` in your browser.

The home page lists available dashboards. Click DNS Best Practices to view that dashboard.

Note that the default domains are microsoft.com and github.com. You can change those defaults to check other domains.

Use dashboards to explore your resources
Dashboards use charts, tables, and interactive widgets to help you explore and visualize your resources.

The AWS Insights mod, for example, provides dozens of dashboards that exercise the full set of widgets. To use these dashboards, first install the AWS plugin and authenticate. Then clone AWS Insights, change to its directory, launch steampipe dashboard, and open localhost:9194.

Community

We thrive on feedback and community involvement!

Have a question? → Join our Slack community or open a GitHub issue.

Want to get involved? → Learn how to contribute.

Want to work with the team? → We are hiring!

Steampipe Cloud

Want a hosted version of Steampipe? Bring your team to Steampipe Cloud.

More Repositories

1

steampipe-mod-aws-compliance

Run individual controls or full compliance benchmarks for CIS, PCI, NIST, HIPAA and more across all of your AWS accounts using Steampipe.
HCL
278
star
2

flowpipe

Flowpipe is a cloud scripting engine. Automation and workflow to connect your clouds to the people, systems and data that matters.
Go
262
star
3

steampipe-plugin-aws

Use SQL to instantly query AWS resources across regions and accounts. Open source CLI. No DB required.
Go
128
star
4

steampipe-mod-aws-perimeter

Is your AWS perimeter secure? Use Powerpipe and Steampipe to check your AWS accounts for public resources, resources shared with untrusted accounts, insecure network configurations and more.
HCL
105
star
5

steampipe-mod-aws-insights

View dashboards and reports across all of your AWS accounts using Steampipe.
HCL
80
star
6

powerpipe

Powerpipe: Dashboards for DevOps. Visualize cloud configurations. Assess security posture against a massive library of benchmarks. Build custom dashboards with code.
TypeScript
69
star
7

steampipe-mod-aws-thrifty

Are you a Thrifty AWS dev? This Steampipe mod checks your AWS accounts for unused and under-utilized resources.
HCL
64
star
8

steampipe-mod-zoom-compliance

Run individual configuration, compliance and security controls or full compliance benchmarks for CIS for Zoom.
HCL
61
star
9

steampipe-plugin-github

Use SQL to instantly query repositories, users, gists and more from GitHub. Open source CLI. No DB required.
Go
43
star
10

steampipe-sqlite

Steampipe SQLite is a zero-ETL engine for SQLite. Virtual tables translate queries into live API calls for cloud services and APIs. Hundreds of plugins with thousands of documented examples.
Go
41
star
11

steampipe-postgres-fdw

Postgres FDW for Steampipe
Go
40
star
12

steampipe-mod-azure-compliance

Run individual configuration, compliance and security controls or full compliance benchmarks for CIS, HIPAA HITRUST, NIST, and more across all of your Azure subscriptions using Steampipe.
HCL
39
star
13

steampipe-samples

Examples, samples, snippets and scripts to use with Steampipe.
HCL
38
star
14

steampipe-mod-github-sherlock

Interrogate your GitHub resources with the help of the world's greatest detectives: Steampipe + Sherlock.
HCL
34
star
15

steampipe-plugin-kubernetes

Use SQL to instantly query Kubernetes API resources. Open source CLI. No DB required.
Go
31
star
16

steampipe-plugin-gcp

Use SQL to instantly query GCP resources across regions, projects and organizations. Open source CLI. No DB required.
Go
28
star
17

steampipe-plugin-azure

Use SQL to instantly query Azure resources across regions and subscriptions. Open source CLI. No DB required.
Go
25
star
18

steampipe-plugin-shodan

Use SQL to instantly query host, DNS and exploit information using Shodan. Open source CLI. No DB required.
Go
24
star
19

steampipe-mod-kubernetes-insights

View dashboards and reports across all of your Kubernetes clusters using Steampipe.
HCL
24
star
20

steampipe-mod-gcp-compliance

Run individual configuration, compliance and security controls or full compliance benchmarks for CIS across all of your GCP projects using Steampipe.
HCL
24
star
21

steampipe-mod-kubernetes-compliance

Run individual controls or full compliance benchmarks for NSA CISA Kubernetes Hardening Guidance across all of your Kubernetes clusters using Steampipe.
HCL
23
star
22

steampipe-plugin-virustotal

Use SQL to instantly query file, domain, URL and IP scanning results from VirusTotal.
Go
21
star
23

guardrails-samples

Provides teams using Turbot Guardrails automation and configuration-as-code examples for effective management of Guardrails for their organization.
Python
21
star
24

steampipe-plugin-terraform

Use SQL to instantly query resources, data sources and more from Terraform code. Open source CLI. No DB required.
Go
20
star
25

steampipe-plugin-sdk

Steampipe Plugin SDK provides a simple abstraction layer for all Steampipe Plugins
Go
19
star
26

steampipe-plugin-oci

Use SQL to instantly query Oracle Cloud resources across regions and accounts. Open source CLI. No DB required.
Go
17
star
27

steampipe-mod-terraform-aws-compliance

Run compliance and security controls to detect Terraform AWS resources deviating from security best practices prior to deployment.
HCL
17
star
28

steampipe-plugin-stripe

Use SQL to instantly query customers, products, invoices and more from Stripe. Open source CLI. No DB required.
Go
16
star
29

steampipe-mod-microsoft365-compliance

Run individual controls or full compliance benchmarks for CIS across all of your Microsoft 365 and Office 365 tenants using Powerpipe and Steampipe.
HCL
16
star
30

steampipe-plugin-reddit

Use SQL to instantly query Reddit posts, comments & more. Open source CLI. No DB required.
Go
15
star
31

steampipe-plugin-jira

Use SQL to instantly query Jira. Open source CLI. No DB required.
Go
14
star
32

steampipe-plugin-prometheus

Use SQL to instantly query Prometheus metrics, alerts, labels and more. Open source CLI. No DB required.
Go
14
star
33

steampipe-plugin-whois

Use SQL to instantly query WHOIS. Open source CLI. No DB required.
Go
14
star
34

steampipe-plugin-net

Use SQL to instantly query DNS records, certificates and other network information. Open source CLI. No DB required.
Go
14
star
35

steampipe-plugin-mastodon

Use SQL to instantly query Mastodon resources. Open source CLI. No DB required.
Go
13
star
36

steampipe-plugin-code

Use SQL to instantly query secrets and more from source code. Open source CLI. No DB required.
Go
13
star
37

flowpipe-samples

Flowpipe sample mods, demonstrating common pipeline patterns and how to use the Flowpipe library mods. Run directly or use as examples for your own pipelines.
HCL
13
star
38

steampipe-plugin-datadog

Use SQL to instantly query Datadog resources across accounts. Open source CLI. No DB required.
Go
12
star
39

steampipe-mod-mastodon-insights

View dashboards and reports across your Mastodon resources using Steampipe.
HCL
11
star
40

steampipe-plugin-linkedin

Use SQL to instantly query LinkedIn for profiles, companies, connections & more. Open source CLI. No DB required.
Go
11
star
41

steampipe-plugin-csv

Use SQL to query data from CSV files. Open source CLI. No DB required.
Go
11
star
42

steampipe-plugin-scaleway

Use SQL to instantly query instances, networks, databases, and more from Scaleway. Open source CLI. No DB required.
Go
11
star
43

steampipe-plugin-hackernews

Use SQL to instantly query stories, users and other items from Hacker News. Open source CLI. No DB required.
Go
10
star
44

steampipe-plugin-slack

Use SQL to instantly query users, channels, emoji and more from your Slack workspace. Open source CLI. No DB required.
Go
10
star
45

steampipe-action-setup

Set up your GitHub Actions workflow with Steampipe and plugin connections
JavaScript
10
star
46

steampipe-plugin-googledirectory

Use SQL to instantly query users, groups, domains and more from Google Directory. Open source CLI. No DB required.
Go
9
star
47

steampipe-docs

Steampipe documentation content in markdown format. Automatically published to steampipe.io.
9
star
48

steampipe-mod-azure-thrifty

Are you a Thrifty Azure dev? This Steampipe mod checks your Azure subscription(s) for unused and under-utilized resources.
HCL
9
star
49

steampipe-plugin-ipstack

Use SQL to instantly query IP geolocation and more from ipstack. Open source CLI. No DB required.
Go
9
star
50

pipe-fittings

Shared components for use across pipe projects.
Go
9
star
51

steampipe-mod-aws-well-architected

Are AWS Well-Architected best practices being followed? Use Powerpipe and Steampipe to check if your AWS accounts are following best practices from each lens and pillar.
HCL
9
star
52

steampipe-plugin-alicloud

Use SQL to instantly query Alibaba Cloud resources across regions and accounts. Open source CLI. No DB required.
Go
9
star
53

steampipe-plugin-googleworkspace

Use SQL to instantly query calendar events, drive files, gmail messages, and more from Google Workspace. Open source CLI. No DB required.
Go
9
star
54

steampipe-plugin-digitalocean

Use SQL to instantly query droplets, VPCs, users and more from DigitalOcean. Open source CLI. No DB required.
Go
8
star
55

steampipe-plugin-trivy

Use SQL to instantly query advisories, vulnerabilities, packages, findings and more using Trivy. Open source CLI. No DB required.
Go
8
star
56

steampipe-mod-azure-insights

View dashboards and reports across all of your Azure subscriptions using Steampipe.
HCL
8
star
57

steampipe-plugin-zendesk

Use SQL to instantly query Zendesk. Open source CLI. No DB required.
Go
8
star
58

steampipe-plugin-turbot

Use SQL to instantly query the Turbot CMDB. Open source CLI. No DB required.
Go
8
star
59

steampipe-mod-gcp-insights

View dashboards and reports across all of your GCP projects using Steampipe.
HCL
8
star
60

steampipe-mod-github-compliance

Run individual controls or full compliance benchmarks for across all of your GitHub resources using Powerpipe and Steampipe.
HCL
8
star
61

steampipe-plugin-cloudflare

Use SQL to instantly query accounts, zones and more from Cloudflare. Open source CLI. No DB required.
Go
8
star
62

steampipe-mod-aws-tags

Is your AWS tagging strategy following best practice? This Steampipe mod checks if your AWS resource tags are set correctly to help you manage them effectively.
HCL
8
star
63

steampipe-plugin-twitter

Use SQL to instantly query tweets, users and followers from Twitter. Open source CLI. No DB required.
Go
8
star
64

steampipe-plugin-exec

Use SQL to instantly query & run shell commands on local & remote servers. Open source CLI. No DB required.
Go
8
star
65

steampipe-plugin-tfe

Use SQL to query workspaces, runs and more from Terraform Cloud/Enterprise. Open source CLI. No DB required.
Go
7
star
66

steampipe-plugin-azuread

Use SQL to instantly query groups, service principals, users and more from Azure Active Directory. Open source CLI. No DB required.
Go
7
star
67

steampipe-plugin-openai

Use SQL to instantly query OpenAI for completions, models & more. Open source CLI. No DB required.
Go
7
star
68

steampipe-plugin-steampipe

Use SQL to instantly query plugin metadata from the Steampipe Hub. Open source CLI. No DB required.
Go
7
star
69

steampipe-plugin-docker

Use SQL to instantly query Dockerfile commands and more from Docker. Open source CLI. No DB required.
Go
7
star
70

terraform-provider-turbot

Terraform Turbot provider
Go
7
star
71

steampipe-plugin-supabase

Use SQL to instantly query Supabase resources. Open source CLI. No DB required.
Go
7
star
72

steampipe-plugin-finance

Use SQL to instantly query financial data including quotes (equities, cryptocurrency, etc) and US public company information. Open source CLI. No DB required.
Go
7
star
73

steampipe-plugin-crowdstrike

Use SQL to instantly query CrowdStrike resources. Open source CLI. No DB required.
Go
7
star
74

steampipe-plugin-googlesheets

Use SQL to query spreadsheets, sheets, and cell data from Google Sheets. Open source CLI. No DB required.
Go
7
star
75

steampipe-mod-gcp-thrifty

Are you a Thrifty GCP dev? This Steampipe mod checks your GCP project(s) for unused and under-utilized resources.
HCL
7
star
76

steampipe-plugin-microsoft365

Use SQL to instantly query calendars, contacts, drives, mailboxes and more from Microsoft 365. Open source CLI. No DB required.
Go
6
star
77

steampipe-plugin-shopify

Use SQL to instantly query Shopify products, orders and more. Open source CLI. No DB required.
Go
6
star
78

homebrew-tap

Turbot's Homebrew Tap for distribution of Steampipe and other tools.
Ruby
6
star
79

steampipe-plugin-crtsh

Use SQL to instantly query crt.sh for certificates, log entries and more. Open source CLI. No DB required.
Go
6
star
80

steampipe-plugin-ibm

Use SQL to instantly query instances, networks, users and more from IBM Cloud. Open source CLI. No DB required.
Go
6
star
81

steampipe-plugin-rss

Use SQL to instantly query RSS channels and Atom Feeds. Open source CLI. No DB required.
Go
6
star
82

steampipe-plugin-chaos

Chaos Plugin for testing Steampipe with the craziest edge cases we can think of. Open source CLI. No DB required.
Go
6
star
83

steampipe-plugin-bitbucket

Use SQL to instantly query Bitbucket. Open source CLI. No DB required.
Go
6
star
84

steampipe-plugin-openapi

Use SQL to instantly query resources from OpenAPI. Open source CLI. No DB required.
Go
6
star
85

steampipe-plugin-linode

Use SQL to query instances, domains and more from Linode. Open source CLI. No DB required.
Go
6
star
86

steampipe-mod-alicloud-compliance

Run individual configuration, compliance and security controls or full compliance benchmarks for CIS across all of your Alibaba Cloud accounts using Steampipe.
HCL
6
star
87

steampipe-plugin-onepassword

Use SQL to instantly query 1Password vaults, items, files & more. Open source CLI. No DB required.
Go
6
star
88

steampipe-plugin-ldap

Use SQL to instantly query users, groups, OUs and more from LDAP. Open source CLI. No DB required.
Go
6
star
89

steampipe-action-check

Run Steampipe checks against your Infrastructure as Code, deployed infrastructure, and more
JavaScript
6
star
90

steampipe-plugin-okta

Use SQL to instantly query users, groups, applications and more from Okta. Open source CLI. No DB required.
Go
6
star
91

flowpipe-mod-aws

AWS pipeline library for the Flowpipe cloud scripting engine. Automation and workflows to connect AWS to the people, systems and data that matters.
HCL
6
star
92

steampipe-plugin-salesforce

Use SQL to instantly query Salesforce resources. Open source CLI. No DB required.
Go
5
star
93

steampipe-mod-oci-compliance

Run individual configuration, compliance and security controls or full compliance benchmarks for CIS across all of your Oracle Cloud Infrastructure accounts using Steampipe.
HCL
5
star
94

steampipe-plugin-grafana

Use SQL to instantly query dashboards, data sources, users and more from Grafana. Open source CLI. No DB required.
Go
5
star
95

guardrails-cli

Turbot Guardrails Command Line Interface (CLI)
Shell
5
star
96

steampipe-plugin-heroku

Use SQL to query apps, dynos and more from Heroku. Open source CLI. No DB required.
Go
5
star
97

steampipe-mod-digitalocean-thrifty

Are you a Thrifty DigitalOcean dev? This Steampipe mod checks your DigitalOcean account(s) for unused and under-utilized resources.
HCL
5
star
98

steampipe-plugin-abuseipdb

Use SQL to instantly query IP abuse scores and more from AbuseIPDB. Open source CLI. No DB required.
Go
5
star
99

steampipe-plugin-pagerduty

Use SQL to instantly query resources from PagerDuty. Open source CLI. No DB required.
Go
5
star
100

steampipe-mod-gcp-labels

Is your GCP labels strategy following best practice? This Steampipe mod checks if your GCP resource labels are set correctly to help you manage them effectively.
HCL
5
star