• Stars
    star
    5,464
  • Rank 7,087 (Top 0.2 %)
  • Language
    Go
  • License
    Mozilla Public Li...
  • Created over 3 years ago
  • Updated 28 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

The open source high performance data integration platform built for developers.

cloudquery logo

CloudQuery is an open-source, high-performance data integration framework built for developers.

CloudQuery extracts, transforms, and loads configuration from cloud APIs to variety of supported destinations such as databases, data lakes, or streaming platforms for further analysis.

Installation

See the Quickstart guide for instructions how to start syncing data with CloudQuery.

Why CloudQuery?

  • Open source: Extensible plugin architecture. Contribute to our official plugins or develop your own with CloudQuery SDK.
  • Blazing fast: CloudQuery is optimized for performance, utilizing the excellent Go concurrency model with light-weight goroutines.
  • Deploy anywhere: CloudQuery plugins are single-binary executables and can be deployed and run anywhere.
  • Pre-built queries: CloudQuery maintains a number of out-of-the-box security and compliance policies for cloud infrastructure.
  • Eliminate data silos: Eliminate data silos across your organization, unifying data between security, infrastructure, marketing and finance teams.
  • Unlimited scale: CloudQuery plugins are stateless and can be scaled horizontally on any platform, such as EC2, Kubernetes, batch jobs or any other compute.

Use Cases

  • Cloud Security Posture Management: Use as an open source CSPM solution to monitor and enforce security policies across your cloud infrastructure for AWS, GCP, Azure and many more.
  • Cloud Asset Inventory: First-class support for major cloud infrastructure providers such as AWS, GCP and Azure allow you to collect and unify configuration data.
  • Cloud FinOps: Collect and unify billing data from cloud providers to drive financial accountability.
  • ELT Platform: With hundreds of plugin combinations and extensible architecture, CloudQuery can be used for reliable, efficient export from any API to any database, or from one database to another.
  • Attack Surface Management: Open source solution for continuous discovery, analysis and monitoring of potential attack vectors that make up your organization's attack surface.

Links

License

By contributing to CloudQuery you agree that your contributions will be licensed as defined on the LICENSE file.

Hiring

If you are into Go, Backend, Cloud, GCP, AWS - ping us at jobs [at] our domain

Contribution

Feel free to open a pull request for small fixes and changes. For bigger changes and new plugins, please open an issue first to prevent duplicated work and to have the relevant discussions first.

More Repositories

1

pg_gpt

Experimental extension that brings OpenAI API to your PostgreSQL to run queries in human language.
Rust
454
star
2

terraform-aws-cloudquery

Terraform module to deploy cloudquery
HCL
36
star
3

cq-provider-aws

CloudQuery Provider for AWS
Go
29
star
4

aws

Official AWS security & compliance CloudQuery policy pack
HCL
21
star
5

plugin-sdk

CloudQuery Go SDK for source and destination plugins
Go
20
star
6

helm-charts

Helm v3 chart that deploys CloudQuery to a Kubernetes cluster
Smarty
20
star
7

cq-provider-azure

CloudQuery Provider for Azure
Go
11
star
8

cq-provider-k8s

CloudQuery Provider for Kubernetes
Go
9
star
9

cq-provider-gcp

CloudQuery Provider for GCP
Go
8
star
10

cq-provider-sdk

CloudQuery Provider SDK enables building providers to query any service or custom in-house solutions with SQL
Go
8
star
11

setup-cloudquery

Setup CloudQuery CLI in GitHub Actions workflows
TypeScript
8
star
12

sqlite

fork of github.com/go-gorm/sqlite with pure-go implementation modernc.org/sqlite
Go
7
star
13

plugin-sdk-java

CloudQuery Java SDK
Java
5
star
14

terraform-gcp-cloudquery

Deploy CloudQuery on GCP
HCL
5
star
15

python-plugin-template

Python
5
star
16

docs

https://docs.cloudquery.io
CSS
4
star
17

.github

The open-source cloud asset inventory powered by SQL.
4
star
18

filetypes

A helper library to create destination file plugins for CloudQuery
Go
3
star
19

cq-provider-template

template repository to create new providers for cloudquery
Go
3
star
20

homebrew-tap

homebrew tap for cloudquery
Ruby
3
star
21

cq-source-simple-analytics

A CloudQuery source plugin for Simple Analytics that loads Simple Analytics data into PostgreSQL, BigQuery, Athena, and many other destinations
Go
3
star
22

cq-provider-terraform

CloudQuery Provider for Terraform state files
Go
3
star
23

plugin-sdk-python

Python SDK for building CloudQuery Plugins
Python
3
star
24

plugin-sdk-javascript

TypeScript
3
star
25

cq-policy-core

CloudQuery Policy Packs
HCL
3
star
26

dashboards

Grafana dashboards for CloudQuery ☁️
3
star
27

azure

Moved to https://github.com/cloudquery/cq-provider-azure/tree/main/policies
HCL
3
star
28

cq-provider-digitalocean

Digital Ocean CloudQuery Provider
Go
3
star
29

plugin-pb-python

CloudQuery Plugin Python low level API
Python
2
star
30

k8s

Moved to: https://github.com/cloudquery/cq-provider-k8s
HCL
2
star
31

cq-source-plaid

A CloudQuery source plugin for [Plaid](https://plaid.com/)
Go
2
star
32

cq-provider-test

Test Provider for CloudQuery
Go
2
star
33

plugin-pb-javascript

CloudQuery Plugin JavaScript low level API
TypeScript
2
star
34

recipes

Real-world CloudQuery configuration examples
2
star
35

cq-gen

cloudquery provider generator
HCL
2
star
36

cq-provider-okta

CloudQuery Provider for Okta
Go
2
star
37

plugin-pb

protobuf files related to plugin-sdk (https://github.com/cloudquery/plugin-sdk)
2
star
38

cloudquery-api-go

Auto-generated CloudQuery APIs for Go.
Go
2
star
39

iam-for-aws-orgs

2
star
40

cq-provider-openstack

CloudQuery OpenStack Provider
Go
1
star
41

cq-provider-cloudflare

CloudQuery Provider for Cloudflare
Go
1
star
42

cloudquerydoc

CloudQuery git backed docs - https://docs.cloudquery.io
1
star
43

plugin-pb-go

Generated Go client and server definitions from github.com/cloudquery/plugin-pb files
Go
1
star
44

plugin-pb-java

CloudQuery Plugin Java low level API
Java
1
star
45

javascript-plugin-template

A starter template for a source plugin using CloudQuery JavaScript SDK
TypeScript
1
star
46

codegen

Libraries used for generating or bootstrapping CloudQuery plugins
Go
1
star