CloudQuery is an open-source ELT platform that enables easy data integration from hundreds of cloud and security tools to any destination.

At a Glance:

CloudQuery is an open-source cloud asset inventory tool that syncs cloud infrastructure metadata from 70+ sources including AWS, Azure, and GCP into data warehouses, making it queryable with SQL and supporting security, FinOps, and automation workflows.

Overview:

CloudQuery is a cloud asset inventory platform built for platform teams to collect, normalize, and unify infrastructure metadata across AWS, Azure, GCP, and 70+ cloud and SaaS sources. It syncs cloud configuration data into data warehouses, enabling users to query their cloud assets using standard SQL rather than dealing with provider APIs directly. The tool runs on the user's own infrastructure, supports code-first configuration, and provides an open plugin system for extending integrations. Primary use cases include cloud asset inventory, cloud security posture management, and FinOps cost analysis, with connections available to BI tools, Slack alerts, and Jira ticketing systems.

Key Decision Points:

  • Runs on your infrastructure: Cloud data never touches CloudQuery's servers, making it suitable for regulated or security-sensitive environments that require full data residency control.

  • Open plugin system with SDK: Developers can write, extend, and ship custom plugins using the Plugin SDK, with the framework, CLI, and some integrations being open source.

  • SQL-based querying: Cloud assets become queryable with SQL after syncing into a data warehouse, eliminating the need to write custom scripts against provider APIs.

  • Partial open-source model: The framework, SDK, and CLI are open source, but some integrations have moved to closed source under MPL 2.0, with historical code available in git history.

Core Features:

  • Multi-source cloud sync: Collects cloud infrastructure metadata from AWS, Azure, GCP, and 70+ cloud and SaaS sources such as Wiz, Finout, and GitHub.

  • Normalized data output: Transforms disparate cloud provider data into a consistent, normalized format within the destination data warehouse.

  • SQL-accessible cloud assets: Makes synced cloud configuration data queryable using standard SQL, removing the need for API scripting.

  • Apache Arrow-powered syncs: Handles large data volumes with high performance and fine-grained control over sync operations.

  • Extensible plugin system: Supports a code-first, multi-language plugin architecture with an open SDK for building custom integrations.

  • Downstream integrations: Connects synced data to BI tools, Slack alerts, Jira ticketing, databases, and other destinations.

Use Cases:

  • Cloud asset inventory: Platform teams can unify cloud configuration data from major providers like AWS, GCP, and Azure into a single queryable warehouse for auditing and visibility.

  • Cloud security posture management: Security teams can monitor and enforce security policies across multi-cloud infrastructure using synced configuration data as a CSPM solution.

  • Cloud FinOps: Finance and engineering teams can collect and unify billing data from cloud providers to analyze and optimize cloud spending.

Open-Source Alternative Value:

CloudQuery provides an open-source framework, CLI, and Plugin SDK that allows platform teams to build and run their own cloud asset inventory without relying on a hosted service. The code-first, extensible plugin architecture lets developers customize integrations and sync logic to match their specific infrastructure stack. Because it runs entirely on the user's infrastructure, cloud data remains under the organization's control, which is relevant for teams operating in environments where data cannot be sent to external services. The open plugin system means users can extend functionality beyond what is provided out of the box, using the supported SDK to write custom source or destination plugins.

TeilenXLinkedInReddit

Ähnliche Tools

Projektstatistiken

Sterne

6,441

Forks

549

Lizenz

MPL-2.0

Metadaten

Alternative zu
Snowflake