singer-io/getting-started

Makefilesinger.io

This repository is a getting started guide to Singer.

etletl-frameworkpythonsingerdata-analysis

Key Metrics

Star Growth

Stars

1.3k

Forks

140

Weekly Growth

—

Issues

5001k

Mar 2017Sep 2018Apr 2020Nov 2021Jun 2023Dec 2024Jul 2026

README

Singer

Singer is an open source standard for moving data between databases, web APIs, files, queues, and just about anything else you can think of. The Singer spec describes how data extraction scripts — called “Taps” — and data loading scripts — called “Targets” — should communicate using a standard JSON-based data format over stdout. By conforming to this spec, Taps and Targets can be used in any combination to move data from any source to any destination.

Join the Singer Slack channel to get help from members of the Singer community.

Docs

Related repositories

pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

PythonPyPIOtherbatch-processingkafka

pathway.com

62.6k1.7k

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

PythonPyPIApache License 2.0airflowapache

airflow.apache.org

46.2k17.4k

kestra-io/kestra

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

JavaMavenApache License 2.0orchestrationdata-orchestration

go.kestra.io/home

27.4k2.8k

vectordotdev/vector

A high-performance observability data pipeline.

Rustcrates.ioMozilla Public License 2.0logsmetrics

vector.dev

22.2k2.2k

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

PythonPyPIOtherdatapipeline

airbyte.com

21.7k5.3k

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

PythonPyPIApache License 2.0data-pipelinesdagster

dagster.io

15.9k2.2k

cocoindex-io/cocoindex

Incremental engine for long horizon agents 🌟 Star if you like it!

Rustcrates.ioApache License 2.0aichange-data-capture

cocoindex.io

11k841

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

PythonPyPIApache License 2.0machine-learningartificial-intelligence

mage.ai

8.8k979

redpanda-data/connect

Fancy stream processing made operationally mundane

GoGo Modulesmessage-queuestream-processing

docs.redpanda.com/connect/home/

8.7k951

turbot/steampipe

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

GoGo ModulesGNU Affero General Public License v3.0steampipepostgresql

steampipe.io

7.9k339

cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

GoGo ModulesMozilla Public License 2.0awsgcp

cloudquery.io

6.5k549

apache/flink-cdc

Flink CDC is a streaming data integration tool

JavaMavenApache License 2.0change-data-capturecdc

nightlies.apache.org/flink/flink-cdc-docs-stable

6.4k2.2k