Data Sources and Targets

VDK integrates Data Sources and Targets via Plugins. Versatile Data Kit supports querying multiple databases using its Plugin framework.

Data Source Plugin

The data-sources project is a plugin for the Versatile Data Kit (VDK). It aims to simplify data ingestion from multiple sources by offering a single, unified API. Whether you're dealing with databases, REST APIs, or other forms of data, this project allows you to manage them all consistently. This is crucial for building scalable and maintainable data pipelines.

Singer.io

A relevant integration for data sources is vdk-singer which provides integration with singer.io and provides connectors for a lot of APIs. It provides a separate command for listing the available sources with command vdk singer --list

Available connections can be seen in Singer Taps and Targets:

Taps extract data from any source and write it to a standard stream in a JSON-based format:

• 3PL Central
• AdRoll
• Amazon S3 CSV
• Amplitude
• AppsFlyer
• Autopilot
• BigCommerce
• Bing Ads
• Google Ads
• Facebook Ads
• LinkedIn Ads
• Ebay
• Eloqua
• Front
• GitHub
• GitLab
• Google Analytics
• Google Sheets
• HubSpot
• Jira
• Looker
• MySQL
• ORACLE
• PostgreSQL
• SFTP
• Salesforce
• Slack
• Trello
• Workday Raas
• Zoom
• ...

You can see all supported plugins here.

Open a new ticket if your database is missing.

You can always develop your own plugins and contribute them to our repository so other people can reuse your code.

➡️ Next Section: Properties