PyPI to Apache Superset Integration
AI-first ETL from PyPI into Apache Superset. Governed entities, incremental sync, typed landing tables.
How Datrise loads PyPI into Apache Superset
Datrise syncs PyPI's packages, releases, versions, download counts, maintainers, and dependencies into Apache Superset as governed SQL tables Superset queries directly. Flexible or custom fields land in flattened columns for the explore UI, and timestamps such as created, updated, and status changes are typed as temporal columns for time-series charts.
Sync is incremental: Datrise uses incremental refresh of the queried tables, so re-runs update only what changed. Date-partitioned tables to keep dashboards responsive. Superset charts run live SQL, so Datrise lands query-friendly, indexed tables rather than wide raw payloads.
Ideal for open-source dashboards over your own database.
Endpoints
PyPI: Python package registry metadata and downloads.
Apache Superset: Open-source BI for SQL exploration, charts, and dashboard publishing.
How PyPI entities map to Apache Superset
| PyPI entity | Apache Superset object | Notes |
|---|---|---|
| packages | pypi_packages | id PK · custom fields → flattened columns for the explore UI |
| releases | pypi_releases | id PK · linked to pypi_packages |
| versions | pypi_versions | id PK · linked to pypi_packages |
| download counts | pypi_download_counts | id PK · linked to pypi_packages |
FAQ
How does Datrise handle PyPI's custom fields in Apache Superset?
Flexible values are stored as flattened columns for the explore UI, so new fields don't require a migration; strongly-typed fields — dates, numbers, and references — are promoted to native Apache Superset types.
How does the PyPI to Apache Superset sync stay up to date?
It runs incrementally — Datrise uses incremental refresh of the queried tables.
Related pipelines
More destinations for PyPI
More sources for Apache Superset
- Qualaroo → Apache Superset
- Quick Base → Apache Superset
- RD Station Marketing → Apache Superset
- Recruitee → Apache Superset
- Redshift → Apache Superset
- Referral Saasquatch → Apache Superset
- Reply.io → Apache Superset
- Responsys → Apache Superset
- Retently → Apache Superset
- Revinate → Apache Superset
- Rocket Chat → Apache Superset
- RSS → Apache Superset
Early access
Connect PyPI to Apache Superset the easy way
Skip brittle scripts and manual exports. Join the waitlist to get a guided setup, AI-assisted mapping, and reliable incremental sync for this integration.