PyPI to Looker Integration
AI-first ETL from PyPI into Looker. Governed entities, incremental sync, typed landing tables.
How Datrise loads PyPI into Looker
Datrise syncs PyPI's packages, releases, versions, download counts, maintainers, and dependencies into Looker as governed warehouse tables with LookML-ready naming. Flexible or custom fields land in flattened columns (nested fields expanded for modeling), and timestamps such as created, updated, and status changes are typed as date/time dimension columns.
Sync is incremental: Datrise uses incremental refresh of the underlying warehouse tables Looker explores, so re-runs update only what changed. Date-partitioned fact tables for PDT performance. Looker models live in LookML on top of SQL, so Datrise lands clean, stable column names rather than churn that would break your views.
Ideal for governed, version-controlled BI on a warehouse.
Endpoints
PyPI: Python package registry metadata and downloads.
Looker: Google Cloud BI with LookML semantic models and governed dashboards.
How PyPI entities map to Looker
| PyPI entity | Looker object | Notes |
|---|---|---|
| packages | pypi_packages | id PK · custom fields → flattened columns (nested fields expanded for modeling) |
| releases | pypi_releases | id PK · linked to pypi_packages |
| versions | pypi_versions | id PK · linked to pypi_packages |
| download counts | pypi_download_counts | id PK · linked to pypi_packages |
FAQ
How does Datrise handle PyPI's custom fields in Looker?
Flexible values are stored as flattened columns (nested fields expanded for modeling), so new fields don't require a migration; strongly-typed fields — dates, numbers, and references — are promoted to native Looker types.
How does the PyPI to Looker sync stay up to date?
It runs incrementally — Datrise uses incremental refresh of the underlying warehouse tables Looker explores.
Related pipelines
More destinations for PyPI
Early access
Connect PyPI to Looker the easy way
Skip brittle scripts and manual exports. Join the waitlist to get a guided setup, AI-assisted mapping, and reliable incremental sync for this integration.