Apache Spark → Yellowfin
AI-first ETL from Apache Spark into Yellowfin. Governed entities, incremental sync, typed landing tables.
How Datrise loads Apache Spark into Yellowfin
Datrise syncs Apache Spark's records, events, and configuration objects into Yellowfin as warehouse tables Yellowfin builds views on. Flexible or custom fields land in flattened columns, and timestamps such as created, updated, and status changes are typed as date/time dimensions.
Sync is incremental: Datrise uses incremental refresh of the connected tables, so re-runs update only what changed. Date-partitioned facts. Yellowfin views reference columns by name, so Datrise lands stable, well-typed columns to keep reports valid.
Ideal for dashboards with automated data storytelling.
Endpoints
Apache Spark: SaaS or API data source for analytics and warehouse sync.
Yellowfin: BI suite with dashboards, automated insights, and data storytelling.
How Apache Spark entities map to Yellowfin
| Apache Spark entity | Yellowfin object | Notes |
|---|---|---|
| records | apache_spark_records | id PK · custom fields → flattened columns |
| events | apache_spark_events | date/time dimensions events |
| configuration objects | apache_spark_configuration_objects | id PK · linked to apache_spark_records |
FAQ
How does Datrise handle Apache Spark's custom fields in Yellowfin?
Flexible values are stored as flattened columns, so new fields don't require a migration; strongly-typed fields — dates, numbers, and references — are promoted to native Yellowfin types.
How does the Apache Spark to Yellowfin sync stay up to date?
It runs incrementally — Datrise uses incremental refresh of the connected tables.
Related pipelines
More destinations for Apache Spark
- Apache Spark → PostgreSQL
- Apache Spark → MySQL
- Apache Spark → Microsoft SQL Server
- Apache Spark → Oracle Database
- Apache Spark → Snowflake
- Apache Spark → Google BigQuery
- Apache Spark → Amazon Redshift
- Apache Spark → Databricks SQL Warehouse
- Apache Spark → ClickHouse
- Apache Spark → DuckDB
- Apache Spark → Amazon Athena
- Apache Spark → Amazon S3 Data Lake
More sources for Yellowfin
Early access
Connect Apache Spark to Yellowfin the easy way
Skip brittle scripts and manual exports. Join the waitlist to get a guided setup, AI-assisted mapping, and reliable incremental sync for this integration.