DataStream Connectors#
Use these pages for Java builder APIs, connector-specific serialization and deserialization schemas, and the runtime behavior that the Table connectors reuse. For DDL, SQL type mappings, metadata columns, and planner-specific restrictions, see the Table API connectors. The connector overview explains how to choose between the two APIs.
Capability map#
The source column names how Flink distributes reads, while the destination column names the
record-level routing surface of the sink.
The delivery column summarizes connector-to-service writes; the delivery guarantees page defines the checkpoint and state qualifications.
Not applicable means that the capability does not fit the service’s role; it is not an
implementation-status claim.
| Connector pages | Primary role | Source and split strategy | Sink delivery | Per-record destination | CDC |
|---|---|---|---|---|---|
| BigQuery: Quickstart, DataStream examples source and sink, DataStream reference source and sink, Table reference source, sink, and CDC | Analytics warehouse | Bounded; Storage Read API stream splits | At-least-once or exactly-once service writes | Table through a resolver | Upsert/delete sink on the at-least-once default stream; Experimental (#706) |
| Cloud Pub/Sub: Quickstart, Examples, DataStream (source, sink), Table (source, sink) | Messaging | Unbounded; subscription splits | At-least-once | Topic through a resolver | No native DataStream changelog; Table formats can carry one |
| Cloud Tasks: Quickstart, Examples, DataStream, Table | Task delivery | Not applicable; sink only | At-least-once | Queue through a resolver | Not applicable |
| Bigtable: Quickstart, Examples, DataStream source, sink, and Change Streams, Table source, sink, lookup, and Change Streams | Wide-column store | Bounded; sampled row-range splits | At-least-once | Table through a resolver | Change Streams partitions; unbounded or bounded |
| Spanner: Quickstart, Examples, DataStream, Table | Relational database | Bounded; service-planned partitions | At-least-once | Table in each serialized mutation | Change Streams partitions; unbounded |