Flink/Delta Connector可以创建多个databricks表吗

Question

我正在使用新的Flink/Databricks 连接器，我试图了解单个 Flink 接收器是否可以创建多个增量表？

查看文档，对 path/s3/hdfs 的引用是单个位置

   /**
 * Convenience method for creating a {@link RowDataDeltaSinkBuilder} for {@link DeltaSink} to a
 * Delta table.
 *
 * @param basePath root path of the Delta table
 * @param conf     Hadoop's conf object that will be used for creating instances of
 *                 {@link io.delta.standalone.DeltaLog} and will be also passed to the
 *                 {@link ParquetRowDataBuilder} to create {@link ParquetWriterFactory}
 * @param rowType  Flink's logical type to indicate the structure of the events in the stream
 * @return builder for the DeltaSink
 */
public static RowDataDeltaSinkBuilder forRowData(
    final Path basePath,
    final Configuration conf,
    final RowType rowType
) {
    return new RowDataDeltaSinkBuilder(
        basePath,
        conf,
        rowType,
        false // mergeSchema
    );

是否可以根据事件 stream 动态更改 basePath？

Answer 1

所以一般来说这是不支持的。 Delta/Flink Source 和 Sink 目前都可以读取/写入一个位置（一个表）。