如何在Spark-java数据框中添加常量列

Question

I have imported

import org.apache.spark.sql.Column;
import org.apache.spark.sql.functions;

in my Java-Spark driver

But

DataFrame inputDFTwo = hiveContext.sql("select * from sourcing_src_tbl");
inputDFTwo.withColumn("asofdate", lit("2016-10-2"));

here "lit" is still showing error in eclipse(windows).Which library should I include to make it work.

Answer 1

Either import object like you do know and use it to access method:

import org.apache.spark.sql.functions;

df.withColumn("foo", functions.lit(1));

or use import static and call method directly:

import static org.apache.spark.sql.functions.lit;

df.withColumn("foo", lit(1));