[英]Declare Pyspark variable in Synapse and use it in Kusto query
我想在 Synapse 中聲明 Pyspark 變量並在 Kusto 查詢中使用該變量。
Pyspark中聲明的變量如下
s = "02-01-2022"
print(s)
e = "02-10-2022"
print(e)
想要在 Kusto 查詢中使用變量“ s
”和“ e
”,如下所示
%%pyspark
s = "02-01-2022"
print(s)
e = "02-10-2022"
print(e)
# Read data from Azure Data Explorer table(s)
# Full Sample Code available at: https://github.com/Azure/azure-kusto-spark/blob/master/samples/src/main/python/SynapseSample.py
sales_data = spark.read \
.format("com.microsoft.kusto.spark.synapse.datasource") \
.option("spark.synapse.linkedService", "LinkedServiceName") \
.option("kustoDatabase", "DatabaseName") \
.option("kustoQuery", "let starttime = startofday(todatetime('s')); let endtime = startofday(todatetime('e')); Table | where Time between (starttime .. endtime) | summarize amount = count() by Date= bin(TIMESTAMP,5h) | project Date,amount | order by Date asc") \
.load()
display(sales_data)
在pyspark中可以通過以下方式使用該變量:
option("kustoQuery", "let starttime = startofday(todatetime('" + s + "')); let endtime = startofday(todatetime('" + e + "')); Table | where Time between (starttime .. endtime) | summarize amount = count() by Date= bin(TIMESTAMP,5h) | project Date,amount | order by Date asc")
另外,請參閱Azure Data Explorer (Kusto) connector for Apache Spark
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.