使用 RDD.mapPartitionsWithIndex 时如何获取每个分区的索引？

Question

I am new in spark and scala. Is there a way in Spark to get the Partition ID/No from RDD.mapPartitionsWithIndex where it defined as follows:

def randomint(index: Int, iter: Iterator[T]) : Iterator[(Int, T)]={
...
}
self.mapPartitionsWithIndex(randomint).partitionBy(new randParti(nump)).values

Answer 1

Your naming might be confusing, but the index variable in the randomint function does contain what you are looking for: the partition no.