spark- find the len of each row (python)

Question

I wrote this code:

logFile = sc.textFile("\README.md") #read the file

def lengthfunction(line):
    return len(line) 

logFile.map(lambda line: line.split()).reduce(lengthfunction)

It gave me an error:

"lengthfunction() takes exactly 1 argument (2 given)"

I also tried

logFile.map(lambda line: line.split()).reduce(lambda line: len)

But that did not work too. Can someone help me out?

Answer 1

您可以：

logFile.map(lambda line: line.split()).map(len)