电子邮件和地图减少工作

Question

I'm just starting out with Hadoop and writing some Map Reduce jobs. I was looking for help on writing a MR job in python that allows me to take some emails and put them into HDFS so I can search on the text or attachments of the email?

Thank you!

Answer 1

For handling the emails, the email module from the stdlib is probably going to be handy. For the Hadoop side of things, Using Python with Hadoop might be handy, although there are plenty of Google results to choose from.

Answer 2

是的，如果要使用编写Python代码来运行MapReduce作业，则需要使用hadoop流