行格式蜂巢中的蜂巢

Question

I am using hadoop 2.0.4 and working in twitter sentiment analysis. I have used flume to ingest data but now the twitter data must be stored in hive table.

I have created a table but ROW FORMAT SERDE is giving error

'Unable to validate'

Kindly tell me how to proceed.

Answer 1

Are you using a custom SerDe?

Please refer to the below information provided in Language Manual of hive

You can create tables with a custom SerDe or using a native SerDe. A native SerDe is used if ROW FORMAT is not specified or ROW FORMAT DELIMITED is specified.

Hope the information is useful.

Answer 2

You can try adding this jar

hive-serdes-1.0-SNAPSHOT.jar

After adding the jar you can create an external hive table containing the tweet_id and the tweet_text which refers to the tweets directory for performing sentiment analysis like this.

create external table load_tweets(id BIGINT,text STRING) ROW FORMAT SERDE 'com.cloudera.hive.serde.JSONSerDe' LOCATION '/user/flume/tweets'

You can refer to the below link for performing sentiment analysis using hive.

https://acadgild.com/blog/sentiment-analysis-on-tweets-with-apache-hive-using-afinn-dictionary/

Answer 3

Check weather you have added hive-serdes-1.0-SNAPSHOT.jar in your hive directory under lib folder. Your hive directory path will be the one which you have mentioned in your .bashrc file.