Creating Hive Table for tweets data


#1

I am creating table in hive for twitter json file.The problem i am facing is that i am not able to create an array
with struct because the data i have contains 4 same structs in a single array (extended_entities array incase of videos). Can anyone tell how can i create array with same structs. I have tried giving each struct different name, the table was created successfully but i was not able to pull data from table.Kindly Help .
Thanks


#2

Try to change the metastore database used by hive in my case its MySql and in SERDES table change the
PARAM_VALUE to varchar(8191) or more as per your requirement.I have done that but error still exist if you find any solution pls post it back.

I also check the query without the extended_entities table creats well.

Also try to put below two lines in your create table query

ROW FORMAT SERDE ‘org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe’ WITH SERDEPROPERTIES ( ‘hive.serialization.extend.nesting.levels’=‘true’);

Execute the query and see what error it is giving.If you found any solutions for that than revert back as soon as possible