I am trying to initialize an Apache Spark instance on Windows 10 to run a local test. My problem is during the initialization of the Spark instance, I ...
I am trying to initialize an Apache Spark instance on Windows 10 to run a local test. My problem is during the initialization of the Spark instance, I ...
I am trying to create a Hive table with partitions but getting the above error. What am I doing wrong? The code works without the partitioning clau ...
I know we can do some random sample in hive using something like Row_Number() OVER (partition by deptid ORDER BY rand() desc) (assuming we want to get ...
Data preview: Is there a way to add a column called 'total_num_user' counting total number of users in a room when each person first joined the roo ...
In Hive, I have a column date that looks like below, array of string. I have another hivevar that look like this set hivevar:sunny = ('2022-12-17', '2 ...
I have to make Kafka source and sink connectors for connecting HIVE to MYSQL. I am not able to find anything on above question. I have looked the con ...
i'm trying to execute a query in a test.hql with beeline and i'm not getting results here the command : in test.hql file : But if i execute the ...
Hi I am new to Hive and kerberos. I have some hive jobs which run more then life time of ticket. how can I configure hive so that when I start hive sh ...
I want to drop the whole column 'index' (column name and values) in Impala: index case_id customer_id ...
Does anyone know of a way to LAG in a specified order? In the example below, I provide a table with my current output [Lag (Current)] and my desired o ...
I try to get the data in the past 3 second by compare the _timestamp and unix_timestamp() but got the error: Error while compiling statement: FAILED: ...
My periodically running process writes data to a table over parquet files with the configuration "spark.sql.sources.partitionOverwriteMode" = "dynamic ...
SQL novice here trying to perform a delete operation using Hive syntax and ACID transformations I have two delta files that I have brought in as dataf ...
I have a column that contains a length 16 hexademical string. I would like to convert it to a bigint. Is there any way to accomplish that? The usual a ...
I had a table and need to add one condition in column. My condition was to exclude only Age_Flag=AB and include all null value.The above query excl ...
I have a requirement to implement the solution for below usecase. Currently Applications are storing data into Postgres database but Postgres databas ...
IF we have a sample field say 'note' note could be in ( 'xyz #abc-xyz-dfg. #abd' , '#123%36&89' , '## avc #1 "Changed xyz #2 from "string"\n - st ...
I'm a Hadoop newcomer trying to export data from Hive to Oracle. Can Sqoop update data to Oracle table let say, Oracle Table have column A,B,C,D,E I ...
I have a string field with records like the following “Harry Potter (HP) (ab-cd)” “John Doe (ab-cd)” “Richard Smith (RS)” “William Johnson” I would ...
I have duplicate IDs with different activities. To return all the IDs, but remove duplicates, and to return three new columns called email, phone call ...