Hudi-Glue-Integration with EMR cluster
Question
I am looking to implement SCD2 logic with the help of S3,Hudi and Glue in AWS. Can anyone suggest how to implement without EMR? Also is there way to install/deploy hudi without EMR in AWS.
Thanks
1 answers
solution1
0 2022-04-09 15:37:00
Check below AWS blog about using Glue with Hudi, no need of EMR
https://aws.amazon.com/blogs/big-data/writing-to-apache-hudi-tables-using-aws-glue-connector/
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Is there a way to use Apache Hudi on AWS glue?
How to add Hudi Package to local AWS Glue Interactive Notebook
Deleting records from Apache Hudi Table which is part of Glue Tables created using AWS Glue Job and Kinesis
Limit on EMR Cluster history?
Error when creating EMR cluster, EMR service role is invalid
Apache Iceberg tables not working with AWS Glue in AWS EMR
Spark SQL error from EMR notebook with AWS Glue table partition
What is the difference between AWS Glue ETL Job and AWS EMR?
AWS EMR: Does master node stores hdfs data in EMR cluster?
Connecting AWS Glue to Mongodb Atlas Cluster
Related Tags