AWS Glue Python Shell script timing out
Question
I am trying to connect to and read an on-premise data source using an AWS Glue Python Shell job. I am using Pygresql (which comes bundled on Glue) and Pandas. Everything works locally.
But when I push this job up to Glue, the database connections all timeout. Why is this happening? Do I need to do something magic with VPCs?
2 answers
solution1
1 2019-09-10 11:07:10
我想您需要使用VPC设置创建Glue连接并将其附加到Glue作业。
solution2
0 2019-09-10 17:18:01
Note that pygresql SQL query doesn't work in python shell. Recommended is postgresql
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
AWS Glue Python Shell Job Fails with MemoryError
AWS Glue: Installing pandas==1.0.3 on AWS Glue python shell jobs Python library path
AWS Glue Job Python Script Boto3 - want to hide credentials
Python 3 pow() / ** timing out
How to Bulk insert data into MSSQL database in a AWS Glue python shell job?
Header is repeating when merging multiple files using Python shell in AWS Glue
Missing Logs in AWS Glue Python
AWS Glue job, Python script for datetime.today().strftime(%y/%m/%d) getting UTC date & time?
How to use python packages in aws-glue
SQL Server connection with AWS GLUE Python 3 Job
Related Tags