An error occurred while calling o92.getDynamicFrame. Glue ETL Marketplace: failed to retrieve primary key from source.driverClassName: cdata.jdbc.dynamicscrm.DynamicsCRMDriver, error message: Failed to login CRM Server: Failed to login CRM Server: unexpected SPNEGO response. This can be caused by invalid connection settings.
I have used C-Data Connector in AWS GLUE Jobs.
Also Got this error log as follows,
/usr/bin/java -cp /tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar:/tmp/* -Dlog4j.configuration=log4j -server -aaaaadscd -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:MaxHeapFreeRatio=70 -XX:+CMSClassUnloadingEnabled -XX:OnOutOfMemoryError=kill -9 %p -XX:+UseCompressedOops -Djavax.net.ssl.trustStore=/opt/amazon/certs/ExternalAndAWSTrustStore.jks -Djavax.net.ssl.trustStoreType=JKS -Djavax.net.ssl.trustStorePassword=aaa -DRDS_ROOT_CERT_PATH=/opt/amazon/certs/rds-combined-ca-bundle.pem -DREDSHIFT_ROOT_CERT_PATH=/opt/amazon/certs/aaa.pem -DRDS_TRUSTSTORE_URL=file:/opt/amazon/certs/RDSTrustStore.jks -Dspark.hadoop.mapred.output.committer.class=org.apache.hadoop.mapred.DirectOutputCommitter -Dspark.executor.extraClassPath=/tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar -Dspark.script.location=N/A -Dspark.glue.enable-job-insights=true -Dspark.glue.connection-names=dynamics365-aaaa -Dspark.glue.JOB_RUN_ID=jr_6d15c011060a368aab14ae9e7aaaa -Dspark.glueExceptionAnalysisEventLog.dir=/tmp/glue-exception-analysis-logs/ -Dspark.authenticate.secret=<HIDDEN> -Dspark.cloudwatch.logging.conf.jobRunId=jr_6d15c011060a368aab14ae9e79-Dspark.hadoop.aws.glue.proxy.host=aaa -Dspark.hadoop.mapred.output.direct.EmrFileSystem=true -Dspark.glueJobInsights.enabled=true -Dspark.glue.JOB_NAME=crm-test-with-http-full-url -Dspark.hadoop.lakeformation.credentials.url=aaaa:9998/lakeformationcredentials -Dspark.eventLog.dir=/tmp/spark-event-logs/ -Dspark.rpc.askTimeout=600 -Dspark.hadoop.fs.s3.impl=com.amazon.ws.emr.hadoop.fs.EmrFileSystem -Dspark.hadoop.mapred.output.direct.NativeS3FileSystem=true -Dspark.master=jes -Dspark.cloudwatch.logging.ui.showConsoleProgress=true -Dspark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=2 -Dspark.hadoop.mapreduce.fileoutputcommitter.marksuccessfuljobs=false -Dspark.unsafe.sorter.spill.read.ahead.enabled=false -Dspark.hadoop.parquet.enable.summary-metadata=false -Dspark.hadoop.glue.michiganCredentialsProviderProxy=com.amazonaws.services.glue.remote.LakeformationCredentialsProvider -Dspark.glueAppInsightsLog.dir=/tmp/glue-app-insights-logs/ -Dspark.glue.enable-continuous-cloudwatch-log=true -Dspark.glue.jobLanguage=python -Dspark.glue.endpoint=glue-jes-prod.us-east-1.amazonaws.com -Dspark.ui.enabled=false -Dspark.hadoop.aws.glue.proxy.port=8888 -Dspark.driver.extraClassPath=/tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar -Dspark.glue.USE_PROXY=true -Dspark.files.overwrite=true -Dspark.authenticate=true com.amazonaws.services.glue.ProcessLauncher --launch-class org.apache.spark.executor.CoarseGrainedExecutorBackendWrapper --hostname aaaa --driver-url spark://CoarseGrainedScheduler@aaaa --executor-id 10 --app-id spark-application-aaaa --cores 16