Dynamics Community Forum Thread Details

Error Connectivity

An error occurred while calling o92.getDynamicFrame. Glue ETL Marketplace: failed to retrieve primary key from source.driverClassName: cdata.jdbc.dynamicscrm.DynamicsCRMDriver, error message: Failed to login CRM Server: Failed to login CRM Server: unexpected SPNEGO response. This can be caused by invalid connection settings.

I have used C-Data Connector in AWS GLUE Jobs.

Also Got this error log as follows,

/usr/bin/java -cp /tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar:/tmp/* -Dlog4j.configuration=log4j -server -aaaaadscd -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:MaxHeapFreeRatio=70 -XX:+CMSClassUnloadingEnabled -XX:OnOutOfMemoryError=kill -9 %p -XX:+UseCompressedOops -Djavax.net.ssl.trustStore=/opt/amazon/certs/ExternalAndAWSTrustStore.jks -Djavax.net.ssl.trustStoreType=JKS -Djavax.net.ssl.trustStorePassword=aaa -DRDS_ROOT_CERT_PATH=/opt/amazon/certs/rds-combined-ca-bundle.pem -DREDSHIFT_ROOT_CERT_PATH=/opt/amazon/certs/aaa.pem -DRDS_TRUSTSTORE_URL=file:/opt/amazon/certs/RDSTrustStore.jks -Dspark.hadoop.mapred.output.committer.class=org.apache.hadoop.mapred.DirectOutputCommitter -Dspark.executor.extraClassPath=/tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar -Dspark.script.location=N/A -Dspark.glue.enable-job-insights=true -Dspark.glue.connection-names=dynamics365-aaaa -Dspark.glue.JOB_RUN_ID=jr_6d15c011060a368aab14ae9e7aaaa -Dspark.glueExceptionAnalysisEventLog.dir=/tmp/glue-exception-analysis-logs/ -Dspark.authenticate.secret=<HIDDEN> -Dspark.cloudwatch.logging.conf.jobRunId=jr_6d15c011060a368aab14ae9e79-Dspark.hadoop.aws.glue.proxy.host=aaa -Dspark.hadoop.mapred.output.direct.EmrFileSystem=true -Dspark.glueJobInsights.enabled=true -Dspark.glue.JOB_NAME=crm-test-with-http-full-url -Dspark.hadoop.lakeformation.credentials.url=aaaa:9998/lakeformationcredentials -Dspark.eventLog.dir=/tmp/spark-event-logs/ -Dspark.rpc.askTimeout=600 -Dspark.hadoop.fs.s3.impl=com.amazon.ws.emr.hadoop.fs.EmrFileSystem -Dspark.hadoop.mapred.output.direct.NativeS3FileSystem=true -Dspark.master=jes -Dspark.cloudwatch.logging.ui.showConsoleProgress=true -Dspark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=2 -Dspark.hadoop.mapreduce.fileoutputcommitter.marksuccessfuljobs=false -Dspark.unsafe.sorter.spill.read.ahead.enabled=false -Dspark.hadoop.parquet.enable.summary-metadata=false -Dspark.hadoop.glue.michiganCredentialsProviderProxy=com.amazonaws.services.glue.remote.LakeformationCredentialsProvider -Dspark.glueAppInsightsLog.dir=/tmp/glue-app-insights-logs/ -Dspark.glue.enable-continuous-cloudwatch-log=true -Dspark.glue.jobLanguage=python -Dspark.glue.endpoint=glue-jes-prod.us-east-1.amazonaws.com -Dspark.ui.enabled=false -Dspark.hadoop.aws.glue.proxy.port=8888 -Dspark.driver.extraClassPath=/tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar -Dspark.glue.USE_PROXY=true -Dspark.files.overwrite=true -Dspark.authenticate=true com.amazonaws.services.glue.ProcessLauncher --launch-class org.apache.spark.executor.CoarseGrainedExecutorBackendWrapper --hostname aaaa --driver-url spark://CoarseGrainedScheduler@aaaa --executor-id 10 --app-id spark-application-aaaa --cores 16

Hi Ashir,

There might be an issue with the connection settings when connecting to the Dynamics CRM server. There can be various reasons for this error, some possible reasons are:

Invalid credentials: Make sure that you are providing the correct username and password for the Dynamics CRM server. Also, check if the user has the correct permissions to access the server.
Incorrect URL: Check the URL of the Dynamics CRM server that you are trying to connect to and make sure it is correct.
DNS resolution: Make sure that your server is able to resolve the DNS address of the CRM server. You can use 'nslookup' command for this.
Firewall: Ensure that the Firewall between your Glue Job and Dynamics CRM is not blocking the port you are trying to connect through.
SPNEGO : The error message mentions about the unexpected SPNEGO response, This typically happens when there's an issue with the Kerberos authentication. Verify the settings, whether the correct SPN is being used and check the clock skew between Glue Job and Dynamics CRM.
Try connecting to the Dynamics CRM server using the same credentials and URL outside of Glue Jobs to see if you are able to connect successfully.

If you still can't find a solution to the issue, you might want to consider consulting with AWS and C-Data support to further investigate the problem.

Quick Links