Personalized Community is here!
Quickly customize your community to find the content you seek.
Have questions on moving to the cloud? Visit the Dynamics 365 Migration Community today! Microsoft’s extensive network of Dynamics AX and Dynamics CRM experts can help.
2023 Release Wave 1Check out the latest updates and new features of Dynamics 365 released from April 2023 through September 2023
The FastTrack program is designed to help you accelerate your Dynamics 365 deployment with confidence.
FastTrack Community | FastTrack Program | Finance and Operations TechTalks | Customer Engagement TechTalks | Upcoming TechTalks | All TechTalks
An error occurred while calling o92.getDynamicFrame. Glue ETL Marketplace: failed to retrieve primary key from source.driverClassName: cdata.jdbc.dynamicscrm.DynamicsCRMDriver, error message: Failed to login CRM Server: Failed to login CRM Server: unexpected SPNEGO response. This can be caused by invalid connection settings.
I have used C-Data Connector in AWS GLUE Jobs.
Also Got this error log as follows,
/usr/bin/java -cp /tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar:/tmp/* -Dlog4j.configuration=log4j -server -aaaaadscd -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:MaxHeapFreeRatio=70 -XX:+CMSClassUnloadingEnabled -XX:OnOutOfMemoryError=kill -9 %p -XX:+UseCompressedOops -Djavax.net.ssl.trustStore=/opt/amazon/certs/ExternalAndAWSTrustStore.jks -Djavax.net.ssl.trustStoreType=JKS -Djavax.net.ssl.trustStorePassword=aaa -DRDS_ROOT_CERT_PATH=/opt/amazon/certs/rds-combined-ca-bundle.pem -DREDSHIFT_ROOT_CERT_PATH=/opt/amazon/certs/aaa.pem -DRDS_TRUSTSTORE_URL=file:/opt/amazon/certs/RDSTrustStore.jks -Dspark.hadoop.mapred.output.committer.class=org.apache.hadoop.mapred.DirectOutputCommitter -Dspark.executor.extraClassPath=/tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar -Dspark.script.location=N/A -Dspark.glue.enable-job-insights=true -Dspark.glue.connection-names=dynamics365-aaaa -Dspark.glue.JOB_RUN_ID=jr_6d15c011060a368aab14ae9e7aaaa -Dspark.glueExceptionAnalysisEventLog.dir=/tmp/glue-exception-analysis-logs/ -Dspark.authenticate.secret=<HIDDEN> -Dspark.cloudwatch.logging.conf.jobRunId=jr_6d15c011060a368aab14ae9e79-Dspark.hadoop.aws.glue.proxy.host=aaa -Dspark.hadoop.mapred.output.direct.EmrFileSystem=true -Dspark.glueJobInsights.enabled=true -Dspark.glue.JOB_NAME=crm-test-with-http-full-url -Dspark.hadoop.lakeformation.credentials.url=aaaa:9998/lakeformationcredentials -Dspark.eventLog.dir=/tmp/spark-event-logs/ -Dspark.rpc.askTimeout=600 -Dspark.hadoop.fs.s3.impl=com.amazon.ws.emr.hadoop.fs.EmrFileSystem -Dspark.hadoop.mapred.output.direct.NativeS3FileSystem=true -Dspark.master=jes -Dspark.cloudwatch.logging.ui.showConsoleProgress=true -Dspark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=2 -Dspark.hadoop.mapreduce.fileoutputcommitter.marksuccessfuljobs=false -Dspark.unsafe.sorter.spill.read.ahead.enabled=false -Dspark.hadoop.parquet.enable.summary-metadata=false -Dspark.hadoop.glue.michiganCredentialsProviderProxy=com.amazonaws.services.glue.remote.LakeformationCredentialsProvider -Dspark.glueAppInsightsLog.dir=/tmp/glue-app-insights-logs/ -Dspark.glue.enable-continuous-cloudwatch-log=true -Dspark.glue.jobLanguage=python -Dspark.glue.endpoint=glue-jes-prod.us-east-1.amazonaws.com -Dspark.ui.enabled=false -Dspark.hadoop.aws.glue.proxy.port=8888 -Dspark.driver.extraClassPath=/tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar -Dspark.glue.USE_PROXY=true -Dspark.files.overwrite=true -Dspark.authenticate=true com.amazonaws.services.glue.ProcessLauncher --launch-class org.apache.spark.executor.CoarseGrainedExecutorBackendWrapper --hostname aaaa --driver-url spark://CoarseGrainedScheduler@aaaa --executor-id 10 --app-id spark-application-aaaa --cores 16
There might be an issue with the connection settings when connecting to the Dynamics CRM server. There can be various reasons for this error, some possible reasons are:
Invalid credentials: Make sure that you are providing the correct username and password for the Dynamics CRM server. Also, check if the user has the correct permissions to access the server.
Incorrect URL: Check the URL of the Dynamics CRM server that you are trying to connect to and make sure it is correct.
DNS resolution: Make sure that your server is able to resolve the DNS address of the CRM server. You can use 'nslookup' command for this.
Firewall: Ensure that the Firewall between your Glue Job and Dynamics CRM is not blocking the port you are trying to connect through.
SPNEGO : The error message mentions about the unexpected SPNEGO response, This typically happens when there's an issue with the Kerberos authentication. Verify the settings, whether the correct SPN is being used and check the clock skew between Glue Job and Dynamics CRM.
Try connecting to the Dynamics CRM server using the same credentials and URL outside of Glue Jobs to see if you are able to connect successfully.
If you still can't find a solution to the issue, you might want to consider consulting with AWS and C-Data support to further investigate the problem.
Business Applications communities