Skip to main content

Notifications

Customer experience | Sales, Customer Insights,...
Unanswered

Error Connectivity

(0) ShareShare
ReportReport
Posted on by 5

An error occurred while calling o92.getDynamicFrame. Glue ETL Marketplace: failed to retrieve primary key from source.driverClassName: cdata.jdbc.dynamicscrm.DynamicsCRMDriver, error message: Failed to login CRM Server: Failed to login CRM Server: unexpected SPNEGO response. This can be caused by invalid connection settings.

I have used C-Data Connector in AWS GLUE Jobs.

Also Got this error log as follows,

/usr/bin/java -cp /tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar:/tmp/* -Dlog4j.configuration=log4j -server -aaaaadscd -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:MaxHeapFreeRatio=70 -XX:+CMSClassUnloadingEnabled -XX:OnOutOfMemoryError=kill -9 %p -XX:+UseCompressedOops -Djavax.net.ssl.trustStore=/opt/amazon/certs/ExternalAndAWSTrustStore.jks -Djavax.net.ssl.trustStoreType=JKS -Djavax.net.ssl.trustStorePassword=aaa -DRDS_ROOT_CERT_PATH=/opt/amazon/certs/rds-combined-ca-bundle.pem -DREDSHIFT_ROOT_CERT_PATH=/opt/amazon/certs/aaa.pem -DRDS_TRUSTSTORE_URL=file:/opt/amazon/certs/RDSTrustStore.jks -Dspark.hadoop.mapred.output.committer.class=org.apache.hadoop.mapred.DirectOutputCommitter -Dspark.executor.extraClassPath=/tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar -Dspark.script.location=N/A -Dspark.glue.enable-job-insights=true -Dspark.glue.connection-names=dynamics365-aaaa -Dspark.glue.JOB_RUN_ID=jr_6d15c011060a368aab14ae9e7aaaa -Dspark.glueExceptionAnalysisEventLog.dir=/tmp/glue-exception-analysis-logs/ -Dspark.authenticate.secret=<HIDDEN> -Dspark.cloudwatch.logging.conf.jobRunId=jr_6d15c011060a368aab14ae9e79-Dspark.hadoop.aws.glue.proxy.host=aaa -Dspark.hadoop.mapred.output.direct.EmrFileSystem=true -Dspark.glueJobInsights.enabled=true -Dspark.glue.JOB_NAME=crm-test-with-http-full-url -Dspark.hadoop.lakeformation.credentials.url=aaaa:9998/lakeformationcredentials -Dspark.eventLog.dir=/tmp/spark-event-logs/ -Dspark.rpc.askTimeout=600 -Dspark.hadoop.fs.s3.impl=com.amazon.ws.emr.hadoop.fs.EmrFileSystem -Dspark.hadoop.mapred.output.direct.NativeS3FileSystem=true -Dspark.master=jes -Dspark.cloudwatch.logging.ui.showConsoleProgress=true -Dspark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=2 -Dspark.hadoop.mapreduce.fileoutputcommitter.marksuccessfuljobs=false -Dspark.unsafe.sorter.spill.read.ahead.enabled=false -Dspark.hadoop.parquet.enable.summary-metadata=false -Dspark.hadoop.glue.michiganCredentialsProviderProxy=com.amazonaws.services.glue.remote.LakeformationCredentialsProvider -Dspark.glueAppInsightsLog.dir=/tmp/glue-app-insights-logs/ -Dspark.glue.enable-continuous-cloudwatch-log=true -Dspark.glue.jobLanguage=python -Dspark.glue.endpoint=glue-jes-prod.us-east-1.amazonaws.com -Dspark.ui.enabled=false -Dspark.hadoop.aws.glue.proxy.port=8888 -Dspark.driver.extraClassPath=/tmp:/opt/amazon/conf:/opt/amazon/glue-manifest.jar -Dspark.glue.USE_PROXY=true -Dspark.files.overwrite=true -Dspark.authenticate=true com.amazonaws.services.glue.ProcessLauncher --launch-class org.apache.spark.executor.CoarseGrainedExecutorBackendWrapper --hostname aaaa --driver-url spark://CoarseGrainedScheduler@aaaa --executor-id 10 --app-id spark-application-aaaa --cores 16

  • Naveen Ganeshe Profile Picture
    Naveen Ganeshe 3,393 User Group Leader on at
    RE: Error Connectivity

    Hi Ashir,

    There might be an issue with the connection settings when connecting to the Dynamics CRM server. There can be various reasons for this error, some possible reasons are:

    1. Invalid credentials: Make sure that you are providing the correct username and password for the Dynamics CRM server. Also, check if the user has the correct permissions to access the server.

    2. Incorrect URL: Check the URL of the Dynamics CRM server that you are trying to connect to and make sure it is correct.

    3. DNS resolution: Make sure that your server is able to resolve the DNS address of the CRM server. You can use 'nslookup' command for this.

    4. Firewall: Ensure that the Firewall between your Glue Job and Dynamics CRM is not blocking the port you are trying to connect through.

    5. SPNEGO : The error message mentions about the unexpected SPNEGO response, This typically happens when there's an issue with the Kerberos authentication. Verify the settings, whether the correct SPN is being used and check the clock skew between Glue Job and Dynamics CRM.

    6. Try connecting to the Dynamics CRM server using the same credentials and URL outside of Glue Jobs to see if you are able to connect successfully.

    If you still can't find a solution to the issue, you might want to consider consulting with AWS and C-Data support to further investigate the problem.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

News and Announcements

Announcing Category Subscriptions!

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Tips for Writing Effective Verified Answers

Best practices for providing successful forum answers ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,359 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,370 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans