Connecting Databricks SQL Database To MuleSoft

Author: Ashish Singh Chauhan

Prerequisite:

1. You must have all the credentials provided by your client as the Databricks reside at the client end so you won’t be able to access it directly.

2. Your public IP address must be unblocked by the client for accessing the Databricks database. This will help to test your application on a local machine.

Steps of connection:

1. Add a listener to trigger your flow and configure it.

2. Add a Database module to your Mule palette.

Mule palette → Add modules → Database Module and drop in the palette.

3. Save connection details i.e Host, Port, Sql HTTP path, and Personal access token.

4. For making connections download the databricks-jdbc jar file and pom file. For that:

• Go to the link – https://search.maven.org/artifact/com.databricks/databricks-jdbc/2.6.25-1/jar
• Go to the top right corner in downloads → Download jar and pom from there. 

5. Go to global elements → create → Connector configuration → Database config → Select the generic connection.

6. In configuring JDBC driver – use the local file – in File and pom, add the path to your downloaded jar and pom of jdbc.

7. Configure Url as follows →

jdbc:databricks://<host>:<port>/default;transportMode=http;ssl=1;AuthMech=3;httpPath=<http_path>;UID=token;PWD=<personal_access_token>;

Replace your <host>, <port>, <http_path> and <personal_access_token> with credentials saved in step 3.

Driver class name – com.databricks.client.jdbc.Driver

Username and Password – Not required since you are using a personal access token.

After configuring the test connection.

Note – i) Here jdbc:databricks is used for integration purposes with MuleSoft. In general, jdbc:sparks is used.

 ii) Make sure your VPN is active before making the connection.

8. Add a Select component in Mule flow and write your query in it.

9. The Mule flow will be like below:

10. Run your Mule application and hit the endpoint. You will see the data in your postman.

References:

1. https://docs.databricks.com/integrations/jdbc-odbc-bi.html
2. https://search.maven.org/artifact/com.databricks/databricks-jdbc/2.6.25-1/jar