{"id":28409,"date":"2020-12-28T12:14:23","date_gmt":"2020-12-28T12:14:23","guid":{"rendered":"https:\/\/www.testpreptraining.com\/tutorial\/?page_id=28409"},"modified":"2020-12-28T12:14:24","modified_gmt":"2020-12-28T12:14:24","slug":"extract-transform-and-load-data-by-using-azure-databricks","status":"publish","type":"page","link":"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/","title":{"rendered":"Extract, transform, and load data by using Azure Databricks"},"content":{"rendered":"\n<p><a href=\"https:\/\/www.testpreptraining.ai\/tutorial\/exam-dp-200-implementing-an-azure-data-solution\/\" target=\"_blank\" rel=\"noreferrer noopener\">Go back to DP-200 Tutorials<\/a><\/p>\n\n\n\n<p>In this we will learn about how to perform an ETL (extract, transform, and load data) operation by using Azure Databricks. Here, we will learn to extract data from Azure Data Lake Storage Gen2 into Azure Databricks, run transformations on the data in Azure Databricks. And then, load the transformed data into Azure Synapse Analytics.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Prerequisites<\/strong><\/h2>\n\n\n\n<ul class=\"wp-block-list\"><li>Firstly, create an Azure Synapse, create a server-level firewall rule, and connect to the server as a server admin. <\/li><li>Secondly, create a master key for the Azure Synapse. <\/li><li>Then, create an Azure Blob storage account, and a container within it. Also, retrieve the access key to access the storage account.<\/li><li>After that, create an Azure Data Lake Storage Gen2 storage account. <\/li><li>Create a service principal. See How to: Use the portal to create an Azure AD application and service principal that can access resources.<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Create an Azure Databricks service<\/strong><\/h4>\n\n\n\n<p>In this section, you create an Azure Databricks service by using the Azure portal.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Firstly, from the Azure portal menu, select Create a resource. Then, select Analytics > Azure Databricks.<\/li><li>Secondly, under Azure Databricks Service, provide the following values to create a Databricks service:<ul><li><strong>Property Description<\/strong><ul><li>Workspace name: Provide a name for your Databricks workspace.<\/li><li>Subscription: From the drop-down, select your Azure subscription.<\/li><li>Resource group: Specify whether you want to create a new resource group or use an existing one. However, a resource group is a container that holds related resources for an Azure solution.<\/li><li>Location: Select West US 2.<\/li><li>Pricing Tier: Select Standard.<\/li><\/ul><\/li><\/ul><\/li><li>Thirdly, the account creation takes a few minutes. To monitor the operation status, view the progress bar at the top.<\/li><li>Lastly, select Pin to dashboard and then select Create.<\/li><\/ul>\n\n\n\n<p><strong>Create a Spark cluster in Azure Databricks<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Firstly, in the Azure portal, go to the Databricks service that you created, and select Launch Workspace.<\/li><li>Then, you&#8217;re redirected to the Azure Databricks portal. From the portal, select Cluster.<\/li><li>Thirdly, in the New cluster page, provide the values to create a cluster.<\/li><li>Lastly, fill in values for the following fields, and accept the default values for the other fields:<ul><li>Enter a name for the cluster.<\/li><li>Make sure you select the Terminate after __ minutes of inactivity check box. If the cluster isn&#8217;t being used, provide a duration (in minutes) to terminate the cluster.<\/li><li>Select Create cluster. After the cluster is running, you can attach notebooks to the cluster and run Spark jobs.<\/li><\/ul><\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Create a file system in the Azure Data Lake Storage Gen2 account<\/strong><\/h4>\n\n\n\n<p>In this section, you create a notebook in Azure Databricks workspace and then run code snippets to configure the storage account<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Firstly, in the Azure portal, go to the Azure Databricks service that you created, and select Launch Workspace.<\/li><li>Secondly, on the left, select Workspace. From the Workspace drop-down, select Create > Notebook.<\/li><li>Next, in the Create Notebook dialog box, enter a name for the notebook. Select Scala as the language, and then select the Spark cluster that you created earlier.<\/li><li>Fourthly, select Create.<\/li><li>Below, the following code block sets default service principal credentials for any ADLS Gen 2 account accessed in the Spark session. The second code block appends the account name to the setting to specify credentials for a specific ADLS Gen 2 account.<\/li><\/ul>\n\n\n\n<h6 class=\"wp-block-heading\"><strong>Session configuration<\/strong><\/h6>\n\n\n\n<p><strong>Scala<\/strong><br>val appID = &#8220;&#8221;<br>secret = &#8220;&#8221;<br>val tenantID = &#8220;&#8221;<\/p>\n\n\n\n<p>spark.conf.set(&#8220;fs.azure.account.auth.type&#8221;, &#8220;OAuth&#8221;)<br>spark.conf.set(&#8220;fs.azure.account.oauth.provider.type&#8221;, &#8220;org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider&#8221;)<br>spark.conf.set(&#8220;fs.azure.account.oauth2.client.id&#8221;, &#8220;&#8221;)<br>spark.conf.set(&#8220;fs.azure.account.oauth2.client.secret&#8221;, &#8220;&#8221;)<br>spark.conf.set(&#8220;fs.azure.account.oauth2.client.endpoint&#8221;, &#8220;https:\/\/login.microsoftonline.com\/\/oauth2\/token&#8221;)<br>spark.conf.set(&#8220;fs.azure.createRemoteFileSystemDuringInitialization&#8221;, &#8220;true&#8221;)<\/p>\n\n\n\n<h6 class=\"wp-block-heading\"><strong>Account configuration<\/strong><\/h6>\n\n\n\n<p><strong>Scala<\/strong><br>val storageAccountName = &#8220;&#8221;<br>val appID = &#8220;&#8221;<br>secret = &#8220;&#8221;<br>val fileSystemName = &#8220;&#8221;<br>val tenantID = &#8220;&#8221;<\/p>\n\n\n\n<p>spark.conf.set(&#8220;fs.azure.account.auth.type.&#8221; + storageAccountName + &#8220;.dfs.core.windows.net&#8221;, &#8220;OAuth&#8221;)<br>spark.conf.set(&#8220;fs.azure.account.oauth.provider.type.&#8221; + storageAccountName + &#8220;.dfs.core.windows.net&#8221;, &#8220;org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider&#8221;)<br>spark.conf.set(&#8220;fs.azure.account.oauth2.client.id.&#8221; + storageAccountName + &#8220;.dfs.core.windows.net&#8221;, &#8220;&#8221; + appID + &#8220;&#8221;)<br>spark.conf.set(&#8220;fs.azure.account.oauth2.client.secret.&#8221; + storageAccountName + &#8220;.dfs.core.windows.net&#8221;, &#8220;&#8221; + secret + &#8220;&#8221;)<br>spark.conf.set(&#8220;fs.azure.account.oauth2.client.endpoint.&#8221; + storageAccountName + &#8220;.dfs.core.windows.net&#8221;, &#8220;https:\/\/login.microsoftonline.com\/&#8221; + tenantID + &#8220;\/oauth2\/token&#8221;)<br>spark.conf.set(&#8220;fs.azure.createRemoteFileSystemDuringInitialization&#8221;, &#8220;true&#8221;)<br>dbutils.fs.ls(&#8220;abfss:\/\/&#8221; + fileSystemName + &#8220;@&#8221; + storageAccountName + &#8220;.dfs.core.windows.net\/&#8221;)<br>spark.conf.set(&#8220;fs.azure.createRemoteFileSystemDuringInitialization&#8221;, &#8220;false&#8221;)<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Then, in this code block, replace the , , , and placeholder values in this code block with the values that you collected while completing the prerequisites of this tutorial. Replace the placeholder value with whatever name you want to give the file system.<\/li><li>Lastly, press the SHIFT + ENTER keys to run the code in this block.<\/li><\/ul>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><a href=\"https:\/\/www.testpreptraining.ai\/implementing-an-azure-data-solution-dp-200-free-practice-test\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" width=\"961\" height=\"150\" src=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/08\/dp-200-pracice-tests-1.png\" alt=\"DP-200 practice tests\" class=\"wp-image-18535\" srcset=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/08\/dp-200-pracice-tests-1.png 961w, https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/08\/dp-200-pracice-tests-1-750x117.png 750w\" sizes=\"auto, (max-width: 961px) 100vw, 961px\" \/><\/a><\/figure><\/div>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Transform data in Azure Databricks<\/strong><\/h4>\n\n\n\n<p>The raw sample data small_radio_json.json file captures the audience for a radio station and has a variety of columns. In this section, you transform the data to only retrieve specific columns from the dataset.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Firstly, retrieve only the columns firstName, lastName, gender, location, and level from the dataframe that you created.<\/li><\/ul>\n\n\n\n<p><strong>Scala<\/strong><br><em>val specificColumnsDf = df.select(&#8220;firstname&#8221;, &#8220;lastname&#8221;, &#8220;gender&#8221;, &#8220;location&#8221;, &#8220;level&#8221;)<br>specificColumnsDf.show()<\/em><\/p>\n\n\n\n<p><strong>You receive output as shown in the following snippet:<\/strong><\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"724\" height=\"400\" src=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/12\/commands-15-724x400.png\" alt=\"Extract, transform, and load data by using Azure Databricks\" class=\"wp-image-28449\" srcset=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/12\/commands-15-724x400.png 724w, https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/12\/commands-15.png 753w\" sizes=\"auto, (max-width: 724px) 100vw, 724px\" \/><figcaption>Image Source: Microsoft<\/figcaption><\/figure><\/div>\n\n\n\n<ul class=\"wp-block-list\"><li>Secondly, you can further transform this data to rename the column level to subscription_type.<\/li><\/ul>\n\n\n\n<p><strong>Scala<\/strong><br><em>val renamedColumnsDF = specificColumnsDf.withColumnRenamed(&#8220;level&#8221;, &#8220;subscription_type&#8221;)<br>renamedColumnsDF.show()<\/em><\/p>\n\n\n\n<p><strong>You receive output as shown in the following snippet.<\/strong><\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"728\" height=\"400\" src=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/12\/commands-16-728x400.png\" alt=\"Extract, transform, and load data by using Azure Databricks\" class=\"wp-image-28450\" srcset=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/12\/commands-16-728x400.png 728w, https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/12\/commands-16.png 750w\" sizes=\"auto, (max-width: 728px) 100vw, 728px\" \/><figcaption>Image Source: Microsoft<\/figcaption><\/figure><\/div>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Load data into Azure Synapse<\/strong><\/h4>\n\n\n\n<p>In this section, you upload the transformed data into Azure Synapse. You use the Azure Synapse connector for Azure Databricks to directly upload a dataframe as a table in a Synapse Spark pool.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Firstly, provide the configuration to access the Azure Storage account from Azure Databricks.<\/li><\/ul>\n\n\n\n<ul class=\"wp-block-list\"><li>Secondly, specify a temporary folder to use while moving data between Azure Databricks and Azure Synapse.<\/li><\/ul>\n\n\n\n<p><strong>Scala<\/strong><br><em>val tempDir = &#8220;wasbs:\/\/&#8221; + blobContainer + &#8220;@&#8221; + blobStorage +&#8221;\/tempDirs&#8221;<\/em><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Thirdly, run the following snippet to store Azure Blob storage access keys in the configuration. This action ensures that you don&#8217;t have to keep the access key in the notebook in plain text.<\/li><\/ul>\n\n\n\n<h6 class=\"wp-block-heading\"><strong>Scala<\/strong><\/h6>\n\n\n\n<p><em>val acntInfo = &#8220;fs.azure.account.key.&#8221;+ blobStorage<br>sc.hadoopConfiguration.set(acntInfo, blobAccessKey)<\/em><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>After that, provide the values to connect to the Azure Synapse instance. You must have created an Azure Synapse Analytics service as a prerequisite. Use the fully qualified server name for dwServer. <\/li><\/ul>\n\n\n\n<ul class=\"wp-block-list\"><li>Then, run the following snippet to load the transformed dataframe, renamedColumnsDF, as a table in Azure Synapse. Moreover, this snippet creates a table called SampleTable in the SQL database.<\/li><\/ul>\n\n\n\n<h6 class=\"wp-block-heading\"><strong>Scala<\/strong><\/h6>\n\n\n\n<p><em>spark.conf.set(<br>&#8220;spark.sql.parquet.writeLegacyFormat&#8221;,<br>&#8220;true&#8221;)<\/em><\/p>\n\n\n\n<p><em>renamedColumnsDF.write.format(&#8220;com.databricks.spark.sqldw&#8221;).option(&#8220;url&#8221;, sqlDwUrlSmall).option(&#8220;dbtable&#8221;, &#8220;SampleTable&#8221;) .option( &#8220;forward_spark_azure_storage_credentials&#8221;,&#8221;True&#8221;).option(&#8220;tempdir&#8221;, tempDir).mode(&#8220;overwrite&#8221;).save()<\/em><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Next, connect to the SQL database and verify that you see a database named SampleTable.<\/li><li>Lastly, run a select query to verify the contents of the table.However, the table should have the same data as the renamedColumnsDF dataframe.<\/li><\/ul>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><a href=\"https:\/\/www.testpreptraining.ai\/implementing-an-azure-data-solution-dp-200-practice-exam\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" width=\"961\" height=\"150\" src=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/08\/dp-200-online-course-1.png\" alt=\"Extract, transform, and load data by using Azure Databricks DP-200 Online course\" class=\"wp-image-18534\" srcset=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/08\/dp-200-online-course-1.png 961w, https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/08\/dp-200-online-course-1-750x117.png 750w\" sizes=\"auto, (max-width: 961px) 100vw, 961px\" \/><\/a><\/figure><\/div>\n\n\n\n<p class=\"has-text-align-right\"><strong>Reference: <\/strong><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/databricks\/scenarios\/databricks-extract-load-sql-data-warehouse\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Documentation<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.testpreptraining.ai\/tutorial\/exam-dp-200-implementing-an-azure-data-solution\/\" target=\"_blank\" rel=\"noreferrer noopener\">Go back to DP-200 Tutorials<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Go back to DP-200 Tutorials In this we will learn about how to perform an ETL (extract, transform, and load data) operation by using Azure Databricks. Here, we will learn to extract data from Azure Data Lake Storage Gen2 into Azure Databricks, run transformations on the data in Azure Databricks. And then, load the transformed&#8230;<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[],"tags":[],"class_list":["post-28409","page","type-page","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Extract, transform, and load data by using Azure Databricks - Testprep<\/title>\n<meta name=\"description\" content=\"Enhance your skill and knowledge by learning about Azure Databricks using Microsoft DP-200 online course and Practice Exam Now!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Extract, transform, and load data by using Azure Databricks - Testprep\" \/>\n<meta property=\"og:description\" content=\"Enhance your skill and knowledge by learning about Azure Databricks using Microsoft DP-200 online course and Practice Exam Now!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/\" \/>\n<meta property=\"og:site_name\" content=\"Testprep Training Tutorials\" \/>\n<meta property=\"article:modified_time\" content=\"2020-12-28T12:14:24+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/08\/dp-200-pracice-tests-1.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/\",\"name\":\"Extract, transform, and load data by using Azure Databricks - Testprep\",\"isPartOf\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\"},\"datePublished\":\"2020-12-28T12:14:23+00:00\",\"dateModified\":\"2020-12-28T12:14:24+00:00\",\"description\":\"Enhance your skill and knowledge by learning about Azure Databricks using Microsoft DP-200 online course and Practice Exam Now!\",\"breadcrumb\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Extract, transform, and load data by using Azure Databricks\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"name\":\"Testprep Training Tutorials\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\",\"name\":\"Testprep Training\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"contentUrl\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"width\":583,\"height\":153,\"caption\":\"Testprep Training\"},\"image\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Extract, transform, and load data by using Azure Databricks - Testprep","description":"Enhance your skill and knowledge by learning about Azure Databricks using Microsoft DP-200 online course and Practice Exam Now!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/","og_locale":"en_US","og_type":"article","og_title":"Extract, transform, and load data by using Azure Databricks - Testprep","og_description":"Enhance your skill and knowledge by learning about Azure Databricks using Microsoft DP-200 online course and Practice Exam Now!","og_url":"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/","og_site_name":"Testprep Training Tutorials","article_modified_time":"2020-12-28T12:14:24+00:00","og_image":[{"url":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2020\/08\/dp-200-pracice-tests-1.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/","url":"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/","name":"Extract, transform, and load data by using Azure Databricks - Testprep","isPartOf":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website"},"datePublished":"2020-12-28T12:14:23+00:00","dateModified":"2020-12-28T12:14:24+00:00","description":"Enhance your skill and knowledge by learning about Azure Databricks using Microsoft DP-200 online course and Practice Exam Now!","breadcrumb":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/extract-transform-and-load-data-by-using-azure-databricks\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.testpreptraining.ai\/tutorial\/"},{"@type":"ListItem","position":2,"name":"Extract, transform, and load data by using Azure Databricks"}]},{"@type":"WebSite","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","name":"Testprep Training Tutorials","description":"","publisher":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization","name":"Testprep Training","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/","url":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","contentUrl":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","width":583,"height":153,"caption":"Testprep Training"},"image":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/28409","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/comments?post=28409"}],"version-history":[{"count":7,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/28409\/revisions"}],"predecessor-version":[{"id":28587,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/28409\/revisions\/28587"}],"wp:attachment":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/media?parent=28409"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/categories?post=28409"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/tags?post=28409"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}