{"id":34351,"date":"2021-01-29T14:35:13","date_gmt":"2021-01-29T14:35:13","guid":{"rendered":"https:\/\/www.testpreptraining.com\/tutorial\/?page_id=34351"},"modified":"2022-03-22T10:44:52","modified_gmt":"2022-03-22T10:44:52","slug":"improve-cardinality-levels-by-changing-data-types-and-through-summarization","status":"publish","type":"page","link":"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/","title":{"rendered":"Improve cardinality levels by changing data types and through summarization"},"content":{"rendered":"\n<p>We&#8217;ll go over two popular approaches for reducing the amount of data put into Import models. Remember that import models are loaded with data that has been compressed and optimized, and then the VertiPaq storage engine saves it to disc. Now you&#8217;ll learn about data compression strategies.<\/p>\n\n\n\n<p>The key data reduction approaches used to decrease the data input into the import models will now be discussed.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"optimize-column-data-types\"><strong>Optimize data types<\/strong><\/h4>\n\n\n\n<p>Considering the VertiPaq storage engine uses separate data structures for each column. Some of the features of optimizing column data types include &#8211; <\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Firstly, by design, these data structures achieve the highest optimizations for numeric column data, which use-value encoding. <\/li><li>Also, text and other non-numeric data, uses hash encoding. <\/li><li>Further, it requires the storage engine to assign a numeric identifier to each unique text value contained in the column. <\/li><li>Moreover, it is the numeric identifier, then, that is then stored in the data structure, requiring a hash lookup during storage and querying.<\/li><\/ul>\n\n\n\n<p>You can also transform raw text data into numeric numbers in some cases. For example, a text value may be regularly prefixed to a sales order number (e.g. &#8220;SD123456&#8221;). The order number value might be changed to a whole number without the prefix. It can lead to considerable data reduction in big tables, especially when the column includes unique or high cardinality values.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"group-by-and-summarize\"><strong>Group by and summarize<\/strong><\/h4>\n\n\n\n<p>This is possibly one of the most effective techniques used to reduce a model size is to load pre-summarized data. <\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Firstly, this technique can be used to raise the grain of fact-type tables. <\/li><li>Secondly, there is a distinct trade-off, however, resulting in loss of detail.<\/li><li>Moreover, deciding to summarize fact-type data always involves tradeoffs. <\/li><li>Lastly, tradeoff could be mitigated by a Mixed model design, and this option is described in the&nbsp;Switch to Mixed mode&nbsp;technique.<\/li><\/ul>\n\n\n\n<p>A source sales fact table, for example, maintains one row per order line. However, by summarising all sales indicators and sorting by date, client, and product, considerable data reduction might be achieved. Consider that grouping by date at the monthly level might result in even more considerable data reduction. This might now result in a 99 percent decrease in model size, but reporting at the day or individual order level is no longer viable.<\/p>\n\n\n\n<div class=\"wp-block-image is-style-default\"><figure class=\"aligncenter\"><a href=\"https:\/\/www.testpreptraining.ai\/analyzing-data-with-microsoft-power-bi-da-100-free-test\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2021\/01\/Microsoft-Exam-DA-100-Free-Practice-Test.png\" alt=\"Microsoft Exam DA-100 Free Practice Test\"\/><\/a><\/figure><\/div>\n\n\n\n<p><strong>Reference: <a href=\"https:\/\/docs.microsoft.com\/en-us\/power-bi\/guidance\/import-modeling-data-reduction\" target=\"_blank\" rel=\"noreferrer noopener\">Data reduction techniques for Import modeling<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We&#8217;ll go over two popular approaches for reducing the amount of data put into Import models. Remember that import models are loaded with data that has been compressed and optimized, and then the VertiPaq storage engine saves it to disc. Now you&#8217;ll learn about data compression strategies. The key data reduction approaches used to decrease&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[174],"tags":[1830,3955,3954],"class_list":["post-34351","page","type-page","status-publish","hentry","category-microsoft-azure","tag-da-100-study-guide","tag-microsoft-exam-da-100-exam-questions","tag-microsoft-exam-da-100-free-practice-test"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Data Reduction Techniques | Changing Data Types | Summarization<\/title>\n<meta name=\"description\" content=\"Learn about data reduction techniques with latest practice test and online tutorial. Start your preparation for Microosft Exam DA-100 Now!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Data Reduction Techniques | Changing Data Types | Summarization\" \/>\n<meta property=\"og:description\" content=\"Learn about data reduction techniques with latest practice test and online tutorial. Start your preparation for Microosft Exam DA-100 Now!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/\" \/>\n<meta property=\"og:site_name\" content=\"Testprep Training Tutorials\" \/>\n<meta property=\"article:modified_time\" content=\"2022-03-22T10:44:52+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2021\/01\/Microsoft-Exam-DA-100-Free-Practice-Test.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/\",\"name\":\"Data Reduction Techniques | Changing Data Types | Summarization\",\"isPartOf\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\"},\"datePublished\":\"2021-01-29T14:35:13+00:00\",\"dateModified\":\"2022-03-22T10:44:52+00:00\",\"description\":\"Learn about data reduction techniques with latest practice test and online tutorial. Start your preparation for Microosft Exam DA-100 Now!\",\"breadcrumb\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Improve cardinality levels by changing data types and through summarization\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"name\":\"Testprep Training Tutorials\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\",\"name\":\"Testprep Training\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"contentUrl\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"width\":583,\"height\":153,\"caption\":\"Testprep Training\"},\"image\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Data Reduction Techniques | Changing Data Types | Summarization","description":"Learn about data reduction techniques with latest practice test and online tutorial. Start your preparation for Microosft Exam DA-100 Now!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/","og_locale":"en_US","og_type":"article","og_title":"Data Reduction Techniques | Changing Data Types | Summarization","og_description":"Learn about data reduction techniques with latest practice test and online tutorial. Start your preparation for Microosft Exam DA-100 Now!","og_url":"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/","og_site_name":"Testprep Training Tutorials","article_modified_time":"2022-03-22T10:44:52+00:00","og_image":[{"url":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2021\/01\/Microsoft-Exam-DA-100-Free-Practice-Test.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/","url":"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/","name":"Data Reduction Techniques | Changing Data Types | Summarization","isPartOf":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website"},"datePublished":"2021-01-29T14:35:13+00:00","dateModified":"2022-03-22T10:44:52+00:00","description":"Learn about data reduction techniques with latest practice test and online tutorial. Start your preparation for Microosft Exam DA-100 Now!","breadcrumb":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/improve-cardinality-levels-by-changing-data-types-and-through-summarization\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.testpreptraining.ai\/tutorial\/"},{"@type":"ListItem","position":2,"name":"Improve cardinality levels by changing data types and through summarization"}]},{"@type":"WebSite","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","name":"Testprep Training Tutorials","description":"","publisher":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization","name":"Testprep Training","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/","url":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","contentUrl":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","width":583,"height":153,"caption":"Testprep Training"},"image":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/34351","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/comments?post=34351"}],"version-history":[{"count":7,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/34351\/revisions"}],"predecessor-version":[{"id":53341,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/34351\/revisions\/53341"}],"wp:attachment":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/media?parent=34351"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/categories?post=34351"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/tags?post=34351"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}