{"id":320,"date":"2019-02-06T10:08:48","date_gmt":"2019-02-06T10:08:48","guid":{"rendered":"https:\/\/www.testpreptraining.com\/tutorial\/?page_id=320"},"modified":"2020-05-01T12:29:28","modified_gmt":"2020-05-01T12:29:28","slug":"amazon-redshift-amazon-dynamodb","status":"publish","type":"page","link":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/","title":{"rendered":"Amazon Redshift"},"content":{"rendered":"\n<ul class=\"wp-block-list\"><li>It is a quick, powerful, and fully managed, petabyte-scale data warehouse service in AWS<\/li><li>It is a RDBMS\n<ul>\n<li>built specifically for OLAP<\/li>\n<\/ul>\n<ul>\n<li>optimized for high-performance analysis and reporting<\/li>\n<\/ul>\n<ul>\n<li>for very large datasets<\/li>\n<\/ul>\n<\/li><li>Usage in fast querying capabilities<\/li><li>Uses standard SQL commands for interactive query<\/li><li>connectivity by ODBC or JDBC<\/li><li>It depends on PostgreSQL<\/li><li>It also automatically monitors nodes and drives to support recovery from any failures.<\/li><li>Has a massively parallel processing (MPP) architecture to parallelize and distribute SQL operations<\/li><li>stores three copies of your data \u2014 all data written to a node in cluster is automatically replicated to other nodes within the cluster, and all data is continuously backed up to Amazon S3.<\/li><li>Snapshots are automated, incremental, and continuous and stored for a user-defined period (1-35 days)<\/li><li>Manual snapshots can be created and are retained until deleted.<\/li><li>Continuously monitors health of cluster<\/li><li>Automatically re-replicates data from failed drives and replaces nodes as necessary.<\/li><li>has three pricing components:\n<ul>\n<li>data warehouse node hours \u2013 total number of hours run across all the compute node<\/li>\n<\/ul>\n<ul>\n<li>backup storage \u2013 storage cost for automated and manual snapshots<\/li>\n<\/ul>\n<ul>\n<li>data transfer\n<ul>\n<li>There is no data transfer charge for data transferred to or from Amazon Redshift outside of Amazon VPC<\/li>\n<\/ul>\n<ul>\n<li>Data transfer to or from Amazon Redshift in Amazon VPC accrues standard AWS data transfer charges.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li><li>number of nodes can be easily scaled as per demand<\/li><\/ul>\n\n\n\n<p><strong>Clusters and Nodes <\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>cluster is composed of a leader node and one or more compute nodes.<\/li><li>client application interacts directly only with leader node<\/li><li>compute nodes are transparent to external applications.<\/li><li>Redshift provides support for six different node types and each has a different mix of CPU, memory, and storage.<\/li><li>node types are grouped into categories\n<ul>\n<li>Dense Compute \u2013support clusters up to 326TB using fast SSDs<\/li>\n<\/ul>\n<ul>\n<li>Dense Storage \u2013support clusters up to 2PB using large magnetic disks.<\/li>\n<\/ul>\n<\/li><\/ul>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"371\" height=\"340\" src=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/08\/image-257.png\" alt=\"\" class=\"wp-image-2774\"\/><\/figure><\/div>\n\n\n\n<p><strong>Data Types <\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Redshift columns support a wide range of data types<\/li><li>Supported data types are\n<ul>\n<li>numeric &#8211; INTEGER, DECIMAL, and DOUBLE<\/li>\n<\/ul>\n<ul>\n<li>text &#8211; CHAR and VARCHAR<\/li>\n<\/ul>\n<ul>\n<li>date &#8211; DATE and TIMESTAMP<\/li>\n<\/ul>\n<\/li><li>Additional columns can be added to table using ALTER TABLE command<\/li><li>existing columns cannot be modified.<\/li><\/ul>\n\n\n\n<p><strong>Compression Encoding <\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Redshift\u2019s data compression is key performance optimizations<\/li><li>During data loading into an empty table, Redshift samples data and selects best compression scheme for each column.<\/li><li>User can also specify compression encoding on a per-column basis with CREATE TABLE&nbsp; command.<\/li><\/ul>\n\n\n\n<p><strong>Distribution Strategy <\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>how to distribute records across nodes and slices in a cluster<\/li><li>configure distribution style of a table, how data be partitioned to meet query patterns<\/li><li>By running a query, optimizer shifts rows as needed to perform any joins and aggregates<\/li><li>table distribution style aims\n<ul>\n<li>to minimize impact of redistribution step<\/li>\n<\/ul>\n<ul>\n<li>putting data where it needs to be before query is performed.<\/li>\n<\/ul>\n<\/li><li>For best distribution strategy for each table, balance data distribution<\/li><li>During table creation, can choose between distribution styles: EVEN, KEY, or ALL.<\/li><li>EVEN distribution \u2013default option, data being distributed across slices in uniform fashion regardless of data.<\/li><li>KEY distribution \u2013rows are distributed as per values in one column. leader node will store matching values close together and increase query performance for joins.<\/li><li>ALL distribution \u2013a full copy of entire table is distributed to every node. useful for large tables which are not updated frequently.<\/li><\/ul>\n\n\n\n<p><strong>Loading Data&nbsp; <\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>For bulk operations, Redshift provides COPY command<\/li><li>Does not need to repeatedly calling INSERT for bulk upload<\/li><li>loading data from S3, COPY command can read from multiple files at same time.<\/li><li>Redshift can distribute workload to nodes and perform load process in parallel.<\/li><li>Enable parallel processing by cluster with multiple nodes and multiple input files instead single large file with data<\/li><li>After bulk data load run VACUUM command to reorganize data and reclaim space after deletes.<\/li><li>suggested to run ANALYZE command to update table statistics.<\/li><\/ul>\n\n\n\n<p><strong>Querying Data <\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Redshift offers standard SQL commands to query tables<\/li><li>It supports SELECT to query and join tables<\/li><li>For complex queries, can analyze query plan to optimize access pattern.<\/li><li>can monitor performance of cluster by queries using CloudWatch and Redshift web console.<\/li><li>To support many users, configure Workload Management (WLM) to queue and prioritize queries.<\/li><li>WLM defines multiple queues and set concurrency level for each queue.<\/li><\/ul>\n\n\n\n<p><strong>Snapshots <\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>create point-in-time snapshots of Redshift cluster<\/li><li>can be used to restore a copy or create a clone of original Redshift cluster<\/li><li>They are durably stored internally in S3 by Redshift.<\/li><li>Redshift supports automated and manual snapshots<\/li><li>automated snapshots \u2013 Redshift periodically take snapshots of cluster and copy is kept for configurable retention period.<\/li><li>manual snapshots &#8211; can be done and share across regions or with other AWS accounts. Need to be explicitly deleted<\/li><\/ul>\n\n\n\n<p><strong>Security<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>securing Redshift cluster similar to securing databases in cloud.<\/li><li>security plan must include controls to protect\n<ul>\n<li>infrastructure resources<\/li>\n<\/ul>\n<ul>\n<li>database schema<\/li>\n<\/ul>\n<ul>\n<li>records in table<\/li>\n<\/ul>\n<ul>\n<li>network access.<\/li>\n<\/ul>\n<\/li><li>Need to address security at every level to securely operate an Redshift data warehouse.<\/li><li>first layer &#8211; infrastructure level using IAM policies to limit actions like\n<ul>\n<li>to create and manage lifecycle of a cluster<\/li>\n<\/ul>\n<ul>\n<li>scaling<\/li>\n<\/ul>\n<ul>\n<li>backup<\/li>\n<\/ul>\n<ul>\n<li>recovery operations.<\/li>\n<\/ul>\n<\/li><li>Deploy clusters within private IP address space of VPC to restrict network connectivity<\/li><li>Fine-grained network access by security groups and network ACLs at subnet level.<\/li><li>At database level, create a master user account for creating to create more users and groups.<\/li><li>Each database user can be granted permission to\n<ul>\n<li>Schemas<\/li>\n<\/ul>\n<ul>\n<li>Tables<\/li>\n<\/ul>\n<ul>\n<li>other database objects<\/li>\n<\/ul>\n<\/li><li>These permissions are independent from IAM policies<\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>It is a quick, powerful, and fully managed, petabyte-scale data warehouse service in AWS It is a RDBMS built specifically for OLAP optimized for high-performance analysis and reporting for very large datasets Usage in fast querying capabilities Uses standard SQL commands for interactive query connectivity by ODBC or JDBC It depends on PostgreSQL It also&#8230;<\/p>\n","protected":false},"author":1,"featured_media":321,"parent":53,"menu_order":23,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[],"tags":[13,14,34,5],"class_list":["post-320","page","type-page","status-publish","has-post-thumbnail","hentry","tag-aws-certified-solutions-architect-professional","tag-aws-exam-dumps","tag-aws-redshift","tag-aws-solutions-architect"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Amazon Redshift | AWS Tutorials | TestPrep<\/title>\n<meta name=\"description\" content=\"Learn more about Amazon Redshift and Amazon DynamoDB with thousands of practice test to qualify the exam with 100% pass guarantee. Get Certified Now!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Amazon Redshift | AWS Tutorials | TestPrep\" \/>\n<meta property=\"og:description\" content=\"Learn more about Amazon Redshift and Amazon DynamoDB with thousands of practice test to qualify the exam with 100% pass guarantee. Get Certified Now!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/\" \/>\n<meta property=\"og:site_name\" content=\"Testprep Training Tutorials\" \/>\n<meta property=\"article:modified_time\" content=\"2020-05-01T12:29:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/02\/Amazon-redshift-and-Amazon-DynamoDB.png\" \/>\n\t<meta property=\"og:image:width\" content=\"753\" \/>\n\t<meta property=\"og:image:height\" content=\"413\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/\",\"name\":\"Amazon Redshift | AWS Tutorials | TestPrep\",\"isPartOf\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\"},\"datePublished\":\"2019-02-06T10:08:48+00:00\",\"dateModified\":\"2020-05-01T12:29:28+00:00\",\"description\":\"Learn more about Amazon Redshift and Amazon DynamoDB with thousands of practice test to qualify the exam with 100% pass guarantee. Get Certified Now!\",\"breadcrumb\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AWS Certified Solutions Architect Associate (SAA-C03)\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Amazon Redshift\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"name\":\"Testprep Training Tutorials\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\",\"name\":\"Testprep Training\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"contentUrl\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"width\":583,\"height\":153,\"caption\":\"Testprep Training\"},\"image\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Amazon Redshift | AWS Tutorials | TestPrep","description":"Learn more about Amazon Redshift and Amazon DynamoDB with thousands of practice test to qualify the exam with 100% pass guarantee. Get Certified Now!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/","og_locale":"en_US","og_type":"article","og_title":"Amazon Redshift | AWS Tutorials | TestPrep","og_description":"Learn more about Amazon Redshift and Amazon DynamoDB with thousands of practice test to qualify the exam with 100% pass guarantee. Get Certified Now!","og_url":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/","og_site_name":"Testprep Training Tutorials","article_modified_time":"2020-05-01T12:29:28+00:00","og_image":[{"width":753,"height":413,"url":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/02\/Amazon-redshift-and-Amazon-DynamoDB.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/","url":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/","name":"Amazon Redshift | AWS Tutorials | TestPrep","isPartOf":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website"},"datePublished":"2019-02-06T10:08:48+00:00","dateModified":"2020-05-01T12:29:28+00:00","description":"Learn more about Amazon Redshift and Amazon DynamoDB with thousands of practice test to qualify the exam with 100% pass guarantee. Get Certified Now!","breadcrumb":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/amazon-redshift-amazon-dynamodb\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.testpreptraining.ai\/tutorial\/"},{"@type":"ListItem","position":2,"name":"AWS Certified Solutions Architect Associate (SAA-C03)","item":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-solutions-architect-associate-table-of-content\/"},{"@type":"ListItem","position":3,"name":"Amazon Redshift"}]},{"@type":"WebSite","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","name":"Testprep Training Tutorials","description":"","publisher":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization","name":"Testprep Training","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/","url":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","contentUrl":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","width":583,"height":153,"caption":"Testprep Training"},"image":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/320","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/comments?post=320"}],"version-history":[{"count":8,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/320\/revisions"}],"predecessor-version":[{"id":5169,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/320\/revisions\/5169"}],"up":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/53"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/media\/321"}],"wp:attachment":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/media?parent=320"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/categories?post=320"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/tags?post=320"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}