{"id":1066,"date":"2019-07-09T10:53:10","date_gmt":"2019-07-09T10:53:10","guid":{"rendered":"https:\/\/www.testpreptraining.com\/tutorial\/?page_id=1066"},"modified":"2022-03-03T06:56:22","modified_gmt":"2022-03-03T06:56:22","slug":"explain-the-durability-and-availability-characteristics-for-the-collection-approach","status":"publish","type":"page","link":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/","title":{"rendered":"Explain the Durability and Availability Characteristics for the Collection Approach"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\"> <strong> <strong>AWS Big Data Exam<\/strong>  updated to <a href=\"https:\/\/www.testpreptraining.ai\/aws-certified-data-analytics-specialty-exam\" target=\"_blank\" rel=\"noreferrer noopener\">AWS Certified Data Analytics Specialty.<\/a><\/strong> <\/h2>\n\n\n\n<p>Amazon Kinesis Data Streams manages the infrastructure,\nstorage, networking, and configuration needed to stream your data at the level\nof your data throughput. You do not have to worry about provisioning,\ndeployment, ongoing-maintenance of hardware, software, or other services for\nyour data streams. In addition, Amazon Kinesis Data Streams synchronously\nreplicates data across three availability zones, providing high availability\nand data durability.<\/p>\n\n\n\n<p>Probably of most paramount concern is how Kinesis\nperforms in production. One thing to keep in mind when looking at these numbers\nis that Kinesis\u2019 durability characteristic is highly relevant. When injecting a\nrecord to a stream, that record is synchronously replicated to three different\navailability zones in the region to help guarantee that you\u2019ll get it out of\nthe other side. There is a performance cost associated with this level of reliability,\nand comparing to a single-node system like Redis (for example), would be\nnonsense.<\/p>\n\n\n\n<p>Amazon ensures availability of a Kinesis stream by\nwriting the stream data to three availability zones in a region. So, if an\navailability zone goes down, the data can still be reachable from other\nregions. But, if the Kinesis service in the whole region goes down, that may\ncause some trouble! For major disasters like this, the data sent to a stream\ncan be replicated to another stream in a different region. Unfortunately,\nAmazon does not provide a configuration for multi-region replication of a\nstream. So, to do this, you will need to get your hands dirty.<\/p>\n\n\n\n<p>Multi-region replication of a stream can be done\nthrough the following ways:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Using a KCL application as the replicator: In\nthis solution, an application that uses the KCL library can be implemented and\ndeployed to an EC2 instance. The application can get recent records from the\nsource stream and after filtering the records that need to be replicated, it\ncan write the records to the backup region.<\/li><li>Using a Lambda function as the replicator: In\nthis solution, the Lambda function can read the data from the stream and write\nit to our backup stream, which is available in another region. To get the data\nfrom a stream, a Kinesis trigger can be defined with a given batch size. The\nLambda service can check the stream once per second and if it sees that new\ndata is available in the stream, it can get the new records and call the Lambda\nfunction. At this step, the function can look for the number of new records\navailable in the stream. If the number is smaller than the given batch size,\nthe function gets all of the new records. If the number is bigger, the function\nlimits the number of records to the given batch size. After the records are\nreceived and filtered, they can be written to the stream in the backup region.\nNote that as Amazon Kinesis is a stream-based trigger, you will have the number\nof shards per stream Lambda functions running in parallel.<\/li><\/ul>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"528\" height=\"328\" src=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/07\/explain-the-durability-and-availability-characteristics-for-the-collection-approach.png\" alt=\"explain the durability and availability characteristics for the collection approach\n\" class=\"wp-image-1185\"\/><\/figure><\/div>\n\n\n\n<p>Monitoring of replication is an important part of the implementation. Delay occurred during the replication must be observed at the replicator. This delay must be small as the records that are lost need to be minimized during a disaster. Also, the whole replication process needs to be monitored. To do this, a test stream can be used. During the test, a Lambda function can write artificial records to this stream in the primary region and check if these records can be read from the backup region. Using this method, the whole Kinesis replication process can be checked if it works as expected or not.<\/p>\n\n\n\n<p>All in all, multi-region replication of Kinesis Streams decreases data losses during region wide disaster cases and increase your availability.<\/p>\n\n\n\n<p>Link for free practice test &#8211; <a href=\"https:\/\/www.testpreptraining.ai\/aws-certified-big-data-specialty-free-practice-test\">https:\/\/www.testpreptraining.ai\/aws-certified-big-data-specialty-free-practice-test<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>AWS Big Data Exam updated to AWS Certified Data Analytics Specialty. Amazon Kinesis Data Streams manages the infrastructure, storage, networking, and configuration needed to stream your data at the level of your data throughput. You do not have to worry about provisioning, deployment, ongoing-maintenance of hardware, software, or other services for your data streams. In&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":1031,"menu_order":5,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-1066","page","type-page","status-publish","hentry","category-amazon-aws"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Explain the Durability and Availability Characteristics for the Collection Approach - Testprep Training Tutorials<\/title>\n<meta name=\"description\" content=\"Explain the durability and availability characteristics for the collection approach tutorial, notes\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Explain the Durability and Availability Characteristics for the Collection Approach - Testprep Training Tutorials\" \/>\n<meta property=\"og:description\" content=\"Explain the durability and availability characteristics for the collection approach tutorial, notes\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/\" \/>\n<meta property=\"og:site_name\" content=\"Testprep Training Tutorials\" \/>\n<meta property=\"article:modified_time\" content=\"2022-03-03T06:56:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/07\/explain-the-durability-and-availability-characteristics-for-the-collection-approach.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/\",\"name\":\"Explain the Durability and Availability Characteristics for the Collection Approach - Testprep Training Tutorials\",\"isPartOf\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\"},\"datePublished\":\"2019-07-09T10:53:10+00:00\",\"dateModified\":\"2022-03-03T06:56:22+00:00\",\"description\":\"Explain the durability and availability characteristics for the collection approach tutorial, notes\",\"breadcrumb\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AWS Certified Big Data Specialty\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Explain the Durability and Availability Characteristics for the Collection Approach\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"name\":\"Testprep Training Tutorials\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\",\"name\":\"Testprep Training\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"contentUrl\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"width\":583,\"height\":153,\"caption\":\"Testprep Training\"},\"image\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Explain the Durability and Availability Characteristics for the Collection Approach - Testprep Training Tutorials","description":"Explain the durability and availability characteristics for the collection approach tutorial, notes","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/","og_locale":"en_US","og_type":"article","og_title":"Explain the Durability and Availability Characteristics for the Collection Approach - Testprep Training Tutorials","og_description":"Explain the durability and availability characteristics for the collection approach tutorial, notes","og_url":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/","og_site_name":"Testprep Training Tutorials","article_modified_time":"2022-03-03T06:56:22+00:00","og_image":[{"url":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/07\/explain-the-durability-and-availability-characteristics-for-the-collection-approach.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/","url":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/","name":"Explain the Durability and Availability Characteristics for the Collection Approach - Testprep Training Tutorials","isPartOf":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website"},"datePublished":"2019-07-09T10:53:10+00:00","dateModified":"2022-03-03T06:56:22+00:00","description":"Explain the durability and availability characteristics for the collection approach tutorial, notes","breadcrumb":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/explain-the-durability-and-availability-characteristics-for-the-collection-approach\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.testpreptraining.ai\/tutorial\/"},{"@type":"ListItem","position":2,"name":"AWS Certified Big Data Specialty","item":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/"},{"@type":"ListItem","position":3,"name":"Explain the Durability and Availability Characteristics for the Collection Approach"}]},{"@type":"WebSite","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","name":"Testprep Training Tutorials","description":"","publisher":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization","name":"Testprep Training","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/","url":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","contentUrl":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","width":583,"height":153,"caption":"Testprep Training"},"image":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1066","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/comments?post=1066"}],"version-history":[{"count":7,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1066\/revisions"}],"predecessor-version":[{"id":51828,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1066\/revisions\/51828"}],"up":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1031"}],"wp:attachment":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/media?parent=1066"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/categories?post=1066"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/tags?post=1066"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}