{"id":1083,"date":"2019-07-09T10:59:53","date_gmt":"2019-07-09T10:59:53","guid":{"rendered":"https:\/\/www.testpreptraining.com\/tutorial\/?page_id=1083"},"modified":"2020-05-01T10:06:36","modified_gmt":"2020-05-01T10:06:36","slug":"determine-appropriate-data-structure-and-storage-format","status":"publish","type":"page","link":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/","title":{"rendered":"Determine Appropriate Data Structure and Storage Format"},"content":{"rendered":"\n
\"determine<\/figure><\/div>\n\n\n\n

Object storage<\/h2>\n\n\n\n

Amazon Simple Storage Service (Amazon S3) is highly\ndurable, general-purpose object storage that works well for unstructured data\nsets such as media content. Amazon S3 provides the highest level of data\ndurability and availability on the AWS Cloud. There are three tiers of storage:\none each for hot, warm, or cold data. In terms of pricing, the colder the data,\nthe cheaper it is to store, and the costlier it is to access when needed. You\ncan easily move data between these storage options to optimize storage costs:<\/p>\n\n\n\n

  • Amazon S3 Standard \u2013 The best storage option for\ndata that you frequently access. Amazon S3 delivers low latency and high\nthroughput and is ideal for use cases such as cloud applications, dynamic\nwebsites, content distribution, gaming, and data analytics.<\/li>
  • Amazon S3 Standard – Infrequent Access (Amazon\nS3 Standard – IA) \u2013 Use this storage option for data that you access less\nfrequently, such as long-term backups and disaster recovery. It offers cheaper\nstorage over time, but higher charges to retrieve or transfer data.<\/li>
  • Amazon Glacier \u2013 Designed for long-term storage\nof infrequently accessed data, such as end-of-lifecycle, compliance, or\nregulatory backups. Different methods of data retrieval are available at\nvarious speeds and cost. Retrieval can take from a few minutes to several\nhours.<\/li><\/ul>\n\n\n\n

    Block Storage<\/h2>\n\n\n\n

    Amazon Elastic Block Store (Amazon EBS) volumes provide\na durable block-storage option for use with EC2 instances. Use Amazon EBS for\ndata that requires long-term persistence and quick access at guaranteed levels\nof performance. There are two types of block storage: solid-state-drive (SSD)\nstorage and hard-disk-drive (HDD) storage.<\/p>\n\n\n\n

    SSD storage is optimized for transactional workloads\nwhere performance is closely tied to IOPS. There are two SSD volume options to\nchoose from:<\/p>\n\n\n\n

    • EBS Provisioned IOPS SSD (io1) \u2013 Best for\nlatency-sensitive workloads that require specific minimum-guaranteed IOPS. With\nio1 volumes, you pay separately for provisioned IOPS, so unless you need high\nlevels of provisioned IOPS, gp2 volumes are a better match at lower cost.<\/li>
    • EBS General Purpose SSD (gp2) \u2013 Designed for\ngeneral use and offer a balance between cost and performance.<\/li><\/ul>\n\n\n\n

      HDD storage is designed for throughput-intensive\nworkloads such as data warehouses and log processing. There are two types of\nHDD volumes:<\/p>\n\n\n\n

      • Throughput Optimized HDD (st1) \u2013 Best for\nfrequently accessed, throughput-intensive workloads.<\/li>
      • Cold HDD (sc1) \u2013 Designed for less frequently\naccessed, throughput-intensive workloads.<\/li><\/ul>\n\n\n\n

        File Storage<\/h2>\n\n\n\n

        Amazon Elastic File System (Amazon EFS) provides\nsimple, scalable file storage for use with EC2 instances. Amazon EFS supports\nany number of instances at the same time. Its storage capacity can scale from\ngigabytes to petabytes of data without needing to provision storage. Amazon EFS\nis designed for workloads and applications such as big data, media-processing\nworkflows, content management, and web serving. Amazon EFS also supports file\nsynchronization capabilities so that you can efficiently and securely\nsynchronize files from on-premises or cloud file systems to Amazon EFS at\nspeeds of up to 5 times faster than standard Linux copy tools.<\/p>\n\n\n\n

        Amazon S3 and Amazon EFS allocate storage based on your\nusage and you pay for what you use. However, for EBS volumes, you are charged\nfor provisioned (allocated) storage whether or not you use it. The key to\nkeeping storage costs low without sacrificing required functionality is to\nmaximize the use of Amazon S3 when possible and use more expensive EBS volumes\nwith provisioned I\/O only when application requirements demand it.<\/p>\n","protected":false},"excerpt":{"rendered":"

        Object storage Amazon Simple Storage Service (Amazon S3) is highly durable, general-purpose object storage that works well for unstructured data sets such as media content. Amazon S3 provides the highest level of data durability and availability on the AWS Cloud. There are three tiers of storage: one each for hot, warm, or cold data. In…<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":1031,"menu_order":10,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-1083","page","type-page","status-publish","hentry","category-amazon-aws"],"acf":[],"yoast_head":"\nDetermine Appropriate Data Structure and Storage Format - Testprep Training Tutorials<\/title>\n<meta name=\"description\" content=\"Determine appropriate data structure and storage format tutorial, notes\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Determine Appropriate Data Structure and Storage Format - Testprep Training Tutorials\" \/>\n<meta property=\"og:description\" content=\"Determine appropriate data structure and storage format tutorial, notes\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/\" \/>\n<meta property=\"og:site_name\" content=\"Testprep Training Tutorials\" \/>\n<meta property=\"article:modified_time\" content=\"2020-05-01T10:06:36+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/07\/determine-appropriate-data-structure-and-storage-format.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/\",\"name\":\"Determine Appropriate Data Structure and Storage Format - Testprep Training Tutorials\",\"isPartOf\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\"},\"datePublished\":\"2019-07-09T10:59:53+00:00\",\"dateModified\":\"2020-05-01T10:06:36+00:00\",\"description\":\"Determine appropriate data structure and storage format tutorial, notes\",\"breadcrumb\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AWS Certified Big Data Specialty\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Determine Appropriate Data Structure and Storage Format\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"name\":\"Testprep Training Tutorials\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\",\"name\":\"Testprep Training\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"contentUrl\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"width\":583,\"height\":153,\"caption\":\"Testprep Training\"},\"image\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Determine Appropriate Data Structure and Storage Format - Testprep Training Tutorials","description":"Determine appropriate data structure and storage format tutorial, notes","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/","og_locale":"en_US","og_type":"article","og_title":"Determine Appropriate Data Structure and Storage Format - Testprep Training Tutorials","og_description":"Determine appropriate data structure and storage format tutorial, notes","og_url":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/","og_site_name":"Testprep Training Tutorials","article_modified_time":"2020-05-01T10:06:36+00:00","og_image":[{"url":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/07\/determine-appropriate-data-structure-and-storage-format.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/","url":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/","name":"Determine Appropriate Data Structure and Storage Format - Testprep Training Tutorials","isPartOf":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website"},"datePublished":"2019-07-09T10:59:53+00:00","dateModified":"2020-05-01T10:06:36+00:00","description":"Determine appropriate data structure and storage format tutorial, notes","breadcrumb":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/determine-appropriate-data-structure-and-storage-format\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.testpreptraining.ai\/tutorial\/"},{"@type":"ListItem","position":2,"name":"AWS Certified Big Data Specialty","item":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/"},{"@type":"ListItem","position":3,"name":"Determine Appropriate Data Structure and Storage Format"}]},{"@type":"WebSite","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","name":"Testprep Training Tutorials","description":"","publisher":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization","name":"Testprep Training","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/","url":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","contentUrl":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","width":583,"height":153,"caption":"Testprep Training"},"image":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1083","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/comments?post=1083"}],"version-history":[{"count":4,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1083\/revisions"}],"predecessor-version":[{"id":5072,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1083\/revisions\/5072"}],"up":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1031"}],"wp:attachment":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/media?parent=1083"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/categories?post=1083"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/tags?post=1083"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}