{"id":1079,"date":"2019-07-09T10:56:18","date_gmt":"2019-07-09T10:56:18","guid":{"rendered":"https:\/\/www.testpreptraining.com\/tutorial\/?page_id=1079"},"modified":"2020-05-01T10:05:57","modified_gmt":"2020-05-01T10:05:57","slug":"storage-aws-big-data-specialty","status":"publish","type":"page","link":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/","title":{"rendered":"Storage – AWS Big Data – Specialty"},"content":{"rendered":"\n
Various storage and database services offered by AWS\nare listed.<\/p>\n\n\n\n
Amazon S3<\/h2>\n\n\n\n
Amazon Simple Storage Service (Amazon S3) is an object\nstorage service that offers industry-leading scalability, data availability,\nsecurity, and performance. This means customers of all sizes and industries can\nuse it to store and protect any amount of data for a range of use cases, such\nas websites, mobile applications, backup and restore, archive, enterprise\napplications, IoT devices, and big data analytics. Amazon S3 provides\neasy-to-use management features so you can organize your data and configure finely-tuned\naccess controls to meet your specific business, organizational, and compliance\nrequirements. Amazon S3 is designed for 99.999999999% (11 9’s) of durability,\nand stores data for millions of applications for companies all around the\nworld.<\/p>\n\n\n\n
Amazon Elastic Block Store<\/h2>\n\n\n\n
Amazon Elastic Block Store (Amazon EBS) provides\npersistent block storage volumes for use with Amazon EC2 instances in the AWS\nCloud. Each Amazon EBS volume is automatically replicated within its\nAvailability Zone to protect you from component failure, offering high\navailability and durability. Amazon EBS volumes offer the consistent and\nlow-latency performance needed to run your workloads. With Amazon EBS, you can\nscale your usage up or down within minutes\u2014all while paying a low price for\nonly what you provision.<\/p>\n\n\n\n
Amazon Elastic File System<\/h2>\n\n\n\n
Amazon Elastic File System (Amazon EFS) provides a\nsimple, scalable, elastic file system for Linux-based workloads for use with\nAWS Cloud services and on-premises resources. It is built to scale on demand to\npetabytes without disrupting applications, growing and shrinking automatically\nas you add and remove files, so your applications have the storage they need \u2013\nwhen they need it. It is designed to provide massively parallel shared access\nto thousands of Amazon EC2 instances, enabling your applications to achieve\nhigh levels of aggregate throughput and IOPS with consistent low latencies.\nAmazon EFS is a fully managed service that requires no changes to your existing\napplications and tools, providing access through a standard file system\ninterface for seamless integration. Amazon EFS is a regional service storing\ndata within and across multiple Availability Zones (AZs) for high availability\nand durability. You can access your file systems across AZs and regions and\nshare files between thousands of Amazon EC2 instances and on-premises servers\nvia AWS Direct Connect or AWS VPN.<\/p>\n\n\n\n
Amazon EFS is well suited to support a broad spectrum\nof use cases from highly parallelized, scale-out workloads that require the highest\npossible throughput to single-threaded, latency-sensitive workloads. Use cases\nsuch as lift-and-shift enterprise applications, big data analytics, web serving\nand content management, application development and testing, media and\nentertainment workflows, database backups, and container storage.<\/p>\n\n\n\n
Amazon FSx for Lustre<\/h2>\n\n\n\n
Amazon FSx for Lustre is a fully managed file system\nthat is optimized for compute-intensive workloads, such as high performance\ncomputing, machine learning, and media data processing workflows. Many of these\napplications require the high-performance and low latencies of scale-out,\nparallel file systems. Operating these file systems typically requires\nspecialized expertise and administrative overhead, requiring you to provision\nstorage servers and tune complex performance parameters. With Amazon FSx, you\ncan launch and run a Lustre file system that can process massive data sets at\nup to hundreds of gigabytes per second of throughput, millions of IOPS, and\nsub-millisecond latencies.<\/p>\n\n\n\n
Amazon FSx for Lustre is seamlessly integrated with\nAmazon S3, making it easy to link your long-term data sets with your high\nperformance file systems to run compute-intensive workloads. You can\nautomatically copy data from S3 to FSx for Lustre, run your workloads, and then\nwrite results back to S3. FSx for Lustre also enables you to burst your\ncompute-intensive workloads from on-premises to AWS by allowing you to access\nyour FSx file system over Amazon Direct Connect or VPN. FSx for Lustre helps\nyou cost-optimize your storage for compute-intensive workloads: It provides\ncheap and performant non-replicated storage for processing data, with your\nlong-term data stored durably in Amazon S3 or other low-cost data stores. With\nAmazon FSx, you pay for only the resources you use. There are no minimum\ncommitments, upfront hardware or software costs, or additional fees.<\/p>\n\n\n\n
Amazon FSx for Windows File Server<\/h2>\n\n\n\n
Amazon FSx for Windows File Server provides a fully\nmanaged native Microsoft Windows file system so you can easily move your\nWindows-based applications that require file storage to AWS. Built on Windows\nServer, Amazon FSx provides shared file storage with the compatibility and\nfeatures that your Windows-based applications rely on, including full support\nfor the SMB protocol and Windows NTFS, Active Directory (AD) integration, and\nDistributed File System (DFS). Amazon FSx uses SSD storage to provide the fast\nperformance your Windows applications and users expect, with high levels of\nthroughput and IOPS, and consistent sub-millisecond latencies. This\ncompatibility and performance is particularly important when moving workloads\nthat require Windows shared file storage, like CRM, ERP, and .NET applications,\nas well as home directories.<\/p>\n\n\n\n
With Amazon FSx, you can launch highly durable and\navailable Windows file systems that can be accessed from up to thousands of\ncompute instances using the industry-standard SMB protocol. Amazon FSx\neliminates the typical administrative overhead of managing Windows file\nservers. You pay for only the resources used, with no upfront costs, minimum\ncommitments, or additional fees.<\/p>\n\n\n\n
Amazon S3 Glacier<\/h2>\n\n\n\n
Amazon S3 Glacier is a secure, durable, and extremely\nlow-cost storage service for data archiving and long-term backup. It is\ndesigned to deliver 99.999999999% durability, and provides comprehensive\nsecurity and compliance capabilities that can help meet even the most stringent\nregulatory requirements. Amazon S3 Glacier provides query-in-place\nfunctionality, allowing you to run powerful analytics directly on your archive\ndata at rest. You can store data for as little as $0.004 per gigabyte per\nmonth, a significant savings compared to on-premises solutions. To keep costs\nlow yet suitable for varying retrieval needs, Amazon S3 Glacier provides three\noptions for access to archives, from a few minutes to several hours.<\/p>\n\n\n\n
AWS Storage Gateway<\/h2>\n\n\n\n
The AWS Storage Gateway is a hybrid storage service\nthat enables your on-premises applications to seamlessly use AWS cloud storage.\nYou can use the service for backup and archiving, disaster recovery, cloud data\nprocessing, storage tiering, and migration. Your applications connect to the\nservice through a virtual machine or hardware gateway appliance using standard\nstorage protocols, such as NFS, SMB and iSCSI. The gateway connects to AWS\nstorage services, such as Amazon S3, Glacier, and Amazon EBS, providing storage\nfor files, volumes, and virtual tapes in AWS. The service includes a\nhighly-optimized data transfer mechanism, with bandwidth management, automated\nnetwork resilience, and efficient data transfer, along with a local cache for\nlow-latency on-premises access to your most active data.<\/p>\n\n\n\n
AWS Databases<\/h2>\n\n\n\n
As the cloud continues to drive down the cost of storage and compute, a new generation of applications have emerged, creating a new set of requirements for databases. These applications need databases to store terabytes to petabytes of new types of data, provide access to the data with millisecond latency, process millions of requests per second, and scale to support millions of users anywhere in the world. To support these requirements, you need both relational and non-relational databases that are purpose-built to handle the specific needs of your applications. AWS offers the broadest range of databases purpose-built for your specific application use cases. <\/p>\n\n\n\n
<\/figure><\/div>\n\n\n\n
Relational <\/strong><\/p>\n\n\n\n
Relational databases store data with pre-defined schema\nand relationships between them, designed for supporting ACID transactions,\nmaintaining referential integrity, and data consistency. Used for: Traditional\napplications, ERP, CRM, and e-commerce.<\/p>\n\n\n\n
Key-value databases are optimized to store and retrieve\nkey-value pairs in large volumes and in milliseconds, without the performance\noverhead and scale limitations of relational databases. Used for:\nInternet-scale applications, real-time bidding, shopping carts, and customer\npreferences.<\/p>\n\n\n\n
AWS Offering<\/p>\n\n\n\n
Amazon DynamoDB<\/li><\/ul>\n\n\n\n
Document<\/strong><\/p>\n\n\n\n
Document databases are designed to store\nsemi-structured data as documents and are intuitive for developers to use\nbecause the data is typically represented as a readable document. Used for:\nContent management, personalization, and mobile applications.<\/p>\n\n\n\n
In-memory databases are used for applications that\nrequire real time access to data. By storing data directly in memory, these\ndatabases provide microsecond latency where millisecond latency is not enough.\nUsed for: Caching, gaming leaderboards, and real-time analytics.<\/p>\n\n\n\n
AWS Offerings:<\/p>\n\n\n\n
Amazon ElastiCache for Redis<\/li>
Amazon ElastiCache for Memcached<\/li><\/ul>\n\n\n\n
Graph<\/strong><\/p>\n\n\n\n
Graph databases are used for applications that need to\nenable millions of users to query and navigate relationships between highly\nconnected, graph datasets with millisecond latency. Used for: Fraud detection,\nsocial networking, and recommendation engines<\/p>\n\n\n\n
AWS Offering:<\/p>\n\n\n\n
Amazon Neptune<\/li><\/ul>\n\n\n\n
Time Series<\/strong><\/p>\n\n\n\n
Time series databases are used to efficiently collect,\nsynthesize, and derive insights from enormous amounts of data that changes over\ntime (known as time-series data). Used for: IoT applications, DevOps, and\nindustrial telemetry.<\/p>\n\n\n\n
AWS Offering:<\/p>\n\n\n\n
Amazon Timestream<\/li><\/ul>\n\n\n\n
Ledger<\/strong><\/p>\n\n\n\n
Ledger databases are used when you need a centralized,\ntrusted authority to maintain a scalable, complete and cryptographically\nverifiable record of transactions. Used for: Systems of record, supply chain,\nregistrations, and banking transactions.<\/p>\n\n\n\n
Various storage and database services offered by AWS are listed. Amazon S3 Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. This means customers of all sizes and industries can use it to store and protect any amount of data for a range of…<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":1031,"menu_order":6,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-1079","page","type-page","status-publish","hentry","category-amazon-aws"],"acf":[],"yoast_head":"\n
Storage - AWS Big Data - Specialty - Testprep Training Tutorials<\/title>\n<meta name=\"description\" content=\"Storage - AWS Big Data - Specialty tutorial, notes\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Storage - AWS Big Data - Specialty - Testprep Training Tutorials\" \/>\n<meta property=\"og:description\" content=\"Storage - AWS Big Data - Specialty tutorial, notes\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/\" \/>\n<meta property=\"og:site_name\" content=\"Testprep Training Tutorials\" \/>\n<meta property=\"article:modified_time\" content=\"2020-05-01T10:05:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/07\/storage-aws-big-data-specialty.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/\",\"name\":\"Storage - AWS Big Data - Specialty - Testprep Training Tutorials\",\"isPartOf\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\"},\"datePublished\":\"2019-07-09T10:56:18+00:00\",\"dateModified\":\"2020-05-01T10:05:57+00:00\",\"description\":\"Storage - AWS Big Data - Specialty tutorial, notes\",\"breadcrumb\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AWS Certified Big Data Specialty\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Storage – AWS Big Data – Specialty\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"name\":\"Testprep Training Tutorials\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\",\"name\":\"Testprep Training\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"contentUrl\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"width\":583,\"height\":153,\"caption\":\"Testprep Training\"},\"image\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Storage - AWS Big Data - Specialty - Testprep Training Tutorials","description":"Storage - AWS Big Data - Specialty tutorial, notes","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/","og_locale":"en_US","og_type":"article","og_title":"Storage - AWS Big Data - Specialty - Testprep Training Tutorials","og_description":"Storage - AWS Big Data - Specialty tutorial, notes","og_url":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/","og_site_name":"Testprep Training Tutorials","article_modified_time":"2020-05-01T10:05:57+00:00","og_image":[{"url":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/07\/storage-aws-big-data-specialty.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/","url":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/","name":"Storage - AWS Big Data - Specialty - Testprep Training Tutorials","isPartOf":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website"},"datePublished":"2019-07-09T10:56:18+00:00","dateModified":"2020-05-01T10:05:57+00:00","description":"Storage - AWS Big Data - Specialty tutorial, notes","breadcrumb":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/storage-aws-big-data-specialty\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.testpreptraining.ai\/tutorial\/"},{"@type":"ListItem","position":2,"name":"AWS Certified Big Data Specialty","item":"https:\/\/www.testpreptraining.ai\/tutorial\/aws-certified-big-data-specialty\/"},{"@type":"ListItem","position":3,"name":"Storage – AWS Big Data – Specialty"}]},{"@type":"WebSite","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","name":"Testprep Training Tutorials","description":"","publisher":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization","name":"Testprep Training","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/","url":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","contentUrl":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","width":583,"height":153,"caption":"Testprep Training"},"image":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1079","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/comments?post=1079"}],"version-history":[{"count":4,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1079\/revisions"}],"predecessor-version":[{"id":5069,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1079\/revisions\/5069"}],"up":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/1031"}],"wp:attachment":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/media?parent=1079"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/categories?post=1079"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/tags?post=1079"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"storage](\"https:\/\/www.testpreptraining.ai\/tutorial\/wp-content\/uploads\/2019\/07\/storage-aws-big-data-specialty.png\")
<\/figure><\/div>\n\n\n\n