{"id":4796,"date":"2020-04-19T18:27:15","date_gmt":"2020-04-19T18:27:15","guid":{"rendered":"https:\/\/www.testpreptraining.com\/tutorial\/?page_id=4796"},"modified":"2022-03-10T12:10:49","modified_gmt":"2022-03-10T12:10:49","slug":"cloud-pub-sub-google-professional-data-engineer-gcp","status":"publish","type":"page","link":"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/","title":{"rendered":"Cloud Pub\/Sub Google Professional Data Engineer GCP"},"content":{"rendered":"\n<p>In this, we will learn about Cloud Pub\/Sub.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Cloud Pub\/Sub:<\/strong><\/h4>\n\n\n\n<p>Services can interact asynchronously using Pub\/Sub, with latencies on the order of 100 milliseconds. In order to ingest and disseminate data, Pub\/Sub utilizes streaming analytics and data integration pipelines. It works well as a messaging-oriented middleware for service integration as well as a queue for job parallelization. You may use Pub\/Sub to establish systems of event producers and consumers, which refer to as publishers and subscribers. Publishers communicate with subscribers asynchronously by broadcasting events, rather than by synchronous remote procedure calls (RPCs). Further,<\/p>\n\n\n<ul>\n<li>Publish\/subscribe messaging, or pub\/sub messaging<\/li>\n<li>a form of asynchronous service-to-service communication<\/li>\n<li>used in serverless and microservices architectures.<\/li>\n<li>any message published to a topic is immediately received by all of the subscribers to the topic.<\/li>\n<li>Google Cloud Pub\/Sub gives durable message ingestion service.<\/li>\n<li>Messages gets saved for 7 days<\/li>\n<li>Messages are opaque and its not processed by pubsub. We can send also metadata(key value pairs) to pubsub<\/li>\n<li>Project for the topic can be different from the project for subscription<\/li>\n<li>Subscriber has to ack within the timeout period<\/li>\n<li>By creating topics for streams or channels, enable different components of application to subscribe to specific streams of data without needing to construct subscriber-specific channels on each device.<\/li>\n<li>It also connects to GCP services to connect ingestion, data pipelines, and storage systems.<\/li>\n<li>Able to handle data spikes<\/li>\n<\/ul>\n<p>\u00a0<\/p>\n<p><strong>Streaming Data Challenges<\/strong><\/p>\n<ul>\n<li>Reliance on centralized storage and compute clusters.<\/li>\n<li>Centralized ownership<\/li>\n<li>Scalability bottlenecks<\/li>\n<li>Controlling network experience<\/li>\n<li>Business integration hiccups<\/li>\n<li>Streaming Data is Very Complex &#8211; continuously generate by an array of sources and devices in a wide variety of formats.<\/li>\n<\/ul>\n\n\n<p><strong><a href=\"https:\/\/www.testpreptraining.ai\/certified-professional-data-engineer-practice-exam\" target=\"_blank\" rel=\"noreferrer noopener\">Pass the GCP Exam Now!<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this, we will learn about Cloud Pub\/Sub. Cloud Pub\/Sub: Services can interact asynchronously using Pub\/Sub, with latencies on the order of 100 milliseconds. In order to ingest and disseminate data, Pub\/Sub utilizes streaming analytics and data integration pipelines. It works well as a messaging-oriented middleware for service integration as well as a queue for&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"categories":[617],"tags":[689,619,623,622,618,621],"class_list":["post-4796","page","type-page","status-publish","hentry","category-google-gcp","tag-cloud-pub-sub","tag-data-engineer","tag-gcp","tag-google-certification","tag-google-cloud","tag-professional-data-engineer"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Cloud Pub\/Sub Google Professional Data Engineer GCP<\/title>\n<meta name=\"description\" content=\"Pass the Google Cloud Certified Professional Data Engineer by learning and understanding the concepts of Cloud Pub\/Sub Now!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Cloud Pub\/Sub Google Professional Data Engineer GCP\" \/>\n<meta property=\"og:description\" content=\"Pass the Google Cloud Certified Professional Data Engineer by learning and understanding the concepts of Cloud Pub\/Sub Now!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/\" \/>\n<meta property=\"og:site_name\" content=\"Testprep Training Tutorials\" \/>\n<meta property=\"article:modified_time\" content=\"2022-03-10T12:10:49+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/\",\"name\":\"Cloud Pub\/Sub Google Professional Data Engineer GCP\",\"isPartOf\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\"},\"datePublished\":\"2020-04-19T18:27:15+00:00\",\"dateModified\":\"2022-03-10T12:10:49+00:00\",\"description\":\"Pass the Google Cloud Certified Professional Data Engineer by learning and understanding the concepts of Cloud Pub\/Sub Now!\",\"breadcrumb\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Cloud Pub\/Sub Google Professional Data Engineer GCP\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#website\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"name\":\"Testprep Training Tutorials\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#organization\",\"name\":\"Testprep Training\",\"url\":\"https:\/\/www.testpreptraining.ai\/tutorial\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"contentUrl\":\"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png\",\"width\":583,\"height\":153,\"caption\":\"Testprep Training\"},\"image\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Cloud Pub\/Sub Google Professional Data Engineer GCP","description":"Pass the Google Cloud Certified Professional Data Engineer by learning and understanding the concepts of Cloud Pub\/Sub Now!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/","og_locale":"en_US","og_type":"article","og_title":"Cloud Pub\/Sub Google Professional Data Engineer GCP","og_description":"Pass the Google Cloud Certified Professional Data Engineer by learning and understanding the concepts of Cloud Pub\/Sub Now!","og_url":"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/","og_site_name":"Testprep Training Tutorials","article_modified_time":"2022-03-10T12:10:49+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/","url":"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/","name":"Cloud Pub\/Sub Google Professional Data Engineer GCP","isPartOf":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website"},"datePublished":"2020-04-19T18:27:15+00:00","dateModified":"2022-03-10T12:10:49+00:00","description":"Pass the Google Cloud Certified Professional Data Engineer by learning and understanding the concepts of Cloud Pub\/Sub Now!","breadcrumb":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/cloud-pub-sub-google-professional-data-engineer-gcp\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.testpreptraining.ai\/tutorial\/"},{"@type":"ListItem","position":2,"name":"Cloud Pub\/Sub Google Professional Data Engineer GCP"}]},{"@type":"WebSite","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#website","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","name":"Testprep Training Tutorials","description":"","publisher":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.testpreptraining.ai\/tutorial\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#organization","name":"Testprep Training","url":"https:\/\/www.testpreptraining.ai\/tutorial\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/","url":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","contentUrl":"https:\/\/www.testpreptraining.com\/tutorial\/wp-content\/uploads\/2020\/07\/tpt-logo-6.png","width":583,"height":153,"caption":"Testprep Training"},"image":{"@id":"https:\/\/www.testpreptraining.ai\/tutorial\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/4796","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/comments?post=4796"}],"version-history":[{"count":3,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/4796\/revisions"}],"predecessor-version":[{"id":52574,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/pages\/4796\/revisions\/52574"}],"wp:attachment":[{"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/media?parent=4796"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/categories?post=4796"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/tutorial\/wp-json\/wp\/v2\/tags?post=4796"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}