{"id":25323,"date":"2024-05-24T15:09:35","date_gmt":"2024-05-24T09:39:35","guid":{"rendered":"https:\/\/www.testpreptraining.com\/blog\/?p=25323"},"modified":"2024-05-24T15:09:35","modified_gmt":"2024-05-24T09:39:35","slug":"learn-to-install-cloudera-hive-in-aws","status":"publish","type":"post","link":"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/","title":{"rendered":"Learn to Install Cloudera Hive in AWS"},"content":{"rendered":"\n<p>Apache Hive is a data warehouse tool built on top of Apache Hadoop that allows users to query and analyze data. Hive provides a SQL Like Interface for querying data stored in various Hadoop-integrated databases and filesystems. It allows for the reading, writing, and management of large datasets in distributed storage. Hive queries are transformed into a series of jobs that run on a Hadoop cluster using MapReduce or Apache Spark. It also makes batch processing for Apache Hadoop simple and familiar. <\/p>\n\n\n\n<p><strong><em>Let us learn how to set up Cloudera Hive in AWS!<\/em><\/strong><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Install Cloudera Hive in AWS<\/strong><\/h3>\n\n\n\n<p><em>To install Cloudera Hive on the AWS platform, follow the steps below.<\/em><\/p>\n\n\n\n<p><strong>Step 1: Go to <a href=\"https:\/\/www.cloudera.com\/downloads\/connectors\/hive\/odbc\/2-5-25.html\">https:\/\/www.cloudera.com\/downloads\/connectors\/hive\/odbc\/2-5-25.html<\/a> and get the software.<\/strong><\/p>\n\n\n\n<p>ClouderaHiveODBC-2.5.25.1020-1.el7.x86 64.rpm will get download.<\/p>\n\n\n\n<p><strong>Step 2:<\/strong> Log in as root to EC2 and create the directory listed below.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\"><strong>mkdir -p \/tmp\/cloudera-hive &amp;&amp; cd \/tmp\/cloudera-hive<\/strong><\/pre>\n\n\n\n<p>Furthermore, <strong>Step 3:<\/strong> Put the rpm package in the above-mentioned path.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\"><strong>aws s3 cp s3:\/\/test-bucket\/Hive\/ClouderaHiveODBC-2.5.25.1020-1.el7.x86_64.rpm .<\/strong><\/pre>\n\n\n\n<p><strong>Step 4:<\/strong>Set up the package.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\"><strong>yum --nogpgcheck localinstall ClouderaHiveODBC-2.5.25.1020-1.el7.x86_64.rpm<\/strong><\/pre>\n\n\n\n<p>Also, <strong>Step 5:<\/strong>\u00a0Examine the package<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\"><strong>yum list | grep ClouderaHiveODBC<\/strong><\/pre>\n\n\n\n<p><strong>Step 6:\u00a0<\/strong>If the directory does not already exist, you must create it.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\"><strong>mkdir -p \/opt\/odbc_path\/client\/ODBC_64<\/strong><\/pre>\n\n\n\n<p>Furthermore, <strong>Step 7:<\/strong>\u00a0Navigate to the directory and create two odbc files (odbc.ini and obcinst.ini) within it.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\"><strong>cd \/opt\/odbc_path\/client\/ODBC_64<\/strong><\/pre>\n\n\n\n<p>Make an odbc.ini file with the following contents.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">[ODBC]\n#QEWSD=2458358\n InstallDir=\/opt\/teradata\/client\/ODBC_64\n Trace=no\n Pooling=yes\n [ODBC Data Sources]\n Teradata ODBC DSN=Teradata Database ODBC Driver 16.20\n [Teradata ODBC DSN]\n Description=Teradata Database ODBC Driver 16.20\n [testdsn]\r\n Driver=\/opt\/teradata\/client\/ODBC_64\/lib\/tdataodbc_sb64.so\r\n DBCName=&lt;Your DB End Point>\r\n MechanismName=LDAP\r\n Username=&lt;User Name>\r\n Passowrd=&lt;Password>\r\n Database=&lt;DB Name>\r\n AccountString=\r\n CharacterSet=ASCII\r\n DatasourceDNSEntries=\r\n DateTimeFormat=AAA\r\n DefaultDatabase=\r\n DontUseHelpDatabase=0\r\n DontUseTitles=1\r\n EnableExtendedStmtInfo=1\r\n EnableReadAhead=1\r\n IgnoreODBCSearchPattern=0\r\n LogErrorEvents=0\r\n LoginTimeout=20\r\n MaxRespSize=65536\r\n MaxSingleLOBBytes=0\r\n MaxTotalLOBBytesPerRow=0\r\n MechanismName=\r\n NoScan=0\r\n PrintOption=N\r\n retryOnEINTR=1\r\n ReturnGeneratedKeys=N\r\n SessionMode=System Default\r\n SplOption=Y\r\n TABLEQUALIFIER=0\r\n TCPNoDelay=1\r\n TdmstPortNumber=1025\r\n UPTMode=Not set\r\n USE2XAPPCUSTOMCATALOGMODE=0\r\n UseDataEncryption=0\r\n UseDateDataForTimeStampParams=0\r\n USEINTEGRATEDSECURITY=0\r\n UseSequentialRetrievalOnly=0\r\n UseXViews=0\r\n [ODBC]\r\n Trace = 1\r\n TraceFile =\r\n [ODBC Data Sources]\r\n Cloudera Hive 32-bit=Cloudera ODBC Driver for Apache Hive 32-bit\r\n Cloudera Hive 64-bit=Cloudera ODBC Driver for Apache Hive 64-bit\r\n [Cloudera Hive 32-bit]\r\n Description=Cloudera ODBC Driver for Apache Hive (32-bit) DSN\r\n Driver=\/opt\/cloudera\/hiveodbc\/lib\/32\/libclouderahiveodbc32.so\r\n HOST=[HOST]\r\n PORT=[PORT]\r\n Schema=default\r\n ServiceDiscoveryMode=0\r\n ZKNamespace=\r\n HiveServerType=2\r\n AuthMech=2\r\n ThriftTransport=1\r\n UseNativeQuery=0\r\n UID=\r\n KrbHostFQDN=_HOST\r\n KrbServiceName=hive\r\n KrbRealm=\r\n SSL=0\r\n TwoWaySSL=0\r\n ClientCert=\r\n ClientPrivateKey=\r\n ClientPrivateKeyPassword=\r\n [Hive]\r\n Description=Cloudera ODBC Driver for Apache Hive (64-bit) DSN\r\n Driver=\/opt\/cloudera\/hiveodbc\/lib\/64\/libclouderahiveodbc64.so\r\n HOST=\r\n PORT=\r\n Schema=\r\n ServiceDiscoveryMode=0\r\n ZKNamespace=\r\n HiveServerType=2\r\n AuthMech=3\r\n ThriftTransport=1\r\n UseNativeQuery=0\r\n UID=\r\n PWD=\r\n KrbHostFQDN=_HOST\r\n KrbServiceName=hive\r\n KrbRealm=\r\n SSL=0\r\n TwoWaySSL=0\r\n ClientCert=\r\n ClientPrivateKey=\r\n ClientPrivateKeyPassword=<\/pre>\n\n\n\n<p>Create an odbcinst.ini file with the following contents:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">[ODBC Drivers]\nTeradata Database ODBC Driver 16.20=Installed\n[Teradata Database ODBC Driver 16.20]\nDescription=Teradata Database ODBC Driver 16.20\nDriver=\/opt\/teradata\/client\/ODBC_64\/lib\/tdataodbc_sb64.so\n[ODBC Drivers]\nCloudera ODBC Driver for Apache Hive 32-bit=Installed\nCloudera ODBC Driver for Apache Hive 64-bit=Installed\n[Cloudera ODBC Driver for Apache Hive 32-bit]\nDescription=Cloudera ODBC Driver for Apache Hive (32-bit)\nDriver=\/opt\/cloudera\/hiveodbc\/lib\/32\/libclouderahiveodbc32.so\n[Cloudera ODBC Driver for Apache Hive 64-bit]\nDescription=Cloudera ODBC Driver for Apache Hive (64-bit)\nDriver=\/opt\/cloudera\/hiveodbc\/lib\/64\/libclouderahiveodbc64.so<\/pre>\n\n\n\n<p><strong>Step 8:<\/strong>\u00a0Configure the environment variables<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">export ODBCINI=\/opt\/odbc_path\/client\/ODBC_64\/odbc.ini \nexport ODBCINSTINI=\/opt\/odbc_path\/client\/ODBC_64\/odbcinst.ini<\/pre>\n\n\n\n<p>You could also update the same in your \/etc\/profile file to avoid having to update environment variables every time they change.<\/p>\n\n\n\n<p>You are now ready to test connectivity to Hive EDL using pyodbc python packages. Here&#8217;s an example of how to connect to Hive.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">import pyodbc\npyodbc.autocommit = True\npyodbc.pooling = False\nconn_str = \"DSN=\"+'Hive'+\";HOST=\"+'Hostname'+\";UID=\"+'User_ID'+\";PWD=\"+'Password'+\";PORT=\"+'Port_No'\ncon = pyodbc.connect(conn_str, autocommit=True)         <\/pre>\n\n\n\n<p>Hurry up and try the free practice tests now for<a href=\"https:\/\/www.testpreptraining.ai\/cloud-computing-courses\" target=\"_blank\" rel=\"noreferrer noopener\"> AWS exams offered by testpreptraining.ai!<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Apache Hive is a data warehouse tool built on top of Apache Hadoop that allows users to query and analyze data. Hive provides a SQL Like Interface for querying data stored in various Hadoop-integrated databases and filesystems. It allows for the reading, writing, and management of large datasets in distributed storage. Hive queries are transformed&#8230;<\/p>\n","protected":false},"author":7,"featured_media":25327,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[31],"tags":[7,9,20,4312,4311],"class_list":["post-25323","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-aws","tag-aws","tag-aws-certification","tag-cloud-computing","tag-install-cloudera-hive","tag-learn-to-install-cloudera-hive-in-aws"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Learn to Install Cloudera Hive in AWS - Blog<\/title>\n<meta name=\"description\" content=\"Learn to Install Cloudera Hive in AWS and upgrade your skills. Hurry up and try the free practice tests now for AWS exams offered by TPT!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Learn to Install Cloudera Hive in AWS - Blog\" \/>\n<meta property=\"og:description\" content=\"Learn to Install Cloudera Hive in AWS and upgrade your skills. Hurry up and try the free practice tests now for AWS exams offered by TPT!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog\" \/>\n<meta property=\"article:published_time\" content=\"2024-05-24T09:39:35+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.testpreptraining.ai\/blog\/wp-content\/uploads\/2022\/04\/Learn-to-Install-Cloudera-Hive-in-AWS.png\" \/>\n\t<meta property=\"og:image:width\" content=\"750\" \/>\n\t<meta property=\"og:image:height\" content=\"400\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Anandita Doda\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Anandita Doda\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/\",\"url\":\"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/\",\"name\":\"Learn to Install Cloudera Hive in AWS - Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/blog\/#website\"},\"datePublished\":\"2024-05-24T09:39:35+00:00\",\"dateModified\":\"2024-05-24T09:39:35+00:00\",\"author\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/blog\/#\/schema\/person\/cba9e2b360b5f8a57840070d4430e30f\"},\"description\":\"Learn to Install Cloudera Hive in AWS and upgrade your skills. Hurry up and try the free practice tests now for AWS exams offered by TPT!\",\"breadcrumb\":{\"@id\":\"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.testpreptraining.ai\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Learn to Install Cloudera Hive in AWS\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.testpreptraining.ai\/blog\/#website\",\"url\":\"https:\/\/www.testpreptraining.ai\/blog\/\",\"name\":\"Learning Resources\",\"description\":\"Testprep Training Blogs\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.testpreptraining.ai\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.testpreptraining.ai\/blog\/#\/schema\/person\/cba9e2b360b5f8a57840070d4430e30f\",\"name\":\"Anandita Doda\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.testpreptraining.ai\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/24208861aac3fc70a037f9774224d0a4061ed40fd41b0b6f6d8731403b1a40f3?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/24208861aac3fc70a037f9774224d0a4061ed40fd41b0b6f6d8731403b1a40f3?s=96&d=mm&r=g\",\"caption\":\"Anandita Doda\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Learn to Install Cloudera Hive in AWS - Blog","description":"Learn to Install Cloudera Hive in AWS and upgrade your skills. Hurry up and try the free practice tests now for AWS exams offered by TPT!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/","og_locale":"en_US","og_type":"article","og_title":"Learn to Install Cloudera Hive in AWS - Blog","og_description":"Learn to Install Cloudera Hive in AWS and upgrade your skills. Hurry up and try the free practice tests now for AWS exams offered by TPT!","og_url":"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/","og_site_name":"Blog","article_published_time":"2024-05-24T09:39:35+00:00","og_image":[{"width":750,"height":400,"url":"https:\/\/www.testpreptraining.ai\/blog\/wp-content\/uploads\/2022\/04\/Learn-to-Install-Cloudera-Hive-in-AWS.png","type":"image\/png"}],"author":"Anandita Doda","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Anandita Doda","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/","url":"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/","name":"Learn to Install Cloudera Hive in AWS - Blog","isPartOf":{"@id":"https:\/\/www.testpreptraining.ai\/blog\/#website"},"datePublished":"2024-05-24T09:39:35+00:00","dateModified":"2024-05-24T09:39:35+00:00","author":{"@id":"https:\/\/www.testpreptraining.ai\/blog\/#\/schema\/person\/cba9e2b360b5f8a57840070d4430e30f"},"description":"Learn to Install Cloudera Hive in AWS and upgrade your skills. Hurry up and try the free practice tests now for AWS exams offered by TPT!","breadcrumb":{"@id":"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.testpreptraining.ai\/blog\/learn-to-install-cloudera-hive-in-aws\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.testpreptraining.ai\/blog\/"},{"@type":"ListItem","position":2,"name":"Learn to Install Cloudera Hive in AWS"}]},{"@type":"WebSite","@id":"https:\/\/www.testpreptraining.ai\/blog\/#website","url":"https:\/\/www.testpreptraining.ai\/blog\/","name":"Learning Resources","description":"Testprep Training Blogs","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.testpreptraining.ai\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.testpreptraining.ai\/blog\/#\/schema\/person\/cba9e2b360b5f8a57840070d4430e30f","name":"Anandita Doda","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.testpreptraining.ai\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/24208861aac3fc70a037f9774224d0a4061ed40fd41b0b6f6d8731403b1a40f3?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/24208861aac3fc70a037f9774224d0a4061ed40fd41b0b6f6d8731403b1a40f3?s=96&d=mm&r=g","caption":"Anandita Doda"}}]}},"_links":{"self":[{"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/posts\/25323","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/comments?post=25323"}],"version-history":[{"count":7,"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/posts\/25323\/revisions"}],"predecessor-version":[{"id":25331,"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/posts\/25323\/revisions\/25331"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/media\/25327"}],"wp:attachment":[{"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/media?parent=25323"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/categories?post=25323"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.testpreptraining.ai\/blog\/wp-json\/wp\/v2\/tags?post=25323"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}