UhloboUkuqeqesha ekilasini
BHALISA

Xhumana nathi

Izinsimu ezimakwe nge * Kudingeka

 

inkambo enkulu ye-hadoop certification course

I-Big Data Hadoop Certification Course & Training

Uhlolojikelele

Izilaleli & Izidingo Zokuqala

Uhlaka Lokufunda

Uhlelo noHlelo

Certification

I-Big Data Hadoop Certification Overview Overview

Kuyinkambo ebanzi yokuqeqesha i-Hadoop Big Data eyakhiwe yizimboni ochwepheshe ngokucubungula izidingo zamanje embonini yomsebenzi ukuhlinzeka ngokujulile kokufunda idatha enkulu kanye ne-Hadoop Modules. Lena imboni ibone inkambo yokuqeqesha isitifiketi se-Big Data enhlanganisela izifundo zokuqeqesha ku-Hadoop yonjiniyela, umlawuli we-Hadoop, ukuhlolwa kwe-Hadoop, kanye ne-analytics. Lokhu I-Cloudera Ukuqeqeshwa kwe-Hadoop kuzokulungiselela ukuthi ususe isitifiketi esikhulu sedatha.

Izinhloso

  • I-Master eyisisekelo ye-Hadoop 2.7 ne-YARN bese ubhala izinhlelo zokusebenza usebenzisa zona
  • Ukusetha i-node ye-node ne-Multi node cluster ku-Amazon EC2
  • I-HDFS ye-Master, i-MapTeduce, iHive, iPig, i-Oozie, iSqoop, i-Flume, i-Zookeeper, i-HBase
  • Funda i-Spark, Spark i-RDD, i-Graphx, i-MLlib ebhala izinhlelo ze-Spark
  • I-Master Hadoop imisebenzi yokuphatha njenge-cluster yokuphatha, ukuqapha, ukuphatha nokuxazulula izinkinga
  • Ilungiselela amathuluzi we-ETL afana ne-Pentaho / Talend ukuze asebenze ne-MapReduce, Hive, i-pig, njll
  • Ukuqonda okuningiliziwe kwe-Big Data analytics
  • Izinhlelo ze-Hadoop zokuhlola usebenzisa i-MR Unit nezinye amathuluzi ezenzekelayo.
  • Sebenzisa amafomethi we-Avro
  • Yenza imiklamo yangempela yokuphila usebenzisa uHadoop no-Apache Spark
  • Qinisekisa ukusula i-Big Data Hadoop Certification.

netetsamelilwati

  • Abahleli be-Developers ne-System System
  • Abaqeqeshiwe abanokuhlangenwe nakho, abaphathi bephrojekthi
  • I-Big DataHadoop Developers bazimisele ukufunda amanye ama-verticals afana nokuhlola, i-Analytics, i-Administration
  • I-Mainframe Abasebenzi, Abaqambi Bokuhlola & Abahloli bokuhlola
  • I-Business Intelligence, Abagcini bemininingwane yokugcina imininingwane kanye ne-Analytics
  • Abaphothule iziqu, abaqeqeshi be-undergraduates abafisa ukufunda ubuchwepheshe be-Big Data yakamuva bangathatha lolu qeqesho lwe-Big Data Hadoop Certification online

Okudingekayo

  • Akunakudingeka ngaphambili ukuthatha ukuqeqeshwa kwedatha enkulu futhi ukuqonda uHadoop. Kodwa izinto eziyisisekelo ze-UNIX, i-SQL ne-java zizoba kuhle.Ngokuthi i-Intellipaat, sinikeza inkampani ye-Unix yokubhalisa kanye ne-Java ngokuqeqeshwa kwethu kwe-Big Data isitifiketi ukuze sisebenzise amakhono adingekayo ukuze ukwazi ukuhamba kahle kuHadoop endleleni yokufunda.

Isikhathi sokuphuma kwesikhathi sezinkathi: Izinsuku ze-2

Isingeniso ku-Big Data & Hadoop kanye ne-Ecosystem yayo, Imephu Yokunciphisa ne-HDFS

Iyini i-Big Data, i-Hadoop ihlala kuphi, i-Hadoop Distributed File System - Izimpendulo, Usayizi we-Block, i-Namenode yesibili, Ukutholakala okuphezulu, Ukuqonda i-YARN - ImithomboManager, i-NodeManager, umehluko phakathi kwe-1.x no-2.x

Ukufakwa kwe-Hadoop nokusetha

I-Hadoop 2.x I-Cluster Architecture, i-Federation kanye Nokutholakala Okuphezulu, I-Setup Cluster Yokukhiqiza Ejwayelekile, ama-Hadoop Cluster Modes, ama-Common Hadoop Shell Commands, Amafayela Wokuhlela we-Hadoop 2.x, iqoqo le-Cloudera elilodwa le-node

I-Deep Dive ku-Mapreduce

Indlela i-Mapreduce isebenza ngayo, Yeka ukuthi i-Reducer isebenza kanjani, Indlela yokushayela esebenza ngayo, ama-Combiners, ama-Partitioners, amafomu wokufaka, amafomu okuphuma, ukuxhuma nokuhlelwa, ukujoyina kwempumalanga, ukunciphisa ukujoyina eceleni, i-MRUnit, i-Distributed Cache

I-Lab isebenzisa:

Ukusebenza nge-HDFS, Ukubhala i-WordCount Program, Ukuhlukanisa isiko sokwabelana, i-Mapreduce ne-Combiner, Imephu eceleni Joyina, Ukunciphisa Ukujoyina Okuhlangene, Ukuhlola I-Unit Mappinguce, Ukuqalisa I-Mapreduce kwimodi ye-LocalJobRunner

Igrafu Yokuxazulula Inkinga

Iyini iGrafu, Ukumelela kweGrafu, Isinkwa sokuqala I-Algorithm Yokusesha, Ukumelelwa KweGrafu Ukunciphisa Kwemephu, Indlela Yokwenza I-Algorithm YeGrafu, Isibonelo seMephu YeGrafu Ukunciphisa,

    Ukuzivocavoca 1: Ukuzivocavoca 2: Ukuzivocavoca 3:

Ukuqonda okuningiliziwe kwe-pig

A. Isingeniso ku-Pig

Ukuqonda i-Apache Pig, izici, ukusetshenziswa okuhlukahlukene nokufunda ukuxhumana no-Pig

B. Ukuthumela i-pig ukuze kuhlaziywe kwedatha

I-syntax ye-Pig Latin, izincazelo ezihlukahlukene, ukuhlunga idatha kanye nokuhlunga, izinhlobo zedatha, ukuthumela i-Pig ye-ETL, ukulayisha idatha, ukubukwa kwe-schema, izincazelo zenkambu, imisebenzi ejwayelekile esetshenziswa.

C. Ingulube yokucubungula idatha eyinkimbinkimbi

Izinhlobo ezehlukene zedatha kufaka phakathi isidleke futhi eziyinkimbinkimbi, ukucubungula idatha ne-Pig, ukuqoqa idatha iteration, ukuvivinya umzimba

D. Ukwenza imisebenzi eminingi yedathasethi

Idatha eqoqweni yokujoyina, ukuhlukaniswa kwedatha, izindlela ezahlukene zokusetha idatha, ukusetha imisebenzi, ukuzivocavoca izandla

E. Ukwandisa iPig

Ukuqonda imisebenzi echazwe ngumsebenzisi, ukwenza ukucubungula kwedatha nezinye izilimi, ukungeniswa kanye nama-macros, usebenzisa ukusakaza kanye nama-UDF ukudlulisa iPig, ukuvivinya umzimba

Imisebenzi ye-Pig

Ukusebenza namaqoqo e-data wangempela okubandakanya i-Walmart ne-Electronic Arts njengocwaningo lwecala

Ukuqonda okuningiliziwe kwamaHive

A. Isingeniso seHive

Ukuqonda amaHive, ukuqhathaniswa kwesisekelo samasiko namaHive, i-Pig kanye neHive, ukugcina idatha kuHive neHive schema, ukuxhumana kwamaHive kanye namacala ahlukahlukene wokusebenzisa amaHive

B. I-Hive yokuhlaziywa kwedatha yokuxoxisana

Ukuqonda i-HiveQL, i-syntax eyisisekelo, amatafula ahlukahlukene kanye nolwazi oluthile, izinhlobo zedatha, ukuqoqwa kwedatha, imisebenzi ehlukene eyakhelwe ngaphakathi, ukuthumela imibuzo yamaHive ngezikripthi, igobolondo ne-Hue.

C. Ukuphathwa kwedatha ngeHive

Imininingwane yolwazi oluhlukahlukene, ukudalwa kolwazi, amafomethi wedatha kuHive, ukufometha kwedatha, Amathebula aphethwe yiHive, amathebula alawulwa yedwa, ukulayisha idatha, ukuguqula imininingwane kanye namathebula, ukuguqulwa kwemibono nokubukwa, ukugcina umbuzo wemiphumela, ukulawulwa kokufinyelela kwedatha, ukulawula idatha nge-Hive, i-Metastore yamaHive ne-Thrift iseva.

D. Ukuthuthukisa amaHive

Ukusebenza kokusebenza kombuzo, ukukhomba idatha, ukwahlukanisa nokwehlukanisa

E. Ukwandisa amaHive

Ukuthumela imisebenzi echazwe ngumsebenzisi yokwandisa amaHive

F. Amandla Ekuzivocavoca - esebenza ngamaqoqo amakhulu yedatha nokucaphuna okubanzi

Ukuthumela amaHive ngezinqwaba zemithamo yezinombolo kanye nokukhululeka kwe-querying

I-G. UDF, ukufaneleka kombuzo

Ukusebenza kabanzi nemibuzo echazwe ngumsebenzisi, ukufunda indlela yokwandisa imibuzo, izindlela ezehlukene zokwenza ukulungiswa kokusebenza.

Impala

A. Isingeniso eMpala

Iyini iMpala ?, Indlela i-Impala ehlula ngayo amaHive nePig, Indlela iMpala ehluke ngayo kuma-database, ama-Limitations kanye neziqondiso zesikhathi esizayo, Ukusebenzisa i-Impala Shell

B. Ukukhetha i-Best (iHive, i-pig, impala)

C. Ukulinganisa nokuphatha idatha nge Impala neHive

Ukubukwa Kwesitoreji Sokudatha, Ukudala Amadokhumenti kanye Namathebula, Ukulondoloza Idatha kumaTables, Ukukhangisa, Imfihlo Ye-Imeta Metadata

D. Data Partitioning

Ukubheka ngokubambisana, Ukuhlukanisa i-Impala neHive

(AVRO) Data Formats

Ukukhetha ifomethi yefayili, Ukusekelwa kweThuluzi lamafomethi wefayela, i-Avro Schemas, Ukusebenzisa i-Avro neHive neSqoop, i-Avro Schema Evolution, Ukucindezela

Isingeniso esakhiweni se-Hbase

Iyini i-Hbase, iphi lapho ihambisana khona, Iyini i-NOSQL

I-Apache Spark

A. Kungani u-Spark? Ukusebenza ngeSistimu Yefayela YeSpark neHadoop

Iyini i-Spark, Ukuqhathanisa phakathi kwe-Spark ne-Hadoop, Izingxenye ze-Spark

B. I-Spark Components, i-Common Spark I-Algorithms-Iterative Algorithms, Ukuhlaziywa Kwegrafu, Ukufunda Komshini

I-Apache Spark- Isingeniso, Ukuvumelana, Ukutholakala, Isahluko, I-Stack Spark Ehlanganisiwe, Izingxenye ze-Spark, Isibonelo se-Scalding, umnakekeli, isiphepho, igrafu

C. Running Spark kwiCluster, Ukubhala Izicelo ze-Spark usebenzisa iPython, Java, Scala

Chaza isibonelo se-python, Bonisa ukufaka u-spark, Chaza uhlelo lokushayela, Ukuchazela umongo wenkanyezi ngesibonelo, Chaza ukuguquguquka okwenziwe ngokungafani, Hlanganisa i-scala ne-java ngokucophelela, Chaza ukuvumelanisa nokusabalalisa., Chaza ukuthi yikuphi ukuziphatha, Chaza umsebenzi ophezulu we-oda ngesibonelo, Chaza i-OFI iScheduler, Izinzuzo ze-Spark, Isibonelo se-Lamda usebenzisa u-spark, Chaza i-Mapreduce ngesibonelo

Ukusetha i-Hadoop Cluster ne-Running Map Kunciphisa Imisebenzi

Ukusethwa kwe-Multi Code Cluster usebenzisa i-Amazon ec2 - Ukwakha ukusethwa kwe-node cluster ye-4, I-Running Map Imisebenzi Yokunciphisa I-Cluster

Iphrojekthi enkulu - Ukuyihlanganisa ndawonye nokuxhuma amaDots

Ukubeka konke kanye nokuxhuma amaDokhumenti, Ukusebenza ngamasethi amakhulu wedatha, Izinyathelo ezihilelekile ekuhlaziyeni idatha enkulu

I-ETL Ukuxhumana ne-Hadoop Ecosystem

Indlela amathuluzi e-ETL asebenza ngayo kwi-Big Data Industry, Ukuxhuma kwi-HDFS kusuka ku-ETL ithuluzi nokuhambisa idatha kusuka kuhlelo lwendawo ku-HDFS, Ukuhambisa idatha kusuka ku-DBMS kuya ku-HDFS, Ukusebenza ngeHive nge-ETL Ithuluzi, Ukudala umsebenzi wokunciphisa imephu ku-ETL ithuluzi, Ukuphela kokuphela kwe-ETL I-PoC ibonisa ukuhlanganiswa okukhulu kwedatha nethuluzi le-ETL.

Ukuhlelwa kweCluster

Uhlolojikelele lokulungiswa kanye nefayela elibalulekile lokumisa, imingcele yokulungisa kanye namanani, imingcele ye-HDFS ImephuNciphisa imingcele, isethaphu se-Hadoop yemvelo, 'Faka phakathi' futhi 'Ungafaki' amafayela wokuhlela, I-Lab: ImephuYenza Ukunciphisa Ukusebenza Kokusebenza

Ukuphatha nokulondoloza

Izakhiwo ze-Namenode / Datanode nezinhlaka namafayela, Ifayela lesistimu yefayela kanye ne-Hlela log, I-Checkpoint Procedure, inqubo yokuhluleka nokubuyiswa kwe-Namenode, I-Safe Mode, iMetadata kanye ne-Backup Data, Izinkinga ezingenzeka kanye nezixazululo / okubhekayo, Ukwengeza nokukhipha ama-node, I-Lab: ImephuNciphisa uhlelo lwefayela I-Recovery

Ukuqapha nokuxazulula izinkinga

Imikhuba emihle yokuqapha iqoqo, Ukusebenzisa izingodo kanye namathrekhi omkhondo wokuqapha nokuxazululwa kwezinkinga, Ukusebenzisa amathuluzi avulekile-source ukuqapha iqoqo

Umhleli weJobe: Imephu inciphisa ukugeleza kokuthunyelwa komsebenzi

Indlela yokuhlela Imisebenzi kwiqoqo elifanayo, i-FIFO Schedule, i-Fair Scheduler kanye nokuhlelwa kwayo

Ukusethwa kwe-Cluster Cluster Nokusetha Map Ukunciphisa Imisebenzi ku-Amazon Ec2

Ukusethwa kwe-Multi Code Cluster usebenzisa i-Amazon ec2 - Ukwakha ukusethwa kwe-node cluster ye-4, I-Running Map Imisebenzi Yokunciphisa I-Cluster

I-ZOOKEEPER

UKUSEBENZA Isingeniso, ama-ZOOKEEPER asebenzisa amacala, amasevisi we-ZOOKEEPER, i-ZOOKEEPER Idatha yesithombe, ama-Znodes nezinhlobo zawo, imisebenzi ye-Znodes, ama-Znodes ama-watch, ama-Znodes afunda futhi abhala, ukuqinisekiswa okuhambisanayo, ukuphathwa kweCluster, ukhetho lwabaholi, ukuhlukaniswa kwe-Exclusive Lock, amaphuzu abalulekile

Ngaphambi kwe-Oozie

Kungani u-Oozie? Ukufaka i-Oozie, Ukugijima isibonelo, i-Oozi- injini ye-flowflow, Isibonelo se-M / R, isibonelo se-Word, Isicelo sokuhamba komsebenzi, ukuthunyelwa komsebenzi, Ukuthunyelwa komsebenzi, Ukuthunyelwa komsebenzi, Ukuphepha emsebenzini we-Oozie, Kungani ukuphepha kwe-Oozie? , Ukuhlala okuningi nokungahambi kahle, I-Time time yomsebenzi we-Oozie, Umxhumanisi, Isibopho, Izakhiwo zokukhishwa, Izakhiwo, Ukusebenzisa I-1: izikhathi zokuqala, Sebenzisa I-Case 2: i-data ne-time stimulators, Sebenzisa i-Case 3: iwindi lokuvula

I-Flute Yokuqala

Uhlolojikelele lwe-Apache Flume, ngokusatshalaliswa ngokomzimba Imithombo yemininingwane, Ukushintsha isakhiwo seDatha, Ukubukeka okuseduze, i-Anatomy ye-Flume, imiqondo engundoqo, Umcimbi, Amaklayenti, ama-Agents, Umthombo, Iziteshi, Izinkinobho, Abathintekayo, Umkhethi weSiteshi, Umshini wokucubungula, I-data ingest, Iphayiphi ye-Agent , Ukushintshaniswa kwemininingwane ye-Transactional, Ukulandelana nokuphindaphinda, Kungani iziteshi ?, Sebenzisa icala- I-aggregation login, Ukwengeza i-agent ye-flume, Ukuphatha ipulazi leseva, Ivolumu yedatha ngayinye, Isibonelo esichaza ukuthunyelwa kwe-flute eyodwa

Ngaphambi kwe-HUE

Isingeniso se-HUE, imvelo ye-HUE, Iyini i-HUE?, Ukubuka kwezwe kwangempela kwe-HUE, Izinzuzo ze-HUE, Ukulayisha kanjani idatha ku-Isiphequluli seFayili ?, Buka okuqukethwe, Ukuhlanganisa abasebenzisi, Ukuhlanganisa i-HDFS, Izimfuneko ze-HUE FRONTEND

Ngaphambi Impala

IMPALA Sibutsetelo: Izinhloso, Umbono womsebenzisi we-Impala: Sibutsetelo, Umbono womsebenzisi we-Impala: I-SQL, Ukubukwa komsebenzisi we-Impala: I-Apache HBase, i-Impala isakhiwo, isitolo se-Impala, isevisi yezincwadi ze-Impala, Izigaba zokwenza umbuzo, Ukuqhathanisa i-Impala kuya eHive

I-Hadoop Ukuhlolwa Kwesicelo

Kungani ukuhlola kubalulekile, Ukuhlolwa kweyunithi, Ukuhlolwa kokuhlanganiswa, Ukuhlolwa kokusebenza, Ukuhlola, Ukuhlolwa kwe-Nightly QA, Ukuhlola kokuphela kokuphela, ukuhlolwa kokusebenza, ukuhlolwa kokukhishwa, ukuhlolwa kokuphepha, ukuhlolwa kwe-Scalability, Ukumisa nokuqokwa kwama-Data Nodes Ukuhlolwa, ukuhlolwa okuthembekile , Ukukhulula ukuhlolwa

Izindleko Nemithwalo Yemfanelo Ye-Hadoop Testing Professional

Ukuqonda Isidingo, ukulungiswa kokulingwa kokuhlola, Amacala okuhlola, Idatha yokuhlola, Ukudalwa kwamathebhu okuhlola, Ukuhlolwa kokuhlolwa, Ukubika okukhohlisayo, Ukubuyiswa kwe-Defect, Ukulethwa kwezimo zansuku zonke, ukuqedwa kokuhlolwa, ukuhlolwa kwe-ETL kuzo zonke izigaba (i-HDFS, i-HIVE, i-HBASE) ngesikhathi ukulayisha okufakwayo (izingodo / amafayela / amarekhodi njll) usebenzisa i-sqoop / flume ehlanganisa kodwa engagcini ekuqinisweni kwedatha, ukubuyisana, ukugunyazwa komsebenzisi nokuhlolwa kokuqinisekisa (Amaqembu, Abasebenzisi, Amalungelo, njll), Bika amaphutha kwiqembu lokuthuthukisa noma umphathi nokushayela ukuvala, Ukuhlanganisa zonke iziphambeko nokudala imibiko yokukhubazeka, Ukuqinisekisa isici esisha nezindaba ku-Core Hadoop.

Uhlaka olubizwa ngokuthi i-MR Unit yokuhlolwa kwemephu-ukunciphisa izinhlelo

Bika ukungalungi eqenjini lokuthuthukiswa noma umphathi futhi ubashayele ukuvala, Ukuhlanganisa zonke iziphambeko nokudala imibiko yokukhubazeka, Uxanduva lokudala uHlelo lokuhlola olubizwa ngokuthi uM MR Unit lokuhlola izinhlelo zokunciphisa imephu.

Ukuhlolwa kwe-Unit

Ukuhlola okuzenzekelayo usebenzisa i-OOZIE, Ukuqinisekiswa kwedatha kusetshenziswa ithuluzi lokuqhutshwa kombuzo.

Ukuhlolwa kokuhlolwa

Uhlelo lokuhlola lwe-HDFS ukuthuthukiswa, ukuzenzekela kokuhlolwa nokuphumela

Isu Lokuhlola Isu nokubhala Izivivinyo zokuhlola uHadoop Application

Indlela yokuhlola ukufaka nokulungisa

Ukusekelwa kweJobe nokuqinisekiswa

I-Cloudera Certification Certification Tips and Guidance kanye Nokuhlekisa Ukuxoxa Ukulungiselela, Amathiphu Okuthuthukiswa Okusebenzayo Nezobuchwepheshe

Sicela ubhalele kithi info@itstechschool.com & xhumana nathi ku-91-9870480053 ngezindleko zemali & isitifikedi, isimiso & indawo

Siphonsa Umbuzo

Le nkambo yokuqeqesha iklanyelwe ukukusiza ukusula kokubili I-Cloudera Spark ne-Hadoop Developer Certification (CCA175) ukuhlolwa kanye I-Cloudera Certified Administrator ye-Apache Hadoop (CCAH) ukuhlolwa. Yonke into yokuqeqeshwa yenkambo ihambisana nalezi zinhlelo ezimbili zokuqinisekisa futhi ikusiza ukusula lezi zivivinyo ngokuqinisekiswa futhi uthole imisebenzi engcono kakhulu kuma-MNC aphezulu.

Njengengxenye yalokhu kuqeqeshwa uzobe usebenza emisebenzini yesikhathi sangempela kanye nemisebenzi enomthelela omkhulu embonini yezwe yangempela yemvelo ngaleyo ndlela ikusiza ukuba ulandelele umsebenzi wakho ngokuzikhandla.

Ekupheleni kwalolu hlelo lokuqeqesha kuzoba nemikhakha ekhombisa ukuthi uhlobo luni lwemibuzo eceliwe ezihlolwayo ezihlolwayo futhi luyakusiza ukuthi uphawule amamaki angcono ekuhlolweni kwesitifiketi.

Isitifiketi Sokuqedela Isiqu Sakho izoklonyelwa ekuphothulweni komsebenzi weProjekthi (ngokubuyekezwa kobuchwepheshe) futhi ngokufaka amagoli okungenani ama-60% amanothi kumbuzo. Isitifiketi se-Intellipaat siyabonakala kahle kuma-80 + MNC aphezulu njengo-Ericsson, i-Cisco, i-Cognizant, i-Sony, i-Mu Sigma, i-Saint-Gobain, i-Standard Chartered, i-TCS, i-Genpact, i-Hexaware, njll.

Ukuze uthole olunye ulwazi ngomusa Xhumana nathi.


Izibuyekezo