Hadoop Tutorial For Beginners

Compare Hadoop & Spark Criteria Hadoop Spark Dedicated storage HDFS None Speed of processing average excellent Libraries Separate tools available Spark Core, SQL, Streaming, MLlib, GraphX Modes Hadoop can be run in? Hadoop can run in three modes: Standalone Mode:  Default mode of Hadoop, it uses local file stystem for input and output operations. This mode is mainly used for debugging purpose, and it does not support the use of HDFS. Further, in this mode, there is no custom configuration required for mapred-site.xml, core-site.xml, hdfs-site.xml files. Much faster when compared to other modes. Pseudo-Distributed Mode (Single Node Cluster):  In this case, you need configuration for all the three files mentioned above. In this case, all daemons are running on one node and thus, both Master and Slave node are the same. Fully Distributed Mode (Multiple Cluster Node):  This is the production phase of Hadoop (what Hadoop is known for) where data is ...

What is Splunk? Splunk is Google for your machine data.It’s a software/Engine which can be used for searching,visualizing,Monitoring,reporting etc of your enterprise data.Splunk takes valuable machine data and turns it into powerful operational intelligence by providing real? time insight to your data through charts,alerts,reports etc Compare Splunk & Spark Criteria Splunk Spark Deployment area Collecting large amounts of machine generated data Iterative applications & in-memory processing Nature of tool Proprietary Open Source Working mode Streaming mode  Both streaming and batch mode What are common port numbers used by Splunk? Below are common port numbers used by splunk,however you can change them if required Service Port number Used Splunk Web Port:  8000  Splunk Management Port:  8089  Splunk Indexing Port:  9997  Splunk Index Replication Port   8080  Splunk network port 514 (Used to get d...

Compare Solr & ElasticSearch Criteria Solr ElasticSearch Data varieties JSON, XML, CSV JSON Data de duplication Supported Not supported Updates Through configuration changes Through custom work What is Apache Solr? Apache Solr is a standalone full-text search platform to perform searches on multiple websites and index documents using XML and HTTP. Built on a Java Library called Lucence, Solr supports a rich schema specification for a wide range and offers flexibility in dealing with different document fields. It also consists of an extensive search plugin API for developing custom search behavior. What file contains configuration for data directory? Solrconfig.xml file contains configuration for data directory. What file contains definition of the field types and fields of documents? schema.xml file contains definition of the field types and fields of documents. What are the features of Apache Solr? Allows Scalable, high per...