Compare Hadoop & Spark Criteria Hadoop Spark Dedicated storage HDFS None Speed of processing average excellent Libraries Separate tools available Spark Core, SQL, Streaming, MLlib, GraphX Modes Hadoop can be run in? Hadoop can run in three modes: Standalone Mode: Default mode of Hadoop, it uses local file stystem for input and output operations. This mode is mainly used for debugging purpose, and it does not support the use of HDFS. Further, in this mode, there is no custom configuration required for mapred-site.xml, core-site.xml, hdfs-site.xml files. Much faster when compared to other modes. Pseudo-Distributed Mode (Single Node Cluster): In this case, you need configuration for all the three files mentioned above. In this case, all daemons are running on one node and thus, both Master and Slave node are the same. Fully Distributed Mode (Multiple Cluster Node): This is the production phase of Hadoop (what Hadoop is known for) where data is ...
What is Splunk? Splunk is Google for your machine data.It’s a software/Engine which can be used for searching,visualizing,Monitoring,reporting etc of your enterprise data.Splunk takes valuable machine data and turns it into powerful operational intelligence by providing real? time insight to your data through charts,alerts,reports etc Compare Splunk & Spark Criteria Splunk Spark Deployment area Collecting large amounts of machine generated data Iterative applications & in-memory processing Nature of tool Proprietary Open Source Working mode Streaming mode Both streaming and batch mode What are common port numbers used by Splunk? Below are common port numbers used by splunk,however you can change them if required Service Port number Used Splunk Web Port: 8000 Splunk Management Port: 8089 Splunk Indexing Port: 9997 Splunk Index Replication Port 8080 Splunk network port 514 (Used to get d...