DOI: https://doi.org/10.18517/ijods.5.1.1-18.2024
Identification of Influential Nodes in Social Network: Big Data - Hadoop
Abstract
Software development and associated data is the most critical factor these days. Currently, people are living in an internet world where data and related artifacts are major sets of information these days. The data is correlated with real-world data. The analysis of large datasets was done as part of the experimental analysis. The dataset for online social media like Facebook and Twitter was taken for the identification of influential nodes. The analysis of the dataset provides an overview and observation of the dataset for Facebook or Twitter. Here, in the current activity, an overview of cloud computing and big data technologies are discussed along with effective methods and approaches to resolve the problem statement. Particularly, big data technologies such as Hadoop provided by Apache for processing and analysis of Gigabyte(GB) or petabyte(PB) scale datasets are discussed for processing data in distributed and parallel data fashion. Here, the processing of large datasets is done by big data technology by implementing Apache Hadoop in online social media.
Article Details
How to Cite
[1]
R. K. Kumar, Laxmi Ahuja, and Suman Mann, “Identification of Influential Nodes in Social Network: Big Data - Hadoop”, Int. J. Data. Science., vol. 5, no. 1, pp. 1-18, Jun. 2024.
Issue
Section
Articles
References
Statista. Total Data Volume Worldwide 2010–2025. Available online: https://www.statista.com/statistics/871513/worldwide/data-created/.
Forbes. Big Data Goes Big. Available online: https://www.forbes.com/sites/rkulkarni/2019/02/07/big-data-goes-big/?sh=5b9 85d0920d7.
Bhosale, H.S.; Gadekar, D.P. A review paper on big data and Hadoop. IJSR 2014, 4, 1–7.
SangeethaLakshmi, M.G.; Jayashree, M.M. Comparative Analysis of Various Tools for Data Mining and Big Data Mining. IRJET 2019, 6, 704–708.
Apache Hadoop Home Page. Available online: https://hadoop.apache.org/.
Wu, Y.; Wu, C.; Li, B.; Zhang, L.; Li, Z.; Lau, F.C. Scaling social media applications into geo-distributed clouds. IEEE ACM Trans. Netw. 2014, 23, 689–702.
Zaharia, M.; Chowdhurry, M.; Das, T.; Dave, A.; Ma, J.; McCauley, M.; Franklin, J.M.; Shenker, S.; Stoica, I. Fast and interactive analytics over Hadoop data with Spark. Usenix Login 2012, 37, 45–51.
Apache Hadoop. MapReduce Tutorial. Available online: https://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/ hadoop-mapreduce-client-core/MapReduceTutorial.html.
Apache SparkTM. Unifified Engine for Large-Scale Data Analytics. Available online: https://spark.apache.org/.
Ahmed, N.; Barczak, A.L.; Susnjak, T.; Rashid, M.A. A comprehensive performance analysis of Apache Hadoop and Apache Spark for large scale data sets using HiBench. J. Big Data 2020, 7, 110.
Ahmadvand, H.; Goudarzi, M.; Foroutan, F. Gapprox: Using gallup approach for approximation in big data processing. J. Big Data 2019, 6, 20.
Samadi, Y.; Zbakh, M.; Tadonki, C. Performance comparison between Hadoop and Spark frameworks using HiBench benchmarks. Concurr. Comput. Pract. Exp. 2018, 30, e4367.
Isah, H.; Abughofa, T.; Mahfuz, S.; Ajerla, D.; Zulkernine, F.; Khan, S. A survey of distributed data stream processing frameworks. IEEE Access 2019, 7, 154300–154316.
Khezr, S.N.; Navimipour, N.J. MapReduce and its applications, challenges, and architecture: A comprehensive review and directions for future research. J. Grid Comput. 2017, 15, 295–321
Aziz, K.; Zaidouni, D.; Bellafkih, M. Big data processing using machine learning algorithms: Mllib and mahout use case. In proceedings of the 12th International Conference on Intelligent Systems: Theories and Applications, Rabat, Morocco, 24–25 October 2018, 1st ed.; Association for Computing Machinery: New York, NY, USA, 2018; pp. 1–6.
H. Oktay, A. S. Balkir, I. Foster, and D. Jensen ”Distance estimation with MapReduce for large networks”, in Proceedings of the Workshop on Information Networks,
WIN, pp. 1-6, 2011
Mavrogiorgou, A.; Kiourtis, A.; Kyriazis, D. Plug ‘n’play IoT devices: An approach for dynamic data acquisition from unknown heterogeneous devices. In Proceedings of the Conference on Complex, Intelligent, and Software Intensive Systems, Turin, Italy, 10–13 July 2017; Springer: Berlin/Heidelberg, Germany, 2017; pp. 885–895.
Goudarzi, M. Heterogeneous architectures for big data batch processing in mapreduce paradigm. IEEE Trans. Big Data 2017, 5, 18–33.
Koo, J.; Kang, G.; Kim, Y.G. Security and privacy in big data life cycle: A survey and open challenges. Sustainability 2020, 12, 10571.
Prerna, Agarwal.; Rafeeq, Ahmed.;Tanvir, Ahmad.; Identification and ranking of key persons in a Social Networking Website using Hadoop & Big Data Analytics AICTC '16: Proceedings of the International Conference on Advances in Information Communication Technology & ComputingAugust 2016Article No.: 65Pages 1–6https://doi.org/10.1145/2979779.2979844
Perakis, K.; Miltiadou, D.; De Nigro, A.; Torelli, F.; Montandon, L.; Magdalinou, A.; Mavrogiorgou, A.; Kyriazis, D. Data Sources and Gateways: Design and Open Specifification. Acta Inform. Med. 2019, 27, 341.
Mavrogiorgou, A.; Kiourtis, A.; Kyriazis, D. A pluggable IoT middleware for integrating data of wearable medical devices. Smart Health 2022, 26, 100326.
Anderson, J.W.; Kennedy, K.E.; Ngo, L.B.; Luckow, A.; Apon, A.W. Synthetic data generation for the internet of things. In Proceedings of the 2014 IEEE International Conference on Big Data (Big Data), Washington, DC, USA, 27–30 October 2014; pp. 171–176.
Sebek Homepage. Available online: https://honeynet.onofri.org/tools/sebek/.
Honeynet. Hflflow2. Available online: https://www.honeynet.org/projects/old/hflflow2/.
Viecco, C. Improving honeynet data analysis. In Proceedings of the 2007 IEEE SMC Information Assurance and Security Workshop, West Point, NY, USA, 20–22 June 2007; pp. 99–106.
Honeynet. Nepenthes Pharm. Available online: https://www.honeynet.org/2009/11/29/nepenthes-pharm/.
Kojoney—A Honeypot for the SSH Service. Available online: http://kojoney.sourceforge.net/.Information 2023, 14, 93 32 of 34
Honeynet. Capture-HPC. Available online: https://www.honeynet.org/projects/old/capture-hpc/.
Apache Kafka Home Page. Available online: https://kafka.apache.org/.
Padgavankar, M.H.; Gupta, S.R. Big data storage and challenges. Int. J. Comput. Sci. Inf. Technol. 2014, 5, 2218–2223.
Hypertable.org Home Page. Available online: https://hypertable.org/.
Khezr, S.N.; Navimipour, N.J. MapReduce and its applications, challenges, and architecture: A comprehensive review and directions for future research. J. Grid Comput. 2017, 15, 295–321
Forbes. Big Data Goes Big. Available online: https://www.forbes.com/sites/rkulkarni/2019/02/07/big-data-goes-big/?sh=5b9 85d0920d7.
Bhosale, H.S.; Gadekar, D.P. A review paper on big data and Hadoop. IJSR 2014, 4, 1–7.
SangeethaLakshmi, M.G.; Jayashree, M.M. Comparative Analysis of Various Tools for Data Mining and Big Data Mining. IRJET 2019, 6, 704–708.
Apache Hadoop Home Page. Available online: https://hadoop.apache.org/.
Wu, Y.; Wu, C.; Li, B.; Zhang, L.; Li, Z.; Lau, F.C. Scaling social media applications into geo-distributed clouds. IEEE ACM Trans. Netw. 2014, 23, 689–702.
Zaharia, M.; Chowdhurry, M.; Das, T.; Dave, A.; Ma, J.; McCauley, M.; Franklin, J.M.; Shenker, S.; Stoica, I. Fast and interactive analytics over Hadoop data with Spark. Usenix Login 2012, 37, 45–51.
Apache Hadoop. MapReduce Tutorial. Available online: https://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/ hadoop-mapreduce-client-core/MapReduceTutorial.html.
Apache SparkTM. Unifified Engine for Large-Scale Data Analytics. Available online: https://spark.apache.org/.
Ahmed, N.; Barczak, A.L.; Susnjak, T.; Rashid, M.A. A comprehensive performance analysis of Apache Hadoop and Apache Spark for large scale data sets using HiBench. J. Big Data 2020, 7, 110.
Ahmadvand, H.; Goudarzi, M.; Foroutan, F. Gapprox: Using gallup approach for approximation in big data processing. J. Big Data 2019, 6, 20.
Samadi, Y.; Zbakh, M.; Tadonki, C. Performance comparison between Hadoop and Spark frameworks using HiBench benchmarks. Concurr. Comput. Pract. Exp. 2018, 30, e4367.
Isah, H.; Abughofa, T.; Mahfuz, S.; Ajerla, D.; Zulkernine, F.; Khan, S. A survey of distributed data stream processing frameworks. IEEE Access 2019, 7, 154300–154316.
Khezr, S.N.; Navimipour, N.J. MapReduce and its applications, challenges, and architecture: A comprehensive review and directions for future research. J. Grid Comput. 2017, 15, 295–321
Aziz, K.; Zaidouni, D.; Bellafkih, M. Big data processing using machine learning algorithms: Mllib and mahout use case. In proceedings of the 12th International Conference on Intelligent Systems: Theories and Applications, Rabat, Morocco, 24–25 October 2018, 1st ed.; Association for Computing Machinery: New York, NY, USA, 2018; pp. 1–6.
H. Oktay, A. S. Balkir, I. Foster, and D. Jensen ”Distance estimation with MapReduce for large networks”, in Proceedings of the Workshop on Information Networks,
WIN, pp. 1-6, 2011
Mavrogiorgou, A.; Kiourtis, A.; Kyriazis, D. Plug ‘n’play IoT devices: An approach for dynamic data acquisition from unknown heterogeneous devices. In Proceedings of the Conference on Complex, Intelligent, and Software Intensive Systems, Turin, Italy, 10–13 July 2017; Springer: Berlin/Heidelberg, Germany, 2017; pp. 885–895.
Goudarzi, M. Heterogeneous architectures for big data batch processing in mapreduce paradigm. IEEE Trans. Big Data 2017, 5, 18–33.
Koo, J.; Kang, G.; Kim, Y.G. Security and privacy in big data life cycle: A survey and open challenges. Sustainability 2020, 12, 10571.
Prerna, Agarwal.; Rafeeq, Ahmed.;Tanvir, Ahmad.; Identification and ranking of key persons in a Social Networking Website using Hadoop & Big Data Analytics AICTC '16: Proceedings of the International Conference on Advances in Information Communication Technology & ComputingAugust 2016Article No.: 65Pages 1–6https://doi.org/10.1145/2979779.2979844
Perakis, K.; Miltiadou, D.; De Nigro, A.; Torelli, F.; Montandon, L.; Magdalinou, A.; Mavrogiorgou, A.; Kyriazis, D. Data Sources and Gateways: Design and Open Specifification. Acta Inform. Med. 2019, 27, 341.
Mavrogiorgou, A.; Kiourtis, A.; Kyriazis, D. A pluggable IoT middleware for integrating data of wearable medical devices. Smart Health 2022, 26, 100326.
Anderson, J.W.; Kennedy, K.E.; Ngo, L.B.; Luckow, A.; Apon, A.W. Synthetic data generation for the internet of things. In Proceedings of the 2014 IEEE International Conference on Big Data (Big Data), Washington, DC, USA, 27–30 October 2014; pp. 171–176.
Sebek Homepage. Available online: https://honeynet.onofri.org/tools/sebek/.
Honeynet. Hflflow2. Available online: https://www.honeynet.org/projects/old/hflflow2/.
Viecco, C. Improving honeynet data analysis. In Proceedings of the 2007 IEEE SMC Information Assurance and Security Workshop, West Point, NY, USA, 20–22 June 2007; pp. 99–106.
Honeynet. Nepenthes Pharm. Available online: https://www.honeynet.org/2009/11/29/nepenthes-pharm/.
Kojoney—A Honeypot for the SSH Service. Available online: http://kojoney.sourceforge.net/.Information 2023, 14, 93 32 of 34
Honeynet. Capture-HPC. Available online: https://www.honeynet.org/projects/old/capture-hpc/.
Apache Kafka Home Page. Available online: https://kafka.apache.org/.
Padgavankar, M.H.; Gupta, S.R. Big data storage and challenges. Int. J. Comput. Sci. Inf. Technol. 2014, 5, 2218–2223.
Hypertable.org Home Page. Available online: https://hypertable.org/.
Khezr, S.N.; Navimipour, N.J. MapReduce and its applications, challenges, and architecture: A comprehensive review and directions for future research. J. Grid Comput. 2017, 15, 295–321