دانلود رایگان مقاله اهمیت و چالشهای پژوهش کلان داده

Abstract

In recent years, the rapid development of Internet, Internet of Things, and Cloud Computing have led to the explosive growth of data in almost every industry and business area. Big data has rapidly developed into a hot topic that attracts extensive attention from academia, industry, and governments around the world. In this position paper, we first briefly introduce the concept of big data, including its definition, features, and value. We then identify from different perspectives the significance and opportunities that big data brings to us. Next, we present representative big data initiatives all over the world. We describe the grand challenges (namely, data complexity, computational complexity, and system complexity), as well as possible solutions to address these challenges. Finally, we conclude the paper by presenting several suggestions on carrying out big data projects.

5. Conclusions

Big data has made a strong impact in almost every sector and industry today. In this paper, we have briefly reviewed the opportunities and significance of big data, as well as some grand challenges that big data brings us. We close by a few suggestions on how to make a big data project successful. It is no secret that in big data research and applications, industry is ahead of academia. For example, according to the figure Alibaba disclosed in March 2014, their data center has stored more than 100 PB of processed data, which amounts to 100 million highresolution movies. During the just past “Singles’ Day” (also known as “Double 11 Day”), Alibaba pulled in CNY 9.3 billion in sales from this shopping event, which corresponded to around 278 million orders. For this annual shopping event, Alibaba developed a real-time data processing platform called Galaxy, which can handle 5 million transactions per second. The total amount of data that Galaxy can process every day is about 2 PB. Industry is more successful in this respect because it has two essential driving forces: they really need to possess big data in real time and they have the requirements on making better use of the data collected.