PENGEMBANGAN INTELLIGENT DATA COLLECTOR UNTUK ANALISIS BIG DATA ARTIKEL BERITA ONLINE

Abstrak

Big data has become one of the most popular research areas in information technology. One of the big data sources which is available and free to access is online news article. In fact, a popular news website can produce more than 100 new articles in one day. We can imagine that how many news webpage are available to read now. To perform a big data analysis for this online news article, the initial stage which is used to be done is data storing and preprocessing step. Therefore, it is a necessity to develop an application that can ease us to collect online news article. Based on this idea, this research is intended to develop an automatic data collector application that can collect online news article automatically from online news website.This application is called as intelligent data collector (IDC). The IDC application will collect online news article from news website, perform preprocessing step and then save output in local database. This local database can then be used for several data mining process such as opinion mining (sentiment analysis), topic classification, text summarization and etc.