research-article

Extending the National Lake Database of Malaysia (MyLake) as a Central Data Exchange using Big Data Integration

Authors:

Farashazillah Yahya,

Bashirah Mohd Fazli,

Mohd Fikri Abdullah,

Harlisa ZulkifliAuthors Info & Claims

DSIT 2019: Proceedings of the 2019 2nd International Conference on Data Science and Information Technology

Pages 30 - 35

https://doi.org/10.1145/3352411.3352417

Published: 19 July 2019 Publication History

Abstract

With the rise of heterogeneous large spatial and non-spatial data, systems are developed to manage these data sets. Big data emphasizes heterogeneity among systems leading to data integration issues due to the nature of big data which includes volume, variety and velocity. MyLake is a National Lake Database to manage information and knowledge sharing on lakes in Malaysia. At the moment, data are uploaded by each agency using MyLake as a platform. Nevertheless, this is carried out manually and require timely human effort. Each agency does one-to-one data integration (in-silo) where the integration is developed according to the agency-specific needs resulting from a possibility of integration issue across agencies. Therefore, this paper introduces a big data integration approach that extends the MyLake repository. The big data integration platform is a preliminary idea of how data can be shared, integrated, retrieved, and disseminated within a reliable and authenticated environment. The proposed centralized platform consisting of a set of standards, tools, repository and registry that enable multiple integrations between different agencies. The platform offers the potential to provide a reliable platform that acts as data retriever and disseminator.

References

[1]

Cegarra-Navarro, J. G., Pachón, J. R. C., & Cegarra, J. L. M. (2012). E-government and citizen's engagement with local affairs through e-websites: The case of Spanish municipalities. International Journal of Information Management, 32(5), 469--478.

Digital Library

[2]

Mossberger, K., & Jiminez, B. (2009). Can e-government promote civic engagement? A study of local government websites in Illinois and the U.S. Institute for Policy and Civic Engagement, University of Illinois at Chicago. Retrieved December 12, 2018, from http://www.uic.edu/cuppa/ipce/egovtreportfinal.pdf

[3]

NAHRIM 2009. Technical Report: Gedung. Seri Kembangan, Selangor: National Hydraulic Research Institute of Malaysia.

[4]

International Lake Environment Committee Foundation (ILEC), 2005. Managing Lakes and their Basins for Sustainable Use: A Report for Lake Basin Managers and Stakeholders. Technical Report, 67--74.

[5]

Nakamura, M., & Rast, W. 2008. Key Challenges to Lake Governance. Japan: Shiga University.

[6]

N. Zulkifli, M.T.S. Mohammad and A.H. Hamzah (2015). Suggested Information Strategies for Malaysian Land Administration. Global Journal of Business and Social Science Review (GJBSSR), Vol. 4(1), 380--389

[7]

A. Gandomi, M. Haider (2015). Beyond the hype: Big data concepts, methods, and analytics. International Journal of Information Management 35, 137--144

Digital Library

[8]

D. Laney (2001). 3-D data management: Controlling data volume, velocity and variety. Application Delivery Strategies by META Group Inc. Retrieved from http://blogs.gartner.com/doug-laney/files/2012/01/ad949--3D-DataManagement-Controlling-Data-Volume-Velocity-and-Variety.pdf

[9]

H. Chen, R.H.L. Chiang, V.C. Storey (2012). Business intelligence and analytics: From big data to big impact MIS Quarterly, 36 (4), pp. 1165--1188

Digital Library

[10]

O. Kwon, N. Lee, B. Shin (2014). Data quality management, data usage experience and acquisition intention of big data analytics. International Journal of Information Management, 34 (3), pp. 387--394

[11]

Gartner IT Glossary (n.d.). Retrieved from http://www.gartner.com/it-glossary/bigdata/

[12]

H. Abbes and F. Gargouri (2016). Big Data Integration: A MongoDB Database and Modular Ontologies based Approach. Procedia Computer Science 96, 446--455

Digital Library

[13]

X. L. Dong and D. Srivastava (2013). Big data integration. IEEE 29th International Conference on Data Engineering (ICDE), pp. 1245--1248.

Digital Library

[14]

H.J., Oulidi and A. Moumen (2015). Towards a Spatial Data Infrastructure and an Integrated Management of Groundwater Resources. Journal of Geographic Information System, 7, 667--676.

[15]

G. Kang, J.Z. Gao and G. Xie (2017). Data-Driven water quality analysis and prediction: A survey. 2017 IEEE Third International Conference on Big Data Computing Service and Applications (BigDataService), 224--232.

[16]

J. Fan, J. Yan, Y. Ma and L.Wang (2018). Big Data Integration in Remote Sensing across a Distributed Metadata-Based Spatial Infrastructure. Remote Sensing. 10(1):7

[17]

M. E. Shafiee, Z. Barker and A. Rasekh (2018). Enhancing water system models by integrating big data. Sustainable Cities and Society, Volume 37, 485--491

[18]

A. Oussous, FZ. Benjelloun, AA. Lahcen and S. Belfkih (2018). Big Data technologies: A survey. Journal of King Saud University - Computer and Information Sciences. Volume 30, Issue 4, 431--448

[19]

Y.F Huang, S.Y Ang, K.M Lee and T.S Lee (2015) Quality of water resources in Malaysia. Research and Practices in Water Quality

[20]

B. Arputhamary and L. Arockiam (2015) Data Integration in Big Data Environment

[21]

C. Yang, Q. Huang, Z. Li, K. Liu and F. Hu (2016): Big Data and cloud computing: innovation opportunities and challenges, International Journal of Digital Earth.

Cited By

Wahdain EAbdullah N(2024)Data Integration in Big Data Environment: A Review2024 4th International Conference on Emerging Smart Technologies and Applications (eSmarTA)10.1109/eSmarTA62850.2024.10638957(1-8)Online publication date: 6-Aug-2024
https://doi.org/10.1109/eSmarTA62850.2024.10638957
Utomo RYahya FAlmarshad FWills G(2022)Factors Affecting Information Assurance for Big Data2022 1st International Conference on Software Engineering and Information Technology (ICoSEIT)10.1109/ICoSEIT55604.2022.10030038(1-5)Online publication date: 22-Nov-2022
https://doi.org/10.1109/ICoSEIT55604.2022.10030038

Index Terms

Extending the National Lake Database of Malaysia (MyLake) as a Central Data Exchange using Big Data Integration
1. Information systems
  1. Data management systems
    1. Information integration
      1. Mediators and data integration

Recommendations

On-demand big data integration

Scientific research requires access, analysis, and sharing of data that is distributed across various heterogeneous data sources at the scale of the Internet. An eager extract, transform, and load (ETL) process constructs an integrated data repository ...
Building the Enterprise Fabric for Big Data with Vertica and Spark Integration
SIGMOD '16: Proceedings of the 2016 International Conference on Management of Data

Enterprise customers increasingly require greater flexibility in the way they access and process their Big Data while at the same time they continue to request advanced analytics and access to diverse data sources. Yet customers also still require the ...
The implementation of data storage and analytics platform for big data lake of electricity usage with spark
Abstract
Electricity data could generate a large number of records from smart meter day by day. The traditional architecture might not properly handle the increasingly dynamic data that need flexibility. For effective storing and analytics, efficient ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

DSIT 2019: Proceedings of the 2019 2nd International Conference on Data Science and Information Technology

July 2019

280 pages

ISBN:9781450371414

DOI:10.1145/3352411

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

The Hong Kong Polytechnic: The Hong Kong Polytechnic University
Natl University of Singapore: National University of Singapore

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

DSIT 2019

DSIT 2019: 2019 2nd International Conference on Data Science and Information Technology

July 19 - 21, 2019

Seoul, Republic of Korea

Acceptance Rates

DSIT 2019 Paper Acceptance Rate 43 of 95 submissions, 45%;

Overall Acceptance Rate 114 of 277 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
130
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wahdain EAbdullah N(2024)Data Integration in Big Data Environment: A Review2024 4th International Conference on Emerging Smart Technologies and Applications (eSmarTA)10.1109/eSmarTA62850.2024.10638957(1-8)Online publication date: 6-Aug-2024
https://doi.org/10.1109/eSmarTA62850.2024.10638957
Utomo RYahya FAlmarshad FWills G(2022)Factors Affecting Information Assurance for Big Data2022 1st International Conference on Software Engineering and Information Technology (ICoSEIT)10.1109/ICoSEIT55604.2022.10030038(1-5)Online publication date: 22-Nov-2022
https://doi.org/10.1109/ICoSEIT55604.2022.10030038

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten