skip to main content
10.1145/3010089.3010095acmotherconferencesArticle/Chapter ViewAbstractPublication PagesbdawConference Proceedingsconference-collections
research-article

TAF: Temporal Analysis Framework for Handling Data velocity in Healthcare Analytics

Published:10 November 2016Publication History

ABSTRACT

We are inundated in a flood of data today. Data is being collected at a rapid scale from variety of sources like healthcare, e-commerce, social networking and so on. Decisions which were earlier made on assumptions can now be made on the data itself. It's a well known fact that volume, variety, velocity and veracity are the challenges associated in handling Big Data. The dynamic nature of the Internet and the velocity factor pose humongous challenges in retrieving patterns from the data. Coping up with noisy data which occurs at a rapid rate is still an open challenge. We have handled the issues associated with variety and veracity. After reviewing the existing system, it was found that there is no significant research model towards addressing data velocity problem exclusively taking case study of healthcare analytics.

Hence, this paper presents a novel framework TAF or Temporal Analysis Framework that mainly targets at handling the incoming speed of data and redundancies in Healthcare Analytics. The proposed system uses real-time data analysis that significantly handles the data velocity along with retention of minimal error. The study outcome was assessed to find minimal algorithm complexities compared to any system that doesn't use this approach of self-adaptable real-time data analysis.

References

  1. Menon, S.P., and Hegde, N. P. 2015. A framework to handle data heterogeneity contextual to medical big data. IEEE International Conference on Computational Intelligence and Computing Research, Madurai, 1--7,Google ScholarGoogle Scholar
  2. Menon, S.P., and Hegde, N. P. 2016. Predictive-based Data Analysis for Addressing Data Veracity Problems in Complex Medical Data. 2nd International Conference on Big Data and Analytics for Business, New Delhi, ISBN 978-194482051-0Google ScholarGoogle Scholar
  3. J. Hurwitz, A. Nugent, F. Halper, M. Kaufman, Big data for dummies, For Dummies (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Khan, M.A., Uddin, M. F. and Gupta, N. 2014. Seven V's of Big Data understanding Big Data to extract value. In IEEE Zone 1 Conference of the American Society for Engineering Education, 1--5,Google ScholarGoogle Scholar
  5. Quackenbush, J., 2002. Microarray data normalization and transformation. Nature genetics, 32, pp.496--501.Google ScholarGoogle Scholar
  6. Chen, Y., Alspaugh, S. and Katz, R., 2012. Interactive analytical processing in big data systems: A cross-industry study of mapreduce workloads. Proceedings of the VLDB Endowment, 5(12), pp.1802--1813. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Neumeyer, L., Robbins, B., Nair, A. and Kesari, A., 2010, December. S4: Distributed stream computing platform. In 2010 IEEE International Conference on Data Mining Workshops, pp. 170--177 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. www.webopedia.com/TERM/P/predictive-analytics.htmlGoogle ScholarGoogle Scholar
  9. http://searchbusinessanalytics.techtarget.com/definition/big-data-analyticsGoogle ScholarGoogle Scholar
  10. http://searchbusinessanalytics.techtarget.com/definition/ad-hoc-analysisGoogle ScholarGoogle Scholar
  11. Chardonnens, T., Mauroux, P.C., Grund, M., and Perroud, B. 2013. Big data analytics on high Velocity streams: A case study, IEEE International Conference on Big Data, pp. 784--787.Google ScholarGoogle Scholar
  12. Endert, A., Pike, W.A., and Cook, K. 2014. From Streaming Data to Streaming Insights: The Impact of Data Velocities on Mental Models. ACM-Proceedings of the 2014 Workshop on Human Centered Big Data Research, Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Goss, R. G., and Veeramuthu, K. 2013. Heading towards big data building a better data warehouse for more data, more speed, and more users, ASMC-SEMI Advanced Semiconductor Manufacturing Conference, Saratoga Springs, NY, pp. 220--225.Google ScholarGoogle Scholar
  14. Grolinger, K., Hayes, M., Wilson, A.H. 2014. Challenges for Map Reduce in Big Data. Electrical and Computer Engineering Publications.Google ScholarGoogle Scholar
  15. Jiang, D., Wu, S., Chen, G., Ooi, B.C., Tan, K-L. 2014. epiC: an extensible and scalable system for processing Big Data. Springer-The VLDB Journal, vol.25, pp.3--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kiran, M., Murphy, P., Monga, I., Dugan, J. 2015. Lambda Architecture for Cost-effective Batch and Speed Big Data processing. ACM-IEEE International Conference on Big Data (Big Data). pp.2785--2792, Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Tran, D.H., Gaber, M.M., Sattler, K.U. 2014. Change detection in streaming data in the era of big data: models and issues. ACM SIGKDD Explorations Newsletter, vol.16, Iss.1, pp. 30--38 Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Valle, E.D., Aglio, D.D., Margara, A. 2016. Tutorial: Taming Velocity and Variety Simultaneously in Big Data with Stream Reasoning. Proceedings of the 10th ACM International Conference on Distributed and Event-based Systems, Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Winlaw, M., Hynes, M.B., Caterini, A., Sterck, H.D. 2015. Algorithmic Acceleration of Parallel ALS for Collaborative Filtering: Speeding up Distributed Big Data Recommendation in Spark. IEEE 21st International Conference on Parallel and Distributed Systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Yu, S.Y., Brownlee, N., and Mahanti, A. 2015. Comparative analysis of big data transfer protocols in an international high-speed network. IEEE 34th International Performance Computing and Communications Conference, 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Zhang, B., and Shi, Z. Z. 2013. Classification of big velocity data via cross-domain Canonical Correlation Analysis. IEEE International Conference on Big Data, Silicon Valley, CA, 493--498,Google ScholarGoogle Scholar
  22. Zhong, T., Doshi, K.A., Tang, X. 2013. On mixing high-speed updates and in-memory queries: A big-data architecture for real-time analytics. IEEE International Conference on Big Data, Silicon Valley, CA, 102--109,Google ScholarGoogle ScholarCross RefCross Ref
  23. Menon, S.P., and Hegde, N. P. 2015. A survey of tools and applications in big data. IEEE 9th International Conference on Intelligent Systems and Control, Coimbatore, 1--7,Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    BDAW '16: Proceedings of the International Conference on Big Data and Advanced Wireless Technologies
    November 2016
    398 pages
    ISBN:9781450347792
    DOI:10.1145/3010089

    Copyright © 2016 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 10 November 2016

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader