Skip to main content

Advertisement

SpringerLink
Log in

A model for automated technological surveillance of web portals and social networks

  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

Technology can influence the reduction of operational costs, quality control, increase scale or can be a competitive advantage for industry. It influences industry structural changes and could create new industries. On the other hand, without enough investments it can limit the growth of an industrial sector. Therefore, a systemic understanding of the technological scenario is necessary. Several organizations have implemented Technology Surveillance systems (TS) to execute structured processes in order to identify and monitor technologies from formal sources of information, such as scientific articles and patents. However, with the ever smaller cycles of technological innovation and an unprecedented volume of information passing through different digital channels, like portals, specialized databases and social networks, the technological monitoring has become a challenge, especially with the current Big Data scenarios. This work presents a conceptual model and architecture for technology surveillance automated systems from web portals and social networks sources. The model is divided into four key modules (collection, preparation, analysis and diffusion) and two auxiliary ones (parameterization and persistence). To evaluate this approach a case study was carried out in which a computer system prototype was developed and implemented in an organization. The results demonstrated its feasibility and the developed system is still in use today.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Code 1
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. https://www.mongodb.com/

  2. The Protegé software is available at https://protege.stanford.edu

  3. Microsoft PowerBI is a business intelligence system from Microsoft which can connect to data sources and view them interactively.

  4. https://forms.google.com

References

  • ABNT/C-130. (2011). ABNT NBR 16501:2011 Brazilian standard. Associação Brasileira de Normas Técnicas (Brazilian Association of Technical Standards). Accessed 10 Feb 2019.

  • AENOR. (2019). Norma española experimental une 166006 gestión de la i+d+i: Sistema de vigilancia tecnológica. (Spanish Experimental Standard UNE 166006 R+D+i Management: Technological Surveillance System.). Accessed 10 Feb 2019.

  • AIMPLAS. (2020). Softvt. https://www.softvt.com, Accessed 1 Nov 2020.

  • Andrade Navia, J.M., Ramírez Plazas, E., & Orjuela Garzón, A. (2018). Technological watch applied to the production chain of cocoa. Espacios 39(9).

  • Antara. (2020). Antara Mussol. https://www.antara.ws/es/soluciones-software/inteligencia-competitiva-semantica, Accessed 1 Nov 2020.

  • Berges-Garcia, A., Meneses-Chaus, J.M., & Martinez-Ortega, J.F. (2016). Methodology for evaluating functions and products for technology watch and competitive intelligence (TW/CI) and their implementation through web. Profesional de la Informacion, 25(1), 103–113.

    Article  Google Scholar 

  • CDE. (2020). Hontza. http://www.hontza.es, Accessed 1 Nov 2020.

  • Chickerur, S., Goudar, A., & Kinnerkar, A. (2015). Comparison of relational database with document-oriented database (mongodb) for big data applications. In 2015 8th international conference on advanced software engineering & its applications (pp. 41–47). ASEA: IEEE.

  • Chouchani, N., & Abed, M. (2020). Online social network analysis: Detection of communities of interest. Journal of Intelligent Information Systems, 54 (1), 5–21.

    Article  Google Scholar 

  • Cichocki, A, Ansari, HA, Rusinkiewicz, M, & Woelk, D. (2012). Workflow and process automation: concepts and technology Vol. 432. New York: Springer Science & Business Media.

    Google Scholar 

  • DATAAGE2025. (2017). Data Age 2025: The evolution of data to life-critical. https://www.seagate.com/www-content/our-story/trends/files/Seagate-WP-DataAge2025-March-2017.pdf.

  • Demchenko, Y., Grosso, P., De Laat, C., & Membrey, P. (2013). Addressing big data issues in scientific data infrastructure. In Proceedings of the 2013 International Conference on Collaboration Technologies and Systems, CTS 2013 (May) (pp. 48–55).

  • Digital, R. (2020). Intelligent Watcher. https://intelligentwatcher.com, Accessed 1 Nov 2020.

  • E-Intelligent. (2020). vicubo Cloud. https://www.vicubocloud.es, Accessed 1 Nov 2020.

  • Färber, M. (2016). Using a semantic wiki for technology forecast and technology monitoring. Program, 50(2), 225–242.

    Article  Google Scholar 

  • Fiesc. (2013). Setores Portadores de Futuro para a Indústria Catarinense 2022 (Sectors with a Future for the Santa Catarina Industry 2022). Fiesc, http://www4.fiescnet.com.br/images/banner-pedic/documento-oficial-setores.pdf, Accessed 9 Mar 2020.

  • Fiesc. (2014). Programa de Desenvolvimento da indústria Catarinense 2022: competitividade com sustentabilidade (Santa Catarina Industry Development Program 2022: competitiveness with sustainability.), Fiesc. http://www4.fiescnet.com.br/homepdic, Accessed 9 Mar 2020.

  • Fiesc. (2019a). Observató,rio da industria catarinense (Santa Catarina Industry Observatory). http://www.portalsetorialfiesc.com.br, Accessed 5 Mar 2019.

  • Fiesc. (2019b). Sobre a fiesc (About Fiesc). http://fiesc.com.br/sobre-fiesc, Accessed 3 Dec 2019.

  • Filippo, D., Pimentel, M., & Wainer, J. (2011). Metodologia de pesquisa científica em sistemas colaborativos (Methodology of scientific research in collaborative systems). Sistemas Colaborativos, 1, 379–404.

    Google Scholar 

  • Geum, Y., Jeon, J., & Seol, H. (2013). Technology Analysis & Strategic Management Identifying technological opportunities using the novelty detection technique: A case of laser technology in semiconductor manufacturing Technology Analysis &, Strategic Management (October 2016): 1–22.

  • Goorha, S., & Ungar, L. (2010). Discovery of significant emerging trends. ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD).

  • Grajales López, C.A., Zartha Sossa, J.W., Hernández Zarta, R., Estrada Reveiz, R., Guarnizo Gómez, C.A., Díaz Uribe, J.H., & Gómez Garcés, J. (2016). Technological surveillance and analysis of the life cycle of the technology: Review of tools for enterprise diagnosis and the application of the life cycle of the product in the tourism sector. Espacios 37(36).

  • Grajales López, C.A., Zartha Sossa, J.W., Hernández Zarta, R.H., Estrada Reveiz, R.E., Guarnizo Gómez, C.A., Díaz Uribe, J.H., Gómez Garcės, J.G., & Valencia Grisales, L.V. (2017). Technology surveillance and curves in ‘S’: Environmental technologies in Tourism, Quindio Innova project. Espacios, 38(32), 78–86.

    Google Scholar 

  • Hakim, A.R., & Djatna, T. (2016). Extraction of multi-dimensional research knowledge model from scientific articles for technology monitoring. In Proceedings - 2015 3rd international conference on adaptive and intelligent agroindustry, ICAIA 2015 (pp. 300–305).

  • Henri, D., & Clerc, P. (2015). Trends in 3-D printing from a patent information analysis (APA). International Journal of Technology Intelligence and Planning, 10(3-4), 354–372.

    Article  Google Scholar 

  • IALE. (2020). Vigiale. https://www.vigiale.com, Accessed 1 Nov 2020.

  • IDCEMC2. (2014). The digital universe of opportunities: Rich data and the increasing value of the internet of things. https://www.emc.com/leadership/digital-universe/2014iview/executive-summary.htm.

  • IDEKO. (2020). Innguma. https://www.innguma.com, Accessed 1 Nov 2020.

  • Jiménez Gonzȧlez, S., Díez Ochoa, S., Arango Alzate, B., & Hernández Zarta, R. (2017). Technological surveillance of s curves and cycle life of technology. Espacios 38(44).

  • Jung, M.G., Youn, S.A., Bae, J., & Choi, Y.L. (2015). A study on data input and output performance comparison of mongodb and postgresql in the big data environment. In 2015 8th international conference on database theory and application (DTA) (pp. 14–17): IEEE.

  • Karvonen, M., Kapoor, R., Uusitalo, A., & Ojanen, V. (2016). Technology competition in the internal combustion engine waste heat recovery: A patent landscape analysis. Journal Of Cleaner Production, 112(5), 3735–3743.

    Article  Google Scholar 

  • Kim, M., Park, Y., & Yoon, J. (2016). Generating patent development maps for technology monitoring using semantic patent-topic analysis. Computers and Industrial Engineering, 98, 289–299.

    Article  Google Scholar 

  • Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele, UK Keele University, 33(2004), 1–26.

    Google Scholar 

  • Lee, K., & Lee, S. (2013). Patterns of technological innovation and evolution in the energy sector: A patent-based approach. Energy Policy, 59, 415–432.

    Article  Google Scholar 

  • López, C.C.A., & Zartha Sossa, J.W. (2014). Technological surveillance in advanced steel used in the automotive industry. Espacios, 35(8), 1.

    Google Scholar 

  • Loria, S. (2020). TextBlob. https://textblob.readthedocs.io/en/dev/, Accessed 1 Oct 2020.

  • Martínez Rivero, F, & Maynegra Díaz, E.R. (2014). Evaluation of web platforms for their implementation in the system of Biomundi consulting technological surveillance. Revista Cubana de Informacion en Ciencias de la Salud, 25(1), 99–109.

    Google Scholar 

  • Marulanda, C.E., Hernández, A, & López, M. (2016). Technology surveillance for university students. The case of the national university of Colombia, Manizales Campus. Formacion Universitaria, 9(2), 17–27.

    Article  Google Scholar 

  • Marulanda Echeverry CE, López Trujillo, M., & López Villegas, L.I. (2016). Developing a mobile application for technological alerts. Revista Virtual Universidad Catolica Del Norte, 48, 316–330.

    Google Scholar 

  • Mikova, N., & Sokolova, A. (2019). Comparing data sources for identifying technology trends. Technology Analysis and Strategic Management, 31 (11), 1353–1367.

    Article  Google Scholar 

  • Miniera. (2020). Miniera. http://www.miniera.es/pt-br/plataforma-inteligencia-competitiva, Accessed 1 Nov 2020.

  • Momeni, A., & Rost, K. (2016). Identification and monitoring of possible disruptive technologies by patent-development paths and topic modeling. Technological Forecasting &, Social Change, 104, 16–29.

    Article  Google Scholar 

  • Moreno, C.J.A., & Díaz, D.P. (2019). Trends in logistics in the last five Years - A review through technological surveillance. In 2019 Congreso Internacional de Innovación y Tendencias en Ingenieria (CONIITI) (pp. 1–5).

  • Nam, S., & Kim, K. (2017). Monitoring newly adopted technologies using keyword based analysis of cited patents. IEEE Access, 5, 23086–23091.

    Article  Google Scholar 

  • OVTT. (2019). Technology surveillance concept. https://pt.ovtt.org/vigilancia-tecnologica-conceitos, Accessed 9 Feb 2019.

  • Padilla, J.B., Zartha, J.W., Alvarez, V.T., & Orozco, G.L. (2018a). Technological surveillance for the identification of innovations in leather tanning byproducts. Informacion Tecnologica, 29(4), 127–141.

    Article  Google Scholar 

  • Padilla, J.B., Zartha, J.W., Alvarez, V.T., & Orozco, G.L. (2018b). Technological surveillance for the identification of innovations in leather tanning byproducts. Informacion Tecnologica, 29(4), 127–141.

    Article  Google Scholar 

  • Palop, F., & Vicentem, J.M. (1999). Vigilancia Tecnológica e Inteligencia Competitiva. Su potencial para la empresa española (Technological Surveillance and Competitive Intelligence. Its potential for the Spanish company.). Cotec Foundation.

  • Perez, A., Basagoiti, R., Cortez, R.A., Larrinaga, F., Barrasa, E., & Urrutia, A. (2018). A case study on the use of machine learning techniques for supporting technology watch. Data and Knowledge Engineering, 117, 239–251.

    Article  Google Scholar 

  • Perez, L.G., Dominguez, E.R., & Ovallos-Gazabon, D. (2017). A proposal for a technological surveillance unit aimed at regional competitiveness. Journal of Engineering and Applied Sciences, 12(21), 5566–5571.

    Google Scholar 

  • Salgado Batista, D., Guzmán Sánchez, M.V., & Carrillo Calvet, H. (2003). Establecimiento de un sistema de vigilancia científico-tecnológica. ACIMED, 11, 0–0.

    Google Scholar 

  • Sȧnchez, J.M., & Palop, F. (2002). Herramientas de software para la práctica en la empresa de la vigilancia tecnolȯgica e inteligencia competitiva (Software tools for the practice in the company of technological surveillance and competitive intelligence). Evaluación Comparativa 1\(^{\underline {a}}\) edición, TRIZ, España.

  • Shokeen, J., & Rana, C. (2019). Social recommender systems: Techniques, domains, metrics, datasets and future scope. Journal of Intelligent Information Systems 1–35.

  • Singh, V. (2017). Replace or retrieve keywords in documents at scale. arXiv:1711.00046.

  • Siriweera, T.H.S., Paik, I., & Kumara, B.T. (2017). Qos and Customizable Transaction-Aware Selection for Big Data Analytics on Automatic Service Composition. Proceedings - 2017 IEEE 14th International Conference on Services Computing, SCC 2017 116–123.

  • Storey, V.C., & Song, I.Y. (2017). Big data technologies and management: What conceptual modeling can do. Data and Knowledge Engineering, 108 (February), 50–67.

    Article  Google Scholar 

  • Tobón Clavijo, M.L., Zarta, R.H., Zartha Sossa, J.W., Reveiz, R.E., Díaz Uribe, J.H., & Gómez Garcés, J.G. (2017). Technological surveillance and technology life cycle analysis: Usability assessment techniques, metrics and tools in the ICT sector. Espacios 38(22).

  • Van Mol, C. (2017). Improving web survey efficiency: The impact of an extra reminder and reminder content on web survey response. International Journal of Social Research Methodology, 20(4), 317–327.

    Article  MathSciNet  Google Scholar 

  • Villarroelg, C., Comai, A., Karmelicpavlov, V., Fernȧndezo, A, & Arriagadav, C. (2015). Design and implementation of a technological surveillance and competitive intelligence unit. Interciencia, 40(11), 751–757.

    Google Scholar 

  • Wei, Y.M., Kang, J.N., Yu, B.Y., Liao, H., & Du, Y.F. (2017). A dynamic forward-citation full path model for technology monitoring: An empirical study from shale gas industry. Applied Energy, 205, 769–780.

    Article  Google Scholar 

  • White, T. (2015). Hadoop: The definitive guide, 4th edn. Beijing: O’Reilly.

    Google Scholar 

  • Wikimedia. (2020). Conceptual Model, Wikimedia. https://en.wikipedia.org/wiki/Conceptual_model.

Download references

Author information

Authors and Affiliations

  1. PGCIN, Federal University of Santa Catarina, Florianópolis, Brazil

    Daniel San Martin Pascal Filho

  2. Departament of Information Science, Federal University of Santa Catarina, Florianópolis, Brazil

    Douglas Dyllon Jeronimo de Macedo

Authors
  1. Daniel San Martin Pascal Filho
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Douglas Dyllon Jeronimo de Macedo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel San Martin Pascal Filho.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Filho, D.S.M.P., de Macedo, D.D.J. A model for automated technological surveillance of web portals and social networks. J Intell Inf Syst 56, 561–579 (2021). https://doi.org/10.1007/s10844-021-00641-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10844-021-00641-0

Keywords

Search

Navigation