research-article

From Reassembly to Object Completion: A Complete Systems Pipeline

Authors:

Georgios Papaioannou,

Tobias Schreck,

Anthousis Andreadis,

Pavlos Mavridis,

Konstantinos VardisAuthors Info & Claims

Journal on Computing and Cultural Heritage (JOCCH), Volume 10, Issue 2

Article No.: 8, Pages 1 - 22

https://doi.org/10.1145/3009905

Published: 21 March 2017 Publication History

Abstract

The problem of the restoration of broken artifacts, where large parts could be missing, is of high importance in archaeology. The typical manual restoration can become a tedious and error-prone process, which also does not scale well. In recent years, many methods have been proposed for assisting the process, most of which target specialized object types or operate under very strict constraints. We propose a digital shape restoration pipeline consisting of proven, robust methods for automatic fragment reassembly and shape completion of generic three-dimensional objects of arbitrary type. In this pipeline, first we introduce a novel unified approach for handling the reassembly of objects from heavily damaged fragments by exploiting both fracture surfaces and salient features on the intact sides of fragments, when available. Second, we propose an object completion procedure based on generalized symmetries and a complementary part extraction process that is suitable for driving the fabrication of missing geometry. We demonstrate the effectiveness of our approach using real-world fractured objects and software implemented as part of the European Union--funded PRESIOUS project, which is also available for download from the project site.

Supplementary Material

a8-papaioannou-apndx.pdf (papaioannou.zip)

Supplemental movie, appendix, image and software files for, From Reassembly to Object Completion: A Complete Systems Pipeline

Download
541.15 KB

References

[1]

Drol Aiger, Niloy J. Mitra, and Daniel Cohen-Or. 2008. 4-points congruent sets for robust surface registration. ACM Trans. Graph. 27, 3 (2008), 1--10.

Digital Library

[2]

Enkhbayar Altantsetseg, Katsutsugu Matsuyama, and Kouichi Konno. 2014. Pairwise matching of 3D fragments using fast fourier transform. Vis. Comput. 30, 6--8 (2014), 929--938.

Digital Library

[3]

Anthousis Andreadis, Rovert Gregor, Ivan Sipiran, Pavlos Mavridis, Papaioannou Georgios, and Tobias Schreck. 2015. Fractured 3D object restoration and completion. In ACM SIGGRAPH 2015 Posters (SIGGRAPH’15). ACM, New York, NY, Article 74.

Digital Library

[4]

Anthousis Andreadis, Pavlos Mavridis, and Georgios Papaioannou. 2014. Facet extraction and classification for the reassembly of fractured 3D objects. In Eurographics 2014—Posters, Mathias Paulin and Carsten Dachsbacher (Eds.). The Eurographics Association.

[5]

Anthousis Andreadis, Georgios Papaioannou, and Pavlos Mavridis. 2015. Generalized digital reassembly using geometric registration. In Digital Heritage, Vol. 2. IEEE, 549--556.

[6]

Sofien Bouaziz, Andrea Tagliasacchi, and Mark Pauly. 2013. Sparse iterative closest point. Comput. Graph. Forum (Symp. Geom. Process.) 32, 5 (2013), 1--11.

Digital Library

[7]

Benedict J. Brown, Corey Toler-Franklin, Diego Nehab, Michael Burns, David Dobkin, Andreas Vlachopoulos, Christos Doumas, Szymon Rusinkiewicz, and Tim Weyrich. 2008. A system for high-volume acquisition and matching of fresco fragments: Reassembling theran wall paintings. ACM Trans. Graph. 27, 3 (2008), 84:1--84:9.

Digital Library

[8]

Fernand Cohen, Zexi Liu, and Taslidere Ezgi. 2013. Virtual reconstruction of archeological vessels using expert priors and intrinsic differential geometry information. Comput. Graph. 37, 1 2 (2013), 41--53.

Digital Library

[9]

Helena Cristina da Gama Leitao and Jorge Stolfi. 2002. A multiscale method for the reassembly of two-dimensional fragmented objects. IEEE Trans. Pattern Anal. Mach. Intell. 24, 9 (Sep 2002), 1239--1251.

Digital Library

[10]

Robert Gregor, Danny Bauer, Ivan Sipiran, Panagiotis Perakis, and Tobias Schreck. 2015. Automatic 3D object fracturing for evaluation of partial retrieval and object restoration tasks: Benchmark and application to 3D cultural heritage data. In Proceedings of the Eurographics Workshop on 3D Object Retrieval (3DOR). Eurographics Association, 7--14.

Digital Library

[11]

Robert Gregor, Ivan Sipiran, Georgios Papaioannou, Tobias Schreck, Anthousis Andreadis, and Pavlos Mavridis. 2014. Towards automated 3D reconstruction of defective cultural heritage objects. Proc. Eurographics Workshop on Graphics and Cultural Heritage (2014), 135--144.

Digital Library

[12]

Gur Harary, Ayellet Tal, and Eitan Grinspun. 2014a. Context-based coherent surface completion. ACM Trans. Graph. 33, 1 (Feb. 2014), 5:1--5:12.

Digital Library

[13]

Gur Harary, Ayellet Tal, and Eitan Grinspun. 2014b. Feature-preserving surface completion using four points. Comput. Graph. Forum 33, 5 (Aug. 2014), 45--54.

Digital Library

[14]

Hui Huang, Shihao Wu, Daniel Cohen-Or, Minglun Gong, Hao Zhang, Guiqing Li, and Baoquan Chen. 2013a. L1-medial skeleton of point cloud. ACM Trans. Graph. 32, 4 (July 2013).

Digital Library

[15]

Hui Huang, Kangxue Yin, Minglun Gong, Dani Lischinski, Daniel Cohen-Or, Uri Ascher, and Baoquan Chen. 2013b. Mind the Gap: Tele-registration for structure-driven image completion. ACM Trans. Graph. (Proc. SIGGRAPH ASIA) 32 (2013), 174:1--174:10.

Digital Library

[16]

Qi-Xing Huang, Simon Flöry, Natasha Gelfand, Michael Hofer, and Helmut Pottmann. 2006. Reassembling fractured objects by geometric matching. ACM Trans. Graph. 25, 3 (July 2006), 569--578.

Digital Library

[17]

Martin Kampel and Robert Sablatnig. 2004. On 3D mosaicing of rotationally symmetric ceramic fragments. In Proceedings of the 17th International Conference on Pattern Recognition (ICPR), Vol. 2. IEEE, 265--268.

Digital Library

[18]

Michael Kazhdan and Hugues Hoppe. 2013. Screened poisson surface reconstruction. ACM Trans. Graph. 32, 3 (July 2013), 29:1--29:13.

Digital Library

[19]

David Koller and Marc Levoy. 2006. Computer-aided reconstruction and new matches in the forma urbis romae. Bullettino Della Commissione Archeologica Comunale di Roma 2 (2006).

[20]

Weixin Kong and B. B. Kimia. 2001. On solving 2D and 3D puzzles using curve matching. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 2, II--583--II--590.

[21]

Jeehyung Lee and Thomas Funkhouser. 2008. Sketch-based search and composition of 3D models. In Proceedings of the EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling.

Digital Library

[22]

Er Li, Xiaopeng Zhang, and Yanyun Chen. 2014. Symmetry based chinese ancient architecture reconstruction from incomplete point cloud. In Proceedings of the 5th International Conference on Digital Home (ICDH). 157--161.

Digital Library

[23]

Hao Li, Robert W. Sumner, and Mark Pauly. 2008. Global correspondence optimization for non-rigid registration of depth scans. Comput. Graph. Forum (Proc. SGP’08) 27, 5 (July 2008).

Digital Library

[24]

Xin Li, Zhao Yin, Li Wei, Shenghua Wan, Wei Yu, and Maoqing Li. 2011. Symmetry and template guided completion of damaged skulls. Comput. Graph. 35, 4 (2011), 885--893. Semantic 3D Media and Content.

Digital Library

[25]

Pavlos Mavridis, Anthousis Andreadis, and Georgios Papaioannou. 2015b. Efficient sparse {ICP}. Comput. Aid. Geom. Des. 35--36 (2015), 16--26. Geometric Modeling and Processing 2015

Digital Library

[26]

Pavlos Mavridis, Anthousis Andreadis, and Georgios Papaioannou. 2015a. Fractured object reassembly via robust surface registration. In Eurographics 2015—Short Papers. The Eurographics Association.

[27]

Pavlos Mavridis, Ivan Sipiran, Anthousis Andreadis, and Georgios Papaioannou. 2015c. Object completion using k-sparse optimization. Comput. Graph. Forum 34, 7 (2015), 13--21.

Digital Library

[28]

Nicolas Mellado, Dror Aiger, and Niloy J. Mitra. 2014. Super 4PCS fast global pointcloud registration via smart indexing. Comput. Graph. Forum 33, 5 (2014), 205--215.

Digital Library

[29]

Nicolas Mellado, Matteo Dellepiane, and Roberto Scopigno. 2016. Relative scale estimation and 3D registration of multi-modal geometry using Growing Least Squares. Retrieved from http://vcg.isti.cnr.it/Publications/2016/MDS16.

[30]

Nicolas Mellado, Patrick Reuter, and Christophe Schlick. 2010. Semi-automatic geometry-driven reassembly of fractured archeological objects. In Proc. 11th International Conference on Virtual Reality, Archaeology and Cultural Heritage (VAST’10). Eurographics Association, 33--38.

Digital Library

[31]

Gregorio Palmas, Nico Pietroni, Paolo Cignoni, and Roberto Scopigno. 2013. A computer-assisted constraint-based system for assembling fragmented objects. In Proceedings of the of Digital Heritage 2013 International Congress, Vol. 1. IEEE, 529--536.

[32]

Georgios Papaioannou and Evaggelia-Aggeliki Karabassi. 2003. On the automatic assemblage of arbitrary broken solid artefacts. Image Vis. Comput. 21, 5 (2003), 401--412.

[33]

Georgios Papaioannou, Evaggelia-Aggeliki Karabassi, and Theoharis Theoharis. 2001. Virtual archaeologist: Assembling the past. IEEE Comput. Graph. Appl. 21 (2001), 53--59.

Digital Library

[34]

Devi Parikh, Rahul Sukthankar, Tsuhan Chen, and Mei Chen. 2007. Feature-based part retrieval for interactive 3D reassembly. In Proceedings of the 8th IEEE Workshop on Applications of Computer Vision (WACV’07). IEEE Computer Society, Washington, DC, 14--.

Digital Library

[35]

Yair Poleg and Shmuel Peleg. 2012. Alignment and mosaicing of non-overlapping images. In Proceedings of the 2012 IEEE International Conference on Computational Photography (ICCP). 1--8.

[36]

Helmut Pottmann, Johannes Wallner, Qi-Xing Huang, and Yong-Liang Yang. 2009. Integral invariants for robust geometry processing. Comput. Aid. Geom. Des. 26, 1 (2009), 37--60.

Digital Library

[37]

Belenguer C. Sanchez and Eduardo Vendrell Vidal. 2012. Archaeological fragment characterization and 3D reconstruction based on projective gpu depth maps. In Virtual Systems and Multimedia (VSMM). IEEE, 275--282.

[38]

Mahmut Şamil. Saǧiroǧlu and Aytul Erçil. 2005. A texture based approach to reconstruction of archaeological finds. In Proceedings of the 6th International Conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage (VAST’05). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 137--142.

Digital Library

[39]

Andrei Sharf, Marc Alexa, and Daniel Cohen-Or. 2004. Context-based surface completion. ACM Trans. Graph. 23, 3 (Aug. 2004), 878--887.

Digital Library

[40]

Ivan Sipiran, Robert Gregor, and Tobias Schreck. 2014. Approximate symmetry detection in partial 3D meshes. Comput. Graph. Forum 33 (2014), 131--140.

Digital Library

[41]

Kilho Son, Eduardo B. Almeida, and David B. Cooper. 2013. Axially symmetric 3D pots configuration system using axis of symmetry and break curve. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 257--264.

Digital Library

[42]

Jian Sun, Maks Ovsjanikov, and Leonidas Guibas. 2009. A concise and provably informative multi-scale signature based on heat diffusion. In Proceedings of the Eurographics Symposium on Geometry Processing (SGP’09). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 1383--1392.

Digital Library

[43]

Kenshi Takayama, Ryan Schmidt, Karan Singh, Takeo Igarashi, Tamy Boubekeur, and Olga Sorkine. 2011. GeoBrush: Interactive mesh geometry cloning. Comput. Graph. Forum (2011).

[44]

Theoharis Theoharis, Christian Schellewald, Panagiotis Perakis, Anthousis Andreadis, Geor gios Papaioannou, Pavlos Mavridis, Michalis Savelonas, Konstantinos Sfikas, Ioannis Pratikakis, Fotis Arnaoutoglou, Ivan Sipiran, Robert Gregor, Tobias Schreck, and Dirk Rieke-Zapp. 2015. PRESIOUS Project—First Evaluation Report. Technical Report D5.4. PRESIOUS EU Project, 600533. Retrieved from http://presious.eu/file_downloads/PRESIOUS-D5.4-v2.4.pdf.

[45]

Barbara Thuswaldner, Simon Fl”ory, Robert Kalasek, Michael Hofer, Qi-Xing Huang, and Hilke Th”ur. 2009. Digital anastylosis of the octagon in ephesos. J. Comput. Cult. Herit. 2, 1 (July 2009).

Digital Library

[46]

Federico Tombari, Samuele Salti, and Luigi Di Stefano. 2010. Unique signatures of histograms for local surface description. In Proceedings of the 11th European Conference on Computer Vision Conference on Computer Vision: Part III (ECCV’10). Springer-Verlag, Berlin, 356--369.

Digital Library

[47]

Li Wei, Wei Yu, Maoqing Li, and Xin Li. 2011. Skull assembly and completion using template-based surface matching. In Proceedings of the 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission. 413--420.

Digital Library

[48]

Andrew R. Willis and David B. Cooper. 2004. Bayesian assembly of 3D axially symmetric shapes from fragments. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 1, I--82--I--89.

[49]

Simon Winkelbach and FriedrichM. Wahl. 2008. Pairwise matching of 3D fragments using cluster trees. Int. J. Comput. Vis. 78, 1 (2008), 1--13.

Digital Library

[50]

Jingyu Yang, Ke Li, Kun Li, and Yu-Kun Lai. 2015. Sparse non-rigid registration of 3D shapes. In Proceedings of the Eurographics Symposium on Geometry Processing (SGP’15). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 89--99.

Digital Library

[51]

Kang Zhang and Xin Li. 2014. A graph-based optimization algorithm for fragmented image reassembly. Graph. Models 76, 5 (2014), 484--495. Geometric Modeling and Processing 2014.

Digital Library

[52]

Kang Zhang, Wuyi Yu, Mary Manhein, Warren Waggenspack, and Xin Li. 2015b. 3D fragment reassembly using integrated template guidance and fracture-region matching. In Proceedings of the IEEE International Conference on Computer Vision (ICCV). 2138--2146.

Digital Library

[53]

Ran Zhang, Xuejin Chen, Takaaki Shiratori, Xin Tong, and Ligang Liu. 2015a. An efficient volumetric method for non-rigid registration. Graph. Models 79 (2015), 1--11.

Digital Library

Cited By

Chiș R(2024)Matching Apictorial Puzzle Pieces Using Deep LearningStudia Universitatis Babeș-Bolyai Informatica10.24193/subbi.2024.1.0169:1(5-20)Online publication date: 10-Jun-2024
https://doi.org/10.24193/subbi.2024.1.01
Alagrami APalmieri LAslan SPelillo MVascon S(2024)Reassembling Broken Objects Using Breaking CurvesPattern Recognition10.1007/978-3-031-78456-9_13(197-208)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/978-3-031-78456-9_13
Montiel GLorenzo C(2023)A New Virtual Reconstruction of the Ndutu CraniumHeritage10.3390/heritage60301516:3(2822-2850)Online publication date: 9-Mar-2023
https://doi.org/10.3390/heritage6030151
Show More Cited By

Index Terms

From Reassembly to Object Completion: A Complete Systems Pipeline

Recommendations

Reassembly of fractured objects using surface signature

As 3D object acquisition technology has improved, research has been actively conducted on the virtual reassembly of broken 3D objects. However, because fractured surfaces are bumpy and complicated, it is difficult to extract salient features from them. ...
Automated reassembly of file fragmented images using greedy algorithms

The problem of restoring deleted files from a scattered set of fragments arises often in digital forensics. File fragmentation is a regular occurrence in hard disks, memory cards, and other storage media. As a result, a forensic analyst examining a disk ...
TCP/IP Reassembly in Network Intrusion Detection and Prevention Systems

Deep Packet Inspection DPI in Network Intrusion Detection and Prevention Systems NIDPS typically involves the matching of packet payloads against attack signatures in the form of fixed strings and regular expressions. As an attack pattern may span ...

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 10, Issue 2

April 2017

109 pages

ISSN:1556-4673

EISSN:1556-4711

DOI:10.1145/3068422

Editor:
Roberto Scopigno
CNRźISTI, Italy

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 March 2017

Accepted: 01 September 2016

Revised: 01 August 2016

Received: 01 June 2016

Published in JOCCH Volume 10, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Seventh Framework Programme

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

56
Total Citations
View Citations
669
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)9

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chiș R(2024)Matching Apictorial Puzzle Pieces Using Deep LearningStudia Universitatis Babeș-Bolyai Informatica10.24193/subbi.2024.1.0169:1(5-20)Online publication date: 10-Jun-2024
https://doi.org/10.24193/subbi.2024.1.01
Alagrami APalmieri LAslan SPelillo MVascon S(2024)Reassembling Broken Objects Using Breaking CurvesPattern Recognition10.1007/978-3-031-78456-9_13(197-208)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/978-3-031-78456-9_13
Montiel GLorenzo C(2023)A New Virtual Reconstruction of the Ndutu CraniumHeritage10.3390/heritage60301516:3(2822-2850)Online publication date: 9-Mar-2023
https://doi.org/10.3390/heritage6030151
Ye SZhu-Tian CChu XLi KLuo JLi YGeng GWu Y(2023)PuzzleFixer: A Visual Reassembly System for Immersive Fragments RestorationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320938829:1(429-439)Online publication date: Jan-2023
https://doi.org/10.1109/TVCG.2022.3209388
Villegas-Suarez ALopez CSipiran I(2023)MatchMakerNet: Enabling Fragment Matching for Cultural Heritage Analysis2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW60793.2023.00178(1624-1633)Online publication date: 2-Oct-2023
https://doi.org/10.1109/ICCVW60793.2023.00178
Song XLamb NBanerjee SBanerjee N(2023)Reinforcement-Learning Based Robotic Assembly of Fractured Objects Using Visual and Tactile Information2023 9th International Conference on Automation, Robotics and Applications (ICARA)10.1109/ICARA56516.2023.10125938(170-174)Online publication date: 10-Feb-2023
https://doi.org/10.1109/ICARA56516.2023.10125938
Lamb NPalmer CMolloy BBanerjee SBanerjee N(2023)Fantastic Breaks: A Dataset of Paired 3D Scans of Real-World Broken Objects and Their Complete Counterparts2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00454(4681-4691)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00454
Basu APaul SGhosh SDas SChanda BBhagvati CSnasel V(2023)Digital Restoration of Cultural Heritage With Data-Driven Computing: A SurveyIEEE Access10.1109/ACCESS.2023.328063911(53939-53977)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3280639
AKBAYLAR HAYRETER İ(2022)Kültürel Miras Objelerinin Voronoi Tabanlı Üretken Tasarım Yöntemleri Kullanılarak Dijital BütünlemesiDigital Integration of Cultural Heritage Objects Using Voronoi-Based Generative Design MethodsJournal of Computational Design10.53710/jcode.10617333:1(39-52)Online publication date: 31-Mar-2022
https://doi.org/10.53710/jcode.1061733
Liu STu YWang XQin BXie ZZhang YZhang HHu D(2022)Transparent reversible prosthesis, a new way to complete the conservation–restoration of a Black Ding bowl with application of 3D technologiesHeritage Science10.1186/s40494-022-00646-010:1Online publication date: 24-Jan-2022
https://doi.org/10.1186/s40494-022-00646-0
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents