Skip to main content

Focused Proofreading to Reconstruct Neural Connectomes from EM Images at Scale

  • Conference paper
  • First Online:
Deep Learning and Data Labeling for Medical Applications (DLMIA 2016, LABELS 2016)

Abstract

Identifying complex neural circuitry from electron microscopic (EM) images may help unlock the mysteries of the brain. However, identifying this circuitry requires time-consuming, manual tracing (proofreading) due to the size and intricacy of these image datasets, thus limiting analysis to small brain regions. Potential avenues to improve scalability include automatic image segmentation and crowdsourcing, but current efforts have had limited success. In this paper, we propose a new strategy, focused proofreading, that works with automatic segmentation and aims to limit proofreading to areas that are most impactful to the resulting circuit. We then introduce a novel workflow, which exploits biological information such as synapses, and apply it to a large fly optic lobe dataset. Our techniques achieve significant tracing speedups without sacrificing quality. Furthermore, our methodology makes proofreading more accessible and could enhance the effectiveness of crowdsourcing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Helmstaedter, M., Briggman, K., Turaga, S., Jain, V., Seung, H., Denk, W.: Connectomic reconstruction of the inner plexiform layer in the mouse retina. Nature 500(7461), 168–174 (2014)

    Article  Google Scholar 

  2. Hubert, L., Arabie, P.: Comparing partitions. J. Classif. 2(1), 193–218 (1985)

    Article  MATH  Google Scholar 

  3. Jain, V., Bollmann, B., Richardson, M., Berger, D., Helmstaedter, M., et al.: Boundary learning by optimization with topological constraints. In: CVPR, pp. 2488–2495 (2010)

    Google Scholar 

  4. Kim, J., Greene, M., Zlateski, A., Lee, K., Richardson, M.: Spacetime wiring specificity supports direction selectivity in the retina. Nature 509(7500), 331–336 (2014)

    Article  Google Scholar 

  5. Meilă, M.: Comparing clusterings by the variation of information. In: Schölkopf, B., Warmuth, M.K. (eds.) COLT-Kernel 2003. LNCS (LNAI), vol. 2777, pp. 173–187. Springer, Heidelberg (2003). doi:10.1007/978-3-540-45167-9_14

    Chapter  Google Scholar 

  6. Nunez-Iglesias, J., Kennedy, R., Parag, T., Shi, J., Chklovskii, D.: Machine learning of hierarchical clustering to segment 2D and 3D images. PLoS One 8(8), e71715 (2013). doi:10.1371/journal.pone.0071715

    Article  Google Scholar 

  7. Olbris, D., Winston P., Plaza S., Bolstad M., Rivlin P., Scheffer L., Chklovskii D.: https://openwiki.janelia.org/wiki/display/flyem/Raveler

  8. Parag, T., Chakraborty, A., Plaza, S., Scheffer, L.: A context-aware delayed agglomeration framework for electron microscopy segmentation. PLoS One 10(5), e0125825 (2015)

    Article  Google Scholar 

  9. Plaza, S., Parag, T., Huang, G., Olbris, D., Saunders, M., Rivlin, P.: Annotating synapses in large EM datasets. In: arXiv.org (2014)

    Google Scholar 

  10. Plaza, S., Scheffer, L., Chklovskii, D.: Toward large-scale connectome reconstructions. In: Current Opinion in Neurobiology, pp. 201–210 (2014)

    Google Scholar 

  11. Plaza, S., Scheffer, L., Saunders, M.: Minimizing manual image segmentation turn-around time for neuronal reconstruction by embracing uncertainty. PLoS One 7(9), e44448 (2012). doi:10.1371/journal.pone.0044448

    Article  Google Scholar 

  12. Rand, W.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66(336), 846–850 (1973)

    Article  Google Scholar 

  13. Saalfeld, S., Cardona, A., Hartenstein, V., Toman, P.: CATMAID: collaborative annotation toolkit for massive amounts of image data. Bioinformatics 25(15), 1984–1986 (2009)

    Article  Google Scholar 

  14. Sommer, C., Straehle, C., Koethe, U., Hamprecht, F.: Ilastik: interactive learning and segmentation toolkit. In: Proceedings of the IEEE International Symposium on Biomedical Imaging, pp. 230–233 (2011)

    Google Scholar 

  15. Takemura, S., Xu, S., Lu, Z., Rivlin, P., Parag, T., et al.: Synaptic circuits and their variations within different columns in the visual system of Drosophila. PNAS 112(44), 13711–13716 (2015)

    Article  Google Scholar 

  16. Takemura, S., Bharioke, A., Lu, Z., Nern, A., Vitaladevuni, S., et al.: A visual motion detection circuit suggested by Drosophila connectomics. Nature 500(7461), 175–181 (2013)

    Article  Google Scholar 

Download references

Acknowledgments

We thank Zhiyuan Lu for sample preparation; Shan Xu and Harald Hess for imaging; Pat Rivlin, Shin-ya Takemura, and the FlyEM proofreading team (Roxanne Aniceto, Lei-Ann Chang, Shirley Lauchie, Mathew Saunders, Christopher Sigmund, Satoko Takemura, Julie Tran) for reconstruction efforts; Donald Olbris for Raveler development; Toufiq Parag for generating segmentation classifiers; Louis Scheffer for useful discussions and suggestions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stephen M. Plaza .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Plaza, S.M. (2016). Focused Proofreading to Reconstruct Neural Connectomes from EM Images at Scale. In: Carneiro, G., et al. Deep Learning and Data Labeling for Medical Applications. DLMIA LABELS 2016 2016. Lecture Notes in Computer Science(), vol 10008. Springer, Cham. https://doi.org/10.1007/978-3-319-46976-8_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46976-8_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46975-1

  • Online ISBN: 978-3-319-46976-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics