Prof. Dr. Fleming and Dr. Schmidt

Visual categorization of complex naturalistic materials

Project C1 combines behavioral experiments, machine learning and brain imaging to investigate how we categorize real-world materials like plastics, textiles and metals. Our main goal is to map the entire hierarchy of material categories and their visual properties. Due to the enormous variety in their appearance, materials provide an ideal testbed for investigating the roles of perceptual (visually-driven) and conceptual (semantically-driven) features in categorization, as well as individual differences in categorization. Taking a ‘big data’ approach, we will train machine learning models of categorization and map the neural representations of essentially all material categories and their visual properties.

new project-related publications
Cheeseman, J. R., Fleming, R. W., & *Schmidt, F.* (2022). Scale ambiguities in material recognition. iScience, 25(3), 103970. find paper, DATA
Filip, J., Lukavsky, J., Dechterenko, F., Fleming, R. , & Schmidt, F. (2023). Perceptual dimensions of wood materials. Journal of Vision, 24(5), 12-12.find paper, DATA
Flachot, A., Akbarinia, A., Schütt, H. H., Fleming, R. W., Wichmann, F. A., & Gegenfurtner, K. R. (2022). Deep neural models for color classification and color constancy. Journal of Vision, 22(4), 17-17. find paper
Guerrero‐Viu, J., Subias, J. D., Serrano, A., Storrs, K. R., Fleming, R. W., Masia, B., & Gutierrez, D. (2024). Predicting Perceived Gloss: Do Weak Labels Suffice?. Computer Graphics Forum (Vol. 43, No. 2, p. e15037).find paper, DATA
Hartmann, F., Maiello, G., Rothkopf, C. A., & Fleming, R. W. (2023). Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping. JoVE (Journal of Visualized Experiments), (194), e64877. find paper DOI
Klein, L. K., Maiello, G., Stubbs, K., Proklova, D., Chen, J., Paulun, V. C., Culham, J. D., & Fleming, R. W. (2023). Distinct neural components of visually guided grasping during planning and execution. Journal of Neuroscience, 43(49), 8504-8514. find paper DOI
Morgenstern, Y., Storrs, K. R., Schmidt, F., Hartmann, F., Tiedemann, H., Wagemans, J., & Fleming, R. W. (2024). High-level aftereffects reveal the role of statistical features in visual shape encoding. Current Biology. find paper , DATA
Morimoto, T., Akbarinia, A., Storrs, K., Cheeseman, J. R., Smithson, H. E., Gegenfurtner, K. R., & Fleming, R. W. (2023). Color and gloss constancy under diverse lighting environments. Journal of Vision, 23(7), 8-8. find paper DOI
Prokott, E., & Fleming, R. W. (2022). Identifying specular highlights: Insights from deep learning. Journal of Vision, 22(7), 6-6. find paper
Schmidt, F. (2022). The Perception of “Intelligent” Design in Visual Structure. i-Perception, 13(1), 20416695221080184. find paper DOI
Schmidt, F., Tiedemann, H., Fleming, R. W., & Morgenstern, Y. (2023). Inferring shape transformations in a drawing task. Memory & Cognition. find paper DOI
Stegmann, U. E., & Schmidt, F. (2023). Homology judgements of pre-evolutionary naturalists explained by general human shape matching abilities. Scientific Reports, 13, 12269. find paper, DATA
Stewart, E. E. M., & Fleming R. W. (2023). The eyes anticipate where an object will move based on its shape. Current Biology, 33(17), R894-R895. find paper DOI
Stewart, E. E., Hartmann, F. T., Morgenstern, Y., Storrs, K. R., Maiello, G., & Fleming, R. W. (2023). Mental object rotation based on two-dimensional visual representations. Current Biology, 32(21), R1224-R1225. find paper DOI
Tamura, H., Prokott, K. E., & Fleming, R. W. (2022). Distinguishing mirror from glass: A “big data” approach to material perception. Journal of vision, 22(4), 4-4. find paper DOI
Tiedemann, H., Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2022). One-shot generalization in humans revealed through a drawing task. eLife 2022; 11:e75485. find paper DOI
Tiedemann, H., Schmidt, F., & Fleming, R. W. (2022). Superordinate categorization based on the perceptual organization of parts. Brain Sciences, 12(5), 667. find paper DOI
former project-related publications
Fleming RW & Schmidt F (2019). Getting ‘‘fumpered’’: Classifying objects by what has been done to them. Journal of Vision, 19(4):15 find paper DOI
Kunsberg B, Holtmann-Rice D, Alexander E, Cholewiak S, Fleming RW, Zucker SW. (2018). Colour, contours, shading and shape: flow interactions reveal anchor neighbourhoods. Interface Focus 8: 20180019. find paper
Maiello G, Paulun VC, Klein LK, & Fleming RW. (2018). The Sequential-Weight Illusion. i-Perception, 9(4), 1–6. find paper DOI
Maiello, G., Paulun, V. C., Klein, L. K., & Fleming, R. W. (2019). Object visibility, not energy expenditure, accounts for spatial biases in human grasp selection. i-Perception. find paper DOI
Schmidt F & Fleming RW (2018). Identifying shape transformations from photographs of real objects. PLoS ONE 13(8): e0202115. find paper DOI
Schmidt F, Phillips F, & Fleming RW (2019). Visual perception of shape-transforming processes: ‘Shape Scission’. Cognition, 189, 167-180. find paper DOI
Schmidt, F., Hegele, M., & Fleming, R. W. (2017). Perceiving animacy from shape. Journal of Vision, 17(11), 10-10. find paper
Vangorp P, Barla, P & Fleming RW (2017). The perception of hazy gloss. Journal of Vision 17(5):19. doi: 10.1167/17.5.19 find paper
Fleming, R. W. (2014). Visual Perception of Materials and their Properties. Vision Research, 94, 62-75. find paper
Fleming, R. W. (2017). Material Perception. Annual Reviews of Vision Science, 3, 8.1–8.24. find paper
Fleming, R. W., & Storrs, K. R. (2019). Learning to see stuff. Current Opinion in Behavioral Sciences, 30, 100-108. find paper
Klein, L. K., Maiello, G., Fleming, R. W., & Voudouris, D. (2021). Friction is preferred over grasp configuration in precision grip grasping. Journal of Neurophysiology, 125(4), 1330-1338. find paper DOI
Klein, L. K., Maiello, G., Paulun, V. C., & Fleming, R. W. (2020). Predicting precision grip grasp locations on three-dimensional objects. PLoS Computational Biology, 16(8): e1008081. find paper DOI
Lauer, T., Schmidt, F., & Võ, M. L. H. (2021). The role of contextual materials in object recognition. Scientific reports, 11(1), 1-12. find paper, DATA
Morgenstern, Y., Hartmann, F., Schmidt, F., Tiedemann, H., Prokott, E., Maiello, G., & Fleming, R. W. (2021). An image-computable model of human visual shape similarity.PLOS Computational Biology, 17(6), e1008981. find paper. DOI
Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2019). One-shot categorization of novel object classes in humans. Vision research, 165, 98-108. find paper DOI
Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2020). A dataset for evaluating one-shot categorization of novel object classes. Data in brief, 29, 105302. DOI
Muryy, A. A., Fleming, R. W., & Welchman, A. E. (2016). ‘Proto-rivalry’: how the binocular brain identifies gloss. Proceedings of the Royal Society of London B, 283, 20160383. DOI find paper
Paulun, V. C., & Fleming, R. W. (2020). Visually inferring elasticity from the motion trajectory of bouncing cubes. Journal of Vision, 20(6), 6-6. find paper DOI
Paulun, V. C., Buckingham, G., Goodale, M. A., & Fleming, R. W. (2019). The Material-Weight Illusion disappears or inverts in objects made of two materials. Journal of Neurophysiology. 121: 996-1010 find paper DOI
Paulun, V., Schmidt, F., van Assen, J. J. R., & Fleming, R. W. (2017). Shape, motion and optical cues to stiffness of elastic objects. Journal of Vision, 17(1):20, 1-22. DOI find paper
Phillips, F. & Fleming, R. W. (2020). The Veiled Virgin illustrates visual segmentation of shape by cause. Proceedings of the National Academy of Sciences, 117 (21), 11735-11743. find paper DOI
Preißler, L., Jovanovic, B., Munzert, J., Schmidt, F., Fleming, R.W. & Schwarzer, G. (2021). Effects of visual and visual-haptic perception of material rigidity on reaching and grasping in the course of development. Acta Psychologica, 221, 103457. find paper
Prokott, K. E., Tamura, H., & Fleming, R. W. (2021). Gloss perception: Searching for a deep neural network that behaves like humans. Journal of Vision, 21(12), 14-14. find paper DOI
Ritchie, J. B., Paulun, V. C., Storrs, K. R., & Fleming, R. W. (2021). Material perception for philosophers. Philosophy Compass, e12777. find paper
Schmidt, F. (2020). The art of shaping materials. Art & Perception, 1(aop), 1-27. find paper
Schmidt, F., & Fleming, R. W. (2016). Visual perception of complex shape-transforming processes. Cognitive Psychology, 90, 48-70. DOI find paper
Schmidt, F., Fleming, R. W., & Valsecchi, M. (2020). Softness and weight from shape: Material properties inferred from local shape features. Journal of Vision, 20(6), 2-2. find paper DOI
Schmidt, F., Hegele, M., & Fleming, R. W. (2017). Perceiving animacy from shape. Journal of Vision, in press. find paper
Schmidt, F., Kleis, J., Morgenstern, Y., & Fleming, R. W. (2020). The role of semantics in the perceptual organization of shape. Scientific Reports, 10/, 22141. find paper. DOI
Schmidt, F., Paulun, V. C., van Assen, J. J. R., & Fleming, R. W. (2017). Inferring the stiffness of unfamiliar objects from optical, shape, and motion cues. Journal of Vision, 17(3):18, 1-17. DOI find paper
Schmidt, F., Spröte, P., & Fleming, R. W. (2016). Perception of shape and space across rigid transformations. Vision Research, 126, 318-329. DOI find paper
Spröte, P., & Fleming, R. W. (2016). Bent out of shape: The visual inference of non-rigid shape transformations applied to objects. Vision Research,126, 330-346. DOI find paper
Spröte, P., Schmidt, F., & Fleming, R.W. (2016). Visual perception of shape altered by inferred causal history. Scientific Reports, 6:36245. DOI find paper
Storrs, K. R., & Fleming, R. W. (2021). Learning about the world by learning about images. Current Directions in Psychological Science, 30(2), 120-128. find paper
Storrs, K. R., Anderson, B. L., & Fleming, R. W. (2021). Unsupervised learning predicts human perception and misperception of gloss. Nature Human Behaviour, 1-16. find paper DOI
Toscani, M., Milojevic, Z., Fleming, R. W., & Gegenfurtner, K. R. (2020). Color consistency in the appearance of bleached fabrics. Journal of Vision, 20(4), 11-11. find paper
van Assen, J. J. R., & Fleming, R. W. (2016). Influence of optical material properties on the perception of liquids. Journal of Vision, 16(15):12, 1–20. DOI find paper
Van Assen, J. J. R., Barla, P., & Fleming, R. W. (2018). Visual features in the perception of liquids. Current Biology, 28(3), 452-458. find paper DOI
Van Assen, J. J. R., Nishida, S., & Fleming, R. W. (2020). Visual perception of liquids: Insights from deep neural networks. PLoS Computational Biology, 16(8): e1008018. find paper DOI
Vergne, R., Barla, P., Bonneau, G. P., & Fleming, R. (2016). Flow-Guided Warping for Image-Based Shape Manipulation. ACM Transactions on Graphics (Proceedings of SIGGRAPH), 35(4): 93. DOI find paper
Zoeller, A. C., Lezkan, A., Paulun, V. C., Fleming, R. W., & Drewing, K. (2019). Integration of prior knowledge during haptic exploration depends on information type. Journal of vision, 19(4), 20-20. find paper DOI