Prof. Dr. Fleming und Dr. Schmidt

Visuelle Kategorisierung komplexer, naturalistischer Materialien

Projekt C1 kombiniert Verhaltensexperimente, maschinelles Lernen und funktionelle Bildgebung, um zu untersuchen, wie wir Materialien wie Kunststoffe, Textilien und Metalle kategorisieren. Unser Hauptziel ist die Beschreibung der vollständigen Hierarchie dieser Kategorien und ihrer visuellen Eigenschaften. Durch die enorme Vielfalt ihres Erscheinungsbildes eignen sich Materialien perfekt, um die Rolle von perzeptuellen (visuell-basierten) und konzeptuellen (semantisch-basierten) Merkmalen in der Kategorisierung sowie individuelle Unterschiede zu untersuchen. Mittels eines ‘Big Data’-Ansatzes werden wir maschinelle Lernmodelle trainieren und die neuronalen Repräsentationen von prinzipiell allen Materialklassen und ihrer visuellen Eigenschaften beschreiben.

Neue Projektrelevante Veröffentlichungen

Cheeseman, J. R., Fleming, R. W., & *Schmidt, F.* (2022). Scale ambiguities in material recognition. iScience, 25(3), 103970. find paper, DATA

Filip, J., Lukavsky, J., Dechterenko, F., Fleming, R. , & Schmidt, F. (2023). Perceptual dimensions of wood materials. Journal of Vision, 24(5), 12-12.find paper, DATA

Flachot, A., Akbarinia, A., Schütt, H. H., Fleming, R. W., Wichmann, F. A., & Gegenfurtner, K. R. (2022). Deep neural models for color classification and color constancy. Journal of Vision, 22(4), 17-17. find paper

Guerrero‐Viu, J., Subias, J. D., Serrano, A., Storrs, K. R., Fleming, R. W., Masia, B., & Gutierrez, D. (2024). Predicting Perceived Gloss: Do Weak Labels Suffice?. Computer Graphics Forum (Vol. 43, No. 2, p. e15037).find paper, DATA

Hartmann, F., Maiello, G., Rothkopf, C. A., & Fleming, R. W. (2023). Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping. JoVE (Journal of Visualized Experiments), (194), e64877. find paper

Klein, L. K., Maiello, G., Stubbs, K., Proklova, D., Chen, J., Paulun, V. C., Culham, J. D., & Fleming, R. W. (2023). Distinct neural components of visually guided grasping during planning and execution. Journal of Neuroscience, 43(49), 8504-8514. find paper

Morgenstern, Y., Storrs, K. R., Schmidt, F., Hartmann, F., Tiedemann, H., Wagemans, J., & Fleming, R. W. (2024). High-level aftereffects reveal the role of statistical features in visual shape encoding. Current Biology. find paper , DATA

Morimoto, T., Akbarinia, A., Storrs, K., Cheeseman, J. R., Smithson, H. E., Gegenfurtner, K. R., & Fleming, R. W. (2023). Color and gloss constancy under diverse lighting environments. Journal of Vision, 23(7), 8-8. find paper

Prokott, E., & Fleming, R. W. (2022). Identifying specular highlights: Insights from deep learning. Journal of Vision, 22(7), 6-6. find paper

Schmidt, F. (2022). The Perception of “Intelligent” Design in Visual Structure. i-Perception, 13(1), 20416695221080184. find paper

Schmidt, F., Tiedemann, H., Fleming, R. W., & Morgenstern, Y. (2023). Inferring shape transformations in a drawing task. Memory & Cognition. find paper

Stegmann, U. E., & Schmidt, F. (2023). Homology judgements of pre-evolutionary naturalists explained by general human shape matching abilities. Scientific Reports, 13, 12269. find paper, DATA

Stewart, E. E. M., & Fleming R. W. (2023). The eyes anticipate where an object will move based on its shape. Current Biology, 33(17), R894-R895. find paper

Stewart, E. E., Hartmann, F. T., Morgenstern, Y., Storrs, K. R., Maiello, G., & Fleming, R. W. (2023). Mental object rotation based on two-dimensional visual representations. Current Biology, 32(21), R1224-R1225. find paper

Tamura, H., Prokott, K. E., & Fleming, R. W. (2022). Distinguishing mirror from glass: A “big data” approach to material perception. Journal of vision, 22(4), 4-4. find paper

Tiedemann, H., Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2022). One-shot generalization in humans revealed through a drawing task. eLife 2022; 11:e75485. find paper

Tiedemann, H., Schmidt, F., & Fleming, R. W. (2022). Superordinate categorization based on the perceptual organization of parts. Brain Sciences, 12(5), 667. find paper

Ältere projektrelevante Veröffentlichungen

Fleming RW & Schmidt F (2019). Getting ‘‘fumpered’’: Classifying objects by what has been done to them. Journal of Vision, 19(4):15 find paper

Kunsberg B, Holtmann-Rice D, Alexander E, Cholewiak S, Fleming RW, Zucker SW. (2018). Colour, contours, shading and shape: flow interactions reveal anchor neighbourhoods. Interface Focus 8: 20180019. find paper

Maiello G, Paulun VC, Klein LK, & Fleming RW. (2018). The Sequential-Weight Illusion. i-Perception, 9(4), 1–6. find paper

Maiello, G., Paulun, V. C., Klein, L. K., & Fleming, R. W. (2019). Object visibility, not energy expenditure, accounts for spatial biases in human grasp selection. i-Perception. find paper

Schmidt F & Fleming RW (2018). Identifying shape transformations from photographs of real objects. PLoS ONE 13(8): e0202115. find paper

Schmidt F, Phillips F, & Fleming RW (2019). Visual perception of shape-transforming processes: ‘Shape Scission’. Cognition, 189, 167-180. find paper

Schmidt, F., Hegele, M., & Fleming, R. W. (2017). Perceiving animacy from shape. Journal of Vision, 17(11), 10-10. find paper

Vangorp P, Barla, P & Fleming RW (2017). The perception of hazy gloss. Journal of Vision 17(5):19. doi: 10.1167/17.5.19 find paper

Fleming, R. W. (2014). Visual Perception of Materials and their Properties. Vision Research, 94, 62-75. find paper

Fleming, R. W. (2017). Material Perception. Annual Reviews of Vision Science, 3, 8.1–8.24. find paper

Fleming, R. W., & Storrs, K. R. (2019). Learning to see stuff. Current Opinion in Behavioral Sciences, 30, 100-108. find paper

Klein, L. K., Maiello, G., Fleming, R. W., & Voudouris, D. (2021). Friction is preferred over grasp configuration in precision grip grasping. Journal of Neurophysiology, 125(4), 1330-1338. find paper

Klein, L. K., Maiello, G., Paulun, V. C., & Fleming, R. W. (2020). Predicting precision grip grasp locations on three-dimensional objects. PLoS Computational Biology, 16(8): e1008081. find paper

Lauer, T., Schmidt, F., & Võ, M. L. H. (2021). The role of contextual materials in object recognition. Scientific reports, 11(1), 1-12. find paper, DATA

Morgenstern, Y., Hartmann, F., Schmidt, F., Tiedemann, H., Prokott, E., Maiello, G., & Fleming, R. W. (2021). An image-computable model of human visual shape similarity.PLOS Computational Biology, 17(6), e1008981. find paper.

Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2019). One-shot categorization of novel object classes in humans. Vision research, 165, 98-108. find paper

Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2020). A dataset for evaluating one-shot categorization of novel object classes. Data in brief, 29, 105302.

Muryy, A. A., Fleming, R. W., & Welchman, A. E. (2016). ‘Proto-rivalry’: how the binocular brain identifies gloss. Proceedings of the Royal Society of London B, 283, 20160383.

find paper

Paulun, V. C., & Fleming, R. W. (2020). Visually inferring elasticity from the motion trajectory of bouncing cubes. Journal of Vision, 20(6), 6-6. find paper

Paulun, V. C., Buckingham, G., Goodale, M. A., & Fleming, R. W. (2019). The Material-Weight Illusion disappears or inverts in objects made of two materials. Journal of Neurophysiology. 121: 996-1010 find paper

Paulun, V., Schmidt, F., van Assen, J. J. R., & Fleming, R. W. (2017). Shape, motion and optical cues to stiffness of elastic objects. Journal of Vision, 17(1):20, 1-22.

find paper

Phillips, F. & Fleming, R. W. (2020). The Veiled Virgin illustrates visual segmentation of shape by cause. Proceedings of the National Academy of Sciences, 117 (21), 11735-11743. find paper

Preißler, L., Jovanovic, B., Munzert, J., Schmidt, F., Fleming, R.W. & Schwarzer, G. (2021). Effects of visual and visual-haptic perception of material rigidity on reaching and grasping in the course of development. Acta Psychologica, 221, 103457. find paper

Prokott, K. E., Tamura, H., & Fleming, R. W. (2021). Gloss perception: Searching for a deep neural network that behaves like humans. Journal of Vision, 21(12), 14-14. find paper

Ritchie, J. B., Paulun, V. C., Storrs, K. R., & Fleming, R. W. (2021). Material perception for philosophers. Philosophy Compass, e12777. find paper

Schmidt, F. (2020). The art of shaping materials. Art & Perception, 1(aop), 1-27. find paper

Schmidt, F., & Fleming, R. W. (2016). Visual perception of complex shape-transforming processes. Cognitive Psychology, 90, 48-70.

find paper

Schmidt, F., Fleming, R. W., & Valsecchi, M. (2020). Softness and weight from shape: Material properties inferred from local shape features. Journal of Vision, 20(6), 2-2. find paper

Schmidt, F., Hegele, M., & Fleming, R. W. (2017). Perceiving animacy from shape. Journal of Vision, in press. find paper

Schmidt, F., Kleis, J., Morgenstern, Y., & Fleming, R. W. (2020). The role of semantics in the perceptual organization of shape. Scientific Reports, 10/, 22141. find paper.

Schmidt, F., Paulun, V. C., van Assen, J. J. R., & Fleming, R. W. (2017). Inferring the stiffness of unfamiliar objects from optical, shape, and motion cues. Journal of Vision, 17(3):18, 1-17.

find paper

Schmidt, F., Spröte, P., & Fleming, R. W. (2016). Perception of shape and space across rigid transformations. Vision Research, 126, 318-329.

find paper

Spröte, P., & Fleming, R. W. (2016). Bent out of shape: The visual inference of non-rigid shape transformations applied to objects. Vision Research,126, 330-346.

find paper

Spröte, P., Schmidt, F., & Fleming, R.W. (2016). Visual perception of shape altered by inferred causal history. Scientific Reports, 6:36245.

find paper

Storrs, K. R., & Fleming, R. W. (2021). Learning about the world by learning about images. Current Directions in Psychological Science, 30(2), 120-128. find paper

Storrs, K. R., Anderson, B. L., & Fleming, R. W. (2021). Unsupervised learning predicts human perception and misperception of gloss. Nature Human Behaviour, 1-16. find paper

Toscani, M., Milojevic, Z., Fleming, R. W., & Gegenfurtner, K. R. (2020). Color consistency in the appearance of bleached fabrics. Journal of Vision, 20(4), 11-11. find paper

van Assen, J. J. R., & Fleming, R. W. (2016). Influence of optical material properties on the perception of liquids. Journal of Vision, 16(15):12, 1–20.

find paper

Van Assen, J. J. R., Barla, P., & Fleming, R. W. (2018). Visual features in the perception of liquids. Current Biology, 28(3), 452-458. find paper

Van Assen, J. J. R., Nishida, S., & Fleming, R. W. (2020). Visual perception of liquids: Insights from deep neural networks. PLoS Computational Biology, 16(8): e1008018. find paper

Vergne, R., Barla, P., Bonneau, G. P., & Fleming, R. (2016). Flow-Guided Warping for Image-Based Shape Manipulation. ACM Transactions on Graphics (Proceedings of SIGGRAPH), 35(4): 93.

find paper

Zoeller, A. C., Lezkan, A., Paulun, V. C., Fleming, R. W., & Drewing, K. (2019). Integration of prior knowledge during haptic exploration depends on information type. Journal of vision, 19(4), 20-20. find paper

Projektleitung

Prof.
Roland W. Fleming, Ph.D. roland.w.fleming@psychol.uni-giessen.de

Dr.
Filipp Schmidt Filipp.Schmidt@psychol.uni-giessen.de

Mitarbeiter

Dr.
Emily A-Izzeddin

PhD Student
Henning Tiedemann