Research
Doctoral research and supervision
My research is broadly situated within computer vision and is currently focused on the acquisition, processing, and analysis of multidimensional images for modeling surface appearance or for extracting information (physiological parameters) when dealing with living surfaces (biomedical applications) . Indeed, as a logical continuation of my work with color and multispectral imaging, I am currently interested in a more comprehensive integrated modeling (in terms of both appearance and function) of surfaces. This involves integrating several modalities and naturally requires me to address the scientific challenges of appropriate data representation and the extension/adaptation of classical methodologies to meet computational time requirements while balancing them with application expectations, particularly in heritage, industry, and biomedicine .
Regarding applications, I have indeed been actively involved in research and collaborations related to the documentation and promotion of cultural heritage for several years. This is a field where several disciplines intersect, and where computer vision and computer science (more generally) play a leading role. For example, I led the CNRS PEPS project (2013-2015) ArchZoo3D ( http://www.archzoo3D.weebly.com ) on the use of 3D in archaeozoology. I was also one of the founding members of the COST Action COSCH (Color and Space in Cultural Heritage), which concluded in November 2016, where I held the central role of scientific and financial manager for the grants for young researchers ( http://www.cosch.info ). I was also the person in charge of LE2I in the Fiat-Lux project (2015-2017) as part of the CNRS Imag’In Challenge led by the CNRS MAP unit in Marseille.
Finally, I am currently the coordinator of the ANR-PRC SUMUM project ( www.anr-sumum.fr ) , selected in the 2017 call for proposals. I am also responsible for WP3 of the European H2020 MSCA-ITN project entitled CHANGE ( https://change-itn.eu ).
The contribution in this application area lies in the development of innovative strategies, both instrumentally and in terms of associated methods, for digitizing and modeling the appearance ( perceptual, visual) of the complex surfaces of heritage objects.
This same approach is suitable for manufactured product surfaces, where controlling the visual perception of these surfaces (appearance) is crucial from both a scientific and industrial perspective. This also forms the basis of my current research, which I lead with a multidisciplinary team (CNU sections 27, 61, and 60). We have been awarded an ANR-JCJC grant called NAPS ( www.anr-naps.fr ), led by Gaëtan Le Goïc (Lecturer, Section 60).
I have recently been developing (2 theses) an activity in the field of biomedicine which has two aspects:
- 1. Investigating the contribution of multimodal imaging in dermatology to aid in the detection and diagnosis of pathologies
- 2. Estimation of physiological parameters from image data from conventional cameras or webcams.
This raises the problems of recalibration, merging, classification, tracking, etc., requiring not only the adaptation of the data representation (spatial and temporal) but also the development of robust and rapid calculation methodologies when real-time or near-real-time is the target (the case of heart rate estimation).
In line with this activity and across these various aspects, 6 doctoral theses have been defended or started since 2014 (see details in the supervision section below). During this same period, I have been awarded several grants, including 2 ANR projects (one as coordinator), 1 PHC project (also as coordinator), and participation in 1 H2020 project and 1 PSPC project ( details on the projects page) .
Several national and international collaborations support this research activity. Regarding international collaborations, I would first mention the ColorLab in Norway (joint PhD supervision, COST COSCH Action, mutual invitations, partnership in Horizon 2020 projects), Morocco (joint PhD supervision and co-mentoring, organization of conferences, PHC Toubkal Project), and Germany (COST COSCH Action, partnership in Horizon 2020 projects, co-development of instruments for heritage preservation). At the national level, I would cite my collaborations with the PRISME Institute at Poly’Tech Orléans on biomedical applications, the LABCOM CICRP/MAP (CNRS ImagIn Fiat-Lux Challenge, ANR-SUMUM), and the Greyc laboratory in Caen (ANR-SUMUM, organization of conferences and scientific seminars). All these collaborations are evidenced by the projects mentioned above, but also by numerous joint publications, the details of which are in the publications section.
Frames
In line with my research theme and activities, my doctoral supervision record includes 8 defended theses and 7 theses currently in progress. I also supervised a postdoctoral researcher in 2016-2017 on aspects related to appearance modeling. Below, I provide a description of these various supervision experiences, specifying the supervision ratios, associated publications, and the career paths of the students trained.
Theses defended (8)
- Candidate : Romain CENDRE (2017-2020) (defended in January 2021)
- Funding : JCE scholarship from the region based on a competition from the doctoral school.
- Subject : Aiding in the diagnosis/prognosis of pigmented lesions in dermatology through multiscale analysis of multimodal images
- Candidate : Jihad HROURA (2015-2018) (defended in December 2018)
- Funding : Moroccan doctoral school scholarship + PHC project that I coordinate for mobility
- Subject : Models and algorithms for processing and extracting descriptors from multimodal 3D data for object recognition
- Candidate : Richard MACWAN (2015-2018) (defended in December 2018)
- Funding : Ministerial scholarship awarded through a doctoral school competition
- Subject : Multivariate data analysis by tensor representation and bio-physical constraints integration
- Candidate : Hanan ANZID (2014-2018) Joint PhD thesis with Morocco ( defended in October 2018 )
- Funding : Moroccan doctoral school scholarship + PHC project that I coordinate for mobility
- Subject : Fusion of multimodal data by combining uncertainty and perception models
- Note : The doctoral school has granted Ms. ANZID a gap year.
- Candidate : Ferdinand DEGER, 2012-2016 ( Joint PhD with Norway )
- Funding : 50% from the Burgundy region and 50% from ColorLab, NTNU, Norway.
- Subject : Contributions to spectral and 3D imaging technology for cultural heritage applications
- Candidate : Jessica EL KHOURY, 2013-2016 (defended in December 2016)
- Funding : Grant for a PSPC project financed by the Public Investment Bank.
- Subject : Model and quality assessment of single image dehazing
- Candidate : Steven LE MOAN (2009-2012) (in co-supervision with Norway, defended in September 2012).
- Funding : 50% from the Burgundy region and 50% from the ColorLab, University of Gjovik (Norway).
- Subject : Salience and dimensionality reduction for spectral image visualization
- Candidate : Jonathan DELCOURT from 01/12/2007 to 30/11/2010 ( defended in October 2010 ).
- Funding : Ministerial allocation
- Subject : An integrated 3D-multispectral acquisition system: data acquisition, encoding, and compression
Current theses (7)
- Candidate : David Lewis (2019-2022)
- Funding : H2020 MSCA-ITN funding ( https://change-itn.eu/about/people/fellows/esr9-david-lewis/ )
- Subject: Appearance change assessment: Link between local geometry and global appearance descriptors
- Candidate: Ramamoorthy Luxman (2019-2022)
- Funding : H2020 MSCA-ITN funding ( https://change-itn.eu/about/people/fellows/esr8-ramamoorthy-luxman/ )
- Subject : Capture and characterization of change In the appearance of CH objects surface
- Candidate : Jizhen CAI (2019-2022)
- Funding : H2020 MSCA-ITN funding ( https://change-itn.eu/about/people/fellows/esr6-jizhen-cai/ )
- Subject: Development of multi modal image data fusion methods for change monitoring
- Candidate: Amalia Siatou (2019-2022)
- Funding : H2020 MSCA-ITN funding ( https://change-itn.eu/about/people/fellows/esr15-amalia-siatou/ )
- Subject : Characterization of change on the surfaces of oxidized, patinated and varnished historical metals by imaging and computer vision
- Candidate : Yuly Castro (2018-2021)
- Funding : ANR PRC CE38 SUMUM funding ( www.anr-sumum.fr ).
- Subject : Digitization and modeling of the appearance of complex surfaces using a multi-scale and multi-modal approach
- Candidate: Marvin Nurit (2018-2021)
- Funding : ANR JCJC NAPS funding ( https://anr.fr/Projet-ANR-17-CE10-0005 ).
- Subject : Modeling the local angular reflectance of complex surfaces for visual inspection
- Candidate : Abir Zendaui (2018-2021)
- Funding : ANR JCJC NAPS funding ( https://anr.fr/Projet-ANR-17-CE10-0005 ).
- Subject : Modeling visual perception by combining sensory approach and neural networks.
Post-Doc
- Candidate : Gilles PITARD (2016-2017)
- Funding : 50% ColorLab (Norway) + 50% LE2I (service/transfer)
- Subject : RTI-Multispectral for appearance modeling
Projects & Funding
Research contracts evaluated following a call for proposals
2023-current: Horizon Europe R&I Action Cheminova Project ( https://cheminova.eu/ )
Role: WP3 Manager, training school organizer
Total budget: €3.4 million, including €422,000 for UBE (ImViA) (1 PhD and one postdoc)
2023-present: ANR PRCE RTI4.0 project (https://anr.fr/Projet-ANR-23-CE10-0017)
Role: WP2 Manager
Total budget: €533,000, including €137,000 for UBE (ImViA) (1 thesis)
2021-present: Industrial Maturation Project with SATT Sayens following the DI RTI-Bot ( RTI-Bot )
Role: Lead Inventor and Project Manager
Total budget: €200,000
2019-2023: H2020 MSCA-ITN Project ( https://change-itn.eu )
Role: WP3 Manager, training school organizer and thesis supervisor for 4 ESRs
Total budget: €4 million including €576,000 for UBFC (ImViA)
2018-2022: ANR-PRC SUMUM project ( www.anr-sumum.fr ),
Role: Coordinator
Total budget: €684,000 including €224,000 for UBFC (ImViA)
2018-2022: ANR-JCJC project led by Gaëtan le Coïc ( www.anr-naps.fr )
Role: Project co-leader and supervisor of theses funded by the project
Budget: €198,000
2015-2018: PHC Toubkal with Morocco
Role: Project leader and coordinator
Budget: €28,000
2014-2018: H2020 Exist
Role : Participant in lots 3 and 4 “Multispectral Sensors of the Future”
https://cordis.europa.eu/project/rcn/198017_en.html
Budget : €203,000 for the University of Burgundy
2012-2016: EU COST Action COSCH (Color and Space in Cultural Heritage).
Role : Founding member and scientific and financial lead for ESR mobility projects
2013-2016: PSPC project called OFS (Open Food System)
Role : Scientific supervisor and PhD director for Jessica El Khoury, funded by the project
Budget: €273,000. Funded by the Public Investment Bank as part of the Structuring Projects for Competitiveness Clusters.
2015-2017: CNRS Imag’In project Fiat-Lux ( http://www.fiatlux.gamsau.archi.fr/?page_id=16 )
Role : Responsible for the work package and deliverables for LE2I
Budget : €55,000
2013-2017: participant for the University of Burgundy in the Franco-Norwegian project HYPERCEPT with the University of Gjovik (Color and Quality in higher dimensions)
The SUMUM project explained in video
Digital Culture Day: Presentations by Serge Haroche (2012 Nobel Prize winner) and Livio De Luca DR-CNRS
Program Chair of ICISP2018
Visit to the Vasarely Foundation in Marseille