Ivar Farup

We explored imaging methods to perform in situ field measurements of physical correlates of the visual appearance of snow. Measurements were performed at three locations in Norway between February and March 2023. We used a method to estimate the absorption and scattering coefficients of snow using only one measurement of reflectance captured by the Dia-Stron© TLS850 translucency meter. We also measured the sparkle indicators (contrast and density of sparkle spots) from digital images of snow. The contrast of sparkle spots can be defined as the median value of all the pixels identified as sparkle spots by an algorithm, and the density of sparkle spots is the number of sparkle spots in a selected area of the image. In the case of the sparkle of the snow surface, we found that there is a potential to use the sparkle indicators for classifying the grain types, but it requires a larger data set coupled with expert labelling to define the type of snow. For the absorption and scattering properties, the measurements confirm the fact that snow is a weakly absorptive and highly scattering material when modelling light interactions in the snow. No correlation between the optical properties and sparkle could be found in our data.

A wireless capsule endoscope (WCE) is a medical device designed for the examination of the human gastrointestinal (GI) tract. Three-dimensional models based on WCE images can assist in diagnostics by effectively detecting pathology. These 3D models provide gastroenterologists with improved visualization, particularly in areas of specific interest. However, the constraints of WCE, such as lack of controllability, and requiring expensive equipment for operation, which is often unavailable, pose significant challenges when it comes to conducting comprehensive experiments aimed at evaluating the quality of 3D reconstruction from WCE images. In this paper, we employ a single-image-based 3D reconstruction method on an artificial colon captured with an endoscope that behaves like WCE. The shape from shading (SFS) algorithm can reconstruct the 3D shape using a single image. Therefore, it has been employed to reconstruct the 3D shapes of the colon images. The camera of the endoscope has also been subjected to comprehensive geometric and radiometric calibration. Experiments are conducted on well-defined primitive objects to assess the method’s robustness and accuracy. This evaluation involves comparing the reconstructed 3D shapes of primitives with ground truth data, quantified through measurements of root-mean-square error and maximum error. Afterward, the same methodology is applied to recover the geometry of the colon. The results demonstrate that our approach is capable of reconstructing the geometry of the colon captured with a camera with an unknown imaging pipeline and significant noise in the images. The same procedure is applied on WCE images for the purpose of 3D reconstruction. Preliminary results are subsequently generated to illustrate the applicability of our method for reconstructing 3D models from WCE images.