Integration of 3D and multispectral data for cultural heritage applications: Survey and perspectives

2013

International audience; Cultural heritage is increasingly put through imaging systems such as multispectral cameras and 3D scanners. Though these acquisition systems are often used independently, they collect complementary information (spectral vs. spatial) used for the study, archiving and visualization of cultural heritage. Recording 3D and multispectral data in a single coordinate system enhances the potential insights in data analysis. Wepresent the state of the art of such acquisition systems and their applications for the study of cultural her- itage. Wealso describe existing registration techniques that can be used to obtain 3D models with multispec- tral texture and explore the idea…

Interpreting Heterogeneous Geospatial Data Using Semantic Web Technologies

2016

International audience; The paper presents work on implementation of semantic technologies within a geospatial environment to provide a common base for further semantic interpretation. The work adds on the current works in similar areas where priorities are more on spatial data integration. We assert that having a common unified semantic view on heterogeneous datasets provides a dimension that allows us to extend beyond conventional concepts of searchability, reusability, composability and interoperability of digital geospatial data. It provides contextual understanding on geodata that will enhance effective interpretations through possible reasoning capabilities. We highlight this through …

Registration of arbitrary multi-view 3D acquisitions

2013

International audience; To register 3D meshes representing smooth surfaces we track the 3D digitization system using photogrammetric techniques and calibrations. We present an example by digitizing a 800 mm x 600 mm portion of a car door. To increase the tracking accuracy the 3D scanner is placed in a cubic frame of side 0.5 m covered with 78 targets. The target frame moves in a volume that is approximately 1100 mm x 850 mm x 900 mm, to digitize the area of interest. Using four cameras this target frame is tracked with of an accuracy of 0.03 mm spatially and 0.180 mrad angularly. A registration accuracy between 0.1 mm and 2 mm is reached. This method can be used for the registration of mesh…

Automatic object detection in point clouds based on knowledge guided algorithms

2013

The modeling of real-world scenarios through capturing 3D digital data has been proven applicable in a variety of industrial applications, ranging from security, to robotics and to fields in the medical sciences. These different scenarios, along with variable conditions, present a challenge in discovering flexible appropriate solutions. In this paper, we present a novel approach based on a human cognition model to guide processing. Our method turns traditional data-driven processing into a new strategy based on a semantic knowledge system. Robust and adaptive methods for object extraction and identification are modeled in a knowledge domain, which has been created by purely numerical strate…

Detection and Isolation of Switches in Point Clouds of the German Railway Network

2015

In order to obtain an automated system of railway management, it is necessary to automatically detect, isolate and identify all switches in a point cloud which represents the railway. To realize this automated system of detection, a set of pre-processing steps is applied. The system begins by detecting and isolating tracks through application of a mask on each section of the point cloud. Then, it does a denoising through mathematical morphology and a compression in replacing a group of points by their centroid. Finally, it closes tracks holes through extrapolation. After that, the system does a low-level processing to search for all intersections between tracks, and records information on t…

A Framework to Improve the Disaster Response Through a Knowledge-Based Multi-Agent System

2017

The disaster response still faces problems of collaboration due to lack of policies concerning the information exchange during the response. Moreover, plans are prepared to respond to a disaster, but drills to apply them are limited and do not allow to determine their efficiency and conflicts with other organizations. This paper presents a framework allowing for different organizations involving in the disaster response to assess their collaboration through its simulation using an explicit representation of their knowledge. This framework is based on a multi-agent system composed of three generic agent models to represent the organizational structure of disaster response. The decision-makin…

Registration of 3D and Multispectral Data for the Study of Cultural Heritage Surfaces

2013

International audience; We present a technique for the multi-sensor registration of featureless datasets based on the photogrammetric tracking of the acquisition systems in use. This method is developed for the in situ study of cultural heritage objects and is tested by digitizing a small canvas successively with a 3D digitization system and a multispectral camera while simultaneously tracking the acquisition systems with four cameras and using a cubic target frame with a side length of 500 mm. The achieved tracking accuracy is better than 0.03 mm spatially and 0.150 mrad angularly. This allows us to seamlessly register the 3D acquisitions and to project the multispectral acquisitions on th…

Modular Method of Detection, Localization and Counting of Mutliple-Taxon Pollen Apertures Using Bag of Words

2014

International audience; Accurate recognition of airborne pollen taxa is crucial for understanding and treating allergic diseases, which affect an important proportion of the world population. Modern computer vision techniques enables the detection of discriminant characteristics. Apertures is one of these characteristic that has been little explored up to now. In this paper, a flexible method of detection, localization and counting of apertures of different pollen taxa with varying appearances is proposed. Apertures are described based by primitive images following the Bag-of-Words strat-egy. A confidence map is estimated based on the classification of sampled regions. The method is designe…

Increasing the accuracy of untaught robot positions by means of a multi-camera system

2010

We aim to improve the absolute in line positional accuracy of a robot-guided effector to better than 1 mm. We do so using photogrammetric techniques and by relying heavily on simulations to fine tune each parameter and avoid weak configurations. We also use simulations to design an LED calibration object adapted to this application. A test procedure enables us to validate both the simulated results as well as the calibration procedure. The test results exceed expectations by improving the absolute positioning of a robot effector by a factor of 20.

Automatic Integration of Spatial Data into the Semantic Web

2017

International audience

Use of Geospatial Analyses for Semantic Reasoning

2010

International audience; This work focuses on the integration of the spatial analyses for semantic reasoning in order to compute new axioms of an existing OWL ontology. To make it concrete, we have defined Spatial Built-ins, an extension of existing Built-ins of the SWRL rule language. It permits to run deductive rules with the help of a translation rule engine. Thus, the Spatial SWRL rules are translated to standard SWRL rules. Once the spatial functions of the Spatial SWRL rules are computed with the help of a spatial database system, the resulting translated rules are computed with a reasoning engine such as Racer, Jess or Pellet.

Classification of Pollen Apertures Using Bag of Words

2013

International audience; The taxonomical recognition of microscopic biological parti- cles such as pollen and spores is relevant for medical and aerobiological applications. Focusing on an accurate and automatic vision-based pollen recognition system, we propose a method for classification of pollen aper- tures based on bag-of-words strategy, with the ability of learning new types from different taxa without the need of new algorithms. Results demonstrate suitable performance and ability to add new taxa.

Spatialization of the Semantic Web

2012

syntax for Horn-like rules. The SWRL as the form, antecedentconsequent, where both antecedent and consequent are conjunctions of atoms written a1^ ... ^ an. Atoms in rules can be of the form C(x), P(x,y), Q(x,z), sameAs(x,y), differentFrom(x,y), or builtIn(pred, z1, ..., zn), where C is an OWL description, P is an OWL individual-valued property, Q is an OWL data-valued property, pred is a datatype predicate URIref, x and y are either individual-valued variables or OWL individuals, and z, z1, ... zn are either data-valued variables or OWL data literals. An OWL data literal is either a typed literal or a plain literal. Variables are indicated by using the standard convention of prefixing the…

Asserting the Precise Position of 3D and Multispectral Acquisition Systems for Multisensor Registration Applied to Cultural Heritage Analysis

2012

International audience; We present a novel method to register multispectral acquisitions on a 3D model. The method is based on the external tracking of the acquisition systems using close-range photogrammetric techniques: multiple calibrated cameras simultaneously observe the successive acquisition systems in use. The views from these cameras are used to precisely determine the position of each acquisition system. All datasets can then be projected in the same coordinate system. The registration is thus independent from the quality and content of the data. This method is well suited to the study of cultural heritage or any other application where we do not wish to place targets on the objec…

Towards the Design of Respond Action in Disaster Management Using Knowledge Modeling

2017

This position paper highlights current problems linked to the aspects of the multi-agency collaboration during disaster response. The coordination and cooperation depend on the information sharing and use which must face up to interoperability, access rights, and quality problems. The research project aims at providing an assessment of information impact on the disaster response in order to support the decision-making about what information shared or what quality of data used to improve the response efficiency. Our research approach propose to combine an information system able to integrate heterogeneous data and a simulation system to assess different strategies of information sharing, dis…

Modélisation sémantique et programmation générative pour une simulation multi-agent dans le contexte de gestion de catastrophe

2020

La gestion de catastrophe nécessite une préparation collaborative entre les divers intervenants. Les exercices collaboratifs visent à entraîner les intervenants à appliquer les plans préparés ainsi qu’à identifier les problèmes et points d’améliorations potentiels. Ces exercices étant coûteux, la simulation informatique est un outil permettant d’optimiser la préparation à l’aide d’une plus grande diversité de cas. Cependant, les travaux de recherche centrés sur la simulation et la gestion de catastrophe sont spécialisés sur un problème spécifique plutôt que sur l’optimisation globale des plans préparés. Cette limite s’explique par le défi que constitue la réalisation d’un modèle de simulati…

Integration of Spatial processing and knowledge Processing through the Semantic Web Stack

2011

International audience; This paper presents the integration process of spatial technologies and Semantic Web technologies and its associated tool. The result of this work is a spatial query and rule engine of spatial. To do so, existing ontology with spatial elements is adjusted in order to process the spatial knowledge through spatial technologies. This paper outlines the methods and the processes of these adjustments and how results are returned by our tool. The SWRL and the SPARQL language are extended for spatial purpose and the existing OWL ontology wine is used as an application example.

Preprocessing of region of interest localization based on local surface curvature analysis for three-dimensional reconstruction with multiresolution

2009

We present an approach to integrate a preprocessing step of the region of interest ROI localization into 3-D scanners laser or ste- reoscopic. The definite objective is to make the 3-D scanner intelligent enough to localize rapidly in the scene, during the preprocessing phase, the regions with high surface curvature, so that precise scanning will be done only in these regions instead of in the whole scene. In this way, the scanning time can be largely reduced, and the results contain only per- tinent data. To test its feasibility and efficiency, we simulated the prepro- cessing process under an active stereoscopic system composed of two cameras and a video projector. The ROI localization is…

Semantic and Logic Modeling of Disaster Simulation for Multi-agent Systems

2019

Modélisation sémantique et logique pour une simulation multi-agent dans le contexte de gestion de catastrophe

2019

International audience

Vers la conception d'une action de réponse pour la gestion de catastrophe, utilisant la modélisation de connaissances

2018

International audience; Ce travail de positionnement souligne les problèmes actuels liés aux diffé-rents aspects de la collaboration inter agence pendant la réponse à une catastrophe. La coordination et la coopération dépendent de l'usage et du partage d'informations, qui doivent faire face aux problèmes d'interopérabilité, de droits d'accès et de qualité. Le projet de recherche a pour but de fournir une évaluation de l'impact de l'information sur la réponse à une catastrophe afin d'aider la prise de décision concernant l'usage et le partage de l'information en répondant à des questions telles que: quelles informa-tions devraient être partagées ou quelle qualité de données utilisées pour am…

Integration of high resolution spatial and spectral data acquisition systems to provide complementary datasets for cultural heritage applications

2010

International audience; Modern optical measuring systems are able to record objects with high spatial and spectral precision. The acquisition of spatial data is possible with resolutions of a few hundredths of a millimeter using active projection-based camera systems, while spectral data can be obtained using filter-based multispectral camera systems that can capture surface spectral reflectance with high spatial resolution. We present a methodology for combining data from these two discrete optical measuring systems by registering their individual measurements into a common geometrical frame. Furthermore, the potential for its application as a tool for the non-invasive monitoring of painti…

Semantic Catalogue to Manage Data Sources in Disaster Management System

2016

International audience; With the climate change, disasters occur more frequently and the need for efficient disaster management systems becomes highly recommended to save lives. This paper deals with a study of existing systems, with the intention of determining the main recent improvement in the domain. The heterogeneous data integration process is a major central point. Thus, a semantic system with three main components is proposed as a new position in the disaster management systems. These three components are a knowledge base, a reasoner and a semantic catalogue. The knowledge base provides a controlled vocabulary and allows storing information retrieval. The semantic catalogue facilita…

An SDI for archaeological data with a RESTful interface to semantically modeled information

2013

International audience; The poster focuses on current activities carried out within a bi-national research project "HIGEOMES - Die historische Geographie Obermesopotamiens im 2. Jahrtausend v. Chr.". Motivated by the increase of archaeological and epigraphic sources in recent decades the project aims at an integrated analysis and transparent access of these heterogeneous data. A designed application needs to consider that archaeological data contain absolute geography - the association with a specific geographic location, while epigraphic data imply relative geography - the topological relation of places. The solution is provided by a Web GIS interface supporting scientists to better unders…

Sketch of an automatic image based pollen detection system

2012

The ability of measuring accurately airborne pollen concentration in the environment is an important goal for palynology. It has been unsatisfactory for agile usage to date. Huge volumes of airborne particles prevent palynologists from opportunely processing statistically suitable information. Additionally, measurements from stationary pollen monitors cannot be accurately associated to individuals. In the context of computer vision, this paper presents the outline for the structure of an image based pollen detection system, under the framework of the Personalized Pollen Profiling and Geospatial Mapping project based on individual information of allergic patient profile measured at multiple …

ArchaeoKM: Managing Data through Knowledge in Industrial Archaeological Sites

2011

pas de résumé

ArchaeoKM: Realizing Knowledge of the Archaeologists

2010

The potentiality of ontology within the faculty of archaeology has recently been felt. However, the use of ontology is limited either within the data interoperability for data sharing within various heterogeneous platforms or data integration of heterogeneous dataset. Thus the full potentiality of ontology is still to be realized within the community of archaeology. We are developing a system "ArchaeoKM" which uses ontology beyond data integration. It uses the strength of ontology to reason the knowledge presented within. Additionally, ArchaeoKM involves archaeologists to define their knowledge of an excavation site through domain rules which they define through the descriptions and observa…

Integration, Bewertung und Nutzung heterogener Datenquellen mittels semantischer Werkzeuge

2017

In diesem Artikel stellen wir unsere Forschung in der Integration von Geodaten in einen Semantic Web Kontext in unserem Projekt Semantic GIS vor. Zunächst möchten wir den Zweck und die Vorteile einer Integration und Interpretation von Daten in das Semantic Web beleuchten und anschließend unseren Integrationprozess bestehend aus Datengewin-nung, automatischer Interpretation, Qualitätssicherung und Provenance sowie den Datenzugriff erklären. Um die Anwendung unserer Forschung zu demonstrieren gehen wir auf zwei Anwendungsfälle in unserem Projekt ein: Die Bewertung von OpenStreetMap Daten und die Verbesserung des Katastrophenschutzes mittels semantischem Reasoning. Wir schließen den Artikel mi…