Search results for "vision."
showing 10 items of 4900 documents
Making Industrial Robots Smarter with Adaptive Reasoning and Autonomous Thinking for Real-Time Tasks in Dynamic Environments: A Case Study
2018
In order to extend the abilities of current robots in industrial applications towards more autonomous and flexible manufacturing, this work presents an integrated system comprising real-time sensing, path-planning and control of industrial robots to provide them with adaptive reasoning, autonomous thinking and environment interaction under dynamic and challenging conditions. The developed system consists of an intelligent motion planner for a 6 degrees-of-freedom robotic manipulator, which performs pick-and-place tasks according to an optimized path computed in real-time while avoiding a moving obstacle in the workspace. This moving obstacle is tracked by a sensing strategy based on ma-chin…
Rotation estimation and vanishing point extraction by omnidirectional vision in urban environment
2012
International audience; Rotation estimation is a fundamental step for various robotic applications such as automatic control of ground/aerial vehicles, motion estimation and 3D reconstruction. However it is now well established that traditional navigation equipments, such as global positioning systems (GPSs) or inertial measurement units (IMUs), suffer from several disadvantages. Hence, some vision-based works have been proposed recently. Whereas interesting results can be obtained, the existing methods have non-negligible limitations such as a difficult feature matching (e.g. repeated textures, blur or illumination changes) and a high computational cost (e.g. analyze in the frequency domai…
Advanced teleoperation and control system for industrial robots based on augmented virtuality and haptic feedback
2021
[EN] There are some industrial tasks that are still mainly performed manually by human workers due to their complexity, which is the case of surface treatment operations (such as sanding, deburring, finishing, grinding, polishing, etc.) used to repair defects. This work develops an advanced teleoperation and control system for industrial robots in order to assist the human operator to perform the mentioned tasks. On the one hand, the controlled robotic system provides strength and accuracy, holding the tool, keeping the right tool orientation and guaranteeing a smooth approach to the workpiece. On the other hand, the advanced teleoperation provides security and comfort to the user when perf…
Vision based attitude and altitude estimation for UAVs in dark environments
2011
This paper presents a system dedicated to the real-time estimation of attitude and altitude for unmanned aerial vehicles (UAV) under low light and dark environment. This system consists in a fisheye camera, which allows to cover a large field of view (FOV), and a laser circle projector mounted on a fixed baseline. The approach, close to structured light systems, uses the geometrical information obtained by the projection of the laser circle onto the ground plane and perceived by the camera. We present a theoretical study of the system in which the camera is modelled as a sphere and show that the estimation of a conic on this sphere allows to obtain the attitude and the altitude of the robot…
Omnidirectional vision for UAV: applications to attitude, motion and altitude estimation for day and night conditions
2012
International audience; This paper presents the combined applications of omnidirectional vision featuring on its application to aerial robotics. Omnidirectional vision is first used to compute the attitude, altitude and motion not only in rural environment but also in the urban space. Secondly, a combination of omnidirectional and perspective cameras permits to estimate the altitude. Finally we present a stereo system consisting of an omnidirectional camera with a laser pattern projector enables to calculate the altitude and attitude during the improperly illuminated conditions to dark environments. We demonstrate that omnidirectional camera in conjunction with other sensors is suitable cho…
Accelerated bearing life-Time test rig development for low speed data acquisition
2017
Condition monitoring plays an important role in rotating machinery to ensure reliability of the equipment, and to detect fault conditions at an early stage. Although health monitoring methodologies have been thoroughly developed for rotating machinery, low-speed conditions often pose a challenge due to the low signal-to-noise ratio. To this aim, sophisticated algorithms that reduce noise and highlight the bearing faults are necessary to accurately diagnose machines undergoing this condition. In the development phase, sensor data from a healthy and damaged bearing rotating at low-speed is required to verify the performance of such algorithms. A test rig for performing accelerated life-time t…
Visual contact with catadioptric cameras
2015
Abstract Time to contact or time to collision (TTC) is utmost important information for animals as well as for mobile robots because it enables them to avoid obstacles; it is a convenient way to analyze the surrounding environment. The problem of TTC estimation is largely discussed in perspective images. Although a lot of works have shown the interest of omnidirectional camera for robotic applications such as localization, motion, monitoring, few works use omnidirectional images to compute the TTC. In this paper, we show that TTC can be also estimated on catadioptric images. We present two approaches for TTC estimation using directly or indirectly the optical flow based on de-rotation strat…
Hankelet-based action classification for motor intention recognition
2017
Powered lower-limb prostheses require a natural, and an easy-to-use, interface for communicating amputee’s motor intention in order to select the appropriate motor program in any given context, or simply to commute from active (powered) to passive mode of functioning. To be widely accepted, such an interface should not put additional cognitive load at the end-user, it should be reliable and minimally invasive. In this paper we present a one such interface based on a robust method for detecting and recognizing motor actions from a low-cost wearable sensor network mounted on a sound leg providing inertial (accelerometer, gyrometer and magnetometer) data in real-time. We assume that the sensor…
Adaptive Neural Control of MIMO Nonstrict-Feedback Nonlinear Systems with Time Delay
2016
In this paper, an adaptive neural output-feedback tracking controller is designed for a class of multiple-input and multiple-output nonstrict-feedback nonlinear systems with time delay. The system coefficient and uncertain functions of our considered systems are both unknown. By employing neural networks to approximate the unknown function entries, and constructing a new input-driven filter, a backstepping design method of tracking controller is developed for the systems under consideration. The proposed controller can guarantee that all the signals in the closed-loop systems are ultimately bounded, and the time-varying target signal can be tracked within a small error as well. The main con…
Smart sensing and adaptive reasoning for enabling industrial robots with interactive human-robot capabilities in dynamic environments — a case study
2019
Traditional industry is seeing an increasing demand for more autonomous and flexible manufacturing in unstructured settings, a shift away from the fixed, isolated workspaces where robots perform predefined actions repetitively. This work presents a case study in which a robotic manipulator, namely a KUKA KR90 R3100, is provided with smart sensing capabilities such as vision and adaptive reasoning for real-time collision avoidance and online path planning in dynamically-changing environments. A machine vision module based on low-cost cameras and color detection in the hue, saturation, value (HSV) space is developed to make the robot aware of its changing environment. Therefore, this vision a…