Project: DEVELOPMENT OF A COMPLETENESS INSPECTION SYSTEM IN 3D FOR INDUSTRIAL ANALYSIS
Completeness inspection is an important step in industrial assembly processes. It is usually an end-of-line inspection to check whether any parts are missing and whether they are correctly positioned and assembled. Completeness inspection with cameras in 2D faces a few challenges that are hard to overcome with conventional methods:_x000D__x000D_(1) Limited contrast: the single parts that should be seen cannot be identified in the current view because of low contrast compared to the background. _x000D__x000D_(2) Only rough presence detection: 2D systems are often only able to detect the presence/absence of parts, but are usually unable to check e.g. whether a plug is securely mounted._x000D__x000D_(3) Non-rigid parts: parts such as cables, hoses or similar, can change their shape with a very high degree of variation. They cannot be fully inspected without information about depth._x000D__x000D_The CO source of all these problems is the fact that 3D information is missing and that it is economically infeasible - and some times even not possible- to obtain an optimal view of each single part of the assembly. _x000D__x000D_We will solve this problem by developing a technology that allows the creation of a 3D appearance model from a number of regular 2D images taken with conventional cameras. From this set of oblique images we produce “ortho-images” that represent a parallel, orthogonal projection of the object, similar to technical line drawings, but extended with color and texture. This enables us to calculate a very large number of views of the object, each chosen in such a way that the part to be inspected can be optimally seen in the image._x000D__x000D_With this technology we will be able to substantially extend the capabilities of completeness inspection systems. The target market will be end-of-line inspection systems for manufacturing and assembly lines with cycle times in the range of 2-30 seconds. The resulting product will be called CIS-3D and will consist of an image acquisition system, including high-resolution cameras and illumination, and a software that performs completeness inspection on an arbitrarily large set of ortho-images that are generated from a few oblique 2D images._x000D_The intended market of the CIS-3D product is machine vision companies and system integrators. The machine vision market in Europe has a size of approximately 3.000 MEURs. In the area of “discrete inspection”, which amounts to 40% of all machine vision systems, the subtopic of “completeness inspection” accounts for roughly 50% of the applications. Thus it's aiming at a significant share (20%-25%) of all machine vision applications. In addition to this the technology has a high potential of opening new market opportunities, because many of the applications that involve very complex assemblies, detailed inspection and non-rigid objects are among those that are not yet solved._x000D_The leading SME in the project is METRIA, who have developed a technology for the fast conversion of oblique 2D images into 3D appearance models. This technology has so far been used for documentation of cultural heritage and architecture and will now be transformed for the use in industrial completeness inspection._x000D_The consortium is completed by two SMEs, and a research centre. There is also a subcontractor for the technical development of some activities._x000D_Profactor is an Austrian RTD performing SME working in the field of production technologies. They have developed a method for very simple and efficient completeness inspection. Their methods will be adapted to be used on the specific images created by METRIA’s technology._x000D_CORTEX Ltd, is an SME specialized on artificial vision products and solutions. They have access to the industry needs and the potential demands_x000D_MTA-SZTAKI CÍM-Laboratory is an eligible EUROSTARS participant according to the Hungarian EUREKA Officer and it’s integrated cooperation with Cortex Technical R&D Ltd. forms a valuable Pship and will technically support the integrators tasks._x000D_Profactor will in this workpackage extend their existing “Complete Inspect” Software for the integration of CIS-3D. “Complete Inspect” is a software tool, that tightly integrates machine vision and robot control. I has an extremely simple user interface for the acquisition of a series of 2D images. This software will be enhanced in order to deal with the specific requirements of CIS-3D such as marking an illumination.
| Acronym | CIS3D (Reference Number: 5089) |
| Duration | 01/03/2010 - 31/12/2012 |
| Project Topic | The objective of this project is the development of applications of three-dimensional partial restitution of surfaces using the generation of disparity maps from photgrametry techniques. This "true" photographs will be used for the completeness analysis. The final product will be a CIS-3D. |
|
Project Results (after finalisation) |
Sequenzer Hardware suitable for image generation of ortho images for inspection of industrial parts._x000D_Virtual sensor framework software with algorithms for completeness inspection_x000D_Detailed algorithms for jumper inspection, signature inspection and wire inspection_x000D_ |
| Network | Eurostars |
| Call | Eurostars Cut-Off 3 |
Project partner
| Number | Name | Role | Country |
|---|---|---|---|
| 4 | CORTEX Technical R&D Ltd | Partner | Hungary |
| 4 | METRIA DIGITAL S.L. | Coordinator | Spain |
| 4 | MTA-SZTAKI Szamitastechnikai es Automatizalasi Kutato Intézet | Partner | Hungary |
| 4 | PROFACTOR GmbH | Partner | Austria |