Reconstruction: the Mighty Camera

At the core of DroneDeploy is a product called Map Engine that is able to quickly and accurately reconstruct 3D scenes from a collection of photographs without any prior knowledge of where the photos were taken, or what they contain. This is one of the core problems of the field of photogrammetry which draws on techniques from computer vision and machine learning extensively. Being able to do this is powerful, as a digital camera is a lot cheaper and easier to move around than a 3D scanner but you do need some smart software.

Reconstruction: the Mighty Camera 1

This is the first of three posts describing how this process takes place from beginning to end. We will also be implementing a simple and educational pipeline that reconstructs 3D scenes from 2D images.First we are going to look at some of the fundamentals of cameras and code up some building blocks.

Our story starts with the mighty digital camera. Cameras use light to capture a 2D representation of the 3D world by exposing a sensor to light that is focused through a lens. This creates a digital image.

Photographers talk about cameras in terms of shutter speed, focal length and ISO. Here is a great interactive illustration of how these factors affect the final image.In computer vision we approach cameras differently and are concerned rather with the external and internal geometry of the camera.

The external geometry, called the extrinsics represents how the world is transformed relative to the camera when we look through it. Its usually more intuitive to specify where the camera is in the world than how it transforms the world though. This is called the pose and we specify it as a matrix [R | t]where R is a 3x3 rotation matrix and t is a 3x1 translation vector.

Reconstruction: the Mighty Camera 2

The extrinsics are then E = [R',-R'*t]. This inversion of the pose transforms the world so that we are effectively looking down the optical axis of the camera. Next we have the internal geometry of the camera, called the intrinsics which represent a conversion to pixels.

Two important values here are the camera center (also called the principal point) and the focal length. Together in 3x3 matrix as K this represents a scaling and translation. This is is as mapping pixels into the image based on the field of field of the camera and where the pinhole of the camera is.

We can now create a projection matrix as P = K * E. Together the camera projection matrix can be thought of as acting on a 3D point as a rotation translation, followed by a translation and scaling yielding the final image coordinates. Which might call off the edges of the image depending on the resolution in pixelsProjectionLets implement a simple pinhole camera.

We can now use the projection matrix of a camera to transform 3D world points to 2D image coordinates. We represent out world coordinates at 4D homogenous coordinates and then multiple by the projection matrix and normalize to get image coordinates. Lets test this out by creating some 3D world points.

Well create the vertices of a cube and place the camera backwards long the z-axis. Well then project each of the vertices of the cube into the camera and we should get a 2D representation. The resulting image shows our cube and correctly captures the perspective introduced by the back face being further from the camera than the the front.

Aside: DecompositionWe can also go backwards and decompose the projection into its K, R, t components remembering that the structure is P = K[R | -R'*C]we can first extract t and decompose the remainder to get K and R. Unfortunately this decomposition is not unique because if you take the resulting R and Q matrices from the RQ decomposition and negate a row and corresponding column of R and Q the resulting projection matrix is the same. Positioning the cameraUp until now weve just had our camera looking down the z-axis which isnt that exciting.

We want to fearlessly be able to place our camera anywhere and pointing in any direction. Placing the camera anywhere is easy we just specify the position t. Pointing it in any direction is a bit less intuitive because we have to specify the orientation as a rotation matrix.

One way to do this is to construct the rotation matrix of the pose as the axes of the camera in world coordinates with the first axis being the direction the camera is pointing and the other two: a vector through the top of the camera and a vector through the side of the camera. Heres a function to position the cameras somewhere looking at a certain point:Implementing this we can position the camera anywhere and look in any direction. Lets test it out and position the camera randomly around our cube and use our existing projection code to look at the cube from different anglesYoull notice an optical illusion here in that the cube will look skew in some images.

As your eyes sort out the orientation you will see them square up. The reason is because we arent sorting the edges by their depth from the camera meaning some lines in the 2D images are draw over other lines that they should be behind. If we wanted to clear this up we should sort our geometry by their depth from the camera and render in that order.

Some more visualizationNow that we can position and look through arbitrary cameras lets visualize the camera positions instead of just what they see. We can do this my placing another camera looking at the whole scene of cameras and render the position of each camera along with its axes and frustum. The result is our whole scene of cameras looking as our cube.

TriangulationNow we should be pretty comfortable with cameras and mapping the 3D world to 2D images. But can we go backwards? Lets try and reconstruct the 3D vertices of the cube from a 2D picture.

Unfortunately we cant do this from a single view because a pixel corresponds to a ray extending out into the real world and the 3D point could lie anywhere along that ray. But if we had a few different poses of the camera the rays should pass through the same corresponding pixel each image and intersect at a unique point in the 3D world. Take a look at this picture to convince yourself that you need at least two pixels to reconstruct a 3D point.

If we take two images of our cube and write out how two 2D pixels were computed from the 3D points using the two projection matrices ( P1 and P2 ) we end up with a linear system of equation. We could try and solve this but a couple of things go wrong here, the matrix is typically not square (unless you have two views and so the inverse doesnt work. A better and more numerically stable way is to instead look as it as a homogeneous systems of equations.

This has a trivial solution at 0 0 0 which we are not super excited about but if we take the singular-value decomposition (SVD) of this matrix and take the singular vector corresponding to the smallest singular value we get a solution to the system with some useful additional properties. In particular it constrains the solution vector to have a magnitude of 1 so avoids the trivial solution. Its also numerically stable and when use to solve over-determined systems naturally.

Lets code this up and create a function that takes a list of cameras and corresponding list of image coordinates and triangulates them.More triangulationThe SVD based triangulation makes two assumptions. The first is the error term we are looking to minimize and the second is how the camera operates on 3D points namely as a linear operation.

We can also triangulate points using a non-linear solver. We can frame this as a problem where we seek the X, Y, Z coordinates in the world such that they project into the corresponding image coordinates in each camera we are considering. We can use something like LevenbergMarquardt to solve this problem.

Although this takes longer than our analytical solution it allows use to be more flexible about some things. For example instead of least square we can use different norms like the Huber norm to handle outliers in our data. This is useful as we will see in the next post where we dont know exactly where our 3D and 2D points are.

Another advantage is that we can use more sophisticated camera models that cant just be represented as a matrix multiplication.DistortionWe just mentioned more sophisticated camera models up until now we have dealt just with an ideal camera called a pinhole camera. In the real world cameras are not as perfect.

Due to imperfections and tolerances in the manufacturing process each camera is slightly different and also the lens used can introduce types of distortion. For example a photograph of a scene with perfectly straight lines may appear to bend in the image. This can cause problems if not handled correctly as typically the reconstructions are used for measurement and planning.

Heres a simple implementation of a BrownConrady camera model:Now lets vary some of the radial and tangential distortion parameters and see what it does to our cube projection.Unfortunately the distortion parameters are not printed on the box of the camera and have to be estimated from the correspondence between between coordinates in different images. This is something we will be solving in the next post.

So that completes our brief walkthrough of camera fundamentals. Weve talked about how to position cameras in the world and view a scene from different locations. We looked at constructing and decomposing the projection matrix.

Weve also looked at reconstructing the position of 3D world points from 2D image coordinates. In the following posts we will tackle the problem of reconstructing 3D scenes using these fundamentals but without any ground truth data like our cube

HOT PRODUCTS
sin datos
GET IN TOUCH WITH US
Artículos recomendados
Fundas
What Is the Difference Between Intelligent Gate and Traditional Gate_ Taigewang Technology
What Is the Difference Between Intelligent Gate and Traditional Gate_ Taigewang Technology
With the continuous development of the automobile industry and the continuous increase of the number of vehicles, the demand for parking lot gate equipment for intelligent management vehicles in the parking lot is also increasing, and colleagues also put forward higher requirements for the performance of parking lot gate. Early road gates usually had a series of disadvantages, which often caused accidents when the gate rod landed, and were easy to cause damage to pedestrians and passing vehicles. The emergence of intelligent gate greatly reduces the occurrence of such accidents. Let's take a look at the difference between intelligent gate and traditional gate! 1: The utility model has the advantages of simple structure, stable operation, automatic pole lifting and convenient installation and maintenance. 2. The crank connecting rod mechanism is adopted for transmission, which reduces mechanical failure, low noise and no pollution. 3. The photoelectric limit control system with high sensitivity is adopted, which has reliable operation and accurate limit. 4. Special manual and automatic pole lifting devices are adopted, so that the gate can lift the pole manually even in the case of power failure, It does not affect the normal passage of vehicles. At the same time, the gate has a variety of control modes, supporting control modes such as wire control, remote control and communication protocol. 5: the intelligent gate has the anti smashing function to effectively prevent the gate rod from accidentally injuring vehicles and pedestrians. As an important part of the parking lot gate system, the gate plays a decisive and key role. Different functional gates are very important for the layout of the parking lot system.
What Factors Affect the Price of Parking Lot Management System_ Taigewang Technology
What Factors Affect the Price of Parking Lot Management System_ Taigewang Technology
As we all know, the diversified functions of the parking lot management system now play an important role in our life, so it can be seen in various public places such as communities and shopping malls. With the continuous development of society and economy and the continuous advancement of urbanization; Parking lot management system plays an important role in people's life. It has become one of the indispensable vehicle management equipment in people's life. Different functions, different workmanship and different services directly determine the price of the parking lot management system. First, the function of the parking lot management system: the function of the parking lot management system is one of the important roles in determining the price of the parking lot management system, because with the increase of vehicles, people's demand is increasing. For the convenience of parking, people's requirements for the parking lot are becoming higher and higher. Vehicles at the entrance and exit pass quickly, find parking spaces quickly, find parking positions quickly Rapid payment, etc. the increase of these functions will affect the price of the parking lot management system. Second: the manufacturing process of the parking lot management system: the complexity of the manufacturing industry and the level of the manufacturing process of the parking lot management system are also the influencing factors of the price of the parking lot management system. The more complex the manufacturing process of the parking lot management system is, the higher the cost will be. Similarly, the appearance of the parking lot management system will become more high-end and the longer the service life will be. Third: after sales service of the parking lot management system: large enterprises will have a good after-sales service for their products, which is also a guarantee for consumers. Consumers can buy the products at ease without worrying about the situation that no one cares if they are broken. Therefore, even if the price is a little expensive, consumers are willing to accept it.
How to Select a Parking License Plate Recognition System to Meet the Needs According to the Special
How to Select a Parking License Plate Recognition System to Meet the Needs According to the Special
The main characteristics of public parking lot are temporary parking, most users use it once, short parking time, frequent access, etc. According to these characteristics, the design of parking license plate recognition system should meet the functions of simplicity and practicality, standardized charge management, and reducing parking operation cost. 1、 The parking lot shall be equipped with parking space guidance function, and the screen displaying the remaining parking spaces shall be set at each main entrance of the parking lot, and the remaining parking spaces in each area shall be displayed separately. The system information screen at each front door of the parking lot displays the division details of the parking lot area, which can correctly guide the driver to park in the fastest way. 2、 With real-time monitoring function. Pay attention to the safety of the parking lot, have the functions of car image comparison, monitoring incoming and outgoing vehicles and storing vehicle data, and make sufficient data records to deal with abnormal events and effectively protect the safety of vehicles. 3、 Meet users' rapid access. In order to meet the fast traffic of fixed users, a license plate recognition system shall be equipped to allow fixed users to pass directly, speed up the traffic speed and alleviate the congestion of access lanes in peak hours. 4、 The equipment is simple and easy to use. Some parking lot equipment are properly equipped with voice broadcasting and LED display functions to guide the operation of vehicles entering and leaving the site, so as to avoid the blockage of entrances and exits caused by some users not knowing to use the equipment.
Today, with the General Trend of Intelligence, the Demand for Parking Lot Management System Continue
Today, with the General Trend of Intelligence, the Demand for Parking Lot Management System Continue
With the rapid development of China's economy, the number of cars is gradually increasing, and the parking problem is imminent. The development of the overall parking management and guidance system is still in its infancy. At the same time, with the continuous expansion of the scale of the parking lot, the demand for the parking lot management system is increasing. With the change of demand, the parking lot management system is mainly reflected in its intelligence. At present, image comparison technology is often used. This technology combines IC induction card and image recognition, and plays a very important role in parking lot management; Secondly, the design of the parking lot system software also reflects the strong anti-interference ability. For the harsh environment, it can resist interference, reduce the occurrence of faults, ensure that it can continue to operate under special circumstances such as network interruption and computer failure, and ensure that all entrances and exits can still work normally. In view of the current situation of the parking lot market, there is no standardized standard, and there is a lack of overall normative basis in the process of construction. Although some parking lots have installed systems, they have not played a corresponding effect. Although the entrance and exit management and charging can be strictly guarded, there is still a blank field for parking space guidance and vehicle search, Compared with foreign intelligent parking system, after more than ten years of development and technical precipitation, China's equipment has been able to catch up with foreign similar products. Combined with the actual situation of domestic parking, we can fully show the advantages of parking system manufacturers. Based on modern electronic and information technology, the parking lot management system installs automatic identification devices at the entrance and exit of the parking area, and implements intelligent management such as judgment and identification, access / rejection, guidance, recording, charging and release of vehicles out of such area through non-contact card or license plate recognition. Its purpose is to effectively control the access of vehicles and personnel, Record all details and automatically calculate the charging amount to realize the safety management of vehicles and charges in the site.
Why Does the Traditional Parking Lot System Need Intelligent Transformation_ Taigewang Technology
Why Does the Traditional Parking Lot System Need Intelligent Transformation_ Taigewang Technology
With the development of society, the progress of technology and the vigorous development of Internet technology, more and more parking lots use intelligent devices to improve management efficiency through access to the Internet. The traditional parking lot system can no longer meet people's needs because of personnel cost and management efficiency. Parking lot managers have transformed and upgraded the traditional parking lot system one after another. At present, the traditional parking lot management system is prone to congestion at the entrance and exit of the parking lot during the rush hour. The traffic efficiency is very low, followed by the simple function of the system. It only plays the role of one car and one gear in the parking lot, and does not have the functions of helping car owners find parking spaces, find cars and pay fees quickly. The adopted manual charging also faces problems such as fund loopholes, card collection and change. Through LAN communication, it is necessary to install an independent database and front-end display in the parking lot during installation, and the client software is installed and run on the front-end display, which is not only large quantities and time-consuming, but also poor system scalability and maintenance. In contrast, the intelligent parking lot management system adopts the full-automatic computer management mode. From the exit of the parking lot to the road gate and then to the management center, all use the automatic control of the computer, which is very convenient for management, and the vehicles enter and leave the parking lot very quickly. In addition, it can easily realize unattended operation at the entrance and exit and automatic charging, which can greatly save the cost. Therefore, the intelligent parking lot system that can meet the needs of managers and car owners has very high potential and broad development prospects in the future. The transformation of traditional parking lot system can adopt advanced license plate recognition technology to clearly capture vehicle information and character images, so that car owners can pass in and out of the parking lot without stopping. It can also monitor the operation status of all online equipment, realize equipment fault pre discovery, self repair, real-time query of various report functions, and provide customers with a variety of pictures to query the on-site situation. It has the ability to query the charging amount in real time. The system breaks through the regional restrictions and realizes the remote management throughout the country. The car park charging system adopts automatic toll collection. It supports the popular mobile payment (Alipay, WeChat) owners who can pay app scan or login special parking APP to pay. The whole process is fast and convenient.
What Are the Parts of Community Entrance and Exit Management_ Taigewang Technology
What Are the Parts of Community Entrance and Exit Management_ Taigewang Technology
The entrance and exit management of the community is divided into two parts: personnel management and vehicle management. The first is personnel management: with the wide promotion of biometric technology and the maturity of system integration, personnel channel management can adopt IC card, ID card, fingerprint, QR code, face recognition, human body recognition and other authentication methods. After residents enter the community, owners and residents can automatically identify. After being identified and confirmed by the system, the owner does not need to manually identify the entry, and the gate will automatically open and light the corresponding floor. The personnel intelligent access control system aims to prevent unauthorized personnel from entering, facilitate the access of the owner, and calculate the number of people entering and leaving the community. Based on biometric applications such as face recognition, it provides safer and more convenient travel modes for owners and visitors. The second is vehicle management: the intelligent parking lot system can not only identify vehicle information and control vehicle passage, but also manage incoming and outgoing vehicles and help residents Park and find vehicles quickly. It mainly integrates radio frequency identification technology and video identification technology, establishes an intelligent monitoring bayonet, and collects the owner's license plate information in advance. The entrance and exit system supports efficient vehicle identification and gate release, and supports the release of the visitor's pre registered license plate information without re verification, and pushes the visitor's access information to the respondent's visual walkie talkie. It not only changes the single identification method, but also realizes the interaction between personnel, vehicles and bayonets, and can access the social security system to facilitate public security inspection. More importantly, it improves the accuracy and timeliness of cracking down on vehicle illegal activities. Better safeguard social stability.
Intelligent Parking System: Intelligent Security, Escort for You_ Taigewang Technology
Intelligent Parking System: Intelligent Security, Escort for You_ Taigewang Technology
In order to meet the market demand and give users more choices, the parking lot system has many intelligent functions to meet the use of different places, create a good parking environment for people and make people parking safer. Intelligent parking lot system combines modern advanced technology and products to realize intelligent management of vehicles. It has a wide variety and complex functions. We can equip different parking lot equipment according to people's requirements and on-site environment. At present, for vehicle management in parking lots, license plate recognition is widely used. For example, in some large parking lots, communities, institutions and other places, intelligent license plate recognition system can track and capture vehicles and improve people's parking safety. The high-performance and multi-functional parking lot system has a good market prospect and great application space and potential, which has played a positive role in promoting the intelligent transportation in China. Intelligent parking lot system is a set of intelligent equipment integrating video acquisition, vehicle detection, license plate recognition, voice number reporting, intelligent analysis of recognition results, automatic alarm, remote duty and remote monitoring. The whole process does not need manual processing, so that car owners can realize non-stop operation, save time and improve the efficiency of vehicle entry and exit management. The process of social development and modernization is very fast, and the number of cars in the city is also increasing, resulting in the increasing traffic flow in the parking lot. Naturally, the intelligent parking lot system will be used more and more in life and play a more and more important role.
License Plate Recognition System Changes the Management Mode of Parking Lot_ Taigewang Technology
License Plate Recognition System Changes the Management Mode of Parking Lot_ Taigewang Technology
With the increasing development of technology, it not only brings many conveniences to people's daily life, but also solves many problems. The difficulty of parking outside is one of them. Now, thanks to the development of technology, parking lot management has entered the era of automatic management of license plate recognition, which has brought earth shaking changes to parking lot management. The intelligent license plate recognition system adopts advanced license plate recognition algorithm, which can quickly recognize the license plate information. It is that vehicles entering the parking lot can pass through without stopping. The entrance greatly reduces the waiting time of vehicles in line. The system is generally composed of license plate recognition camera, relevant billing software, billing display screen and intelligent gate. It is the mainstream system of parking lot management. The whole system includes entrance equipment, exit equipment, charge management equipment and image comparison equipment. Through the intelligent license plate recognition system, vehicles can pass in and out without stopping, and temporary vehicles can pass in and out without stopping. The whole license plate recognition parking lot system has the advantages of simple structure, stability and reliability, and convenient installation, maintenance and use. Many large parking lots have a large daily traffic flow and a large amount of data. This requires that the security of intelligent license plate recognition system has high requirements. Choosing a professional manufacturer of intelligent license plate recognition system can provide the safest protection for the parking lot, reassure the owners and save the parking lot administrators. As a product of the intelligent era, intelligent license plate recognition system will have unlimited development in the future. It will become an important part of leading the progress of parking lot management. Nowadays, many parking lot equipment manufacturers continue to innovate, aiming at realizing unattended parking lot, develop rapidly, and provide people with intelligent, safe and convenient parking life.
What Is the Difference Between Intelligent Gate and Traditional Gate_ Taigewang Technology
What Is the Difference Between Intelligent Gate and Traditional Gate_ Taigewang Technology
With the continuous development of the automobile industry and the continuous increase of the number of vehicles, the demand for parking lot gate equipment for intelligent management vehicles in the parking lot is also increasing, and colleagues also put forward higher requirements for the performance of parking lot gate. Early road gates usually had a series of disadvantages, which often caused accidents when the gate rod landed, and were easy to cause damage to pedestrians and passing vehicles. The emergence of intelligent gate greatly reduces the occurrence of such accidents. Let's take a look at the difference between intelligent gate and traditional gate! 1: The utility model has the advantages of simple structure, stable operation, automatic pole lifting and convenient installation and maintenance. 2. The crank connecting rod mechanism is adopted for transmission, which reduces mechanical failure, low noise and no pollution. 3. The photoelectric limit control system with high sensitivity is adopted, which has reliable operation and accurate limit. 4. Special manual and automatic pole lifting devices are adopted, so that the gate can lift the pole manually even in the case of power failure, It does not affect the normal passage of vehicles. At the same time, the gate has a variety of control modes, supporting control modes such as wire control, remote control and communication protocol. 5: the intelligent gate has the anti smashing function to effectively prevent the gate rod from accidentally injuring vehicles and pedestrians. As an important part of the parking lot gate system, the gate plays a decisive and key role. Different functional gates are very important for the layout of the parking lot system.
Taigewang Intelligent Creates a Cloud Parking System in the Internet Era_ Taigewang Technology
Taigewang Intelligent Creates a Cloud Parking System in the Internet Era_ Taigewang Technology
Now people's definition of the parking lot system has gradually extended from the initial entrance and exit gate rod lifting equipment to a very broad category, that is, booking parking spaces, parking, looking for cars, paying fees, including the centralized management of the parking lot. Modern parking lot system also realizes the unmanned management mode from card ticket management, Bluetooth remote recognition, license plate recognition and other technologies. People park not only to find a place to park, but also to enjoy a safe and convenient parking environment. Entering the Internet plus era, the popularity of big data, cloud services and mobile devices has further stimulated Yunan security's development and application. When security and Internet are combined, networked information transmission, comprehensive function derivation, convenient user management and optimized experience make the traditional parking lot system developed for more than 20 years break through and leap again. Cloud parking, as the name suggests, is to centrally manage the parking lot, realize cross regional resource integration, and realize a new leap in the functions of the traditional parking lot system through Internet technology. The parking cloud platform is composed of cloud management platform, parking lot equipment and terminal equipment, aiming at the application of the parking lot system Design according to the needs of platform management and people's parking requirements, so that the parking lot manager and car owners can follow the reasonable and convenient operation requirements, meet the needs of the project, and expand the customized innovation function. The use of the Internet-based parking lot system in the cloud can realize real-time query, achieve network wide interoperability, provide real-time comprehensive data for the parking lot management, and facilitate timely adjustment according to the use of parking spaces in the parking lot. Almost every parking lot is inseparable from the parking lot system. The linkage expansion function with the third-party platform plays a very important role in the construction of smart city.
sin datos
Shenzhen TGW Technology Co.,Ltd es el proveedor líder de soluciones de control de acceso para el sistema de estacionamiento inteligente de vehículos, el sistema de reconocimiento de matrículas y los torniquetes de control de acceso peatonal y terminales de reconocimiento facial.
sin datos
Contáctenos

Shenzhen TigerWong Technology Co.... Ltd

Tel: 86 0755-23773884  

Correo electrónico: Info@sztigerwong.com

Añadir: Sala 601-605, Edificio 6, 1980 Parque Industrial de Ciencia y Tecnología,  Longhua Street... Longhua District... Shenzhen

           

Copyright©2021 Shenzhen TigerWong Technology Co.... Ltd   | Sitemap
chat online
Please message us and we’ll be sure to respond ASAP, what product you intrested in?