Monday, 13 August 2012

Digital Visual Interface


         Digital video generated by computers are converted into analog signals (Red, Green, Blue video signals) by video graphics card and fed to CRT monitor. As present day plasma, LCD flat panels are digital in nature, generated analog signals are once again converted into digital and fed to display devices. This method is inefficient due to following reasons. First, Digital-to-Analog and Analog-to-Digital process causes loss of image quality. Second, a digital interface can make entire conversion process as well as associated hardware redundant.  A low cost, universally accepted as well as versatile digital interface evolved and it was called Digital Visual Interface (DVI). This was extended for high end devices and called as High-Definition Multimedia Interface (HDMI).


Before getting into the details of DVI technology we have to learn about the need for the technology.

Resolution Name                         Pixel Resolution
Video Graphics Array (VGA)             640 x 480
WVGA                                              854 x 480
Super VGA (SVGA)                         800 x 600
Extended Graphics Array (XGA)     1024 x 768
WXGA                                           1280 x 768
Super XGA (SXGA)                      1280 x 1024
WSXGA                                        1600 x 1024
Ultra XGA                                     1600 x 1200
High Definition TV (HDTV)           1920 x 1080
Quad XGA (QXGA)                     2048 x 1536

Table 1. Resolution Name and Pixel Resolution (Ref. [1], [3])

Resolution name and other details are specified by Video Electronics Standards Association (VESA). The monitor refreshing rates available are 60Hz, 75Hz and 85Hz. Higher the refreshing rate is always better. Now we will calculate the amount of data digital interface has to carry from the computer to display device. 

Data carried = No of horizontal pixels x No of vertical pixels x refreshing rate x Blanking

For a monitor with SXGA resolution and 85Hz refreshing rate, will generate 55 Mega pixels(Mp) data per second for one colour. For three colours it will be 155 Mp per second. This will amount to whopping 1.6 Gbps data rate (155 M pixels and each pixel with 10 bit representation; Yes, 10 bits). Beyond two Gbps it is not possible to send through twisted pairs. This phenomenon is called "Copper Barrier". Data generated by QXGA monitor with 85 Hz refreshing rate is 350 Mp per second. The required bit rate exceeds the copper barrier. So two links are used instead of one. Coaxial cables, Waveguide are other transmission media that can handle two Gbps data rate with ease. But they are expensive compared to twisted pair. In DVI 1.0 specification they have not mentioned the term "twisted pair" explicitly. This term is used in the reference material [1].




                   
In April 1999 DVI 1.0 specification was released by Digital Display Working Group (DDWG).  Its Promoters are Intel, Compaq, Fujitsu, HP, IBM, NEC and Silicon Image. Transition Minimized Differential Signaling (TMDS) technology used in DVI was developed by Silicon Image Inc and connecters were developed by Molex Inc. The first digital standard "Plug and Play" was developed by Video Electronics Standards Association (VESA).  Few years later, "Digital Flat Panel" interface was developed by consortium of Compaq Corporation and its associates. Due to various reasons both standards were not very successful. DVI is backward compatible with analog VGA, Plug and Play and Digital Flat Panel.


DVI have two types of connectors namely DVI-Integrated (DVI-I) and DVI-Digital (DVI-D). 29 pin DVI-I have allotted five pins for analog video and 24 pins for two digital video links. Analog video pins are Red, Green, Blue, Horizontal sync and analog ground. Digital video pins can be grouped into data channels and control signals. There are six pair of data channels to carry  two R’, G', B' colour signals. The difference between RGB and R'G'B' will be discussed in upcoming blog post. Remaining 12 pins carry clock signals and other things. 24 pin DVI-D is designed to carry digital video only. 

TMDS is an electrical technology used to transmit data from computer to display device. Twisted pairs are susceptible to noise and electromagnetic interference (EMI). In differential signaling, one and zero are encoded not in absolute terms but in relative terms. This makes them to be immune to noise. A sharp spike in one twisted pair can create an EMI in adjacent twisted pair. So it becomes necessary to reduce the steep transition in signals.  This is done at the cost of 25 percent increase bit representation (10 bits instead of 8 bits). Earlier to TMDS, Low Voltage Differential Signaling (LVDS) was used in digital interface standards. LVDS was developed by National Semiconductors to transfer data between notebook computer’s CPU to LCD display. This is optimized for short cable length and not for long lengths.

References
  1. “White paper on DVI”, by Infocus Incorporation, available Online from http://electro.gringo.cz/DVI-WhitePaper.pdf
  2.  DVI specification from DDWG,  available Online from http://www.ddwg.org/lib/dvi_10.pdf
  3.  Keith Jack, “Video Demystified: A handbook for the digital engineer”, 5th edition, Publishers:- Newnes , 2007. ISBN: 978-0-7506-8395-1, Indian reprint 978-81-909-3566-1. Rs. 800.
  4.  Pin diagrams of DVI, available Online from http://www.te.com/catalog/Presentations/dvipresentation.pdf

Tuesday, 24 July 2012

Super Hi-Vision

         British Broadcasting Corporation will test broadcast London 2012 Olympics footages in the latest Super Hi-vision (SHV) television format. This format has 16 times the resolution of the existing High Definition TV format and with 22.2 multichannel surround sound. This provides a amazing picture quality and viewers feel a strong sense of reality. One can watch Olympics in Super Hi-vision theaters in  BBC Broadcasting House in London , BBC Pacific Quay in Glasgow and  National Media Museum, in Bradford.  SHV was developed by NHK (Nippon Hōsō Kyōkai) in English it is Japan Broadcasting corporation.


This ultra high definition televsion format has 4000 scanning lines and it contains 7680x4320 pixels per frame. SHV camera uses 8 megapixel CCD camera. It uses four channels Green1, Green2, Red, Blue, instead of traditional Red, Green, Blue channels. Thus around 32 mega pixel data is generated for every frame. It uses MPEG-2 video compression format with 4:2:2 sampling format. AVC/H.264 codec are reconfigured to transport SHV signals to mobile devices. SHV has a angular resolution 40 to 50 degrees, which gives the sense of realness. It has 60 frames per second instead of the conventional 25 frames in PAL and 30 frames in American NTSC colour system.

It needs 24 speakers to create a 3D spatial impression to the viewers. This helps to augment the sense of reality. It has 9 speakers in upper layer frequency, 10 speakers for middle layer frequency, three speakers in lower layer frequency and at last two speakers for  low frequency effect . It uses 48 KHz sampling rate, 24 bit Pulse Code Modulation which results in 28 Mbps or Dolby-E systems having 7 Mbps.

Researchers at NHK used to phychological methods to figure out the relationship between sense of reality verses the viewing angle. They found  higher the viewing angle more the feel the reality. Viewing angle below 40 fail to provide any reality feel. From 40 to 80 sense of reality increases with the viewing angle. Increase in viewing angle beyond 80, do not dramatically increase the 'feel'.

In 1953 televisions had a screen size was 12 inch.  Fourteen inch colour  TV's  emerged after 1960. Size grew to 20 inch in 1975 and it reached 29 inch in 1990. Beyond this size conventional Cathode Ray Tube (CRT) cannot be manufactured. So 50 inch LCD or LED Flat screens were developed in 2006. Viewing distance and resolution has a direct relationship. Optimal viewing distance of conventional TVs are four to six times the diagonal of the TV. For a TV having a diagonal size of 21 inch, needs a viewing distance of seven feet.  Thus size of the room limits the size of TV screen.  So it becomes necessary to increase resolution to have bigger screens at home.

An uncompressed SHV signals require around 50 Gbps and with digital compression bit rate requirement will be between 200 Mbps to 400 Mbps.The present 12 GHz systems can handle upto 52 Mbps. So they move to 21GHz range of frequency (21.4 GHz-22.0 GHz). But at this frequency rain act as a spoilsport. Non-real time broadcasting is used to combat rain attenuation effects.

 Khushu National Mueseum's  SHV theater was inaugurated in October 2005.  This  is the first time  SHV  system was deployed for public use.

SOURCE:
  • Steps Towards the Practical use of Super Hi-vision by M. Maeda et al from NHK Science and technical Research laboratories.
  • "Super Hi-Vision -  research on future ultra HDTV system", article by Masayuki Sugawara, NHK, EBU Technical Reveiw - 2008 Q2
  • S.Sakaida, N. Nakajima, A. Ichigaya, and M. Kurozumi, "The Super Hi-Vision Codec," Proceedings of ICIP 2007, pp. 21-24.
  • Transmission Techniques for Broadcast Satellites in the 21-GHz Band aiming for "Super Hi-Vision" Broadcasting, Broadcast Technology No.24, Autumn 2005 pp 8--13
  • http://www.bbc.co.uk/blogs/bbcinternet/2012/07/super_hi_vision_ultra_hd.html

Saturday, 14 July 2012

Embedded Vision Systems

       Microsoft Kinect product is used as  novel input interface for 'XboX 360' game console.  Kinect is a perfect example for embedded vision system. Eight million Kinect sold, just within two months of the launch. It shows the  power of embedded vision system.
     Embedded Vision can be defined as a microcontroller based system that incorporate vision sensor (ex. camera) and able to understand the environment through the sensor. Digital camera is a microcontroller based system that contain vision sensor . Outcome of digital camera will be pictures. But camera is incapable of interpret the pictures it took. So digital camera is NOT a embedded vision system. System on Chip (SoC), Graphical Processing Unit(GPU) , Digital Signal Processor(DSP) and Field Programmable Gate Array (FPGA) can be used in place of Microcontrollers. General purpose personal computer strictly No-No. Smart phones, tablet computers and surveillance system can be upgraded to embedded vision system.
Applications:
  • To find a child that is struggling in swimming pool.
  • To find intruder(s)
  • To detect whether lane change has occurred  or not and if occurred then warn driver of automobile.
Embedded vision system will carry out following three functions
1. Image acquisition and optimization
  •  Noise reduction, image stabilization and colour space correction
  • Outcome of optimization stage, need not be aesthetically pleasing pictures but they should be easily processable by further stages.
2.  Building objects through pixels
  •  First level operations used are  Image  filtering, Haar filters, Edge detection, Histogram, Optical flow, Erosion and dilation, Thresholding.
  • Second level operations used are Connected component labelling, contour tracing, clustering and hough transform

     3. Object analysis and interpretation
    • object movement tracking, classification, obstacle detection
    • Kalman filters as predictive filters, hidden markov models correlation, finite state models, neural networks All the above operations are  computation intensive. Extensive DSP algorithms are also used.                                                                                                                                                         
    Embedded Vision Alliance  is a organisation that look into every aspect of embedded vision.  It's website address is  http://www.embeddedvision.com/ . In the website go to 'Industry analysis' in that go to 'Market Analysis'. This section seems to be very informative. 'News' section gives a reasonable  amount of information.  'Technical Articles' section needs registration. Most of the website content, directs us where information available than providing them. There are no advertisement section. Website has professional look. It is worth visiting the site.

     The following link gives how much importance IEEE gives embedded vision technology.
    A note on DSP
    linear filtering is an convolution operation. After the advent of Fast Fourier Transform (FFT) it became desirable to transform the signal into frequency domain and multiply with desired frequency response (In time domain it is called impulse response)  and transform back the resultant signal in time domain. If it is a image signal will be transformed to spatial-frequency domain and after multiplication, resultant image will be converted back to spatial domain.  FFT was proposed by Coolie and Tukey in 1965. It was too mathematical. In 1967 Tom Stockham and Charlie Rader gave flow graph representation for FFT. I thing it is called 'Butterfly diagram' nowadays. 
    Courtesy:
    • Eye Robot: embedded vision the next big thing in DSP, by Brian Dipert and Amit  Shoham,  IEEE  Solid State Circuits Magazine,  Vol. 4, No. 2, Spring 2012. [doi : 10.1109/MSSC.2012.2193077]
    • A note on DSP from the above magazine issue page number 36
    • Special thanks to Mr. B. Srinath

    Monday, 2 July 2012

    Machine Vision Magazines

    I searched a lot and found out that only three machine vision magazines are available.

    1. Vision Systems Design



    • Magazine articles are crisp in nature
    • "White paper" section needs registration.
    • Back volumes are available from  September 1996.
    • If we register ourselves then we can get the Digital/Print issue free of cost. Registration process seems to less cumbersome.


     Link: http://www.vision-systems.com/index.html

    2. Imaging and Machine Vision Europe 

     

    • From the home page go to "feature" section (http://www.imveurope.com/features/)   to find back  volumes. They are available from April 2006 onwards. It is an bimonthly (once in two months).
    • Sections like 'Webcast' and "white paper" need registration.
    • The layout is good. 
    • Articles are little bit lengthy.
    Link : http://www.imveurope.com/

    3. Inspect 

    • Without registration, I was able to download PDF files from 'White paper' section .  I have to register myself to get the same content from other magazines.
    • Publication  started from 2009 onwards.
    • It is bimonthy magazine with an additional special issue magazine. So totally seven issues per year. It costs around 54 euro per year subscription.
    • It is available in English as well as German. It is published by Wiley & Sons .
    • They have a print circulation of 20000. Germany consumes 70% of the printed copies.
    • Looking into the archives, need registration. I thing one get a PDF version of the book after registration.The registration is very simple. It asks for your name, a password and CAPTCHA to ensure registration done by humans only. 
    • Archives are from year  2009 onwards. Year 2011 is not available. Why?

    Friday, 29 June 2012

    Machine Vision - Soliton Technologies

    Machine Vision in Printing Industry
            Soliton Technologies, 14 year old, a pioneer in machine vision products and solutions based on India. In this August (2012)
     Soliton is going to launch a automation product that will reduce paper wastage while printing. Reduction is wastage will up to 50 percent compared to earlier  manual methods. A smart camera  would take pictures of the printed newspapers as they come out of the press, detect any errors in the color registration (CMYK). Cyan, Magenta and Yellow are secondary colours used in printing industry and K stands for Black colour. The detected errors are automatically corrected using correction motors present in the press. This process is instantaneous and thus paper wastage is reduced.

    Jewellery
         They have done R&D work to develop a automation technology that will able to inspect, sort and defect detection in the manufacture of jewellery.

    CASE STUDY in Pencil Manufacturing
         A pencil manufacturing   factory was manufacturing one million pencils per day. It employed 60 people inspect and remove defective pencils.  A good quality pencils, can have lead offset of 300 µm only. If the offset increases further pencil leads will break when sharpened. This length is nearly impossible to judge manually. When production was increased to 2 million pencils per day, the manufacturer went for a fully automated system. It means that within a second 23 pencils should be inspected.  This project was handed over to Soliton.  Machine Building and Automation division of Titan Industries was roped by Soliton to build system that will bring the pencils before the camera with minimal vibration. Each of the two ends are inspected by colour camera connected by IEEE 1394 interface.  Depending upon the type of pencils inspected either florescent or fiber optic light is used. They use LabView from National Instruments with IMAQ vision library provided by National Instruments (NI). Image processing algorithms have to find all defects (lead offset, wood chip-off, crack etc) within a time of 40ms. If a pencil is found defective  it is dropped into reject bin else it is lacquered, finished and boxed.

    Smart Camera
    Smart cameras do not require a PC for operation. It can operate stand alone. Soliton has launched a smart camera named Soliton Neo. It contains a buit-in camera, powerful DSP processor, LED lights and other required interfaces like Ethernet to connect to a laptop or remote PC. One has to use a custom software and able to control the camera thats it.
     More Info
    •  Soliton is a industry sponsor for TIFAC CORE on Machine Vision  setup at Rajalakshmi Engineering College (REC), Chennai. This was inagurated by Dr. Chidambaram, Principal Scientific Advisor to the Government of India on 30th June 2009.
    • Instrumentation and Control Engineering students can check analog speedometer webpage and they can try as their final year project.
    • Look into Soliton webpage's case study, press release, in the news section. Very interesting project idia one may get

     Sources: