US6229520B1 - Digital processing for resized graphics images - Google Patents

Digital processing for resized graphics images Download PDF

Info

Publication number
US6229520B1
US6229520B1 US09/008,170 US817098A US6229520B1 US 6229520 B1 US6229520 B1 US 6229520B1 US 817098 A US817098 A US 817098A US 6229520 B1 US6229520 B1 US 6229520B1
Authority
US
United States
Prior art keywords
scaled
format
data
component
scaling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US09/008,170
Inventor
Todd A. Clatanoff
Vishal Markandey
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Texas Instruments Inc
Original Assignee
Texas Instruments Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Texas Instruments Inc filed Critical Texas Instruments Inc
Priority to US09/008,170 priority Critical patent/US6229520B1/en
Assigned to TEXAS INSTRUMENTS INCORPORATED reassignment TEXAS INSTRUMENTS INCORPORATED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CLATANOFF, TODD A., MARKANDEY, VISHAL
Application granted granted Critical
Publication of US6229520B1 publication Critical patent/US6229520B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39Control of the bit-mapped memory
    • G09G5/391Resolution modifying circuits, e.g. variable screen formats
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0407Resolution change, inclusive of the use of different resolutions for different screen areas
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/46Receiver circuitry for the reception of television signals according to analogue transmission standards for receiving on more than one standard at will
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
    • H04N7/0122Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal the input and the output signals having different aspect ratios
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/641Multi-purpose receivers, e.g. for auxiliary information

Definitions

  • This invention relates to image processing, more particularly to image processing for graphics images.
  • Graphics data comes in several formats, such as VGA, SVGA, XGA, SXGA, etc., each with a different spatial resolution.
  • VGA has a 640 ⁇ 480 resolution.
  • a problem arises when graphics data of one format and resolution needs to be resized to fit a display system with a different resolution. For example, an image that was formatted for VGA at 640 ⁇ 480 resolution may need to be displayed on a 800 ⁇ 600 resolution display system. This type of problem is becoming more and more prevalent as more options are offered to consumers for display systems.
  • Graphics data unlike incoming video data, cannot be resized horizontally by changing the sampling frequency.
  • the sampling frequency for that display system would be 800 samples per line instead of 640.
  • Graphics data is originally created in a digital fashion. This results in a signal that is only stable in discrete portions of the analog signal.
  • a typical solution to this problem is to scale the data digitally, in both the horizontal and vertical directions.
  • the 640 samples per line must be scaled to result in 800 samples per line, and the 480 lines must be scaled to result in 600 lines.
  • graphics data is scaled up from 640 ⁇ 480 to 800 ⁇ 600, it can also be scaled down.
  • SVP Scan-line Video Processor
  • scaled images such as that discussed above, appear blurry or soft due to the use of a low-complexity scaling implementation.
  • Graphics images have a tendency to have sharp edges, which become noticeably blurred.
  • One aspect of the invention is an RGB sharpness filter to eliminate softness or blurring in a scaled graphics image.
  • Highpass filters extract high pass information from each of the red, green and blue signals, scaled in amplitude and then added back into each color component.
  • FIG. 1 shows a block diagram of an RGB sharpness operation during processing of graphics images.
  • FIG. 2 shows a block diagram of an RGB sharpness operation.
  • FIG. 3 shows a frequency response of one embodiment of a filter used in RGB sharpening.
  • FIG. 1 shows one embodiment of a method to sharpen these images. Since the source data is graphics images, the method will operate on red-green-blue (RGB) images in most contexts. However, the method is not limited to operation in the RGB realm. Each color of the signal, such as red, will be referred to as the component or component color.
  • RGB red-green-blue
  • the three components of the signal enter the processor for horizontal or vertical scaling at block 12 .
  • the resulting components 14 a , 14 b , and 14 c are still the component colors, but have the soft or blurred edges mentioned above.
  • RGB sharpness is applied. In this embodiment, the sharpness it applied to the RGB signals by an application specific integrated circuit (ASIC), but could be performed in other realms and by other types of processing elements.
  • the resulting RGB signals 18 a , 18 b and 18 c have sharp edges and more closely approximate the image as it was produced in its original format.
  • FIG. 2 An exanded block diagram of the sharpness block 16 is shown in FIG. 2 .
  • the component on line 14 is filtered at block 20 , either in the horizontal or vertical directions, or both, to extract the high frequency information.
  • This high frequency information contains edge information.
  • This information is then scaled in amplitude by the scale factor applied at 22 .
  • the scale factor depends upon the relationship of the format of the image to the resolution of the display upon which it is to be projected. For example, an image created in VGA format having a resolution of 640 ⁇ 480 pixels is to be displayed on a display having a resolution of 800 ⁇ 600 pixels.
  • the horizontal scale factor is 640:800, or 4:5, as is the vertical scale factor of 480:600. For every four pixels of original resolution, 5 pixels must be displayed.
  • the high frequency information is scaled at 22 , it is recombined with the original component signal at 24 . Since the scaling can result in too many bits per pixel, or more values than 256 values for pixel, the data must be limited to 256 values at 26 . Of course, this is not restricted to 256 values, but in this example, the system has 8 bits of data per pixel. In other systems the limit could be 512, or 1024.
  • the scaled and sharpened data is sent on for display on line 18 .
  • This approach uses a post-processing step after scaling that is unique.
  • the resulting data has sharp edges, more closely approximating the original image.
  • it can be tailored to the nature of the system in which it is to be used. For example, the filtering at step 20 could be only in the horizontal direction, not in the vertical. This selection determines the added complexity of the system.
  • a three tap horizontal filter could be used. This will increase the sharpness, while not appreciably increasing the cost or slowing down the processing time.
  • An example of the frequency response of such a filter is shown in FIG. 3, with taps at ⁇ 0.25, 0.50, ⁇ 0.25.

Abstract

A method for scaling graphics image data. The method operates on data that is in red-green-blue format. Each component is filtered to extract high pass information and then that information is scaled in amplitude. Finally, the amplitude scaled information is recombined with the original components of the image data. The filtering and amplitude scaling sharpen the scaled image, producing a clearer picture.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates to image processing, more particularly to image processing for graphics images.
2. Background of the Invention
Graphics data comes in several formats, such as VGA, SVGA, XGA, SXGA, etc., each with a different spatial resolution. For example, VGA has a 640×480 resolution. A problem arises when graphics data of one format and resolution needs to be resized to fit a display system with a different resolution. For example, an image that was formatted for VGA at 640×480 resolution may need to be displayed on a 800×600 resolution display system. This type of problem is becoming more and more prevalent as more options are offered to consumers for display systems.
Graphics data, unlike incoming video data, cannot be resized horizontally by changing the sampling frequency. In the above example, if the input were analog video data, the sampling frequency for that display system would be 800 samples per line instead of 640. Graphics data, however, is originally created in a digital fashion. This results in a signal that is only stable in discrete portions of the analog signal.
A typical solution to this problem is to scale the data digitally, in both the horizontal and vertical directions. In the above example, the 640 samples per line must be scaled to result in 800 samples per line, and the 480 lines must be scaled to result in 600 lines. Additionally, just as graphics data is scaled up from 640×480 to 800×600, it can also be scaled down. These scaling operation are typically performed by a programmable video processor, such as the Scan-line Video Processor (SVP) manufactured by Texas Instruments, or processing chips such as the Genesis 833.
Due to cost and real-time processing restraints, scaled images such as that discussed above, appear blurry or soft due to the use of a low-complexity scaling implementation. Graphics images have a tendency to have sharp edges, which become noticeably blurred.
Therefore, a method for enhancing image sharpness for resized graphics is needed.
SUMMARY OF THE INVENTION
One aspect of the invention is an RGB sharpness filter to eliminate softness or blurring in a scaled graphics image. Highpass filters extract high pass information from each of the red, green and blue signals, scaled in amplitude and then added back into each color component.
It is an advantage of the invention in that it can be tailored to the performance of the scaling operations being used in a particular system.
It is a further advantage of the invention in that it increases the sharpness of a scaled image, facilitating display of images on different fixed resolution displays.
BRIEF DESCRIPTION OF THE DRAWINGS
For a more complete understanding of the present invention and for further advantages thereof, reference is now made to the following Detailed Description taken in conjunction with the accompanying Drawings in which:
FIG. 1 shows a block diagram of an RGB sharpness operation during processing of graphics images.
FIG. 2 shows a block diagram of an RGB sharpness operation.
FIG. 3 shows a frequency response of one embodiment of a filter used in RGB sharpening.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Being able to display different format graphics images on fixed resolution displays offers several advantages. Electronic transmission of images between users of different resolution displays, or different sources of graphics images, becomes much easier. However, since these images are created digitally, they cannot be resampled to adjust for different display resolutions. Image scaling in both the horizontal and vertical directions must be performed digitally. The resulting image will more than likely have soft and blurred edges where edges in the original image were sharp.
FIG. 1 shows one embodiment of a method to sharpen these images. Since the source data is graphics images, the method will operate on red-green-blue (RGB) images in most contexts. However, the method is not limited to operation in the RGB realm. Each color of the signal, such as red, will be referred to as the component or component color.
The three components of the signal enter the processor for horizontal or vertical scaling at block 12. The resulting components 14 a, 14 b, and 14 c, are still the component colors, but have the soft or blurred edges mentioned above. At block 16, RGB sharpness is applied. In this embodiment, the sharpness it applied to the RGB signals by an application specific integrated circuit (ASIC), but could be performed in other realms and by other types of processing elements. The resulting RGB signals 18 a, 18 b and 18 c, have sharp edges and more closely approximate the image as it was produced in its original format.
An exanded block diagram of the sharpness block 16 is shown in FIG. 2. The component on line 14 is filtered at block 20, either in the horizontal or vertical directions, or both, to extract the high frequency information. This high frequency information contains edge information. This information is then scaled in amplitude by the scale factor applied at 22. The scale factor depends upon the relationship of the format of the image to the resolution of the display upon which it is to be projected. For example, an image created in VGA format having a resolution of 640×480 pixels is to be displayed on a display having a resolution of 800×600 pixels. The horizontal scale factor is 640:800, or 4:5, as is the vertical scale factor of 480:600. For every four pixels of original resolution, 5 pixels must be displayed.
After the high frequency information is scaled at 22, it is recombined with the original component signal at 24. Since the scaling can result in too many bits per pixel, or more values than 256 values for pixel, the data must be limited to 256 values at 26. Of course, this is not restricted to 256 values, but in this example, the system has 8 bits of data per pixel. In other systems the limit could be 512, or 1024.
Finally, the scaled and sharpened data is sent on for display on line 18. This approach uses a post-processing step after scaling that is unique. The resulting data has sharp edges, more closely approximating the original image. Additionally, it can be tailored to the nature of the system in which it is to be used. For example, the filtering at step 20 could be only in the horizontal direction, not in the vertical. This selection determines the added complexity of the system.
For example, in a lower cost system, a three tap horizontal filter could be used. This will increase the sharpness, while not appreciably increasing the cost or slowing down the processing time. An example of the frequency response of such a filter is shown in FIG. 3, with taps at −0.25, 0.50, −0.25.
Thus, although there has been described to this point a particular embodiment for a method for sharpening scaled graphics image data, it is not intended that such specific references be considered as limitations upon the scope of this invention except in-so-far as set forth in the following claims.

Claims (7)

What is claimed is:
1. A method for processing graphics image data, comprising the steps of:
scaling said graphics image data from a first format to a second format,
filtering each component of said data, to extract high pass information from each said component;
scaling in amplitude, the high pass information from each said component, producing scaled high pass component signals; and
recombining each of said scaled high pass component signals with its corresponding component.
2. The method of claim 1 wherein said first format has a lower resolution than said second format.
3. The method of claim 1 wherein said second format has a lower resolution than said first format.
4. The method of claim 1 wherein said filtering step is performed in the horizontal and vertical directions.
5. The method claim 1 wherein said filtering step is performed in only the horizontal direction.
6. The method of claim 1 wherein said filtering step is performed only in the vertical direction.
7. The method of claim 1 wherein said components are red, green and blue components of said data.
US09/008,170 1998-01-16 1998-01-16 Digital processing for resized graphics images Expired - Lifetime US6229520B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US09/008,170 US6229520B1 (en) 1998-01-16 1998-01-16 Digital processing for resized graphics images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09/008,170 US6229520B1 (en) 1998-01-16 1998-01-16 Digital processing for resized graphics images

Publications (1)

Publication Number Publication Date
US6229520B1 true US6229520B1 (en) 2001-05-08

Family

ID=21730142

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/008,170 Expired - Lifetime US6229520B1 (en) 1998-01-16 1998-01-16 Digital processing for resized graphics images

Country Status (1)

Country Link
US (1) US6229520B1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6407747B1 (en) * 1999-05-07 2002-06-18 Picsurf, Inc. Computer screen image magnification system and method
US6411305B1 (en) * 1999-05-07 2002-06-25 Picsurf, Inc. Image magnification and selective image sharpening system and method
US20030090592A1 (en) * 2001-11-13 2003-05-15 Callway Edward G. System for improved ratiometric expansion and method thereof
US20050135700A1 (en) * 2003-12-23 2005-06-23 General Instrument Corporation Directional spatial video noise reduction
US20050135699A1 (en) * 2003-12-23 2005-06-23 General Instrument Corporation Directional video filters for locally adaptive spatial noise reduction
WO2007021225A1 (en) * 2005-08-19 2007-02-22 Telefonaktiebolaget Lm Ericsson (Publ) Image management
US8391647B1 (en) * 2010-02-17 2013-03-05 Hewlett-Packard Development Company, L.P. Pixel replacement

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5606375A (en) * 1994-08-31 1997-02-25 Samsung Electronics Co. Ltd. Method for enhancing detail in color signals and circuitry for implementing that method in color video equipment
US5682179A (en) * 1993-07-01 1997-10-28 Intel Corporation Horizontally scaling image signals according to a selected scaling mode
US5754180A (en) * 1996-03-11 1998-05-19 Avid Technology, Inc. Computer system and process for defining and manipulating images using structured objects with variable edge characteristics
US5812144A (en) * 1995-09-08 1998-09-22 International Business Machines Corporation System for performing real-time video resizing in a data processing system having multimedia capability
US5838334A (en) * 1994-11-16 1998-11-17 Dye; Thomas A. Memory and graphics controller which performs pointer-based display list video refresh operations
US5844545A (en) * 1991-02-05 1998-12-01 Minolta Co., Ltd. Image display apparatus capable of combining image displayed with high resolution and image displayed with low resolution
US5886701A (en) * 1995-08-04 1999-03-23 Microsoft Corporation Graphics rendering device and method for operating same
US5940141A (en) * 1995-10-05 1999-08-17 Yves C. Faroudja Nonlinear vertical bandwidth expansion of video signals
US6002810A (en) * 1995-04-14 1999-12-14 Hitachi, Ltd. Resolution conversion system and method

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5844545A (en) * 1991-02-05 1998-12-01 Minolta Co., Ltd. Image display apparatus capable of combining image displayed with high resolution and image displayed with low resolution
US5682179A (en) * 1993-07-01 1997-10-28 Intel Corporation Horizontally scaling image signals according to a selected scaling mode
US5717436A (en) * 1993-07-01 1998-02-10 Intel Corporation Processing image signals with a single image support component
US5831592A (en) * 1993-07-01 1998-11-03 Intel Corporation Scaling image signals using horizontal pre scaling, vertical scaling, and horizontal scaling
US5844541A (en) * 1993-07-01 1998-12-01 Intel Corporation Generating a full-resolution image from sub-sampled image signals
US5606375A (en) * 1994-08-31 1997-02-25 Samsung Electronics Co. Ltd. Method for enhancing detail in color signals and circuitry for implementing that method in color video equipment
US5838334A (en) * 1994-11-16 1998-11-17 Dye; Thomas A. Memory and graphics controller which performs pointer-based display list video refresh operations
US6002810A (en) * 1995-04-14 1999-12-14 Hitachi, Ltd. Resolution conversion system and method
US5886701A (en) * 1995-08-04 1999-03-23 Microsoft Corporation Graphics rendering device and method for operating same
US5812144A (en) * 1995-09-08 1998-09-22 International Business Machines Corporation System for performing real-time video resizing in a data processing system having multimedia capability
US5940141A (en) * 1995-10-05 1999-08-17 Yves C. Faroudja Nonlinear vertical bandwidth expansion of video signals
US5754180A (en) * 1996-03-11 1998-05-19 Avid Technology, Inc. Computer system and process for defining and manipulating images using structured objects with variable edge characteristics

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Oraintara et al., "Image/Video Scaling Algorithm Based On Multirate Signal Processing", IEEE, pp. 1-5, 1998. *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6407747B1 (en) * 1999-05-07 2002-06-18 Picsurf, Inc. Computer screen image magnification system and method
US6411305B1 (en) * 1999-05-07 2002-06-25 Picsurf, Inc. Image magnification and selective image sharpening system and method
US20030090592A1 (en) * 2001-11-13 2003-05-15 Callway Edward G. System for improved ratiometric expansion and method thereof
US7199837B2 (en) * 2001-11-13 2007-04-03 Ati Technologies, Inc. System for improved ratiometric expansion and method thereof
US20050135700A1 (en) * 2003-12-23 2005-06-23 General Instrument Corporation Directional spatial video noise reduction
US20050135699A1 (en) * 2003-12-23 2005-06-23 General Instrument Corporation Directional video filters for locally adaptive spatial noise reduction
US7373013B2 (en) * 2003-12-23 2008-05-13 General Instrument Corporation Directional video filters for locally adaptive spatial noise reduction
US7437013B2 (en) 2003-12-23 2008-10-14 General Instrument Corporation Directional spatial video noise reduction
WO2007021225A1 (en) * 2005-08-19 2007-02-22 Telefonaktiebolaget Lm Ericsson (Publ) Image management
US8391647B1 (en) * 2010-02-17 2013-03-05 Hewlett-Packard Development Company, L.P. Pixel replacement

Similar Documents

Publication Publication Date Title
US7245785B2 (en) Suppression of ringing artifacts during image resizing
JP4688432B2 (en) System for improving display resolution
KR100519776B1 (en) Method and apparatus for converting resolution of video signal
US6535221B1 (en) Image enhancement method and apparatus for internet printing
US7782401B1 (en) Method and system for digital image scaling with sharpness enhancement and transient improvement
US8260087B2 (en) Image upsampling technique
US20040239813A1 (en) Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit
US20020093521A1 (en) Methods and systems for improving display resolution in images using sub-pixel sampling and visual error filtering
US20060152596A1 (en) Noise cleaning sparsely populated color digital images
US20050243109A1 (en) Method and apparatus for converting a color image
AU675387B2 (en) Method and apparatus for graphic processing
US6229520B1 (en) Digital processing for resized graphics images
US6384828B1 (en) Digital processing apparatus and method for use in enlarging the size of an image displayed on a 2D fixed-pixel screen
US6710819B2 (en) Method and system for improved display filtering
US5790205A (en) Method of increase sharpness in digital displays
US6281938B1 (en) Signal processing system
US20010048771A1 (en) Image processing method and system for interpolation of resolution
JP2004524729A (en) Display resolution enhancement method and system using sub-pixel sampling and visual distortion filtering
US5280343A (en) Separable subsampling of digital image data with general periodic symmetry
JPH09200578A (en) Inter-line flicker elimination device by nonlinear transfer function
CA2059929A1 (en) Image scaling apparatus for a multimedia system
JP4526405B2 (en) TV image processing device
US6795587B2 (en) Image resizing using short asymmetric FIR filters
EP0970578B1 (en) Minimizing visual artifacts caused by the pixel display of a video image
US7590302B1 (en) Image edge enhancement system and method

Legal Events

Date Code Title Description
AS Assignment

Owner name: TEXAS INSTRUMENTS INCORPORATED, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CLATANOFF, TODD A.;MARKANDEY, VISHAL;REEL/FRAME:008935/0109;SIGNING DATES FROM 19970121 TO 19970201

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

FPAY Fee payment

Year of fee payment: 12