CN104392411A - Image processing method and device based on Shannon-Blackman wavelet sparse representation - Google Patents

Image processing method and device based on Shannon-Blackman wavelet sparse representation Download PDF

Info

Publication number
CN104392411A
CN104392411A CN201410773139.XA CN201410773139A CN104392411A CN 104392411 A CN104392411 A CN 104392411A CN 201410773139 A CN201410773139 A CN 201410773139A CN 104392411 A CN104392411 A CN 104392411A
Authority
CN
China
Prior art keywords
image
phi
sigma
shannon
blackman
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410773139.XA
Other languages
Chinese (zh)
Other versions
CN104392411B (en
Inventor
梅树立
朱德海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Agricultural University
Original Assignee
China Agricultural University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Agricultural University filed Critical China Agricultural University
Priority to CN201410773139.XA priority Critical patent/CN104392411B/en
Publication of CN104392411A publication Critical patent/CN104392411A/en
Application granted granted Critical
Publication of CN104392411B publication Critical patent/CN104392411B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/40Scaling the whole image or part thereof
    • G06T3/4007Interpolation-based scaling, e.g. bilinear interpolation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/40Scaling the whole image or part thereof
    • G06T3/4053Super resolution, i.e. output image resolution higher than sensor resolution

Abstract

The invention discloses an image processing method and device based on Shannon-Blackman wavelet sparse representation. The method comprises steps as follows: a to-be-processed image is acquired; a multi-scale interpolation operator based on Shannon-Blackman interpolating wavelets is established, and the image is amplified; an image variation model for the amplified image under a wavelet frame is established; and the image variation model under the wavelet frame is solved to obtain a sharp image. According to the Shannon-Blackman wavelet sparse representation based image processing method and device, the image is amplified through the multi-scale interpolation operator, the image variation model under the wavelet frame is established, the image is solved through a sparse grid algorithm to obtain a super-resolution image, and the image processing efficiency and accuracy are improved.

Description

Based on image processing method and the device of Shannon-Blackman small echo sparse expression
Technical field
The present invention relates to technical field of image processing, particularly a kind of image processing method based on Shannon-Blackman small echo sparse expression and device.
Background technology
High resolving power Biomedical Image can provide more accurate and abundant visual information for medical diagnosis and pathological analysis.Although adopt video high density pick-up transducers can improve image resolution ratio to a certain extent, due to the restriction of imaging system self-sensor device arranging density, with high costs and the pollution of noise in image acquisition process cannot be avoided completely; Improve chip size and then can cause the decline of Charger transfer speed and the increase of electric capacity.Therefore, adopt Technique of Super-resolution Image Construction to improve image resolution ratio and there is important scientific meaning and practical value.
Verified, image procossing Variation Model is the effective tool improving Biomedical Image resolution.But when image super-resolution rebuilding, inevitably there is artificial artifact and distortion phenomenon in conventional method of difference and linear interpolation method; And in existing image super-resolution rebuilding Variation Model, the spread function of recognition image object boundary automatically can not have multiple dimensioned characteristic, cause the image local detailed structure after amplifying unintelligible, have impact on the raising of image resolution ratio.For solving this problem, partial differential equation denoising model experienced by from low order to high-order, vector diffusion is spread to tensor, real evolution of spreading to multiple diffusion, but can by the tiny boundary vague in local when the method is corrected the image after amplification, its image processing effect is always not obvious.
In addition, when traditional method of difference solves parabolic type nonlinear partial differential equation, the stability requirement of algorithm is higher, and computational accuracy and efficiency are not high, have impact on application and the popularization of this algorithm.
Summary of the invention
Based on the problems referred to above, the invention provides a kind of image processing method based on Shannon-Blackman small echo sparse expression and device, by multiple dimensioned interpolation operator, image is amplified, Image Variational model is set up under interpolating wavelet framework, and obtain super-resolution image by sparse grid Algorithm for Solving image, improve efficiency and the precision of image procossing.
For above-mentioned purpose, the invention provides a kind of image processing method based on Shannon-Blackman small echo sparse expression, it is characterized in that, comprising:
Obtain pending image;
Construct the multiple dimensioned interpolation operator based on Shannon-Blackman interpolating wavelet, described image is amplified;
To the Image Variational model under the picture construction wavelet frame after amplification;
Solve the Image Variational model under described wavelet frame, get a distinct image.
Wherein, the described structure detailed process of amplifying image based on the multiple dimensioned interpolation operator of Shannon-Blackman interpolation plait is as follows:
If the field of definition of image is (x min, x max) × (y min, y max), in image, the position of each pixel is defined as wherein j is scale parameter, k jxand k jyfor the location parameter on j yardstick;
Definition Shannon-Blackman scaling function is:
φ ( x ) = sin ( πx ) πx ( 0.42 + 0.5 cos ( 2 πx N ) + 0 . 08 cos ( 4 πx N ) ) 2 , - N / 2 ≤ x ≤ N / 2 0 , otherwise ,
Shannon-Blackman scaling function is defined as by tensor product:
w k jx , k jy j ( x , y ) = Φ k jx j ( x ) Φ k jy j ( y ) = Φ ( 2 j x - k jx ) Φ ( 2 j y - k jy )
According to the definition of interpolating wavelet transform, derive multi-scale wavelet interpolation operator as follows:
I n 1 , n 2 ( x , y ) = Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J w k 0 x , k 0 y j 0 ( x , y ) + Σ j = j 0 J - 1 Σ k jx = 0 2 j Σ k jy = 0 2 j ( C 1 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx + 1,2 k jy j + 1 ( x , y ) Φ ( x n 1 J , y n 2 J ) + C 2 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx , 2 k jy + 1 j + 1 ( x , y ) Φ ( x n 1 J , y n 2 J ) + C 3 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx + 1,2 k jy + 1 j + 1 ( x , y ) Φ ( x n 1 J , y n 2 J )
Described image u (x, y) is expressed as by multiple dimensioned interpolating function:
u J ( x , y ) = Σ n 1 = 0 2 J Σ n 2 = 0 2 J I n 1 , n 2 ( x , y ) u J ( x n 1 J , y n 2 J ) ;
Wherein, N is compact schemes constant, and C1, C2, C3 are Wavelet Interpolation transformation matrix, n 1, n 2for the position of interpolation operator, R is Restriction Operators, and J is the maximal value of scale parameter, j 0be expressed as 0 layer of yardstick, j 1for being different from the scale parameter of j;
Wherein,
C 1 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx + 1,2 k jy , n 1 , n 2 j + 1 , j + 2 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) + Σ j 1 = j 0 j - 1 Σ n 2 = 0 2 J Σ k j 1 x = 0 2 j 1 ( C 1 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 2 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) ]
C 2 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx , 2 k jy + 1 , n 1 , n 2 j + 1 , j + 2 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) + Σ j 1 = j 0 j - 1 Σ n 2 = 0 2 J Σ k j 1 x = 0 2 j 1 ( C 1 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y j 1 + 1 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 2 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y + 1 j 1 + 1 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) ]
C 3 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx + 1,2 k jy + 1 , n 1 , n 2 j + 1 , j + 1 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) + Σ j 1 = j 0 j - 1 Σ n 2 = 0 2 J Σ k j 1 x = 0 2 j 1 ( C 1 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 2 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) ] .
Wherein, the position of each pixel in described image be defined as:
x k jx j = x min + k jx x max - x min 2 j
y k jy j = y min + k jy y max - y min 2 j .
Wherein, described Restriction Operators R is defined as:
R k lx , k ly , k jx , k jy l , l , j , j = 1 , xl klx l = x jx j and y ly l = y jy j 0 , otherwise ,
Wherein, l is the scale parameter being different from j.
The described detailed process to the Image Variational model under the picture construction wavelet frame after amplification is:
The calibration model defining the image after described amplification is:
∂ u ( x , y , t ) ∂ t = ∂ [ c ( x , y , t ) · ∂ u ( x , y , t ) ∂ x ] ∂ x + ∂ [ c ( x , y , t ) · ∂ u ( x , y , t ) ∂ y ] ∂ y u ( x , y , 0 ) = f ( x , y ) ,
Wherein, (x, y) represents the position of pixel, and t is parameter diffusion time, and f (x, y) is original two dimensional image, and c is spread function, and u is the expression formula of the image of being expressed by multiple dimensioned interpolating function;
The expression formula of the image of being expressed by multiple dimensioned interpolating function is brought in described calibration model, obtains the Image Variational model under described wavelet frame.
Wherein, described spread function c is defined as:
c ( | ▿ u | ) = ( cos ( π ▿ u N ) ) 2 , - N / 2 ≤ ▿ u ≤ N / 2 0 , otherwise ,
Wherein, N is compact schemes constant, for gradient operator.
Wherein, the detailed process solving the Image Variational model under described wavelet frame described in comprises:
Described Image Variational model is rewritten as:
du J ( x , y , t ) dt = F [ t , x , y , u J ( x , y , t ) , u J ( 1,0 ) ( x , y , t ) , u J ( 0,1 ) ( x , y , t ) , u J ( 2,0 ) ( x , y , t ) , u J ( 1,1 ) ( x , y , t ) , u J ( 0,2 ) ( x , y , t ) ] ,
Wherein, and by u j(x, y, t n) be set as u n, t nthe function F in moment is set as F n;
Structure linear homotopy is: u j(x, y, t)=(1-ε) F n+ ε F n+1;
According to perturbation theory, described linear homotopy is expanded into following formula:
u J = u 0 J + ϵ u 1 J + ϵ 2 u 2 J + . . . ,
According to described expression formula and described revised Image Variational model, obtain one group of ordinary differential system, and solve the correction result obtaining described image;
Wherein, described ε is homotopy parameter, and
According to another aspect of the present invention, a kind of image processing apparatus based on Shannon-Blackman small echo sparse expression is provided, it is characterized in that, comprising:
Image acquisition unit, for obtaining pending image;
Image enlarging unit, for constructing the multiple dimensioned interpolation operator based on Shannon-Blackman interpolating wavelet, amplifies described image;
Unit set up by Image Variational model, for amplify after picture construction wavelet frame under Image Variational model;
Solving unit, for solving the Image Variational model under described wavelet frame, getting a distinct image.
Image processing method based on Shannon-Blackman small echo sparse expression provided by the invention and device, by multiple dimensioned interpolation operator, image is amplified, achieve the adaptive configuration of image slices vegetarian refreshments, effectively can retain detailed structure simultaneously, improve and rebuild efficiency, avoid the phenomenon occurring artificial artifact in amplification process; In addition, adopt multiple dimensioned Blackman function to replace traditional spread function, effectively can avoid the obfuscation of local detail, thus the oversubscription not rate of image can be improved further; Finally, by structure sparse grid Algorithm for Solving Image Variational model, effectively improve efficiency and precision.
Accompanying drawing explanation
Fig. 1 shows the process flow diagram of the image processing method based on Shannon-Blackman small echo sparse expression of the present invention.
Fig. 2 (a) and (b) show the comparison diagram of the Shannon-Blackman scaling function of existing Shannon wavelet scaling function and embodiments of the invention.
Fig. 3 shows the structured flowchart of the image processing apparatus based on Shannon-Blackman small echo sparse expression of the present invention.
Fig. 4 shows the original image of one embodiment of the present of invention.
Fig. 5 show an embodiment of reality of the present invention by the image of Nonlinear magnify 2.
Fig. 6 shows the image after the correction of one embodiment of the present of invention.
The image that Fig. 7 shows one embodiment of the invention uses Shannon-Blackman scaling function to carry out the expression schematic diagram of multiple dimensioned interpolation.
Embodiment
Below in conjunction with drawings and Examples, the specific embodiment of the present invention is described in further detail.Following examples for illustration of the present invention, but are not used for limiting the scope of the invention.
An embodiment provides a kind of image processing method based on Shannon-Blackman small echo sparse expression.
Fig. 1 shows the process flow diagram of the image processing method based on Shannon-Blackman small echo sparse expression of the present invention.Fig. 2 shows the comparison diagram of the Shannon-Blackman scaling function of existing Shannon wavelet scaling function and embodiments of the invention.
With reference to Fig. 1, the image processing method based on Shannon-Blackman small echo sparse expression of the present invention, detailed process comprises:
S1, obtain pending image;
S2, construct multiple dimensioned interpolation operator based on Shannon-Blackman interpolating wavelet, described image is amplified.
Detailed process is as follows:
If the field of definition of image is (x min, x max) × (y min, y max), in image, the position of each pixel is defined as wherein j is scale parameter, k jxand k jyfor the location parameter on j yardstick;
The position of each pixel in image be defined as:
x k jx j = x min + k jx x max - x min 2 j
y k jy j = y min + k jy y max - y min 2 j .
First, defining Shannon-Blackman scaling function is:
φ ( x ) = sin ( πx ) πx ( 0.42 + 0.5 cos ( 2 πx N ) + 0 . 08 cos ( 4 πx N ) ) 2 , - N / 2 ≤ x ≤ N / 2 0 , otherwise ,
According to above-mentioned scaling function, N is compact schemes constant, as shown in Figure 2, relative to Shannon wavelet scaling function, the scaling function that the interpolating wavelet of the present embodiment is corresponding remains interpolation characteristic and orthogonal property, also add compactly supported, the scaling function of compact schemes, can simultaneously innovatory algorithm numerical precision and speed of convergence as the odd function solving partial differential equation simultaneously.
Then Shannon-Blackman scaling function is defined as by tensor product:
w k jx , k jy j ( x , y ) = Φ k jx j ( x ) Φ k jy j ( y ) = Φ ( 2 j x - k jx ) Φ ( 2 j y - k jy )
According to the definition of interpolating wavelet transform, multi-scale wavelet interpolation operator can be derived as follows:
I n 1 , n 2 ( x , y ) = Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J w k 0 x , k 0 y j 0 ( x , y ) + Σ j = j 0 J - 1 Σ k jx = 0 2 j Σ k jy = 0 2 j ( C 1 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx + 1,2 k jy j + 1 ( x , y ) Φ ( x n 1 J , y n 2 J ) + C 2 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx , 2 k jy + 1 j + 1 ( x , y ) Φ ( x n 1 J , y n 2 J ) + C 3 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx + 1,2 k jy + 1 j + 1 ( x , y ) Φ ( x n 1 J , y n 2 J )
Wherein, C1, C2, C3 are Wavelet Interpolation transformation matrix, n 1, n 2for the position of interpolation operator, R is Restriction Operators, and J is the maximal value of scale parameter, j 0be expressed as 0 layer of yardstick, j 1for being different from the scale parameter of j, and
C 1 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx + 1,2 k jy , n 1 , n 2 j + 1 , j + 2 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) + Σ j 1 = j 0 j - 1 Σ n 2 = 0 2 J Σ k j 1 x = 0 2 j 1 ( C 1 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 2 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) ]
C 2 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx , 2 k jy + 1 , n 1 , n 2 j + 1 , j + 2 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) + Σ j 1 = j 0 j - 1 Σ n 2 = 0 2 J Σ k j 1 x = 0 2 j 1 ( C 1 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y j 1 + 1 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 2 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y + 1 j 1 + 1 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) ]
C 3 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx + 1,2 k jy + 1 , n 1 , n 2 j + 1 , j + 1 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) + Σ j 1 = j 0 j - 1 Σ n 2 = 0 2 J Σ k j 1 x = 0 2 j 1 ( C 1 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 2 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1,2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) ] .
In addition, described Restriction Operators R is defined as:
R k lx , k ly , k jx , k jy l , l , j , j = 1 , xl klx l = x jx j and y ly l = y jy j 0 , otherwise ,
Wherein, l is the scale parameter being different from j.
According to above-mentioned derivation, image u (x, y) is expressed as by multiple dimensioned interpolating function:
u J ( x , y ) = Σ n 1 = 0 2 J Σ n 2 = 0 2 J I n 1 , n 2 ( x , y ) u J ( x n 1 J , y n 2 J ) ;
By above-mentioned formula, the multiple dimensioned interpolation amplification of image can be realized.
S3, to amplify after picture construction wavelet frame under Image Variational model;
Its detailed process is:
The calibration model of the image after definition amplification is:
∂ u ( x , y , t ) ∂ t = ∂ [ c ( x , y , t ) · ∂ u ( x , y , t ) ∂ x ] ∂ x + ∂ [ c ( x , y , t ) · ∂ u ( x , y , t ) ∂ y ] ∂ y u ( x , y , 0 ) = f ( x , y ) ,
Wherein, (x, y) represents the position of pixel, and t is parameter diffusion time, and f (x, y) is original two dimensional image, and c is spread function, and u is the expression formula of the image of being expressed by multiple dimensioned interpolating function;
Spread function c is defined as:
c ( | ▿ u | ) = ( cos ( π ▿ u N ) ) 2 , - N / 2 ≤ ▿ u ≤ N / 2 0 , otherwise ,
Wherein, for gradient operator.The present embodiment uses above-mentioned spread function, can guarantee that the spread function in calculating has strict compactly supported.
The expression formula of the image of being expressed by multiple dimensioned interpolating function in step S2 is brought in described calibration model, obtains the Image Variational model under described wavelet frame.
S4, the Image Variational model solved under described wavelet frame, get a distinct image.
Its detailed process comprises:
Described Image Variational model is rewritten as:
du J ( x , y , t ) dt = F [ t , x , y , u J ( x , y , t ) , u J ( 1,0 ) ( x , y , t ) , u J ( 0,1 ) ( x , y , t ) , u J ( 2,0 ) ( x , y , t ) , u J ( 1,1 ) ( x , y , t ) , u J ( 0,2 ) ( x , y , t ) ]
Wherein, and by u j(x, y, t n) be set as u n, t nthe function F in moment is set as F n;
Structure linear homotopy is: u j(x, y, t)=(1-ε) F n+ ε F n+1;
Wherein, described ε is homotopy parameter, and
According to perturbation theory, described linear homotopy is expanded into following formula:
u J = u 0 J + ϵ u 1 J + ϵ 2 u 2 J + . . . ,
According to described expression formula and described revised Image Variational model, obtain one group of ordinary differential system, this solving equations can be obtained the correction result of described image, thus the super-resolution rebuilding result of image can be obtained.
In an alternative embodiment of the invention, provide a kind of image processing apparatus based on Shannon-Blackman small echo sparse expression.
Fig. 3 shows the structured flowchart of the image processing apparatus based on Shannon-Blackman small echo sparse expression of the present invention.
With reference to Fig. 3, the image processing apparatus based on Shannon-Blackman small echo sparse expression of the present embodiment comprises:
Image acquisition unit 10, for obtaining pending image;
Image enlarging unit 20, for constructing the multiple dimensioned interpolation operator based on Shannon-Blackman interpolating wavelet, amplifies described image;
Unit 30 set up by Image Variational model, for amplify after picture construction wavelet frame under Image Variational model;
Solving unit 40, for solving the Image Variational model under described wavelet frame, getting a distinct image.
Below by way of specific embodiment, said method is described.
Fig. 4 shows the original image of an alternative embodiment of the invention.Fig. 5 show another embodiment of reality of the present invention by the image of Nonlinear magnify 2.Fig. 6 shows the image after the correction of an alternative embodiment of the invention.The image that Fig. 7 shows one embodiment of the invention uses Shannon-Blackman scaling function to carry out the expression schematic diagram of multiple dimensioned interpolation.
The present embodiment extracts an image as shown in Figure 4 and uses said method to correct.
First the multiple dimensioned interpolation operator of Shannon-Blackman is adopted to amplify image, shown in figure Fig. 5;
Then adopt the Variation Model under interpolating wavelet framework to correct to the image after amplification, obtain the image after correcting, as shown in Figure 6, thus complete the super-resolution rebuilding of image.
By image processing method of the present invention, multiple dimensioned interpolation operator is used to amplify image at timing, the adaptive configuration of image slices vegetarian refreshments can be realized, as shown in Figure 7, image pixel is 300*300, the adaptive configuration point number of its pixel is 23488, the border annex pixel point density of image object thing is large, and other equal value parts are relatively sparse, when adopting this scheme to carry out Nonlinear magnify, effectively can retain detailed structure, improve simultaneously and rebuild efficiency, avoid in amplification process, occurring artificial artifact phenomenon.
In addition, the present invention adopts multiple dimensioned employing multiple dimensioned Blackman function to replace traditional spread function, effectively can avoid the obfuscation of local detail, thus can improve the oversubscription not rate of image further.
Finally, adopt the multiple dimensioned operator of Shannon-Blackman Construction of Wavelets, and by structure sparse grid Algorithm for Solving Image Variational model, effectively improve efficiency and precision.
Above embodiment is only for illustration of the present invention; and be not limitation of the present invention; the those of ordinary skill of relevant technical field; without departing from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all equivalent technical schemes also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.

Claims (8)

1. based on an image processing method for Shannon-Blackman small echo sparse expression, it is characterized in that, comprising:
Obtain pending image;
Construct the multiple dimensioned interpolation operator based on Shannon-Blackman interpolating wavelet, described image is amplified;
To the Image Variational model under the picture construction wavelet frame after amplification;
Solve the Image Variational model under described wavelet frame, get a distinct image.
2. image processing method as claimed in claim 1, is characterized in that, the detailed process that described structure amplifies image based on the multiple dimensioned interpolation operator of Shannon-Blackman interpolation plait is as follows:
If the field of definition of image is (x min, x max) × (y min, y max), in image, the position of each pixel is defined as wherein j is scale parameter, k jxand k jyfor the location parameter on j yardstick;
Definition Shannon-Blackman scaling function is:
φ ( x ) = sin ( πx ) πx ( 0.12 + 0.5 cos ( 2 πx N ) + 0.08 cos ( 4 πx N ) ) 2 , - N / 2 ≤ x ≤ N / 2 0 , otherwise ;
Shannon-Blackman scaling function is defined as by tensor product:
w k jx , k jy j ( x , y ) = Φ k jx j ( x ) Φ k jy j ( y ) = Φ ( 2 j x - k jx ) Φ ( 2 j y - k jy )
According to the definition of interpolating wavelet transform, derive multi-scale wavelet interpolation operator as follows:
I n 1 , n 2 ( x , y ) = Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J w k 0 x , k 0 y j 0 j ( x , y ) + Σ j = j 0 J - 1 Σ k jx = 0 2 j Σ k jy = 0 2 j ( C 1 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx + 1 , 2 k jy j + 1 ) ( x , y ) Φ ( x n 1 J , y n 2 J ) + C 2 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx , 2 k jy + 1 j + 1 ( x , y ) Φ ( x n 1 J , y n 2 J ) + C 3 k jx , k jy , n 1 , n 2 j , j , J , J w 2 k jx + 1 , 2 k jy + 1 j + 1 ( x , y ) Φ ( x n 1 J , y n 2 J )
Described image u (x, y) is expressed as by multiple dimensioned interpolating function:
u J ( x , y ) = Σ n 1 = 0 2 J Σ n 2 = 0 2 J I n 1 , n 2 ( x , y ) u J ( x n 1 J , y n 2 J ) ;
Wherein, N is compact schemes constant, and C1, C2, C3 are Wavelet Interpolation transformation matrix, n 1, n 2for the position of interpolation operator, R is Restriction Operators, and J is the maximal value of scale parameter, j 0be expressed as 0 layer of yardstick, j 1for being different from the scale parameter of j;
Wherein,
C 1 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx + 1 , 2 k jy , n 1 , n 2 j + 1 , j + 2 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) + C 2 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1 , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx + 1 j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) ]
C 2 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx , 2 k jy , n 1 , n 2 j + 1 , j + 2 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) + C 2 k 1 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1 , 2 k j 1 y + 1 j 1 + 1 ( x 2 k jx j + 1 , y 2 k jy j + 1 ) Φ ( x n 1 J , y n 2 J ) ]
C 3 k jx , k jy , n 1 , n 2 j , j , J , J = R 2 k jx + 1 , 2 k jy + 1 , n 1 , n 2 j + 1 , j + 1 , J , J - [ Σ k 0 x = 0 2 j 0 Σ k 0 y = 0 2 j 0 R k 0 x , k 0 y , n 1 , n 2 j 0 , j 0 , J , J Φ ( x n 1 J , y n 2 J ) w k 0 x , k 0 y j 0 ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) + Σ j 1 = j 0 j - 1 Σ n 2 = 0 2 J Σ k j 1 x = 0 2 j 1 ( C 1 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1 , 2 k j 1 y j 1 + 1 ) ( x 2 k jx + 1 j + 1 , y 2 k jy + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 2 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x , 2 k j 1 y + 1 j 1 + 1 ( x 2 k j 1 x + 1 j + 1 , y 2 k j 1 y + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) + C 3 k j 1 x , k j 1 y , n 1 , n 2 j 1 , j 1 , J , J w 2 k j 1 x + 1 , 2 k j 1 y + 1 j 1 + 1 ( x 2 k j 1 x + 1 j + 1 , y 2 k j 1 y + 1 j + 1 ) Φ ( x n 1 J , y n 2 J ) ]
3. image processing method as claimed in claim 2, is characterized in that, the position of each pixel in described image be defined as:
x k jx j = x min + k jx x max - x min 2 j
y k jy j = y min + k jy y max - y min 2 j .
4. image processing method as claimed in claim 2, it is characterized in that, described Restriction Operators R is defined as:
R k lx , k ly , k jx , k jy l , l , j , j = 1 , xl klx l = x jx j and y ly l = y jy j 0 , otherwise ,
Wherein, l is the scale parameter being different from j.
5. image processing method as claimed in claim 2, is characterized in that, the described detailed process to the Image Variational model under the picture construction wavelet frame after amplification is:
The calibration model defining the image after described amplification is:
∂ u ( x , y , t ) ∂ t = ∂ [ c ( x , y , t ) · ∂ u ( x , y , t ) ∂ x ] ∂ x + ∂ [ c ( x , y , t ) · ∂ u ( x , y , t ) ∂ y ] ∂ y u ( x , y , 0 ) = f ( x , y ) ,
Wherein, (x, y) represents the position of pixel, and t is parameter diffusion time, and f (x, y) is original two dimensional image, and c is spread function, and u is the expression formula of the image of being expressed by multiple dimensioned interpolating function;
The expression formula of the image of being expressed by multiple dimensioned interpolating function is brought in described calibration model, obtains the Image Variational model under described wavelet frame.
6. image processing method as claimed in claim 5, it is characterized in that, described spread function c is defined as:
c ( | ▿ u | ) = ( cos ( π ▿ u N ) ) 2 , - N / 2 ≤ ▿ u ≤ N / 2 0 , otherwise ,
Wherein, for gradient operator.
7. image processing method as claimed in claim 1, is characterized in that, described in the detailed process of Image Variational model that solves under described wavelet frame comprise:
Described Image Variational model is rewritten as:
du J ( x , y , t ) dt = F [ t , x , y , u J ( x , y , t ) , u J ( 1,0 ) ( x , y , t ) , u J ( 0,1 ) ( x , y , t ) , u J ( 2,0 ) ( x , y , t ) , u J ( 1,1 ) ( x , y , t ) , u J ( 0,2 ) ( x , y , t ) ] ,
Wherein, and by u j(x, y, t n) be set as u n, t nthe function F in moment is set as F n;
Structure linear homotopy is: u j(x, y, t)=(1-ε) F n+ ε F n+1;
According to perturbation theory, described linear homotopy is expanded into following formula:
u J = u 0 J + ϵu 1 J + ϵ 2 u 2 J + . . . ,
The expression formula launched according to described linear homotopy and described revised Image Variational model, obtain one group of ordinary differential system, and solve the correction result obtaining described pending image;
Wherein, described ε is homotopy parameter, and
8. based on an image processing apparatus for Shannon-Blackman small echo sparse expression, it is characterized in that, comprising:
Image acquisition unit, for obtaining pending image;
Image enlarging unit, for constructing the multiple dimensioned interpolation operator based on Shannon-Blackman interpolating wavelet, amplifies described image;
Unit set up by Image Variational model, for amplify after picture construction wavelet frame under Image Variational model;
Solving unit, for solving the Image Variational model under described wavelet frame, getting a distinct image.
CN201410773139.XA 2014-12-12 2014-12-12 Image processing method and device based on Shannon Blackman small echo sparse expressions Active CN104392411B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410773139.XA CN104392411B (en) 2014-12-12 2014-12-12 Image processing method and device based on Shannon Blackman small echo sparse expressions

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410773139.XA CN104392411B (en) 2014-12-12 2014-12-12 Image processing method and device based on Shannon Blackman small echo sparse expressions

Publications (2)

Publication Number Publication Date
CN104392411A true CN104392411A (en) 2015-03-04
CN104392411B CN104392411B (en) 2017-06-16

Family

ID=52610309

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410773139.XA Active CN104392411B (en) 2014-12-12 2014-12-12 Image processing method and device based on Shannon Blackman small echo sparse expressions

Country Status (1)

Country Link
CN (1) CN104392411B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106097272A (en) * 2016-06-13 2016-11-09 河北工程大学 Image processing method based on interpolation shearing wave and device
CN107220665A (en) * 2017-05-18 2017-09-29 清华大学深圳研究生院 A kind of image interpolation method and the two-dimensional empirical mode decomposition method based on this method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030012457A1 (en) * 2001-06-11 2003-01-16 Solecki Larry John Method of super image resolution
US20030194150A1 (en) * 2002-04-16 2003-10-16 Kathrin Berkner Adaptive nonlinear image enlargement using wavelet transform coefficients
CN101488216A (en) * 2008-01-18 2009-07-22 三洋电机株式会社 Image processing device and method, and image sensing apparatus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030012457A1 (en) * 2001-06-11 2003-01-16 Solecki Larry John Method of super image resolution
US20030194150A1 (en) * 2002-04-16 2003-10-16 Kathrin Berkner Adaptive nonlinear image enlargement using wavelet transform coefficients
CN101488216A (en) * 2008-01-18 2009-07-22 三洋电机株式会社 Image processing device and method, and image sensing apparatus

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
GERT TAMBERG: "On Blackman-Harris windows for Shannon sampling series", 《PROCEEDINGS IN APPLIED MATHEMATICS AND MECHANICS》 *
林卉 等: "基于小波变换的遥感影像融合与评价", 《煤炭学报》 *
翁志娟: "利用小波变换进行图像插值", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106097272A (en) * 2016-06-13 2016-11-09 河北工程大学 Image processing method based on interpolation shearing wave and device
CN106097272B (en) * 2016-06-13 2018-12-21 河北工程大学 Image processing method and device based on interpolation shearing wave
CN107220665A (en) * 2017-05-18 2017-09-29 清华大学深圳研究生院 A kind of image interpolation method and the two-dimensional empirical mode decomposition method based on this method

Also Published As

Publication number Publication date
CN104392411B (en) 2017-06-16

Similar Documents

Publication Publication Date Title
CN104200449B (en) A kind of FPM method based on compressed sensing
CN106127688B (en) A kind of super-resolution image reconstruction method and its system
CN106204447A (en) The super resolution ratio reconstruction method with convolutional neural networks is divided based on total variance
CN106204449A (en) A kind of single image super resolution ratio reconstruction method based on symmetrical degree of depth network
CN105046672A (en) Method for image super-resolution reconstruction
CN102800076B (en) Image super-resolution reconstruction method based on double-dictionary learning
CN101794440A (en) Weighted adaptive super-resolution reconstructing method for image sequence
CN104463785A (en) Method and device for amplifying ultrasound image
CN114429422A (en) Image super-resolution reconstruction method and system based on residual channel attention network
CN105335929A (en) Depth map super-resolution method
CN102075749B (en) Image compression reconstruction method under compressed sensing frame based on non-convex model
CN104299193B (en) Image super-resolution reconstruction method based on high-frequency information and medium-frequency information
CN105095857A (en) Face data enhancement method based on key point disturbance technology
CN115953303B (en) Multi-scale image compressed sensing reconstruction method and system combining channel attention
CN105513033A (en) Super-resolution reconstruction method based on non-local simultaneous sparse representation
CN107680043A (en) Single image super-resolution output intent based on graph model
CN104252703A (en) Wavelet preprocessing and sparse representation-based satellite remote sensing image super-resolution reconstruction method
CN104766290B (en) A kind of Pixel Information estimation fusion method based on quick NSCT
CN104392411A (en) Image processing method and device based on Shannon-Blackman wavelet sparse representation
CN104091364B (en) Single-image super-resolution reconstruction method
CN105678698A (en) Non-local regularization remote sensing image super-resolution reconstruction method
CN104574294A (en) Image restoration method and device based on Shannon-Nuttall wavelet multi-scale expression
CN104463822A (en) Multi-focus image fusing method and device based on multi-scale overall filtering
CN103591887B (en) A kind of detection method of arabidopsis region phenotype
CN103413306B (en) A kind of Harris angular-point detection method of adaptive threshold

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant