USO0RE43 747E

(19) United States (12) Reissued Patent

(10) Patent Number: US RE43,747 E (45) Date of Reissued Patent: Oct. 16, 2012

Delean (54)

(56)

METHOD AND SYSTEM FOR IMAGE

References Cited

PROCESSING U.S. PATENT DOCUMENTS

(75) Inventor: Bruno Delean, Andorra (FR)

4,288,821 4,393,399 4,447,886 4,546,385 4,577,219 4,578,713 4,656,467 4,682,869 4,718,104

(73) Assignee: Intellectual Ventures I LLC,

Wilmington, DE (U S)

(21) Appl.No.: 11/487,579 (22) Filed:

Jul. 13, 2006

A A A A A A A A A

4,775,858 A

Related US. Patent Documents

9/1981 7/1983 5/1984 10/1985 3/1986 3/1986 4/1987 7/1987 1/1988

10/1988 Stapleton et al.

(Continued)

Reissue of:

(64)

Patent No.:

6,763,146

Issued:

Jul. 13, 2004

FOREIGN PATENT DOCUMENTS

Appl. No.:

10/104,936

Filed:

Mar. 21, 2002

EP

0198269

10/1986

(Continued)

U.S. Applications: (60)

Lavallee et a1. Gast et a1. Meeker Anastassiou Klie et a1. Tsao et a1. Strolle Itoh et a1. Anderson

Division of application No. 09/712,019, ?led on Nov.

OTHER PUBLICATIONS

13, 2000, now Pat. No. 6,512,855, which is a division

ofapplication No. 08/933,798, ?led on Sep. 19, 1997, now Pat. No. 6,181,836, which is a continuation of

application No. 08/327,421, ?led on Oct. 21, 1994, now Pat. No. 5,790,708, which is a continuation of

Burt et al., “The Laplacian Pyramid as a Compact Image Code,” IEEE Transaction on Communications, v01. COM-3 1, N0. 4, Apr. 1983, pp. 532-540, USA.

application No. 08/085,534, ?led on Jun. 30, 1993,

(Continued)

now abandoned.

(30)

Mar. 25, 1993

(51)

(52) (58)

Primary Examiner * Yon Couso

Foreign Application Priority Data (FR) .................................... .. 93 03455

Int. Cl. G06K 9/36 G06K 9/32

(2006.01) (2006.01)

US. Cl. ...................................... .. 382/276; 382/298

Field of Classi?cation Search ................ .. 382/276,

382/272, 232, 299, 298, 300, 302, 309, 311, 382/162; 345/428, 501, 530, 538, 555, 660,

(57)

ABSTRACT

A method for image processing in a computerized system reduces the amount of memory required for image processing and produces a layered effect which permits complex manipulation such as scaling and rotation without long delay, while allowing earlier versions of the visual image to be

recalled. The method involves pre-processing, image editing and raster image processing.

345/418

See application ?le for complete search history.

20 Claims, 10 Drawing Sheets

Ingut -

Pre

processing

\ RIP]

US RE43,747 E Page 2 U.S. PATENT DOCUMENTS 4,833,625 4,868,764 4,910,611 5,065,346 5,113,248

A A A A A

5,113,251 A A A A A A A A A A

5,117,468 5,119,081 5,119,442 5,121,195 5,121,448 5,142,616 5,157,488 5,179,639 5,179,651 5,208,911 5,225,817 5,239,625

A A A 5,245,432 A 5,249,263 A

5/1989 9/1989 3/1990 11/1991 5/1992

Fisher et al. Richards Cok Kawai et al. Hibi et al.

5/1992 Ichiyanasi et al. Hino et al. Ikehira et al. Brown Sekiet al. Katayama et a1. Kellas et al. Pennebaker Taaffe Taaffe et al.

5/1992 6/1992 6/1992 6/1992 6/1992 8/1992 10/1992 1/1993 1/1993 5/1993 7/1993 8/1993

Newman et al.

Long et al. Bogart et al. 9/1993 Jaffray et al. 9/1993 Yanker

5,251,271 A

10/1993 Fling

5,263,136 5,270,836 5,272,760 5,278,950 5,289,570 5,307,452 5,367,388 5,384,862 5,469,536

A A A A A A A A A

11/1993 12/1993 12/1993 1/1994 2/1994 4/1994 11/1994 1/1995 11/1995

5,475,803 5,548,708 5,572,499 5,740,267 5,790,708 5,907,640

A A A A A A

12/1995 8/1996 11/1996 4/1998 8/1998 5/1999

DeAguiar et al. Kang Echerer et al. Takei et al. Suzuki Hahn et al. Ossia Echerer et al. Blank Stearns et al. Sakashita et al. Kohtani Echerer et al. Delean Delean

6,023,261 A *

2/2000 Ugajin ........................ .. 345/634

6,181,836 B1 6,512,855 B1 6,763,146 B2

1/2001 Delean 1/2003 Delean 7/ 2004 Delean

FOREIGN PATENT DOCUMENTS EP EP EP EP EP EP FR FR JP WO WO W0 WO

0365456 0392753 0462788 0512839 0528631 0544509 2702861 02702861 3172075 9115830 WO-9115830 WO 92/06557 WO-9218938

4/1990 10/1990 12/1991 11/1992 2/1993 6/1993 3/1993 9/1994 7/1991 10/1991 10/1991 4/1992 10/1992

OTHER PUBLICATIONS

Gerard J. Holzmann “Beyond Photography; The Digital Darkroom,” 1988, Prentice Hall Software Series, pp. 15-73.

Scopyr, “Digital image capture and exploitation of pyramidal images,” Brochure by Avelem: Mastery of Images, Gargilesse, France.

Porter et al., “Compositing Digital Images,” Computer Graphics, Jul. 1984, vol. 18, No. 3, pp. 253-259. Posch et al., “ACM Transactions On Graphics,”, Jan. 1984, vol. 8, pp. 1-24.

“PC Paintbrush IV Plus,” ZSoft Corporation, 1990, pp. v-x, 21-24,

59-72, 79-80, 95-96, 139-150. Foley et al., “Computer Graphics: Principles and Practice,” 1990, 2nd ed., pp. 201-213 and 815-843, Addison-Wesley. Pennebaker et al., “JPEG Still Image Data Compression Standard,” 1993, Van Nostrand Reinhold, pp. 337-348 and 497-502.

Wiliams, L., “Computer Graphics,” Jul. 1983, vol. 17, pp. 1-11. Eliezer, C., “Seybold Report on Publishing Systems,” Jan. 25, 1993, vol. 22, No. 9, table of contents and pp. 3-7.

International Search Report for Application No. PCT/US94/ 03266; Applicant: Live Picture, Inc.; Mailed Aug. 29, 1994; 2 pgs. “Silkypix Developer Studio Pro 4.1.30.0 Portable” , Jul. 30, 2010. Amazon.com, Nikon D90 12.3MP Digital SLR Camera (Body

Only), http://www.amazon.com/Nikon-D90-12-3MP-Digital-Body/ dp/B001ET5U92, Nov. 12, 2010. Bradley, John, “XViInteractive Image Display For The X Window System,”Version 3.10a, 128 pages, Dec. 29, 1994. Mayall, Brian H. et al., “Experience With The Athena Semi-Auto mated Karyotyping System,” Cytometry, vol. 11, pp. 59-72, 1990. MacKay, Wendy E., “EVA: An Experimental Video Annotator For Symbolic Analysis Of Video Data,” SIGCHI Bulletin, vol. 21, No. 2, pp. 68-71, Oct. 1989.

Sasnett, Russell Mayo, “Recon?gurable Video,” Master’s Thesis submitted to Massachusetts Institute of Technology, 109 pages, Feb. 1986.

L. Williams, Computer Graphics, vol. 17, pp. 1-11 (Jul. 1983). Burt et al., IEEE Transactions on Communications, vol. COM-31,

No. 4, pp. 532-540, (1983). T. Porter and T. Duff, Computer Graphics, vol. 18, pp. 253-259 (Jul.

1984). G.J. Holzmann, Beyond Photography, The Digital Darkroom, (Prentice-Hall, 1988), pp. 15-73. KC. Posch and W.D. Fellner,ACM Transactions on Graphics, vol. 8,

pp. 1-24 (Jan. 1989). ZSoft Corporation, PC Paintbrush IV Plus, pp. v-x, 21-24, 59-72,

79-80, 95-96, 139-150 (1990). J .D. Foley et al., Computer Graphics, Principles and Practice, 2nd ed., (Addison-Wesley, 1990), pp. 201-213, 815-843. W.B. Pennebaker and J.L. Mithchell, JPEG Still Image Data Com

pression Standard, (Van No strand and Reinhold, 1993), pp. 337-348, 497-502.

C. Eliezer, Seybold Report on Publishing Systems, vol. 22, No. 9., Table-of-Contents p. and pp. 3-7 (1993).

Scopyr, Digital Image Capture and Exploitation of Pyramidal Images, brochure by AVELEM: Mastery of Images, Gargilesse, France.

* cited by examiner

US. Patent

Oct. 16, 2012

Input

Sheet 1 0f 10

US RE43,747 E

FITS MOdel

Output

TIFF

TIFF

EPSF

EPSF

Pm.

Dcs 3 processing

.IVUE*_

Image

editing

FITS

CT DDES

FITS

RIP

3 DCS CT

‘WUE

DDES ClC.

etc.

* Full IVUE or compressed IVUE

FIG. 1

US. Patent

Oct. 16, 2012

Sheet 2 0f 10

US RE43,747 E

Workstation

Powerful image editing tools. Access to servers.

Input Generate

.IVUE directly

E

/.w;

Output .IVUE-O-FTI'S .IVUE+FI'I'S 5—;

Embed FITS RIP to o?load

workstation.

w @: Access to stored images.

Compression to minimize network delays. FITS RIP for quality & performance.

US. Patent

0a. 16, 2012

Image

Sheet 3 0f 10

RIP 0 ‘

Editing

FITS Kernel

Input Pre

processing

FIG. 3

US RE43,747 E

US. Patent

061. 16, 2012

Sheet 4 0f 10

US RE43,747 E

1,10 2,10 1,9 2,9

3,10 3,9

4,10 5,10 4,9 5,9

6,10 6,9

7,10 7,9

8,10 8,9

9,10 10,10 9,9 10,9

1,8 1,7 1,6 1,5 1,4 1,3 1,2 1,1

3,8 3,7 3,6 3,5 3,4 3,3 3,2 3,1

4,8 4,7 4,6 4.5 4,4 4,3 4,2 4,1

6,8 6,7 6,6 6.5 6,4 6.3 6,2 6,1

7,8 7,7 7,6 7,5 7,4 7,3 7,2 7,1

8,8 8,7 8,6 8,5 8,4 8,3 8,2 8.1

9,8 9,7 9,6 9,5 9,4 9,3 9,2 9,1

2,8 2,7 2,6 2.5 2,4 2,3 2.2 2,1

5,8 5,7 5,6 5,5 5,4 5,3 5,2 5,1

FIG. 4A

10,8 10,7 10.6 10.5 10,4 10,3 10,2 10,1

US. Patent

P

UGwbu m a

US RE43,747 E

Sheet50f10

()ct 16,2012

I s

1‘1;1..a.F

0 oc o 0

.xo o no .F.xob o .xo o 0 1.xo oia o.

u v

FIG. 4B T +256»

Full De?nition

Jr

0

—1 Definition

De?nition 000°

FIG. 5

d

HFmum.nowMOmm.

US. Patent

Oct. 16, 2012

US RE43,747 E

Sheet 6 0f 10

1

2

o 0

3

K

o

o 0

o

o

Rectangle K

Row 1

Row 2

w

:

P rows

0

Row P

L__v____) q pixels/row

//

Row 1

Row 2

Row P

1/

FIG. 6

U.S. Patent

0a. 16, 2012

Sheet 7 0f 10

mNb—oohl>- o lv—

US RE43,747 E

US. Patent 0

.File

0a. 16, 2012

Edi! Monan Palette

09 Fib Edit Malian PM

Sheet 9 0f 10

US RE43,747 E

Llybul

L

II

DE: "'

I

I

HUB T

US. Patent

0a. 16, 2012

Sheet 10 0f 10

g?“ // ‘ z»,—

US RE43,747 E

9g|

US RE43,747 E 1

2 Prior image retouching systems have used large mainframe

METHOD AND SYSTEM FOR IMAGE PROCESSING

computers or work stations and proprietary hardware. For

example, US. Pat. No. 5,142,616, issued Aug. 25, 1992 to Kellas, et al., teaches an electronic graphic system. In this system, data relating to a user-de?ned low resolution image functions to control an image by the combining other image data with data de?ning a low resolution representation of the initial image. Once desired modi?cations have been

Matter enclosed in heavy brackets [ ] appears in the original patent but forms no part of this reissue speci?ca tion; matter printed in italics indicates the additions made by reissue.

achieved, the image is displayed on a display monitor so that a low resolution control image is converted to a high resolu

This invention relates to computer processing in general,

tion representation. Stapleton, et al., US. Pat. No. 4,775,858,

and more particularly to a method and system for image

issued Oct. 4, 1988, also teaches the use of a large frame store to produce an image of higher resolution than that found on a

processing. This patent application is a divisional of US. application Ser. No. 09/712,019, ?led Nov. 13, 2000, now US. Pat. No. 6,512,855 which is a divisional of US. appli cation Ser. No. 08/933,798, ?led Sep. 19, 1997, now US. Pat. No. 6,181,836, which is a continuation of US. application Ser. No. 08/327,421, ?led on Oct. 21, 1994, now US. Pat. No. 5,790,708, which is a continuation of US. application Ser. No. 08/085,534, ?led on Jun. 30, 1993, now abandoned. This

television screen.

Due to the high amount of memory required for processing, personal computers have proven very slow and marginally acceptable. Moreover, even with larger mainframe systems, there is not always a good correlation between the monitor and the printed image since there is not always a way to 20

resolution and print resolution. Other relevant patents

cation No. 93.03455, ?led Mar. 25, 1993, the contents of which are herein incorporated by reference. BACKGROUND OF THE INVENTION

include: US. Pat. No. 5,179,651 issued Jan. 12, 1993 to Taaffe, et al., US. Pat. No. 5,065,346, issuedNov. 12, 1991 to 25

The present invention was created in response to the short

comings of the current generation of image retouching sys tems. Other retouching systems use one of two methods for

visualize the ?nal image on the display device. Thus, discrep ancies can be introduced due to differences between screen

patent application also claims priority of French patent appli

Kawai, et al., US. Pat. No. 4,656,467, issuedApr. 7, 1987 to Strolle, US. Pat. No. 4,833,625, issued May 23, 1989 to Fisher, et al., US. Pat. No. 4,288,821, issued Sep. 8, 1991 to Lavallee, et al., and US. Pat. No. 4,546,385, issued Oct. 8, 1985 to Anastassiou.

30

Numerous image processing procedures currently exist.

handling images: (1) high resolution/low resolution (high,

Common to all procedures is modi?cation of an image

res/low res), and (2) virtual image. Each of these two

through recalculation operations to irreversibly rearrange

approaches overcomes some major obstacles, however nei ther fully responds to the needs of today’ s color professionals for high quality, and fast response at an affordable price. In the high res/low res approach, the complete scanned

dots or picture elements (“pixels”) of an original image (or those resulting from the most recent modi?cation) into a new 35

arrangement. Perhaps the greatest disadvantage of known procedures

image (referred to as the “high res” image) is subsampled to

stems from the image that is displayed on the monitor not

yield a much smaller image (referred to as the “low res”

being identical to the image that will eventually be printed,

image). Because previous image retouching systems did not yield “real time” performance when handling large images

rendering the operator unable to see the work as it will actu 40

(over 10M or 10 million bytes), it was necessary to invent an

approach to allow the retouching system work on a smaller, i.e. low res image that would yield acceptable response times for the operator. Using this approach, retouching actions are stored in a script. When retouching is complete, the script is typically passed to a more powerful, and expensive, server and “executed.” That is, the actions contained in the script are applied to the high res image, which results in a high quality ?nal image. The disadvantage of this approach is that the operator does not work with the actual image or at highly detailed levels (particularly for a magni?ed “close-up” of a portion). As a result, it is not always possible to perform highly detailed retouching actions such as silhouetting and masking. Moreover, unpleasant surprises may occur upon execution.

monitor screen is in most cases vastly less de?ned than the

scanned image held in the computer’s memory. (This is 45

untrue only in the case of small, low resolution images.)

Resolution (as measured in dots per inch) of modern display monitors is far less than the resolution of printed color

images. 50

A second and perhaps equally important disadvantage of known image processing techniques is that the image editing effects are applied sequentially, i.e. step-by-step. This incurs a severe degradation in the quality of the original image if many image editing effects are applied to the same portion of an image.

55

The virtual image approach, commonly used by desktop image editing packages (e.g. MacIntosh or Windows types),

Operations carried out on an image usually require a high

degree of processing power. If processing power is unavail able, then the time required to carry out the operation becomes unacceptably long, thus reducing the scope and

manipulates a copy of the actual image held in memory. In

sophistication of possible operations to be carried out on the

some cases, one or more copies or intermediate drafts are

held, enabling the user to revert to a previous copy if an error

ally appear in print. Anomalies and discrepancies can there fore occur in the printed image. Known procedures cannot resolve the fact that the image displayed on the operator’s

60

image. For example, airbrush strokes are currently extremely

is introduced. Using the virtual image approach, the image

limited in size as a result of the extreme processing power

itself is transformed as retouching effects are applied.

needed to calculated image changes. The irreversible nature of image processing using known

The virtual image approach suffers two important short comings: ?rst, large amounts of memory are required; and second, each effect is applied immediately to the entire image so that complex manipulation, such as large airbrushing, scal

ing and rotation, incur long processing delays.

procedures precludes the operator from easily implementing 65

any second thoughts. Presently, the only way to correct an airbrush stroke which does not achieve a desired effect is to

superimpose a new stroke (instead of merely erasing the

US RE43,747 E 3

4

unsuccessful stroke). Alternatively, computers equipped with

are stored layer-by-layer in a ?le separate from the original image(s). Each intermediate modi?cation to the image is effectively saved in a layer and each layer can be indepen dently modi?ed, deleted or reordered. The parameters can be stored for points in a grid that is itself independent of the

large memory can save intermediate steps. However, this

requires a huge amount ofmemory (e.g., a single 81/2">< 300 dots per inch (dpi) ?gure requires over 33 million bytes). The present invention overcomes these shortcomings and permits rapid and powerful editing functions even on less powerful desktop computers, by employing at least one, more preferably two and most preferably three new and indepen dent processes: preprocessing, image editing, and raster

“dots-per-inch” resolution (dpi) of either the original imported images, or the ?nal output images. As a result, images for display or print can be generated at an arbitrary resolution.

image processing.

Substantially less memory is required during image editing

The subject invention advantageously uses what I call a

than with the virtual image approach since only the changes to

Functional Interpolating Transfer System (FITS) to greatly

each layer are stored, not entire image each time. As a result,

speed editing of an image on standard microcomputers, thus eliminating the need for expensive workstations or special hardware. FITS breaks down image processing into three

a sophisticated, heavily retouched new image consisting of over 10 layers can be described in a FITS ?le of 2-5 mega

bytes (2-5M), as compared with over 30M (megabytes) for existing virtual image systems to store a 1 page new image (at 300 dpi resolution). Thus, the FITS approach yields a 10 to 1 average savings perpage of image, and substantially more for

steps: preprocessing, image editing and FITS raster image processing. This results in a virtually instantaneous response

and eliminates waiting for ?le saving or processing updates. With this technique, limits on ?le size and resolution disap pear.

larger images or higher resolutions. Note that 600 dpi images 20

Preprocessing in the invention (brand name “FITS”) involves creating a specially formatted version of an image

which allows image editing to progress at rapid speed. Image editing refers to the process of retouching, combin ing or otherwise modifying images, to create the ?nal desired

are now quite common for high quality publishing, and this is likely to increase in the future. To sum up, current computerized image processing for obtaining a high de?nition image suffers from the dual dis

advantages of requiring extremely high processing power, a 25

limitation of productivity and creativity for the operator due to the irreversibility of image editing steps, and the quality

image. Image editing involves, in the broadest sense, all pro cessing operations performed on an original image. This includes the combining of images, effects such as sharpening,

restrictions inherent in a pixel-based approach. The subject invention, on the other hand, provides a com

blurring, brightening, darkening, distortion, and include

puterized image processing procedure which enables the

modi?cations to the color or appearance of all or part of a 30 operator to rapidly carry out advanced graphic operations, original image. and to reverse decisions as requirediwithout in any way

Color changes may be achieved in a variety of ways includ ing global changes to the chromatic range of the image, or selective change to individual colors, e.g. changing blue to red.

affecting the de?nition or precision of the ?nal image. SUMMARY OF THE INVENTION 35

Raster image processing (“RIP”) is performed in two

The invention provides an image processing system for the creating and editing images that are resolution independent

instances: (1) each time a new screen view is generated for display on a monitor, and (2) when an output page is gener

ated for the purpose of printing or incorporated into another system such as a desktop publishing system. FITS raster

40

and characterized by a series of layers, or image objects, that can be combined together to yield an output image, at any resolution, for display or print. The new method of image

image processing combines the input images with the modi ?cations generated in the second stage (image editing) to

processing in a computerized system creates a high perfor mance image representation, that yields much faster image

create either a screen or print image. The output image gen erated by the FITS RIP can have any resolution; thus it is said

processing by supplying data de?ning an original image into the system and reorganizing the original image data.

to be resolution independent.

45

printing or display on a monitor. Modi?cations to the image, made during image editing, are characterized in a manner that

pixels from the original image to pixels in the new image format in such a way that the new image is organized in 50

groups (preferably rectangles and most preferably squares), each of which can be individually compressed (using JPEG or

another compression algorithm) to yield reduced image size

is independent of the resolution of the input images or ?nal output image. During a FITS RIP, layers are ?rst combined mathematically for each pixel or selected pixels in the desired

and faster access over a network, (3) creating a second, lower

resolution, image by averaging groups of pixels falling within

image, rather than by applying each layer successively to the original images. For each ?nal pixel, a single mathematical function is generated that describes the color, in an arbitrary color space, at that point. If, as preferred, only a sample of pixels are fully computed for each layer of change, the color values of intermediate pixels are computed by averaging the mathematical functions of the neighboring pixels and apply ing that function average to the original pixel’s color, rather than simply averaging the color values of the surrounding pixels. This approach results in a time savings in overall

55

image handling and a higher quality resulting image.

65

In the FITS approach, the image editing actions are char acterized by parameters to mathematical functions and these

One aspect of this method (pre-processing, which I call

“IVUE” format) comprises the following steps: (1) supplying data de?ning the original image into the system, (2) assigning

FITS raster image processing (“FITS RIP”) involves tak ing the ensemble of image manipulations (the various steps or “layers” of changes) that are performed during the image editing process and computing a single image for purposes of

a ?rst predetermined area (or neighborhood) into an averaged pixel, and performing this computation across the entire original image; this second image is also organized in groups,

e.g. squares, (4) repeating the previous step, and thereby creating succession of decreasing resolution images, which 60

are stored adjacent to the ?rst two, until a number of pixels less than or equal to a preselected number of pixels remain,

and (5) saving the resulting image representation on a storage device. Also provided is a method for image processing in a com puterized system that involves applying changes to one or more original images as a series of “layers” in which the changes are recorded as resolution-independent mathemati

US RE43,747 E 5

6

cal functions. This approach has the property that only the

data or mathematical functions de?ning the pixels that form

?nal result of the retouching effects in a layer needs to be

tially reversible. The layers themselves are independent and

the desired result. Moreover, the data de?ning the original image may be added to the data de?ning the pixels forming the desired result, and forming an image from the added data.

may at any time be modi?ed, deleted, or reordered. The changes in each layer are generally characterized in a way that

processing which includes: (a) adding data de?ning an origi

calculated or characterized and the effects are wholly or par

The invention may also include a method of raster image

is independent of resolution. This aspect of the method comprises the following steps:

nal image to data de?ning modi?cations to a reduced de?ni

tion image, and (b) forming an image from the added data. Preferably, this is accomplished by a computerized system which comprises: (a) means for adding data de?ning pixels

(1) for a layer 1, 2, 3, etc., generally number “i”, displaying the results of the image processing up to and including all effects applied and original effects inserted for the “i—l”th

layer (e.g. 5th layer) (2) recording all effects applied in the ith

forming an original image to data de?ning modi?cations to a reduced de?nition image, and (b) means for forming an image

layer (e.g. 6th layer) as parameters to mathematical functions that de?ne the effect, so that for each pixel in the displayed image that is modi?ed there is a single function that describes

from the added data. The invention may also include a computerized system for

image processing, comprises: (a) means for assigning pixels

the resulting modi?cation, (3) when the operator terminates processing of the ith layer these parameters are saved along

from an original image to pixels in a new ?rst image format so

with the parameters that describe changes to the preceding

i—l layers. Also provided is a method for image processing in a com

20

puterized system that enables a raster image to be computed, either with the ability of displaying the image on a computer monitor or for printing the image. This method involves: (l) sampling an original image to be processed with a de?nition grid so as to retain a predeter

organized across the entire ?rst image format, to form a reduced de?nition image. Preferably, means are provided for

reducing the number of the ?rst averaged pixels by averaging 25

mined number of dots from all of the dots contained within

groups of pixels falling within a second predetermined area

into a second averaged pixel, organized by the groups of pixels, performing this computation across the entire image format, and repeating this step until a preselected number of pixels remain, the remaining pixels forming a ?nal reduced

the original image, the predetermined number being equal to or less than the number required to either display the result on a computer monitor or to generate an output ?le destined to be

printed; and (2) for each dot in the grid to generate a single mathematical function that represents the cumulative effect of all the layers in the image at that point. This is done by

that the ?rst image is organized into compressible groups of pixels, and (b) means for reducing the number of assigned pixels to form a reduced resolution image by averaging a particular number of adjacent pixels falling within a ?rst (preferably predetermined) area into a ?rst averaged pixel,

30

de?nition image. BRIEF DESCRIPTION OF THE FIGURES

processing the resulting image into elementary recurrent operations each broken down into three parts and providing, based on the result of the previous elementary operation, these three parts added to each other, (3) ?lling in suf?cient additional dots, or pixels, within the grid to reach the required

FIG. liA schematic representation of processing steps of 35

between system hardware. FIG. 3iA schematic representation of software architec

resolution for screen or print by interpolating the functions at the surrounding gridpoints to obtain a single function that can

be applied to intermediate pixels and will yield an interpo lated color value for that pixel, (4) computing the color value results for each pixel, and (5) either printing or displaying the

ture. 40

FIG. 4BiA schematic illustration of a pixel reduction

grid. 45

FIG. SiA schematic illustration of the IVUE format. FIG. 6iA schematic illustration of the FITS reduction.

FIG. 7iA schematic illustration of 2i><2j density func

from the original image to pixels in a new ?rst image format so that the ?rst image is organized into groups of pixels, each of the groups being individually compressible to yield a

reduced size image, and (c) reducing the number of assigned pixels to form a reduced resolution image by averaging (pref

FIG. 4AiA numerical/ graphic illustration of a pixel

reduction grid.

result, or storing the result on a computer storage device. The invention may use a method of image processing in a

computerized system, comprising: (a) supplying data de?n ing an original image into the system, (b) assigning pixels

the invention. FIG. 2iA schematic representation of interconnections

tions.

FIGS. 8A-FiDepictions of computer monitors showing the invention in use. 50

DETAILED DESCRIPTION OF THE INVENTION

erably using a Gaussian function to weight the average for

pixel proximity) a particular number of adjacent pixels falling within a ?rst (preferably predetermined) area into a ?rst aver

aged pixel, organized by the groups of pixels, and performing

55

image retouching systems. The current common personal computer approach, often referred to as virtual image, manipulates a copy of the actual image, which is held in

this computation across the entire ?rst image format, to form a reduced de?nition image.

This method may (and preferably does) further comprise reducing the number of the ?rst averaged pixels by averaging groups of pixels falling within a second predetermined area

into a second averaged pixel, organized by the groups of pixels, performing this computation across the entire second image format, and (preferably) repeating this step until a preselected or lower number of pixels remain, the remaining pixels forming a reduced de?nition image. Data de?ning the reduced de?nition image may be modi?ed by a user to obtain a desired result and the system or user may save a copy of the

To aid in understanding the invention, the following over view is provided: The subject invention was created in response to the shortcomings of the current generation of

memory. 60

Functional interpolating transformation system (FITS)

65

takes a radically different approach in which the underlying image is preserved, and changes are recorded in separate layers in a ?le, named FITS. By processing only changes to the current screen, FITS computes only what is needed, when needed. Further, all modi?cations are resolution independent and can be used to generate output images at any level of resolution (commonly measured in dots per inch or dpi). FIG.

US RE43,747 E 7

8

1 shows an overview of the FITS model, FIG. 2 depicts the interaction of hardware involved, and FIGS. 8A-F show the

be used, both for the full image and for close-up details. As an option, a second IVUE ?le may be created that is compressed using conventional methods, such as JPEG, or by other meth ods The IVUE ?le contains all of the original image data. The image is divided into squares. Each of the squares in each of the various image representations within the IVUE ?le may be individually compressed (see FIG. 5). This is a

system in use.

When image editing is complete, the operator initiates a computation which applies the changes across the entire image. This ?nal processing is termed FITS raster image

processing (RIP) and is vaguely analogous to Postscript raster image processing (a system for generating the raster image

unique approach since other image processing systems com press the entire image. The resulting ?le, termed .IVUE/C, is considerably smaller than the original ?le. The actual size of

that corresponds to pages of printed information described

using the Postscript language). Unlike many high-end and mid-range color systems that

the ?le depends on the compression level used to generate the IVUE ?le. Average compression will yield an 8 to 1 average reduction in the size of the image. In a ?rst product to be based on this invention, to be called Live Picture, for example, three compression levels may be selected when creating the IVUE ?le.

oblige the operator to work with a low-resolution image, FITS operates in high-resolution, i.e., the operator may at any time access any information contained in the original image(s)

without being limited by the FITS processing approach. The subject invention will now be described in terms of its preferred embodiments. These embodiments are set forth to aid understanding the invention, but are not to be construed as

Saving the IVUE sampled ?les together with the original ?le takes up only about 30% more space than the original

limiting. Moreover, the invention includes using only some aspects, or indeed, only one aspect, of the most preferred method.

20

alone. For example, for 1A sampling with the original being assigned 1, the memory required is

The new image processing system is for creating and edit ing images that are resolution independent where the images are characterized by a series of layers that can be combined

together to yield an output image, at any resolution, for dis

25

play or print. Note that the term “layers” can also refer to

or approximately 1.3 times the original ?le size. FIG. 4A shows a 10x10 pixel box in which each of the pixels are identi?ed by a column, row number. The smaller

image objects that are managed independently and combined in pixel format for purposes of output.

The general expression for characterizing an image, using this approach, is as follows:

30

fn(x,y):a combination of one or more of such components as:

external image(s) position independent terms position dependent terms fn_l(x,y) or prior layers

35

1,3 can be determined by averaging 1,1 and 1,5. By thinking

Where fn(x,y) is the color value of a point of an image, in an arbitrary color space (e.g. RGB, or CMYK), at a layer n.

External imageimay be any external image. In FITS, these images are preferably transformed into Input format for fast processing. Generally, however, the images may be in any format. Position independent termsithese are modi?cations which do not depend on the position of the image element. For example, a color applied in a layer to the entire image. Position dependent termsithese are geometric trans

of column 1,1-1,5 as a vector and row 1,1-5,1 as another

vector, each of the pixels can be identi?ed and reconstructed. 40

Another advantage to this system of picking two points out side of the 4x4 pixel square is that a redundancy exists. Returning to FIG. 4A, pixel 1,5 acts as the origin for the 4x4 box above the initial box described. Again, the 5,1 pixels

45

the larger black line square, (having comer points 1,1, 1,8,

serves as the origin for the next 4><4 pixel box. Turning now to

8,8, and 8,1, this 16x16 square will after the ?rst set of reductions, be a 4 pixel square which can be handled in much the manner described above. Once the 256 pixel square

forms, color modi?cations, etc. supplied selectively to differ ent regions of the image. fn_l(x,y)ithe function that describes the color in the preceding layer. The color value of a point (x,y) in layer n may be de?ned by

enclosed box is a 4x4 matrix which is reduced to a single

point. One way to complete the reduction, or apply the FITS layer to do the RIP, is to select an origin point (in this case, 1,1, is selected). Two points are then selected outside of the box along the column and row, as depicted, point 1,5 and 5,1. By knowing these three pixels, each of the pixels in the box can be identi?ed by a simple division by two. For example, pixel

remains, or some other predetermined sized square or area, 50

the next step of image editing can occur. Alternatively, the

a single mathematical function which combines an external

IVUE sampling to make a lower resolution image can average

image or images, position dependent terms, position indepen

4 pixels to make 1, or sample a large group using weighting (e.g. Gaussian) to achieve any desired ratio or compression.

dent terms, and the function de?ning the point (x,y) for the

preceding layer.

A compressed image can be stored either on the operator’ s 55

Three Steps

reduces the disk requirement. In addition, when the IVUE/C ?le is held on a ?le server, network delay in accessing the image is minimized since FITS accesses the IVUE ?le one

FITS comprises three independent processes: preprocess

ing, image editing, and FITS raster image processing (FITS RIP). FITS is overviewed in FIGS. 1 and 6. FIG. 3 illustrates the software architecture.

workstation or on a network ?le server. This approach greatly

screen at a time. 60

There are two principal advantages of using this compres

sion: (1) only the IVUE ?le is used during image editing; thus,

Prepossessing. Initially the input image, in TIFF or another

use of a compressed ?le decreases the disk requirement on the

standard format (such as Postscript), is reorganized to create a specially formatted new ?le, termed IVUE. The IVUE ?le is

retouching station, and (2) during image editing, FITS

used during image editing and also during the FITS RIP. It is

65

accesses the IVUE ?le one screen at a time; thus if the image is on a network image server use of the compression option

reorganized in such a way that a new screen full of image data

will greatly reduce operator wait times induced by network

may be quickly constructed. The screen’s best resolution can

delay.

US RE43,747 E 10

9

Ely-(x,y) is the probability density function for pixel (i,j) at point (x,y). Usually, (x,y) is near to the origin point (i,j), that

The JPEG (or the like) compressed image is used only during the screen editing step, where the quality of the com

pressed image is perfectly acceptable. However, the full image, also in IVUE format, is used during the FITS RIP, in order to obtain the highest quality image. So while I PEG may

is in the “neighborhood.” Thus E is the weight (such as 50% for near points, 20% for more distant points) of any particular neighbor point x,y relative to the “home base” or origin of i,j.

be used to improve a speed and memory, it does not lessen the

The weights are set up to total 100%, and so that E is positive

quality of image. This last point is key because many people

(not zero) in the de?ned radius of the neighborhood (which

incorrectly assume that the use of J PEG will degrade image

can but need not include the whole image). Once E goes to

quality.

zero, there goes the neighborhood, that is, points at or beyond

Preprocessing to IVUE format is fast; for example an A4 image takes approximately 11/2 minutes on a Mac Quadra. Generally, a TIFF image is reprocessed at the rate of 1/2

that distance are not weighted in. Thus

megabyte per second.

and

The following method may be used to generate an IVUE image, which comprises a succession of reduced resolution images each of which is stored as a rectangle.

0< gij(x,y)
This new, reduced image may be stored in rectangles of

l) The original image, in a standard or proprietary image format is opened (i.e., accessed on a storage device). 2) The original image is used to create the ?rst, full reso lution image in the IVUE ?le. It is preferably stored as a

p>
20

succession of p pixel>
4) The third step may be repeated, creating a sucession of images, each (say) 1A the size of the last, until a subim age of less than p>
5) The entire image format is saved on a storage device.

sequential (row 1, row 2, row 3, . . . row p). (See FIGS.

Image editing. Image editing refers to the process of retouching, creation and composition of images. The operator

4A, 4B and 5 for organization of rectangles). Each rect angle may be encoded using JPEG or another compres sion scheme.

successively applies effects such as blur, smooth, and trans formations such as rotation and scaling. Additional images can be inserted at any time and, if desired, with transparency

3) A subsequent, reduced resolution image is created from

25

30

and masking. Each editing action is represented by a mathematical func

the previous image, if there are more than p>
the previous image. Essentially, a neighborhood of pix

tion and recorded in a ?le named .FITS. The .FITS ?le can be

els in the original image are averaged to provide a single pixel in the second image. The image is reduced in each

considered as a database of commands or layers, and is a very

dimension, x and y, by a factor of 2 (or whatever is selected) yielding a 4 to 1 reduction in size for the

compact representation. 35

subimage.

freely applied. In Live Picture, the operator will be able opt to

The general computation for computing fn+l(i,j), the pixel

initiate a new layer at any time, and when a new mode is

at point i,j in the n+1 st subimage is:

selected, a new layer is automatically created and all subse 40

FITS modes include: image insertion (insertion of a

$(x,y) is an arbitrary probability density function integrating

scanned image), painting, pattern, ?lters, lighting effects, mirror, linework and plug-in (i.e. a layer de?ned by an arbi 45

trary application). Text is treated as a special case of linework, since it can be composed of Bezier curves. In fact, there are two types of image insertion modes: standard and advanced. The advanced mode offers the opportunity to distort the

50

decrease in response time.

or a selection of elements in the vicinity. e is an element of.

v is a neighborhood of, and thus v(i,j) is the neighboring area

of the point i,j. As a density function, $(x,y) satis?es the following:

quent actions are contained within this new layer (until a new

layer is created).

in which: over the entire space of real numbers, i.e. a weighting function, that takes into account the contribution of the neighboring area. Thus we may consider $(x,y)ev(2i,2j)

FITS implements types of layers, referred to as FITS modes. For each mode a set of actions are available and can be

image at the price of additional processing and a slight

With FITS, each image editing action is represented by a mathematical function. When the operator ?nishes working on a layer, the parameters of these functions are recorded in a

The presently preferred weighting function is a Gaussian

55

?le named FITS. Only the resulting aggregate modi?cations to the underlying image are recorded. If, for example, the operator applies an effect and then erases it then nothing is

density function. However, other functions may be used as well. As an example, the neighboring weighted average has been

stored. Or, an artist may use hundreds of brush strokes to

create a complex painting, yet the FITS representation describes the resulting painting and not the sequence of brush

implemented on a computer as depicted in FIG. 7. In this case: 60

strokes used to create it.

Thus, FITS typically only records the ?nal effect and not necessarily each image editing action. This saves processing time and also results in a very compact representation of the image editing session within a FITS ?le. For example, if an

Alternatively, an equation which may be used for comput

ing fn+l(i,j), the pixel at point i,j in the n+1 st subimage is: 65

where

A4 image, stored in a 35 Mbyte ?le is heavily retouched, in (ten or more layers), the .FITS ?le will only grow about 2-5 MB.

US RE43,747 E 11

12 Pi(x,y) represents geometric transforms, including rotation,

The FITS retouching ?le may be saved at any time, and may later be reused or modi?ed. At any time, either during the image editing session, each layer can be accessed and re edited.

scaling, distortion and may also include chromatic trans forms of imported dot x,y, yi(x,y) is an additional position dependent term that can affect the color value of pixel (x,y), Each of the terms (pl-(x,y) Ii[Pi(x,y)] and yi(x,y) may be nil, while the term (XI-(x,y) ¢i_l(x,y) should generally never be nil for all the dots (x,y). There is generally no part in

FITS Raster Image Processing (FITS RIP). The invention provides a computerized procedure for cre ating a raster image. This procedure is used both to create a new view of the image on a computer monitor and to create a

high resolution output image. The procedure preferably has

observing all of the prior image.

the following characteristics:

Due to the form of the elementary operations, they can be combined to yield a global function that has a simple struc

Based on the area of the image to be raster image processed

(RIP’ed), which is generally determined by the operator,

ture. The global function, de?ned below, de?nes the color

a de?nition grid is constructed in such a way as to retain,

value at point x,y for an image composed of a number of

from all the pixels to be processed, points equal at the

layers:

most to the number that can be displayed on the monitor

screen, For fast processing, a ratio of 1 dot to 16 pixels can be used. The area to be RIP’ed refers to a portion or

all of the image to be displayed or processed for printing. The objective is to compute the color value resulting from the superposition of a series of layers. The color value is in an arbitrary color space. Commonly, this is in either the colorspace named RGB, de?ned by the three primaries red, green, blue, or in CMYK, de?ned by the three colors cyan, magenta, yellow and an additional value for black.

[jIQ j:

20

or alternatively

2 Fl

25

For one point in each de?nition grid, the general expression for the color value of that point is computed. In practice, a simpli?ed form of the general expression is generally

or alternatively qu

used that can describe most image editing actions. This

form is termed “elementary operation” and it has the

30

advantage of being relative simple to compute. The elementary operations are broken down in turn into three stages and when combined a new result (layer i), based

on the result of the previous elementary operation (layer i—1). The three stages are:

35

?rst, the adoption in the new layer (i) of a color dot (x,y)

at at least one point).

from the previous layer (i—1) with a weighing (0&1) rang

Ij represents an image or layer j to import Pj(x,y) is P,- an import function analogous to the previous

ing from —100% to 100% (i.e., margins from +1 to —1

and including positive and negative value), second, the importing of an external image (Ii) into the layer i, that is, the importing of a color dot from the image (ii), after chromatic and geometric transformation

40

tions Y.-(X,Y), in this procedure, the global function can be generated, but not yet computed, for one point within each grid 45

(depicted in FIG. 4). since the grid represents a subset of the pixels required for the RIP, it is necessary to generate the remaining points, within each grid. For each additional point in the grid a new function is created by interpolating the

by a scalar [3(x,y) with values from —100% to 100%. third, an additional color term yi(x,y) applied to the dot (x,y) of the layer (i). This term may take into account painting or other chromatic effects.

each elementary operation (i) being de?ned by the equa

import functions Pi(x,y) y(x,y) is a chromatic function analogous to chromatic func

(Pl-(x,y)) of this dot to add it to the color dot (x,y) of the

layer (i), the degree of replacement of the dot of the layer (i) by the dot imported from the image (Ii) being de?ned

q:number of imported images that make a visible contri bution at point x,y, in this global function: (xj(x,y) is a scalar analogous to the scalar (XI-(x,y) of a elementary function and 0t].(x,y).neq. 0 (not equal to zero

50

tion taking account of the previous layer or operation

function between the two nearest points where the

global function has been computed. This process is termed functional interpolation. The simplest form of

(1—1):

the function is to created a weighted average based on

distance. As an example, assume the grids are 16x16 and the global

function has been created for dots (1,1) and (1,17). Further, that the global function at dot (1,1) yields cos(x,y) when simpli?ed and the global function at dot (17,1) yields sin(x,y) when simpli?ed. Then the interpolated function at point (1,8)

or alternatively: where

(XI-(x,y) is a scalar function of the dot (x,y) corresponding to the presence at this dot of the image resulting from the

60

is employed, and points 1 and 5 computed, the computer is

previous elementary operation ¢i_l(x,y),

very fast. Point 3 is a simple add and divide by 2 of points 1 and 5. Point 2 is the same average of points 1 and 3. See FIG.

¢i_l(x,y) is a function representing the previous elementary

operation, [3i(x,y) is scalar function corresponding to the presence at dot

(x,y) of a dot corresponding to the imported image, I,- represents the imported image made up of a set of dots,

will be (9/16)cos(x,y)+(7/16)sin(x,y). Ifthe use ofa 4><4 box

65

4A. the functions that have been obtained for each pixel, some

being global functions and some being interpolated functions, are calculated for each pixel.

US RE43,747 E 14

13 The subject method is particularly ef?cient for image pro

(a) sampling an original image to be processed with a de?nition grid so as to retain a predetermined number of

cessing for two reasons: the global function has a relatively simple form and thus can be easily computed, and very little

dots from all of the dots contained within the original

computation is required to generate the interpolated func

image, the predetermined number being approximately

tions. Use of functional interpolation provides a major time saving. For example, when 4><4 grids of l 6 pixels are used the global function is generated only for 1/16 of the total pixels. It

equal to the number that can be displayed on a monitor screen to obtain a resulting image; and

(b) processing the resulting image into elementary recur rent operations each broken down into three parts and providing, based on the result of the previous elementary operation, these three parts added to each other repre

is because of this that high speed, real-time, image processing can be achieved.

The changes to the image caused by the operator actions

senting:

are carried out and displayed almost instantaneously, i.e. in

?rst, adopting color dot at position coordinates (x,y) in the new layer (i) from previous layer (i—l) with a weighing (0&1) ranging from 0 to :100%, second, importing a color dot from external image (Ii) into the layer i, after any desired chromatic and geometric

real time. The operator may, at any moment return and redo a

elementary operation. This is because different actions and their results (i.e., the layers) are de?ned by simple elementary equations. These can be easily modi?ed. In this way, the invention allows for any image effect, such

transformation (Pl-(x,y)) of this dot to add it to the color

as airbrushing, blurring, contrasting, dissolving effects, color modi?cations, in short any operation concerning image graphics and color. The invention also enables geometrical

20

dot (x,y) of the layer (i), the degree of replacement of the dot of the layer (i) by the dot imported from the image (Ii) being de?ned by a scaler (Bl-(x,y)) with values from

transformations or modi?cations, such as rotation, changes of scale, etc. Using FITS, a microcomputer system can follow the actions of the operator, using input means such as in

third, chromatically modifying (yi(x,y)) on dot (x,y) of

general a mouse or light pen on an interactive tracing table, in

each elementary operation (i) being de?ned by the equa

real time.

0 to :100%, and

layer (i), 25

tion

This input (e.g. pen) provides two types of command sig nals: one is a position signal giving the coordinates (x,y) of the dot concerned, and if necessary its environment (for example the path of an airbrush stroke); the other uses the pressure of the pen on the table to create a second type of

30

signal. In the airbrush example, it would govern the density of

previous elementary operation ¢i_l(x,y),

the color being “sprayed”. The parameters for each elementary operation are con stantly updated as the work evolves. To save space and time, only the parameters for dots in the de?nition grid that have a

4),; l(x,y) is a function representing the previous elementary

operation, 35

value or which are show a variation relative to their neighbors are stored. In this way the operator can access, at any moment,

either the present overall result of all the operations, or inter mediate results corresponding to one or several layers. Thus, the operator can intervene and modify a layer without affect

chromatic geometric transfer of one of the set of dots in 40

45

processing (RIP) at the required image de?nition. The RIP computes only those pixels necessary to update the screen, taking into account the portion of the image being displayed

the dots (x,y); 50

function whose parameters are de?ned at all the dots of

55

depending on whether the image zone covers an area of small 60

or great variation to facilitate processing and correction. Even if the ?nal image is unsatisfactory, e.g. the control run has been carried out and a proof image printed, it is still possible to go back and correct any intermediate stage to yield

puterized system, which comprises:

representing i ?rst elementary operations to obtain a

the de?nition grid

generated during image editing within a layer are, in general,

An alternative method for processing image data in a com

yi(x,y) is a chromatic function representing a color trans formation function carried out on a dot (x,y), each of the terms BiIipPi(x,y)] and yi(x,y) can be zero while the term (XI-(x,y) ¢i_l(x,y) is normally never zero for all the elementary operations are effected to obtain a function

The number of dots for which the global function should be

a better result.

elementary operation (pl-(x,y), image,

stage.

relatively small because function evolves with little variation (its second derivative is generally very low for most of the dots in the image). Function only varies substantially at dots corresponding to a large color change. The grid chosen for the de?nition of elementary functions may have an equal mesh at all points. Alternatively, it may be constructed using a different sized mesh at various points,

the image towards the layer (i), to which is applied the Ii[Pl-(x,y)] is the function corresponding to the import of the

level of recurrence and are taken into account during the RIP

and the zoom factor.

[3i(x,y) is scaler function corresponding to the presence at dot (x,y) of a dot corresponding to the imported image, Il- represents the imported image made up of a set of dots,

Pi(x,y) is the function of image import representing the

ing other layers. The link between the layers is only at the When all the necessary operations are ?nished, and the operator wishes to produce the ?nal image or an intermediate image at a given de?nition, the operator orders a raster image

wherein: (XI-(x,y) is a scaler function of the dot (x,y) corresponding to the presence at this dot of the image resulting from the

wherein, q:number of imported images, 0t].(x,y) 1s a scaler 'analogous to the scaler (XI-(x,y) of a

elementary function, I]. represents an image j to import, Pj(x,y) is an import function analogous to the preV1ous 65

import functions Pi(x,y), y(x,y) is a chromatic function analogous to chromatic func

tions Y.(x,y),

US RE43,747 E 15

16

the global function being de?ned by interpolating it at the

matic function yi(x,y) is expressed as a function of the color C and as a complement l to the coef?cient of presence of the

intermediate dots between the dots of the de?nition grid, these intermediate dots depending on the de?nition

previous image, that is

required for the ?nal image, the pixels being calculated for each dot to be obtained.

A system for using this method generally comprises: (a)

The choice of scaler (XI-(x,y) at each dot translates the den

means for sampling an original image to be processed with a

sity of color left by the airbrush. The function of color presence (XI-(x,y) or [l—(xl.(x,y)], i.e.

de?nition grid so as to retain a predetermined number of dots

from all of the dots contained within the original image, the

51-, can be represented by a Gauss function centered on one

predetermined number being approximately equal to the

dot, limited for example to 10% at the edge of the disk. In

number that can be displayed on a monitor screen to obtain a

other words, the two extreme ends of the Gaussian curve

resulting image, and (b) means for processing the resulting image into elementary recurrent operations each broken

beyond 10% (or any other value which may be selected) are

down into three parts and providing, based on the result of the

applied beyond the disk radius chosen.

suppressed. This means that the Gauss function will not be

previous elementary operation, these three parts added to

2) Image Fusion

each other representing the old image, a new imported image

This operation imports an external image into an existing one. Based on the general equation, this importation opera

and a color change, as above. The elementary operations are effected to obtain a function

tion is de?ned as follows:

representing i ?rst elementary operations to obtain a function whose parameters are de?ned at all the dots of the de?nition

20

grid, using the summation function above. The global function is de?ned by interpolating it at the intermediate dots between the dots of the de?nition grid, these intermediate dots depending on the de?nition required for the ?nal image, the pixels being calculated for each dot to be obtained.

25

EXAMPLES

l) Airbrushing

In the general equation (1) to which are applied the par ticular conditions relating to this operation:

The chromatic functionyl. is zero and the coef?cients (xi and

[3,- are complementary coef?cients (their sum is equal to one). 30

In fact, as a hypothesis for this type of operation, a dot of

This involves in making a line with a color. As this line imitates that made by an airbrush, it can be treated as a

pletely, a dot of the previous image. This corresponds in the

succession of colored dots created by the airbrush spray. The

?rst instance to a more or less pronounced dissolve and in the

distribution of the color density in a airbrush dot is a Gaussian function. This means that the intensity of the color is at its

the imported image replaces, more or less, or even com

second to the replacement of the part of the previous image 35

greatest in the center of the dot, diminishing towards the edges as a Gauss function. In a real airbrush, the intensity depends on the pres sure exerted on the trigger, which widens or otherwise changes the ink spray within the air jet. Such a pressure can be simulated in a computerized system by rep

within the contour of the imported one.

The equation below can be simpli?ed and thus gives the

equation for image fusion: 40

resenting (as explained above) a dot by a circle of color with

It should be noted that in the general equation of a layer i,

a density variation between the center and edge expressed as

the scaler 0t,- should never be zero at all points of the layer. On

a Gauss function. The saturation at the center can vary

the other hand, if there is no image importation, the scaler [3,

between 0 and l (or zero and 100%).

should be zero at every point (x,y).

To sum up, the line of an aerograph is a succession of

To lighten or darken an image, it is necessary to use the

colored disks, of which it is possible to modify the path (the location of the disk centers), and the color density. Based on the general equation (1) and the airbrush charac

chromatic function yi(x,y). As explained above, the general

teristics, this equation becomes the following:

50

function (pl-(x,y) should not be limited to only the chromatic function, for this would mean suppressing all the images in layers 1 to i—l (disappearance of (PM), that is, the recurrence. The darken/lighten function therefore assists in adding a color to the color at the previous dot x,y (function of (PM). Based on the general equation, as follows:

55 C = color constant of the “projected material”

and the general equation becomes the following: 60

¢iY):ai(X>Y)¢ii1(X>Y)+[1_ai(X>Y)l'C We obtain:

As there is no imported image in the path of the airbrush, the coef?cient of presence [31. of an external image is nil at all

points of the layer. The application of the airbrush consists in replacing par tially or totally the previous shade of a dot by the shade of the

color “projected” by the airspray. Because of this, the chro

65

4) Deformation/Anamorphosis This operation can be applied to an existing or image. In

fact, if it is desired to transform part of the image of the layer

Method and system for image processing

Jul 13, 2006 - images,” Brochure by Avelem: Mastery of Images, Gargilesse,. France. Porter et al. ..... known image processing techniques is that the image editing effects are applied ..... 6iA schematic illustration of the FITS reduction. FIG.

2MB Sizes 2 Downloads 362 Views

Recommend Documents

Method and system for image processing
Jul 13, 2006 - US RE43,747 E. 0 .File Edi! Monan Palette Llybul. 09 Fib Edit Malian PM L. II I ... image editing packages (e.g. MacIntosh or Windows types), manipulates a copy of ...... ¢iY):ai(X>Y)¢ii1(X>Y)+[1_ai(X>Y)l'C. As there is no ...

Image retrieval system and image retrieval method
Dec 15, 2005 - face unit to the retrieval processing unit, image data stored in the image information storing unit is retrieved in the retrieval processing unit, and ...

Method for processing dross
Nov 20, 1980 - dross than is recovered using prior art cleaning and recovery processes. ..... 7 is an illustration of the cutting edge ofa knife associated with the ...

Method for processing dross
Nov 20, 1980 - able Products from Aluminum Dross", Bur. of Mines. Report of .... the salt bath must be heated at a temperature substan tially above its melting ...

Method for processing dross
Nov 20, 1980 - the free metal entrained in dross or skimmings obtained from the production of aluminum or aluminum based alloys. In the course of conventional aluminum melting op ..... 7 is an illustration of the cutting edge ofa knife.

Electrosurgery system and method
Dec 19, 2002 - FOREIGN PATENT DOCUMENTS. (22) Filed: Dec. ... US PATENT DOCUMENTS pulsed r.f. ...... voltage detector by the doctor. 4. A generator ...

System and method for multicurrency transactions
Mar 18, 2003 - operator of server 100 and the currency broker or brokers. ..... lar mail, email, etc. .... rency or currencies from the list of convertible currencies.

System and method for multicurrency transactions
Mar 18, 2003 - (73) Assignees: PayPal, Inc., San Jose, CA (US);. PayPal International .... network (such as the Internet) and wherein the customer pays for a ...

System and method for controlled directional drilling
May 23, 1989 - [73] Assignee: Smith International, Inc., Houston,. Ten. ... Step”; Canadian Petroleum; Feb. 1966. ...... being i of a day ahead of schedule.

System and method for protecting a computer system from malicious ...
Nov 7, 2010 - so often in order to take advantage of neW virus detection techniques (e. g. .... and wireless Personal Communications Systems (PCS) devices ...

System and method for protecting a computer system from malicious ...
Nov 7, 2010 - ABSTRACT. In a computer system, a ?rst electronic data processor is .... 2005/0240810 A1 10/2005 Safford et al. 6,505,300 ... 6,633,963 B1 10/2003 Ellison et a1' ...... top computers, laptop computers, hand-held computers,.

Digital Image Processing Digital Image Processing - CPE, KU
Domain Filtering. Band reject filter ... Reject Filter: Degraded image. DFT. Notch filter. (freq. Domain). Restored image. Noise ..... Then we get, the motion blurring transfer function: dt e. vuH. T ..... Another name: the spectrum equalization filt

Structured cabling system and method
Dec 7, 2009 - installation is typically carried out at an early stage of build ing ?t-out and can be .... With a respective [integrated desktop connector] insulation.

Automatic steering system and method
Feb 6, 2008 - Such sophisticated autopilot and auto matic steering ..... ware and software complexities associated with proportional steering correction.

Technical Report - Heidelberg Collaboratory for Image Processing
supervised learning framework to tackle this problem. Our framework resembles a .... proposed in the computer vision community for natural image deblurring (see. [12] and ... Firstly, we draw basic statistics from low level features and use RBF kerne

Digital Image Processing
companion web site offers useful support in a number of important areas. For the Student or Independent Reader the site contains: Brief tutorials on probability, ...

feature extraction & image processing for computer vision.pdf ...
feature extraction & image processing for computer vision.pdf. feature extraction & image processing for computer vision.pdf. Open. Extract. Open with. Sign In.

Automatic steering system and method
Feb 6, 2008 - TRACK DRIVE PUMP ... viding GPS-based guidance for an auxiliary steering system, which is installed in .... actual turning rate in a track drive vehicle. FIG. .... ware and software complexities associated with proportional.

Image processing using linear light values and other image ...
Nov 12, 2004 - US 7,158,668 B2. Jan. 2, 2007. (10) Patent N0.: (45) Date of Patent: (54). (75) ..... 2003, available at , 5.

Image shake correction image processing apparatus and program
Dec 29, 2010 - S3 élggll?gg sELEcT BLOCKS. CALCULATE. TO BE STEPPED. S4. CORR. ... which detects an image shake due to camera shake with an.