text:
Method of revealing hidden content via handheld display device
First Claim
1. A method of revealing hidden content associated with printed content using a handheld display device, said method comprising the steps of:
- imaging an area of a printed substrate and generating image data using an image sensor of the handheld display device, the imaged area of the printed substrate containing the printed content but no hidden content;
determining interaction data using said image data, said interaction data identifying a page description corresponding to at least part of the printed substrate;
retrieving display data using the page description, said display data including the hidden content associated with the printed content;
displaying, on an opaque touch-sensitive display screen of the handheld display device, display information at least partially based on said display data, said display information including the hidden content, wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content, and wherein the opaque display screen additionally displays the hidden content in real-time as if it were printed on the printed substrate.
1 Assignment
0 Petitions
Accused Products
A method of revealing hidden content associated with printed content using a handheld display device. The method includes the steps of: imaging an area of a printed substrate and generating image data using an image sensor; determining interaction data using the image data; retrieving display data using an identified page description, the display data including the hidden content associated with the printed content; displaying, on an opaque touch-sensitive display screen of the handheld display device, display information based on the display data and including the hidden content. The opaque display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content. The opaque display screen additionally displays the hidden content in real-time as if it were printed on the printed substrate.
43 Citations
No References
Patent #US 20100184464A1
Filed 03/30/2010
Current AssigneeSilverbrook Research Pty Limited
Sponsoring EntitySilverbrook Research Pty Limited
|Method for accessing content from a computer network via a mobile phone
Patent #US 7,777,911 B2
Filed 01/16/2007
Current AssigneeSilverbrook Research Pty Limited
Sponsoring EntitySilverbrook Research Pty Limited
|Mobile telecommunication device with integral printer mechanism and sensing means
Patent #US 7,609,410 B2
Filed 08/13/2004
Current AssigneeSilverbrook Research Pty Limited
Sponsoring EntitySilverbrook Research Pty Limited
|Retrieval and manipulation of electronically stored information via pointers embedded in the associated printed material
Patent #US 6,964,374 B1
Filed 10/02/1998
Current AssigneeWSOU Investments LLC
Sponsoring EntityAlcatel-Lucent USA Inc.
|Multi-positional handset for personal digital assistant
Patent #US 5,974,334 A
Filed 10/16/1997
Current AssigneeBlackberry Limited
Sponsoring EntityTelefonaktiebolaget LM Ericsson
|System for storing, accessing and displaying html encoded
Patent #US 6,152,369 A
Filed 08/04/1997
Current AssigneeMetrologic Instruments Incorporated
Sponsoring EntityMetrologic Instruments Incorporated
|System and method for composing sets of URL-encoded bar code symbols while using an internet browser program
Patent #US 6,622,917 B1
Filed 02/18/2000
Current AssigneeMetrologic Instruments Incorporated
Sponsoring EntityMetrologic Instruments Incorporated
|Electronic shopping system utilizing a program downloadable wireless videophone
Patent #US 6,512,919 B2
Filed 03/30/1999
Current AssigneeKnapp Investment Company Limited
Sponsoring EntityFujitsu Limited
|Methods and systems for providing human/computer interfaces
Patent #US 6,076,734 A
Filed 10/10/1997
Current AssigneeVulcan Patents LLC
Sponsoring EntityInterval Research Corporation
|Methods and systems for providing a resource in an electronic network
Patent #US 5,995,105 A
Filed 10/04/1996
Current AssigneeAdventure Gallery Software Limited Liability Company
Sponsoring EntityMotorola Inc.
|Viewer configured to display, and method of displaying, information on a display to at least partially take into account a position of the viewer relative to a surface
Patent #US 7,019,319 B2
Filed 09/20/2004
Current AssigneeSilverbrook Research Pty Limited
Sponsoring EntitySilverbrook Research Pty Limited
|Portable data collection system
Patent #US 20020000470A1
Filed 01/30/2001
Current AssigneeSymbol Technologies Inc.
Sponsoring EntitySymbol Technologies Inc.
|Hand-held with auto-zoom for graphical display of Web page
Patent #US 20020030699A1
Filed 07/19/2000
Current AssigneeKoninklijke Philips N.V.
Sponsoring EntityKoninklijke Philips N.V.
|Method and apparatus for using a touch screen display on a portable intelligent communications device
Patent #US 6,433,801 B1
Filed 09/26/1997
Current AssigneeOptis Wireless Technology LLC
Sponsoring EntityTelefonaktiebolaget LM Ericsson
|Method and apparatus for providing a handheld scanner-dictionary apparatus
Patent #US 6,208,435 B1
Filed 03/24/1998
Current AssigneeJan Scott Zwolinski
Sponsoring EntityJan Scott Zwolinski
|Graphical user interface touch screen with an auto zoom feature
Patent #US 6,211,856 B1
Filed 04/17/1998
Current AssigneeUS Philips Corporation
Sponsoring EntityUS Philips Corporation
Patent #US 20010040584A1
Filed 02/16/1999
Current AssigneeIntel Corporation
Sponsoring EntityIntel Corporation
|Multiple mode wireless telephone
Patent #US 6,332,084 B1
Filed 10/09/1999
Current AssigneeQualcomm Inc.
Sponsoring EntityQualcomm Inc.
|Marking medium area with encoded identifier for producing action through network
Patent #US 6,330,976 B1
Filed 03/25/1999
Current AssigneeXerox Corporation
Sponsoring EntityXerox Corporation
|Hand held scanning device
Patent #US 6,043,503 A
Filed 07/22/1998
Current AssigneeHewlett-Packard Development Company L.P.
Sponsoring EntityHP Inc.
|Information processing apparatus
Patent #US 6,100,878 A
Filed 11/18/1992
Current AssigneeSony Corporation
Sponsoring EntitySony Corporation
|Hand-held optically readable character set reader having automatic focus control for operation over a range of distances
Patent #US 6,138,915 A
Filed 11/13/1998
Current AssigneeIntermec IP Corporation
Sponsoring EntityIntermec IP Corporation
Patent #US 5,900,110 A
Filed 07/15/1997
Current AssigneeAvery Dennison Retail Information Services LLC
Sponsoring Entity-
|Hypertext markup language based telephone apparatus
Patent #US 5,923,736 A
Filed 04/02/1996
Current AssigneeNational Semiconductor Corporation
Sponsoring Entity-
|Method for providing human input to a computer
Patent #US 5,982,352 A
Filed 06/29/1995
Current AssigneeTimothy R. Pryor
Sponsoring EntityTimothy R. Pryor
|Printer with motion detection
Patent #US 5,825,995 A
Filed 03/11/1996
Current AssigneeIntermec IP Corporation
Sponsoring EntityIntermec IP Corporation
|Multi-functional personal telecommunications apparatus
Patent #US 5,835,577 A
Filed 04/25/1996
Current AssigneeAU Optronics Corporation
Sponsoring EntityAnixa Biosciences Inc. fka ITUS Corporation
|Absolute optical position determination
Patent #US 5,852,434 A
Filed 12/18/1995
Current AssigneeAnoto Group AB
Sponsoring EntityOral F. Sekendur
|Method and apparatus for reducing bandwidth limited noise in bar code scanner
Patent #US 5,852,286 A
Filed 03/20/1996
Current AssigneePTO
Sponsoring EntityPTO
|Fluorescent detecting apparatus and method
Patent #US 5,608,225 A
Filed 03/08/1995
Current AssigneeHitachi Maxell Limited, MAXELL SEIKI LTD.
Sponsoring EntityHitachi Maxell Limited, MAXELL SEIKI LTD.
|Pen and paper information recording system
Patent #US 5,652,412 A
Filed 07/11/1994
Current AssigneeSIA TECHNOLOGY CORP.
Sponsoring EntitySIA TECHNOLOGY CORP.
|Pen and paper information recording system using an imaging pen
Patent #US 5,661,506 A
Filed 11/10/1994
Current AssigneeSIA TECHNOLOGY CORPORATION
Sponsoring EntitySIA TECHNOLOGY CORPORATION
|Fluorescence authentication reader with coaxial optics
Patent #US 5,666,417 A
Filed 08/08/1996
Current AssigneeAngstrom Technologies Inc.
Sponsoring EntityAngstrom Technologies Inc.
|Formless forms and paper web using a reference-based mark extraction technique
Patent #US 5,692,073 A
Filed 07/30/1996
Current AssigneeXerox Corporation
Sponsoring EntityXerox Corporation
|Hand-held optical scanner with onboard battery recharging assembly
Patent #US 5,381,020 A
Filed 03/31/1993
Current AssigneeHewlett-Packard Development Company L.P.
Sponsoring EntityHP Inc.
|Infrared intrusion sensor
Patent #US 5,465,080 A
Filed 09/07/1994
Current AssigneeCommonwealth of Australia
Sponsoring EntityCommonwealth of Australia
|Optical position determination
Patent #US 5,477,012 A
Filed 04/03/1992
Current AssigneeOral F. Sekendur
Sponsoring EntityOral F. Sekendur
|Stylus pen
Patent #US 5,290,972 A
Filed 01/26/1993
Current AssigneeFujikura Rubber Limited, Fujikura Limited
Sponsoring EntityFujikura Rubber Limited, Fujikura Limited
|Instrumentation system with multiple sensor modules
Patent #US 5,347,476 A
Filed 11/25/1992
Current AssigneeRonald V. Mcbean Sr
Sponsoring EntityRonald V. Mcbean Sr
|Auto focusing bar code reader
Patent #US 5,192,856 A
Filed 11/19/1990
Current AssigneeAN-CON GENETICS INC. A CORP. OF DE
Sponsoring EntityAN-CON GENETICS INC. A CORP. OF DE
|Optical stylus and passive digitizing tablet data input system
Patent #US 5,051,736 A
Filed 06/28/1989
Current AssigneeInternational Business Machines Corporation
Sponsoring EntityInternational Business Machines Corporation
|Automated transaction system with modular printhead having print authentication feature
Patent #US 4,864,618 A
Filed 10/17/1988
Current AssigneePitney Bowes Incorporated
Sponsoring EntityWRIGHT TECHNOLOGIES L.P. A PARTNERSHIP OF DE
|Touch panel apparatus
Patent #US 4,888,479 A
Filed 02/24/1989
Current AssigneeSony Corporation
Sponsoring EntitySony Corporation
20 Claims
- 1. A method of revealing hidden content associated with printed content using a handheld display device, said method comprising the steps of:
imaging an area of a printed substrate and generating image data using an image sensor of the handheld display device, the imaged area of the printed substrate containing the printed content but no hidden content; determining interaction data using said image data, said interaction data identifying a page description corresponding to at least part of the printed substrate; retrieving display data using the page description, said display data including the hidden content associated with the printed content; displaying, on an opaque touch-sensitive display screen of the handheld display device, display information at least partially based on said display data, said display information including the hidden content, wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content, and wherein the opaque display screen additionally displays the hidden content in real-time as if it were printed on the printed substrate.
- View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
- 13. A handheld display device for revealing hidden content associated with printed content, said device comprising:
an optical sensor for imaging an area of a printed substrate containing the printed content and generating image data; a processor for determining interaction data using the image data, said interaction data identifying a page description corresponding to at least part of the printed substrate; a data retrieval unit for retrieving display data using the page description, said display data including the hidden content associated with the printed content; an opaque touch-sensitive display screen for displaying display information based at least partially on said display data, said display information including the hidden content, wherein the opaque display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content, and wherein the opaque display screen additionally displays the hidden content in real-time as if it were printed on the printed substrate.
- View Dependent Claims (14, 15, 16, 17, 18, 19)
- 20. An interactive application for execution on a handheld display device having an image sensor, a processor and an opaque touch-sensitive display screen, the interactive application being configured to operatively control the device so as to perform the steps of:
imaging an area of a printed substrate and generating image data using the image sensor of the handheld display device, the imaged area of the printed substrate containing printed content; determining interaction data using said image data, said interaction data identifying a page description corresponding to at least part of the printed substrate; retrieving display data using the page description, said display data including hidden content associated with the printed content; displaying, on the opaque touch-sensitive display screen, display information at least partially based on said display data, said display information including the hidden content, wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content, and wherein the opaque display screen additionally displays the hidden content in real-time as if it were printed on the printed substrate.
1 Specification
This application is a Continuation of U.S. application Ser. No. 12/750,501 filed Mar. 30, 2010, which is a Continuation of U.S. application Ser. No. 12/341,873 filed Dec. 22, 2008, which is a Continuation of U.S. application Ser. No. 10/917,436 filed Aug. 13, 2004, now issued U.S. Pat. No. 7,609,410, which is a Continuation of U.S. application Ser. No. 09/722,147 filed Nov. 25, 2000, now issued as U.S. Pat. No. 6,946,672 all of which is herein incorporated by reference.
The present invention relates generally to devices for interacting with computer systems, and in particular, to a device which may be used to render otherwise passive surfaces audiovisually interactive via invisible surface codings.
Various methods, systems and apparatus relating to the present invention are disclosed in the following co-pending applications/granted patents filed by the applicant or assignee of the present invention.
The disclosures of these co-pending applications are incorporated herein by cross-reference.
Various methods, systems and apparatus relating to the present invention are disclosed in the following co-pending applications/granted patents filed by the applicant or assignee of the present invention on Oct. 20, 2000:
The disclosures of these co-pending applications are incorporated herein by reference.
Various methods, systems and apparatus relating to the present invention are disclosed in the following co-pending applications/granted patents filed by the applicant or assignee of the present invention on Sep. 15, 2000:
The disclosures of these co-pending applications are incorporated herein by reference.
Various methods, systems and apparatus relating to the present invention are disclosed in the following co-pending applications/granted patents filed by the applicant or assignee of the present invention on Jun. 30, 2000:
The disclosures of these co-pending applications are incorporated herein by cross-reference.
Various methods, systems and apparatus relating to the present invention are disclosed in the following co-pending applications/granted patents filed by the applicant or assignee of the present invention on 23 May 2000:
The disclosures of these co-pending applications are incorporated herein by cross-reference.
Devices such as personal computers, personal digital assistants and even mobile phones may be used to interact with audiovisual information and with computer applications which have an audiovisual interface.
In general, these devices don'"'"'t provide access to situated interactive information or application interfaces, e.g. to an online fan club chat group associated with a concert poster encountered at a train station, or a mortgage calculator associated with a flyer received through the mail. Each device must be used to seek out the desired information or application interface through a virtual space accessible through the device, or the information or application must be brought to the device in a device-compatible physical format.
The present invention utilizes methods, systems and devices related to a system referred to as "netpage", described in our co-pending applications listed above, wherein invisible coded data is disposed on various surfaces to render the surfaces interactive in the manner of graphical user interfaces to computer systems.
In one broad form the invention provides a viewer with one or more sensors capable of sensing coded data. Images which include coded data are sensed by the viewer and decoded. The decoded information is transmitted to a computer system which associates the decoded data with one or more files stored on the system, using previously stored association data. The file or files are transmitted to the viewer and to the user via the viewer'"'"'s display screen. The device includes a printing mechanism which allows markings to be made on a substrate. The markings may be based partially or wholly on user input or on data transmitted from the computer system to the viewer.
Accordingly, in one broad form, the invention provides a viewer including:
at least one sensor for sensing coded data on or in a substrate and for generating first data;
a transceiver for transmitting said first data or second data at least partially based on the first data to a computer system and for receiving at least display data associated with an identity derived from the first data from the computer system;
at least one display device for outputting visual information based at least partially on said display data, and
a printer mechanism for printing on the substrate.
Printer mechanisms other than conventional ink deposition type print mechanisms may be used. Examples of other types of print mechanisms include the use of thermal paper, such as used in facsimile machines. In addition the substrate may be imprinted with electronically active inks and the print mechanism may be a device for selectively changing the state of the electronically active inks. For a better understanding of electronically active inks, reference is made to U.S. Pat. Nos. 6,017,584, 6,124,851, 6,120,839, 6,120,588, 6,118,426 and 6,067,185, all assigned to E Ink Corporation, the contents of each of which are included herein by reference.
In one form the visual output corresponds to a human discernable interface on the substrate, such as text.
In use the viewer may be moved across a substrate tiled with data encoded tags and the output is modified as the viewer is moved across the substrate so as to correspond to the interface on the substrate.
The optical output may correspond to the interface but be text in the same or a different language as the interface. The optical output may include the same, more or less information as the interface on the substrate. The interface may represent information, such as bank account information which is not displayed on the interface in full but is displayed in full via the viewer.
The device preferably has controls to enable the optical output to display information with a size the same, less or more than the corresponding information on the interface.
The device preferably includes a touch screen and the optical output includes interactive elements by which the user may modify the optical output by interaction with the touch screen.
The touch screen may be used to input writing or other markings from the user. The viewer may then print markings on the substrate based on the user input markings. The markings printed may be substantially identical to the user input markings or may be printed text corresponding to user input handwriting after the user input has undergone text recognition processes.
The device may also display motion pictures, in which case the physical relationship between the viewer and the substrate once the coded data has been transmitted may be immaterial.
The viewer may also include memory into which a file or files are downloaded for subsequent viewing.
When the viewer is lifted from the page the portion of the page with which the viewer was last in contact can be retained by the viewer and remain interactive. The viewer can do this by default, or alternatively only when the user 'freezes' or 'snaps' the current view before lifting the viewer from the page, as discussed in more detail below. The viewer may include controls for rotating and panning the view after the viewer has been lifted from the page, allowing the viewer to be used to navigate an entire page after only a single contact with it. The navigation controls may be in the form of a small joystick, or a pair of orthogonal thumb wheels, or may be provided via the touch-screen.
The viewer senses the identity of the underlying page as well as its own position and orientation relative to the page using a netpage sensor embedded in the viewer. The viewer can contain multiple sensors (one in each corner, for example), so that it works when only partially overlapping a page or even when overlapping multiple pages. A single sensor located in the center of the viewer is sufficient for most purposes, however, and is most economical.
The viewer is capable of providing an enhanced view of the underlying page. In the dark, for example, it can provide a lit view of the page. When magnification is needed, it can provide a zoomed view of the page via its zoom controls. The viewer may also be able to provide a zoomed-out view of the page.
The viewer can provide an alternative (or additional) netpage data entry mechanism, i.e. the usual kinds of inputs, including drawing and handwriting and gestures, can be captured relative to the displayed page via the touch-screen instead of relative to the physical page via the netpage pen.
The viewer can provide access to dynamic content, such as audio and video, in the context of a physical page. Playback controls which provide access to interactive content are typically only shown when the page is viewed through the viewer. They may be shown on the printed page as well, although ideally in a form which clearly indicates that they are inactive. Status information such as playing time may also be shown on-screen. The underlying page layout should provide space for the display of interactive controls and status information, so that the printed page and on-screen display remain compatible. Interactive control is not limited to playback of streaming media such as audio and video. It can include arbitrary interaction with a computer application. It may, for example, include manipulation of an object in 3D.
Referring to
The viewer 100 is a netpage system enabled device and communicates with a netpage system in a similar manner to that disclosed in the co-pending applications referred to earlier and in particular to application U.S. Ser. No. 09/722,142 and U.S. Ser. Nos. 09/721,893.
The viewer 100 has upper and lower moldings 114 and 116 respectively which encapsulate a PCB 118 and all of the electronic components are mounted on or connected to this PCB. Power for the device is supplied by a rechargeable 3 volt lithium ion battery 120. The battery is not user replaceable and is located within the casing.
The PCB 118 and attached electronics is attached to the upper molding 114 by screws 125. The printer assembly is attached to the lower molding 116 by screws 127, which pass through the chassis 223 into bosses 242 in the lower molding 116.
The two moldings 114 and 116 are joined together by four screws 124, which extend through the lower molding 116 to engage the upper molding 114.
The PCB includes four electrical switches which are acted on by the push buttons. The zoom buttons 186 allows the view to be zoomed in, zoomed out, and, when activated simultaneously, to be reset to normal scale. The snap button allows the nearest dynamic or interactive object to be snapped to the screen. It more generally allows the current view to be de-synchronized (or 'frozen' or 'lifted') from the underlying page. Optional pan controls allow the view to be panned independently of the underlying page. The power button allows the viewer to be switched on and off. The volume control, in the form of a potentiometer, allows the volume of the viewer'"'"'s audio output to be controlled. The audio output is used to play audio content associated with a page, and optionally to provide operating feedback to the user.
A combined data and power connector 134 is connected to the PCB and is accessible via opening 136 in the casing. The connector 134 includes a power input socket 138 for recharging of the battery 120 and a data socket 140 for input/output of data to and from the device. The connector 134 is connected to the PCB via a flexible PCB 142 and connectors 144 and 146.
The speaker 106 is also connected to the PCB at its lower edge via connector 148 and is positioned between the PCB and the lower edge of the casing. The speaker may be hard wired to the PCB rather than being provided with a removable connector.
Digital audio generated by the viewer is converted to analog via a digital-to-analog converter (DAC) 173, is amplified by an amplifier 177 subject to the volume control 108, and is output to a speaker 106 or to an external audio device via an audio out jack 110. The speaker is disabled when the audio jack is in use.
The volume control 108 and audio out jack 110 are mounted directly on the left hand side of the PCB and are accessible via openings 154 and 156 respectively in the left hand side of the casing.
The battery 120 is also positioned between the PCB and the lower edge of the casing. A removable connector 150 is provided to connect the battery to the PCB. However, since the battery is not intended to be user replaceable, a permanent connection may be used. The battery is preferably shaped to fit the casing and accordingly has a beveled corner 152.
Mounted on the lower surface of the PCB is the optical sensor device 112 capable of detecting infrared markings on a substrate. The sensing device 112 comprises an infrared LED 160 and an image sensor 162. In use infrared light is emitted from the LED 160 and passed through an optical guide 164 and then through an aperture 166 in the lower molding. Reflected light passes through the aperture 166, the optical molding 164 and is focused onto the CCD 162. The optical molding preferably includes a lens 168 and may include a beam splitter/combiner to allow light from and to the LED and the CCD to follow the same path. The LED 160 may be strobed in synchrony with image capture to prevent motion-blurring of captured tag images. The image sensor 162 typically consists of a 200×200 pixel CCD or CMOS image sensor with a near-infrared bandpass filter.
The PCB also includes a processor chip 170, DRAM 172, flash ROM 174, a display controller 270 for controlling the LCD, a transceiver chip 178 and an aerial 180.
In order to display video, the color display 102 usefully has a 4:3 aspect ratio, although with the advent of DVD and digital broadcasting, digital video content with wide screen aspect ratios of 16:9 and wider are becoming more prevalent. The aspect ratio used is not critical. The minimum useful resolution is preferably SIF resolution, which has a square-pixel equivalent of 320×240 pixels. In order to display text, the display preferably has a pitch of at least 100 pixels per inch, giving a maximum diagonal display size of four inches. Larger displays with correspondingly more pixels provide obvious benefits, although with the added expense of a larger form factor and greater processing and communications bandwidth requirements.
The display ideally mimics the optical properties of the underlying paper, i.e. the paper'"'"'s high reflectivity, high contrast, and Lambertian reflectance function. Although the display may be a conventional back-lit color LCD, such as an active-matrix twisted-nematic (TN) color LCD, it is more usefully a reflective display, such as a passive-matrix cholesteric color LCD from Kent Displays Inc, an electrophoretic display from E Ink Corporation, or a rotating ball display from Xerox Corporation, Inc. It may also be a low cost organic LED (OLED) display.
Display output generated by the viewer is routed to the display 102 via the display controller 270. Assuming a 320×240 RGB pixel display, the display controller 270 has an associated or embedded 0.25 Mbyte single-buffered or 0.5 Mbyte double-buffered display memory 181.
A dedicated compressed video and audio decoder 171 which produces square-pixel progressive-scan digital video and digital audio output is also provided. To handle MPEG-1 encoded video and audio, a video and audio decoder similar to a C-Cube CL680 decoder may be used. To handle MPEG-2 encoded video and audio, a video and audio decoder similar to C-Cube'"'"'s ZiVA-3 decoder may be used. An MPEG-1 decoder typically uses a 4 Mbit DRAM during decoding, while an MPEG-2 decoder typically uses a 16 Mbit SRAM during decoding. The decoder memory 179 may be dedicated to the decoder, or may be part of a memory 172 shared with the processor.
The processor 175 controls and coordinates the various electronic components of the viewer. The processor executes software which monitors, via the sensor(s) 112, the identity of the underlying page and the position of the viewer relative to the page; communicates the identity and position data to a netpage base station via the wireless transceiver 183,178; receives identity- and position-related page data from the base station via the transceiver; renders user output to the color display 102 and audio output; and interprets user input captured via the user interface buttons 104 and the screen'"'"'s touch sensor 132. The embedded software executed by the processor is stored in the non-volatile memory 174, which is typically a ROM and/or flash memory. Identity information unique to the viewer, as well as communications encryption keys, are also stored in non-volatile memory. During execution the processor utilizes faster volatile memory, typically in the form of a 256 Mbit (32 Mbyte) dynamic RAM (DRAM) 172.
The processor 175 communicates with the other components via a shared bus 280. The processor 175, the bus 280, and any number of other components may be integrated into a single chip. As indicated in
The processor 175 is sufficiently powerful to render page content at interactive rates, i.e. at least 10 Hz, and to transform video decompressed by the video decoder and merge it with other page content. If it is sufficiently powerful, then it may also perform video and audio decoding, obviating the need for a video and audio decoder.
The transceiver 178 is typically a short-range radio transceiver. It may support any of a number of wireless transmission standards, including Bluetooth/IEEE 802.15, IEEE 802.11, HomeRF/SWAP, HIPERLAN, and OpenAir. Bluetooth/IEEE 802.15, IEEE 802.11-1997, HIPERLAN, OpenAir, and HomeRF/SWAP all support transmission rates in the range of 1 to 2 Mbit/s. IEEE 802.11b supports transmission rates of 5.5 Mbit/s and 11 Mbit/s. HIPERLAN also supports a transmission rate of 24 Mbit/s in an alternative mode. Beyond these currently-supported wireless LAN (WLAN) standards, next-generation WLAN standards promise to support transmission rates of 100 Mbit/s and higher.
The viewer may alternatively be connected to the a base station by cable, or may utilize a non-radio-frequency wireless transport, such as infrared. IEEE 802.11, for example, optionally utilizes an infrared transport. IrDA also utilizes an infrared transport.
The lower surface of the lower casing 16 is provided with four outer feet 182 and four inner feet 184. The outer feet are located near the corners of the device whilst the inner feet 184 are located at the corners of a square centered on the lens 168.
All eight feet extend the same distance and enable the device to be placed on a planar surface with a small gap between the surface and the general plane of the lower molding. The feet have a rounded contact surface and this aids in sliding the device across the surface. The inner feet 184 ensure that if one or more of the outer feet 182 are not supported the device does not tip relative to the surface. They also aid in keeping the surface flat near the sensing device 112.
The sensor device 112 is infrared sensitive. The CCD 162 is sensitive to infrared light, either inherently or by use of filters and the LED 160 emits infrared light, again inherently or by use of filters. The lens 168 is focused on the plane of the inner and outer feet 182 and 184, as this is where a substrate to be sensed will be located. The sensor device is capable of detecting infrared absorptive tags, such as netpage tags. For a full description of the processes involved, reference is made to our co-pending application U.S. Ser. No. 09/721,893 referred to earlier. The CCD 162, the LED 160 and processing functions incorporated in the processor chip 170 are similar to those disclosed in the co-pending application.
The device is thus capable of sensing and decoding netpage tags on a substrate. Image data captured by the CCD 162 is sent to the processor chip 170 and decoded to a region ID (or page ID) and a tag ID. The region ID and tag ID, together with other necessary information, is transmitted to the netpage system via the transceiver chip 183,178. The netpage system resolves the region ID and tag ID to corresponding document data which it transmits back to the device. The processor receives the document data via the transceiver, and renders the data for display on the color display 102 via the display controller 270.
The LCD screen 102 is overlaid with a touch sensitive overlay 132. When viewing information via the LCD screen, the screen will include controls to enable the user to control the device by touching the screen with a non-marking stylus.
The viewer 100 also includes a printer assembly, which is located in the body of the viewer.
The print assembly includes a printhead assembly 202 and an ink cartridge 201 connected together by a hose assembly 205. The printhead assembly 202 includes a printhead 203. The lower molding 116 has an ink cartridge compartment 208 to enable user replacement of the ink cartridge 201. The compartment 208 is accessed via cover 209. The hose assembly 205 includes a connector 211 for connecting to the ink cartridge.
The print assembly is preferably an inkjet type printer and more preferably a full-color inkjet. Accordingly the ink cartridge 201 includes multiple inks. In the preferred embodiment the print assembly is a full-color CMY or CMYK printer and the ink cartridge 201 includes three or four separate ink chambers 252. Whilst any inkjet printhead may be used, more preferably the printhead is a microelectromechanical system (MEMS) type printhead (Memjet), such as that disclosed in our co-pending application U.S. Ser. No. 09/575,141.
A Memjet printhead provides a combination of printhead width, compactness, low power consumption, and low cost which makes it uniquely suitably for integration in the printing viewer. Although a Memjet printhead provides 1600 dpi resolution, a printing viewer may get by with less. If the printing viewer is sufficiently small, then an area printhead can be used rather than a scanning printhead.
The printhead assembly 202 extends across at least the full width of the LCD screen 102 and prints by moving upwards or downwards. The printhead assembly 202 is mounted on a continuous elastomeric belt 213 which runs around rollers 215 and 217 located at the top and bottom of the screen. The lower roller 215 is driven by a DC stepper motor 286 via a worm gear 221. The two rollers are mounted on a printer chassis 223. Mounted on each side of the chassis 223 are transverse rods 225. The printhead assembly 202 is mounted on these rods 225 and these rods maintain the printhead in the correct position; the belt 213 merely causes the printhead assembly 202 to move backwards and forwards along the rods 225.
The lower molding 116 is provided with a rectangular aperture 250 and a metal base plate 236 is attached to the underside of the molding 116. The base plate 236 has a rectangular aperture 252 sized so that the printhead assembly 202 is not exposed when at either extreme of its travel. The base plate is preferably attached to the lower molding 116 by an adhesive.
The operation of the print assembly 202 is controlled by a dedicated print engine/controller (PEC) chip 281 located on the PCB 118. An example of a suitable PEC is described in our co-pending application U.S. Ser. No. 09/575,108. The PEC chip 281 generates bi-level dot data for the printhead in real time and otherwise controls the operation of the printhead. Communication with the printhead assembly 202 is via a flexible PCB 228 which engages the PCB 118 via connector 230. The DC motor 286 is connected to the PCB via a flexible PCB 231.
A master QA chip 282, for example as described in our co-pending application U.S. Ser. No. 09/113,223, is provided which the PEC uses to authenticate an identical QA chip 283 embedded in the replaceable color ink cartridge 201. A raster image processor (RIP) DSP 284 may be used for rendering print data at high speed. Depending on the desired print quality and speed and the performance of the processor, the RIP DSP may be omitted with the processor performing rasterization. Depending on the need to accurately control ink quality and to monitor consumption, and on the availability of alternate mechanisms for detecting ink depletion, the inclusion of the QA chips may not be needed.
Referring to
The elastomeric belt 213 and the printhead assembly 202 extend across the full width of the screen 102 and by necessity obscure the sensor 112 as the printhead assembly moves between the rollers 215 and 217. The belt 213 is provided with two pairs of circular apertures 232 and 234. The first pair 232 align when the printhead assembly 202 is adjacent the drive roller 215. The second pair 234 align when the printhead assembly 202 is adjacent the other roller 217. When the apertures align the sensor 112 may sense coded data on a substrate below the viewer. When the apertures 232 and 234 do not align the sensor 112 cannot sense any data on the substrate.
The viewer may be designed so that the code sensor has a view of the surface during printing. The code sensor itself can then be used to detect movement. Movement detected in this way can be used to terminate printing. It can also be used to modify the print data in real time so that the print data is properly registered with the underlying page at all times. Multiple code sensors may be used if located around the periphery of the viewer.
An accelerometer may be included in the viewer to detect movement of the viewer during printing. If movement is detected, then printing can be immediately terminated.
Referring to
The device may be used with a surface which only carries netpage tags and so appears as a blank document to a user without an authorized viewer. As discussed in our earlier applications, each tag incorporates data which identifies the page it is on and its location within the page. The netpage system is thus capable of determining the location of the viewer 100 and so can extract information corresponding to that position. When displaying static images or text the displayed information usually corresponds to the human discernable text or other markings 204 on the substrate. Additionally the tags include information which enables the device and/or system to derive an orientation of the device relative to the page from the tags. This enables the information displayed to be rotated relative to the device to match the orientation of the text 204. Thus information 206 displayed by the viewer appears to be what is on the page in the corresponding position under the viewer.
When the viewer first comes into contact with a new page, it downloads the corresponding page description from the relevant page server. It then renders the viewer'"'"'s view according to the current view transform, i.e. according to the viewer'"'"'s current zoom setting and its position and rotation relative to the underlying page. Whenever the view transform changes, i.e. because the user moves the viewer or changes the viewer'"'"'s zoom setting, the viewer re-renders the view according to the new view transform. For the purposes of the following discussion, the size of the viewer'"'"'s window onto the page is also assumed to be part of the view transform.
Whenever the view transform changes, the viewer transmits the view transform to the netpage page server responsible for the underlying page. This allows the page server to commence streaming dynamic objects which have come into view and to cease streaming dynamic objects which are no longer in view. It also allows the page server to provide the viewer with static objects, such as images, at a suitable resolution.
As the device is moved the sensor device 112 images the same or different tags, which enables the device 100 and/or system to update the device'"'"'s relative position on the page and to scroll the LCD display as the device moves. The position of the viewer relative to the page can easily be determined from the image of a single tag; as the viewer moves the image of the tag changes and from this change in image the position relative to the tag can be determined. The system "knows" the absolute position of the tag on the page from its tag ID and so the absolute position of the viewer on the page may be derived. The viewer senses tags, and thereby its time-varying position relative to the substrate, and sufficiently frequently that movement of the viewer results in a smooth, as opposed to a jerky, scrolling of the display.
The information 206 displayed in the viewer is preferably aligned with the text 204 on the page 200, so that it appears as if the viewer 100 is transparent. Thus the orientation of the viewer 100 does not alter the orientation of the displayed information 206, as seen in
However, as seen in
The viewer 100, if provided with backlighting of the LCD 132, is capable of displaying information in the dark.
Whilst the information 206 shown on the LCD 102 is similar to the printed information 204, it need not be identical. The left hand control button 186 is a rocker type device. When pressed on the left, the button activates switch 188 and when pushed on the right the button activates switch 190. Pushing down centrally or equally on the left and right activates both switches 188 and 190. Pressing on the left switch 186 causes the display to zoom in whilst pressing on the right causes the display to zoom out. Pressing centrally resets the display to the device default, which may be a 1 to 1 ratio.
The device is not limited to simply reproducing the text printed on a page. Because the printed text is associated with one or more electronic documents in the netpage system, the device can provide more than just the text to the user. Where a document has references, such as footnotes or hyperlinks, these references may be shown on screen. The user may then view those references by touching the reference on screen. This is picked up by the touch screen overlay 132 and the appropriate information displayed, either in a new window or as an overlay on the existing text. This information may be displayed for a set period, after which the display reverts to its original display. The system may also cause additional information to be shown on the LCD screen automatically. Where the page is mainly text the device 100 may be set to a read mode whereby as the user reads the page the text is recited and output via speaker 106. This would be of benefit to people learning to read, such as children or those learning a foreign language. Using a stylus and the touch screen the user indicates where they are reading and the corresponding text is spoken by the machine. Pronunciation of a word or phrase may be practiced by repeatedly drawing the stylus over the relevant text.
The text displayed need not be the same language as the text on the paper. The device may be set to display a single language, when possible. Thus if a netpage document exists in both English and Italian, for example, the device could be set to display the Italian text even though the printed document is in English. Where a document only exists in one language, the system may be configured to either display the document in that language or nothing except a message to the effect that document is not available in the desired language.
If desired the device may be set to an "automatic recital" mode in which the screen automatically scrolls through the entire document, with or without a corresponding aural recital. An aural recital may also occur without a corresponding display of text. The speed of playback may be controlled by the user. Since each tag on the page identifies the document the device merely needs to sense one tag on the page for those features to be activated.
Depending on the document size and device memory, an entire document may be downloaded to the device or "chunks" of data may be downloaded as required or as expected to be required. A simple text document, even of many pages, is relatively small and may be buffered in its entirety without needing extra memory; the device is capable of playing video, as will be discussed later, and the buffer needed to accommodate variations in data reception for video display is more than sufficient to accommodate most text documents. Where an entire document is downloaded, preferably the download is configured to initially send data corresponding to the location of the viewer on the page.
When viewing text or static images the device may have two modes. The first mode, described above, maintains a correlation between the information displayed on the LCD screen and the position of the device to the substrate. In the second mode, the device may be moved without affecting the display; the scrolling and autoplay feature discussed above being a subject of this feature. To set the device to the second mode the user may press the 'snap' button 192. Once in the second mode movement of the device across the paper does not automatically affect the information displayed. The information displayed continues to correspond to the location when the viewer was placed in this mode. Movement of information across the display in this mode is controlled by the user. A document will continue to be displayed or be accessible until the device is placed on a different netpage encoded substrate, at which point the device may normally revert to its first mode. Alternatively, the user must explicitly revert to the first mode by pressing the 'snap' button again.
As an alternative to on-screen controls, the viewer may provide dedicated playback control buttons which control whichever dynamic object is current. It may also provide a dedicated display, such as a monochrome segment LCD, for the display of chapter (or track) information and playing time.
The viewer streams dynamic objects such as video clips from any number of servers via the current netpage base station. The viewer is optimized to only stream objects which are currently visible on the viewer'"'"'s screen. When an object ceases to be displayed, it may be configured to automatically pause, or it may continue to 'play' on the server, without consuming communications bandwidth, so that when it is once again displayed its playback has progressed in time as expected by the user.
As described above, when the viewer is lifted from the page the portion of the page with which the viewer was last in contact remains displayed and interactive. It may also be advantageous for the user to be able to 'freeze' the current view so that the viewer no longer synchronizes the view with the underlying page. When the user snaps the nearest interactive or dynamic object to the screen the view is effectively frozen. When the user presses the snap button again, the viewer once again synchronizes the view with the underlying page. When there is no interactive or dynamic object to be snapped, the viewer may still interpret the snap as a freeze command, but may do no more than rotate the current view so that it is oriented the right way up, i.e. so that the axes of the screen and of the displayed page are aligned. The snap button may therefore be used as a freeze button, but as an alternatively the viewer may provide a freeze button separate from the snap button.
The viewer may provide a mode wherein the axes of the screen and of the displayed page are always kept aligned even though the viewer is otherwise synchronizing the view with the underlying page, i.e. the viewer synchronizes the view according to the position and identity of the underlying page, but not according to the rotation of the underlying page relative to the viewer. This mode has the advantage that the displayed view always looks sensible to the user operating the viewer. It has the further advantage that rotation is never allowed to degrade the quality of the displayed image of the page. If rotation is never respected by the viewer, then the viewer is also freed from ever having to compute a rotated page image. As a compromise, the viewer may respect the nearest multiple of ninety degrees to its actual rotation relative to the page.
Netpage input, in the form of digital ink, is labeled to indicate how it was captured, i.e. through a netpage pen interacting with a printed netpage, or through a stylus interacting with the touch-sensitive screen of a viewer. The digital ink is also labeled with any change in the authorization state of the viewer, e.g. with respect to the presence of the user'"'"'s finger on the viewer'"'"'s fingerprint sensor. This allows the page server, when interpreting netpage input in relation to the corresponding page description, to ignore document elements not visible to the user when the input was captured.
Digital ink generated through a viewer is otherwise suitably transformed to look like it came from a netpage pen interacting with the underlying page, i.e. the digital ink is labeled with the page ID of the underlying page, and the coordinates of position samples in the digital ink are transformed from the coordinate system of the viewer into the coordinate system of the underlying page, according to the view transform current when the position sample was captured. As an alternative, the viewer may provide an insertion point specifiable via the stylus, an associated text cursor, and text entry via an on-screen keyboard or via character-wise character entry and recognition, in the manner of current personal digital assistants (PDAs).
The printer is most useful in filling out forms such as that displayed in
Referring to
The printer assembly may be used to physically transfers onto the underlying page any virtual markings made by the user via the viewer touch-screen. Virtual strokes can be faithfully reproduced, including colors, textures, line widths, and even subtle brushing effects such as produced by striated brushes and airbrushes. The virtual marking mode of the stylus on the screen can be completely controlled in a position-dependent manner by the active application(s), i.e. as one expects in any graphical user interface.
In the limit case, a user interacts with Netpages exclusively via the Netpage printing viewer, eliminating the need for a Netpage Pen.
The printing viewer is designed to print when stationary with respect to the underlying page. Because the printhead 203 is screen-width, it can transfer the entire contents of the screen 102 onto the underlying page in a single pass. When not printing, the printhead assembly 202 is parked in a recess to prevent accidental damage. To conserve power, the printhead assembly 202 can be parked at the top or bottom of the screen 102, and the printhead 203 can print when moving in either direction. To prevent user access to the cavity in which the printhead assembly moves, the assembly is integrated into a screen-width belt which also acts as the carriage transport. The belt obscures the viewer'"'"'s code sensor during printing, but contains pairs of matching holes which line up when the printhead is parked, providing the code sensor with a view of the surface. Two pairs of holes are provided, corresponding to the two parking positions.
Handwritten text can be transferred to the underlying page before or after it is recognized by the Netpage system and converted to computer text. If transferred after conversion, the viewer can transfer the computer text to the underlying page in place of the handwritten text. Similarly, a signature can be transferred to the page before or after it is used by the Netpage system to verify the identity of the user. If transferred after verification, the viewer can transfer a verification icon and/or a serial number in place of the signature.
The Netpage printing viewer can also be used to paste information onto a page, including images and text. The user may take a photo with a camera and paste it into an image field requiring the photo. The printing viewer links the photo to the image field and faithfully transfers the photo to the page, registered with the image field. If the viewer only partially overlaps the field, then only the portion of the field accessible to the viewer is printed with the photo. When the user moves the viewer across the field the viewer prints additional parts of the field. The viewer may prompt the user to move the viewer to cover un-printed portions of the field. Any un-printed portions of the image are recorded as pending output against the page instance maintained by the relevant Netpage page server. If a viewer comes into contact with the image field at a future time then any un-printed portions can be printed.
If the user pastes an image into a viewer-displayed image field when the viewer is not in contact with the page, then the entire image is recorded as pending output.
The printing viewer may incorporate a digital camera. Once the user takes a photo, it may "float" on the display as an icon until the user explicitly pastes it in an image field. The viewer may provide dedicated buttons for browsing, viewing, editing and deleting a collection of photos stored in the viewer. The viewer may also support removable storage, e.g. via a memory card socket, for storage of photos.
The user may also paste information which is known to the viewer or to the Netpage system, such as contact details, into a Netpage form which is not otherwise linked to the user.
The viewer may alternatively or additionally contain a mobile telephone transceiver for longer-range communication with a netpage server via a mobile telephone network. If the transceiver supports a third-generation 'always-on' packet-switched connection, then the viewer may download or stream page content at will. If the transceiver only supports a circuit-switched connection, then the viewer may choose to connect and download a full page description whenever it encounters a new page, provide local navigation of the page via the downloaded page description, and only make further connections when dynamic content needs to be displayed or when hyperlinks are activated.
If the viewer incorporates a longer-range transceiver, then it may act as a netpage base station for wireless netpage pens and other netpage sensing devices.
When used to interrogate secure data, the viewer may incorporate a fingerprint sensor, such as the Vericom FPS200, to allow it to continuously monitor and verify the identity of the user. The processor typically interrogates the fingerprint sensor via a serial interface.
The viewer may incorporate several levels of power management. After a period of inactivity the viewer may inactivate the display. After a longer period of inactivity the processor may enter a power-conserving quiescent state. Power management may be coupled with the image sensor and/or the touch sensor, allowing wake-up on screen interaction or movement. The viewer may also incorporate an accelerometer for this purpose.
The viewer may be configured with software allowing it to function as a personal digital assistant (PDA). The components and functions of the viewer may also be incorporated into a mobile phone.
The viewer handles a variety of page content, including styled text, outline graphics, bitmapped images, audio, and video. While audio and video are by their nature dynamic (i.e. time-varying), text, graphics and images are normally static. They may, however, be part of a dynamic stream representing the output of an interactive application, executing remotely or within the viewer. A local application may be defined by a script object which is interpreted by the viewer, e.g. coded in Java or similar.
Page content falls into three categories: (1) static elements which appear on the printed page; (2) static elements which only appear through the viewer; and (3) dynamic elements which only appear through the viewer. The first category includes all the visual elements of the page. The second category includes, for example, elements associated with controls for dynamic content, e.g. playback controls for a video clip, and elements associated with secure information. The third category includes anything of a dynamic nature, e.g. a video clip. A dynamic element may have a static counterpart in the page description so that it has a meaningful visual appearance on the printed page. A video clip, for example, may be represented by a rectangle of the appropriate size showing the title of the clip.
Document elements in the second and third categories have associated view filters 245 which restrict their appearance. The 'viewer view' 246 filter restricts the element to appearing through a viewer. The 'secure view' 247 filter restricts the element to appearing through an authorized viewer. The view filter class diagram is shown in
A digital ink stream is generated with a maximum data rate of about 5 Kbit/s. The viewer generates a view transform stream with a similar maximum data rate. The viewer therefore generates wireless communications traffic to the base station with a maximum data rate of about 10 Kbit/s, which is negligible.
To minimize wireless communications traffic from the base station to the viewer, it may be mandated that only one dynamic object can be active at a time. Even though more than one object may be visible through the viewer, the page server may deactivate all but one such object. It may, for example, only leave the dynamic object closest to the center of the viewer'"'"'s display active. The user may be able to explicitly activate an alternative dynamic object by clicking on it with the stylus, or the user may be required to explicitly activate any dynamic object, thus implicitly deactivating any currently active object.
Where a dynamic object represents an application window, the page server typically relays to the application any changes to the viewer'"'"'s view transform which relate to the application window. This allows the application to generate output when the window is visible, and to tailor the output to the actual overlap between the window and the viewer'"'"'s view. The output from the application may be in the form of a video stream, or it may be in the form of a stream of graphics commands operating on text, graphics and images.
It is possible to display output from a remote application through the viewer, and capture stylus input through the viewer and route it to the remote application, without the application having to be explicitly designed for interaction with the viewer. Applications typically interact with user interface devices such as bitmapped displays, keyboards and pointing devices in a device-independent manner by utilizing the services of a windowing system, and this allows the user interface devices to be remote from the applications without changing how the applications interact with them.
As an alternative to rendering the view on demand, the viewer may render the entire page into a memory buffer and then simply display a suitably transformed window into the buffer. However, since the rotation of relatively low-resolution text produces unacceptable text quality, the page must either be rendered at a higher resolution than the display resolution and appropriately lowpass filtered before display, or the display resolution must be higher than assumed so far.
As a further alternative, the viewer may rely on the page server or the base station to render the page and supply it to the viewer, typically in compressed form. In this case the viewer is still responsible for integrating dynamic streams with the static page view.
As yet another alternative, the viewer may rely on the page server or the base station to render the current view and supply it to the viewer, typically in compressed form. In this case the viewer need contain no support whatsoever for interpreting and rendering the variety of elements which may comprise a page description. Assuming a 320×240 RGB pixel display, a 10 Hz update rate, and 10:1 compression, this requires a data rate of about 1.8 Mbit/s, which is within the realms of practicality using currently-available personal-area, local-area and wide-area wireless networking technologies as discussed above.
The page server may notify (at E) an application 292 that the viewer'"'"'s view onto a window associated with the application has changed, and the application 292 may respond (at F) with commands instructing the viewer 100 to update parts of its current view. The page server 291 relays (at C) these commands to the base station 290, which relays (at D) the commands on to the viewer 100.
Whilst the display of the preferred embodiment is visual, a Braille viewer may be made according to the invention. A Braille viewer is analogous to the optical viewer. It displays in registered fashion and via a tactile Braille display the text of a netpage. It also displays text labels corresponding to graphics and images, where available in the page description. Because Braille characters are typically rendered at larger sizes than visually-recognized characters, the Braille viewer typically presents a zoomed view of the underlying page. This means that as the viewer is moved over the page, the display moves correspondingly faster.
In other embodiments the viewer can be transparent when it is not in contact with a page, so that while it is being placed on a page, the page is seen through the viewer. This can be implemented using a LCD shutter which is reflective when opaque, positioned behind a transmissive color display. However, the netpage viewer design is simplified if the viewer is always opaque, and only ever virtually transparent.
Whilst the invention has been described with reference to the netpage system which uses invisible tags, the invention is not limited to the netpage system or the use of invisible tags. If desired, the invention may utilize tags or codes which are visible to the average unaided human eye, such as bar codes. The tags need not merely encode an identity which is then used to look up the relevant files. The tags may encode instructions at a higher level. For example a tag may encode an instruction of "play chapter 99". If invisible tags are used they need not be limited to the tags disclosed in relation to the netpage system. Other tagging systems are available and any suitable tagging system may be used. The invention is not limited to the use of inks which absorb certain wavelengths or fluoresce certain wavelengths. Magnetic inks, surface modification, including apertures, modification of the structure of the substrate itself all fall within the scope of the invention. The systems and methods to link the viewer of the present invention and the source of the document data are not limited to netpage systems. A viewer may be linked by a cable to a single computer, rather than a network of computers.
The present invention has been described with reference to a preferred embodiment and number of specific alternative embodiments. However, it will be appreciated by those skilled in the relevant fields that a number of other embodiments, differing from those specifically described, will also fall within the spirit and scope of the present invention. Accordingly, it will be understood that the invention is not intended to be limited to the specific embodiments described in the present specification, including documents incorporated by cross-reference as appropriate. The scope of the invention is only limited by the attached claims.


text:
Weaving Social
October 30, 2019 –
On going Social Weaving on Wednesday from 10:30-12:30 Come in and work on your project.
Weaving with Carole Stewart, she will begin teaching you how to warp and start weaving using a rigid heddle loom and also a frame loom. Cost: $25.00 per class

subset: commoncrawl


text:
Dancing with the Stars Season 10 Cast – To the Moon, and Beyond!!!
Yes, I am (mis)quoting a cartoon. Why? It's the first thing that sprang to mind when reading Access Hollywood:
But Access' "Dancing" casting news doesn't end there!
Access has also learned someone who has walked on the moon is set to shake their former-intergalactic groove thing in the ballroom too, the source said.
Buzz Aldrin, who was the second person to set foot on the moon, is the favorite, thanks to his regular appearances across television. Although, it still yet could be Neil Armstrong.
Buzz has appeared on "The Simpsons," "Celebrity Jeopardy," "NUMB3RS" and most recently, "The Price Is Right" in November 2009.
Access Hollywood also confirms that Pam Anderson will be dancing this season. And after being afraid that Derek might not even be on the show, I'm actually okay with her dancing with my favorite. It's called perspective, people. 🙂


text:
Book Tour and Activities on the Go!
NNNMM31 Ratings
h6 HourslKota Kinabalu
Starting from
NNNMM38 Ratings
h4 HourslLangkawi
Starting from
Semenggoh Wildlife Rehabilitation CentreEstablished in 1975, the 740 acre Semenggoh Wildlife Rehabilitation Centre is the largest Orangutan Rehabilitation Centre located in Sarawak which takes care of the injured and sick or may be orphaned orangutans along with the very famous Sepilok Orangutan Rehabilitation Centre in Sabah. Being such a big rehabilitation centre it is a prominent tourist destination for all the people visiting the country. The location of the Rehabilitation Centre is only at a distance of 30 minutes drive from Kuching and here one can gather enough knowledge about the same. There is a special visitor's platform from where one can witness the feeding of the orangutans. The rehabilitate animals are nurtured and taken care in this centre and when ready they are released in the forest.
Kuching Wetlands National ParkCovering an area of 6610 hectares, the Kuching Wetlands National Park is approximately 15 km away from Kuching. Mostly filled with saline mangrove system, the greatest benefit of the park is its rich marine network with creeks and waterways connecting the major Sibu Laut and Salak rivers bordering the park. The best way to explore the park is by arranging a river cruise through the park where one can enjoy the dense vegetation and luscious greenery. The cruise usually takes half a day tour through the Salak River and entering the smaller creeks thus passing through Malay fishing village, coming up close with wild animals like money , crocodiles etc. All through it's a fabulous and entertaining experience
More Things to do in Kuching
Listings in Kuching
Ask a Question
Ask Question


text:
Meilleurs morceaux
À propos de 10,000 Maniacs
One of the key Adult Alternative bands of the early '90s -- and charter members of the Lilith Fair school of music -- were 10,000 Maniacs. Led by the gifted vocalist Natalie Merchant, they were Alternative Rock darlings until their single "Like the Weather" crossed them over to just about all radio formats except Gangsta Rap. In My Tribe and Blind Man's Zoo went on to become staples in college dorms, womyn's clinics and bead shops everywhere. Then, at the height of their popularity, Merchant had to ruin it all to go solo to become, as the New Yorker puts it, the Stevie Nicks of the '90s. While Merchant continues to sell like Fleetwood Mac, 10,000 Maniacs have carried on to less commercial acclaim. With Mary Ramsey taking the lead vocal spot, their new, even folkier incarnation has its own rewards.
Artistes similaires
Edie Brickell & New Bohemians, R.E.M., Sinead O'Connor, The Connells, The Cranberries, Toad the Wet Sprocket


text:
Foot and Ankle
David B. Thordarson
Lippincott Williams & Wilkins, 2004 - Medical - 333 pages
Written by rising stars in the American Orthopaedic Foot and Ankle Society, this volume of our Orthopaedic Surgery Essentials Series presents all the information residents need during foot and ankle surgery rotations. It can easily be read cover to cover during a rotation or used for quick reference before a patient workup or operation. The user-friendly, visually stimulating format features ample illustrations, algorithms, bulleted lists, charts, and tables.
Coverage begins with anatomy, biomechanics, physical examination, and orthotics and proceeds to the specific problems encountered in the foot and ankle clinic. A chapter on arthroscopy is also included.
What people are saying - Write a review
Selected pages
Anatomy and BiomechanicS 0f the F00t and H�el and SubGalCall�al Pain 182
Physical Examination and Orthotics 24 Hindfoot
NBIII0mIISCIllar DiSOrderS 41 11 Degenerative Joint DiSB�SB 0f the Midfoot
The Diabetic F00t 98 12 ACute Ankle Sprain Chr0mic Ankle InStability
LBSSEr T06 Deformities and Bunionettes 131 13 2 Subtalar Arthroscopy
Mark E Easley and Umur Aydogan


text:
Please login first to complete purchase/ quotation request, view custom order reports, or create favorites list.
Don't have an account with us yet? Please set up an account to place order or obtain customer services.
RKRSRAE (60298-1) is a selective substrate for protein kinase G (PKG) with a strong preference for PKG Ia (Km = 59 mM) over PKG II (Km = 305 mM). The Vmax/Km of the peptide substrate is significantly increased by peptide-546, a PKG activator.
Copyright © 2002-2019 AnaSpec, Inc. All rights reserved. | Site Map | Terms & Conditions | 1-800-452-5530


text:
This download is hosted on a free file share site, so there are very annoying pop-up ads. So sorry.
You can also print the pattern at 300% - 'collage' (in the print settings of Adobe PDF Reader) and create a much bigger version.
This pattern doesn't currently have illustrated instructions. Ya, I'm lazy. I'll get to it maybe sometime later. However I did take time to computer illustrate the pattern and seam allowance.
If want to make the pony smaller print at 30% and use felt without a seam allowance. Overhand stitch the edges together. It takes longer but is very cute. Here are different character eyes for you to use as a reference.
My Little Pony Eyes by datNaro on deviantART
1. Cut out all your pieces. Mark with a pencil on the wrong size were all your seam lines are.
2. Get some yarn or fabric strips for hair and sew the ends together in a straight line to form the mane. For the tail knot the ends together.
4. Sew ear together good sides facing. Leave bottom open. Turn out. x2
5. Sew together the 'head back' to the 'head sides'. x2
6. Match these head side pieces to the 'head top'. Sew from the tip of the nose to the ear opening. Insert the ear. Continue to the end of the neck. x2
7. Once the head sides are together you add the little chin at the bottom of the snout. Sew together in a half circle.
8. At this point you can embroider on the smile, and the eyes. You can also hand stitch on felt eyes at the very end if you prefer, or even draw then on using puffy fabric paints or regular acrylic craft paint with is machine washable after 48 hours.
9. Attach 'inner front leg' to the 'under belly'. The front legs get places near the neck. You will attach them at the semi circle. x2
10. Attach 'inner back leg' to the 'under belly', at the semi circle at the end of the under belly.
11. Attach the body side pieces to the under belly. (add the bum 'cutie mark' now if you are embroidering.) Start at the tip of the neck to down the leg, stop at the bottom of the hoof. Leave an opening for the hoof. Sew up the leg and down the other leg... up the leg across the bum and down the other leg... up the leg STOP leave a spot open for stuffing... then down the leg and so on, until the belly is attached to the top of the body. (IMPORTANT NOTE: you will want to leave a small portion of one side of the belly open to turn out your plush then stuff later.)
12. Add on each hoof (make sure the good side of the hoof fabric is facing INSIDE the plush). With a sewing machine you can place the hood bottom flat and sew around the hoof very carefully in a circle. x4
13. Sew the neck to the body.
13. Sew the neck to the body.
14. Pin on the main and tail. the fabric and yarn will be on the inside of the body. Sew from the top of the head to the bum.
15. It's almost complete. Just turn it right side out, stuff using a pencil or a long tool and hand stitch the opening at the belly closed. Add on eyes now if you have not already and that 'cutie mark'!


text:
Plantation FL Locksmith
Locksmith Plantation FL offers 24/7 Rescue Service. With Flat Rates, Quick Arrival and Professional Service: We ensure all your locksmithing safety needs are met. We are Licensed, Bonded & Insured and therefor the most trusted locksmith serving Plantation FL & Area.
Click To Call 754-265-4745
Accepting All Forms Of Payment
Our Locksmith Guarantee
Offering a full service guarantee with every call: No Rate Hikes, On Time Arrival & a Freed Lock.
Whether you are looking for Emergency Locksmith Service or Scheduled Locksmith Service we are the Locksmith of Choice for Plantation Florida & Surrounding Area. Some of our top locksmith services are:
Locksmith Services in Plantation FL:
Emergency Locksmith Service:
When you are locked out and need speedy service for:
– 24/7 Auto Locksmith: Help With Car Lockouts, Car Keys Replaced
– 24/7 Home Locksmith: Help with Home Lockouts, Rekeys, Locks Replaced
– 24/7 Commercial Locksmith: Help with Office Lockouts, Retail Lockouts with MEDECO or Mul-T-Lock Systems.
Scheduled Locksmith Service:
Our top services include
1. Re-Keys for those of you moving into a new home and don't mind the existing lock, you just want a key no one else has.
2. Change Locks service for customers who need to replace their existing locks.
3. Lock Upgrades for customers that want to Replace Existing Locks with High Security Medeco or Multi-lock.
4. Fresh Lock Installations for customers with new doors.
5. Smart Lock & Smart Bell Installations for the techy in you. Some of these devices are tricky, so you should Read More About Smart Locks.
Locksmith Service Areas
Our Locksmith Service Areas in Plantation FL include the following ZIP codes: 33311, 33313, 33317, 33322, 33323, 33324, 33325, 33388.
Locksmith Customers
Plantation FL is a large size area of 22 square miles, with approximately 85,000 residents and 12,500 businesses. Service by Free My Lock, a local Fort Lauderdale Locksmith Business is here to help you out with all your locksmithing needs.


text:
by Sean Griffin, January 27, 2012
Pool Safety Checklist
Exercising caution around your swimming pool and continually making sure that safety measures, in and around the pool, are in place can be the difference between years of swimming enjoyment and tragedy. Routine inspections can help you to have peace of mind and comfort in knowing your loved ones are safeguarded from a possible mishap.
When it comes to an open body of water in your backyard there is no substitute for adult supervision and common sense safe practices (NO RUNNING!) but we can take precautionary safety measures and keep an eye on them to make sure they are in working order.
Even something as small as a faulty gate latch can allow unwanted access to your swimming pool. The possibilities for accidents around the swimming pool are endless and tragic drowning occurs silently.
Layers of Protection
As a responsible swimming pool owner you will want to evaluate the safety of your home and swimming pool, introduce multiple layers of protection, and continually make sure the safety you have implemented are in proper function. Knowing and monitoring when the pool is in use will allow you to reduce the possibilities of injury and respond in a timely manner if an accident does occur. Fencing and gates should be in place along with safety alarms. The more layers of protection you have surrounding your pool the less likely an unwanted swimmer or curious child might make it to the water. Some common routine maintenance will include…..
-Testing and fixing all gates and points of access to the backyard. Gates should all be self closing and self latching. Converting a gate to be self closing or realigning any latch can easily be achieved with some simple fittings from your local hardware store.
-Test all pool door and pool gate alarms regularly. Just like a fire alarm or a fire extinguisher you will want to make sure they remain fully operational. A non working safety measure can bring a false sense of security.
-Annually inspect any safety cover that will be used. Make sure all springs are intact and that a child or animal cannot gain entry to the pool water.
Chemical Safety
The chemicals used in keeping your pool water sparkling clear can have potentially hazardous side affects if used or stored improperly. Your first goal will be to limit persons who will have access to these chemicals if they are stored on the property. Every individual that is using any pool chemical should have the necessary training and proper knowledge before being able to access any pool chemicals. Understanding chemical reactions and having accident response measures in place will greatly reduce the risk of injury.
-Frequently inspect any pool chemicals stored at your home to ensure they do not get wet or mix together. Visually inspect all containers to make sure they are in-tact.
-Make sure pool chemical storage rooms are properly ventilated, ensure any drains are unblocked in case moisture becomes present.
-Safely discard chemicals that are outdated, tainted, or not being used. Leftover chemicals should never accumulate. Keep all chemical storage neat and tidy to prevent accidents.
Pool Equipment Safety
Pool pumps are now available across the country that have safety vacuum release systems incorporated in their design. Upgrading your pool pump can prevent entrapment. Other pieces of pool equipment to monitor and routinely inspect will include….
-Skimmer lids! A broken or cracked skimmer lid may not support the weight of someone walking the pool perimeter. A broken skimmer lid allowing someone to fall though can easily lead to a sprained ankle.
-Electrical wiring and outlets. You don't need to be an electrician to visually make sure you don't have exposed wiring or broken electrical outlets around the pool.
-Check all pool lighting and pathway lighting leading to your swimming pool. A dark pathway or an ill lit pool will increase the chances of an accident.
Swimming Safety
There is no substitute for adult supervision around your swimming pool. AS always you will want to make sure horseplay and running around your swimming pool is not allowed. Refrain from using glass ware and never use a swimming pool after drinking alcoholic beverages. Swimming aids should be used be beginner level swimmers. Procedures should be in place in case an accident does occur. Make sure everyone using the swimming pool knows what to do in case of an emergency.
-Educate yourself in life saving techniques such as CPR and mouth to mouth resuscitation.
-Make sure all safety equipment is in good condition. A Sheppard's hook and a neck brace are common items you will see at community pools and may come in handy right in your backyard. A first aid kit is a must at every pool!


text:
How to Use Leftovers
If you use a little creativity, leftovers can be fun, tasty, inexpensive meal starters. By camouflaging the leftovers from meal to meal, even your pickiest eaters will have trouble recognizing the roasted chicken from dinner two nights ago in today's pasta salad luncheon.
Make a leftover buffet. Plan one meal each week that uses up the assorted leftovers accumulating on the refrigerator shelves. It's like getting a free meal every week.
After accumulating about half a dozen containers of leftovers, reheat them in the microwave and portion out a little bit of everything onto each person's plate. The variety of items gives it the look of a full plate after you've gone through a buffet line at a party. Toss some crackers, sliced cheese, and fresh cut-up veggies into the mix, and you have an easy, tasty dinner.
Sandwich your leftovers into savings. A favorite use for leftovers is to make sandwiches for lunch or dinner. Rolling leftover meats and veggies into a cold flour tortilla with a bit of cream cheese and a pickle is also a delicious way to add some variety to the typical sandwich presentation.
Stretch the bird. Chicken and turkey are dreams come true if you want to stretch one meal into several others. For a family of four, you can usually stretch at least three meals from each chicken purchase: a roast chicken dinner meal consisting of the drumsticks, thighs, and wings; a casserole, stir-fry, or skillet meal prepared with the cut breast meat roasted the night before; and a hearty, homemade chicken soup made from any leftover meat and bones.