text:
Publication number | US7461353 B2 |
Publication type | Grant |
Application number | US 11/045,757 |
Publication date | Dec 2, 2008 |
Filing date | Jan 28, 2005 |
Priority date | Jun 12, 2000 |
Fee status | Paid |
Also published as | US7210099, US7584423, US7823083, US7831926, US7844889, US8145995, US8386959, US8533628, US9519729, US20020091738, US20050131887, US20050132286, US20070198916, US20070198917, US20070288841, US20070288855, US20080028335, US20090119580, US20110231746, US20110231782, US20170068642, WO2001096985A2, WO2001096985A3 |
Publication number | 045757, 11045757, US 7461353 B2, US 7461353B2, US-B2-7461353, US7461353 B2, US7461353B2 |
Inventors | Gary B. Rohrabaugh, Scott A. Sherman |
Original Assignee | Gary Rohrabaugh |
Export Citation | BiBTeX, EndNote, RefMan |
Patent Citations (19), Non-Patent Citations (30), Referenced by (72), Classifications (34), Legal Events (11) | |
External Links: USPTO, USPTO Assignment, Espacenet | |
The present application is a Divisional Application of U.S. application Ser. No. 09/878,097, filed Jun. 8, 2001, now U.S. Pat. No. 7,210,099, which is a Continuation-in-Part of U.S. Non-Provisional application Ser. No. 09/828,511, filed Apr. 7, 2001, now abandoned, entitled "RESOLUTION INDEPENDENT VECTOR DISPLAY OF INTERNET CONTENT," the benefit of the filing date of which is claimed under 35 U.S.C. � 120. This application further claims the benefit of the filing dates of U.S. Provisional Application No. 60/211,019, filed Jun. 12, 2000, entitled "METHOD AND SYSTEM FOR RESOLUTION INDEPENDENT DISPLAY OF HTML AND XML CONTENT" and U.S. Provisional Application No. 60/217,345, filed Jul. 11, 2000, entitled "METHOD AND SYSTEM FOR SELECTION, RETRIEVAL, AND CONVERSION OF COMPUTER CONTENT TO VECTOR FORMAT FOR RESOLUTION INDEPENDENT DISPLAY," under 35 U.S.C. � 119(e).
The present application is also related to U.S. application Ser. No. 11/735,477 filed on Apr. 15, 2007, U.S. application Ser. No. 11/735,482 filed on Apr. 15, 2007, U.S. application Ser. No. 11/738,486 filed on Apr. 21, 2007, and U.S. application Ser. No. 11/738,932 filed on Apr. 23, 2007, each of which are continuations of U.S. application Ser. No. 09/878,097, now U.S. Pat. No. 7,210,099.
Contained herein is material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction of the patent disclosure by any person as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all rights to the copyright whatsoever.
1. Field of the Invention
The invention relates generally to translation of Internet and World Wide Web content to scalable vector representation. More particularly, the invention relates to apparatus and methods for zoom enabling the display of content in an Internet information browser by retrieving and translating HyperText Markup Language (HTML), extensible Markup Language (XML), and other Internet content to vector representations of that content.
2. Description of the Related Art
Text only Internet information browsers began as a project at the CERN, European Organization for Nuclear Research, facility in Geneva Switzerland. From its inception the intent was to provide a mesh or web of access to data with a common user interface. Browsers moved from the academic environment when NCSA, the National Center for Supercomputing Applications at the University of Illinois in Urbana-Champaign developed Mosaic, an Internet information browser and World Wide Web client.
Internet content is stored in multiple file formats. These formats include HTML (Hyper Text Markup Language) and XML (extended Markup Language) as well as graphic file format GIF (Graphics Interchange Format) and JPEG (Joint Photographic Experts Group). These four file formats constitute the majority of Internet content. Font size and resizing display area for content can alter the size of the display of Internet content in existing browsers. The majority of Internet content displays as a flat single resolution with no browser support for zoom.
Much of the Internet content has been designed for display on desktop computers with a single target resolution. Even though HTML has the ability to adapt to changes in screen resolution, major Internet content providers have chosen to create their Web pages using fixed resolution structures, such as tables. This gives them the ability to control the look and feel of their Web sites. This fixed resolution approach has evolved to the point that the fixed resolution layout of Web pages has become the most common method to brand or uniquely identify Web sites. While this fixed resolution approach is good for site branding and product differentiation it does present a daunting technical problem for display of Internet content (designed for desktop computers) on small screen, low resolution, or different aspect ratio devices, such as cell phones and hand held computers.
In accordance with aspects of the invention, mobile devices enabled to support resolution-independent scalable display of Internet (Web) content to allow Web pages to be scaled (zoomed) and panned for better viewing on smaller screen sizes are disclosed. The mobile devices employ novel processing of original Web content, including HTML-based content, XML, cascade style sheets, etc. to generate scalable content. The scalable content and/or data derived therefrom are then employed to enable the Web content to be rapidly rendered, zoomed, and panned. Moreover, the rendered displays provide substantially the same or identical layout as the original Web page, enabling users to easily navigate to selected content and features on familiar Web pages. Display lists may also be employed to provide further enhancements in rendering speed. Additionally, hardware-based programmed logic may also be employed to facilitate various operations.
According to further aspects, some mobile devices may employ touch-sensitive display screens that enable users to provide various inputs to control display of content within Web pages. Exemplary user inputs include tap-based inputs to selectively zoom in on columns, images, and paragraphs. Users can also define a window to zoom in on via the touch-sensitive display.
According to additional aspects of the invention, methods and software for enabling support for resolution-independent scalable display of Web content are provided. The methods and software enable users of various devices, from handheld devices with small screens, to desktop PC's and laptops, to very large screen devices, to view and interact with Web pages in a manner independent of the screen resolution of such device's built-in or associated display, while maintaining the look and feel of browsing such pages with a conventional desktop browser. Thus, users of various devices having different screen resolutions are enabled to browse Web pages from among literally billions of Web pages while providing a full Web browsing experience.
Other features of the present invention will be apparent from the accompanying drawings and from the detailed description that follows.
The appended claims set forth the features of the invention with particularity. The invention, together with its advantages, may be best understood from the following detailed description taken in conjunction with the accompanying drawings of which:
Apparatus and methods are described for creating resolution independent vector display of Internet content to allow it to be scaled (zoomed) larger and smaller for better viewing or to fit any resolution or screen size. In addition, infrastructure and methods are provided for delivering such content to clients.
In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without some of these specific details. In other instances, well-known structures and devices are shown in block diagram form.
The present invention includes various operations, which will be described below. The operations of the present invention may be performed by hardware components or may be embodied in machine-executable instructions, which may be used to cause a general-purpose or special-purpose processor or logic circuits programmed with the instructions to perform the operations. Alternatively, the operations may be performed by a combination of hardware and software.
The present invention may be provided as a computer program product that may include one or more machine-readable mediums having stored thereon instructions, which may be used to program a computer (or other electronic devices) to perform a process according to the present invention. The machine-readable medium may include, but is not limited to, floppy diskettes, optical disks, CD-ROMs, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, magnetic or optical cards, flash memory, or other type of media/machine-readable medium suitable for storing electronic instructions. Moreover, the present invention may also be downloaded as a computer program product, wherein the program may be transferred from a remote computer (e.g., a server) to a requesting computer (e.g., a client) by way of data signals embodied in a carrier wave or other propagation medium via a communication link (e.g., a modem or network connection). Accordingly, herein, a carrier wave shall be regarded as comprising a machine-readable medium.
Client Overview
According to one embodiment, an ultra-thin client-side viewer provides the graphics, linking, caching, and function handling capabilities necessary for extending the web to almost any platform. It is designed as a lightweight browser (micro-browser) running directly on device operating systems. In alternative embodiments, the client-side viewer may be deployed as a standard browser plug-in, or Java applet for extending browser functionality. In one embodiment, the client-side viewer attains its small size and efficiency by taking advantage of the power of SVF (Simple Vector Format) to describe almost any current web content. SVF files can be handled with a tiny fraction of the client code required by normal web browsers because current browsers must interpret a large and growing number of file types and their idiosyncrasies. SVF was originally designed to handle a superset of the most commonly used file formats in the complex world of CAD. It can accommodate not only new graphical functions, but the storage and transfer of almost any foreseeable new functional capability. SVF has been under consideration by the W3C (World Wide Web Consortium) for adoption as a standard for vector content on the World Wide Web.
By working tightly with a server-side content translator, web content and functionality can be passed seamlessly to the end user platform without any degradation in the look or feel of the output. In addition, because the resulting file graphics are handled as vectors, the end user can control real time changes in the size of text and graphics as well as what portion of the file is viewable in the display. This "zoom and pan" capability, familiar to CAD and other vector content software users, adds dramatically to the usability of non-standard display sizes. For very small displays, real time zooming and panning allows the user to see graphics and text at sizes that make them easily readable, and then "back up" to view an entire page for context or pan in any direction for navigation. Because the client-side viewer manipulates vectors, there is no loss in quality as the display is zoomed. The graphics rendering engine within the client is so efficient that file manipulation happens in a fraction of a second. There is no perceptible wait for the user as the file is resized, or the window is repositioned. Content created for one display resolution now can be sized, real time, for any other display without degradation. Besides making small displays eminently usable, this technology extends web content into some surprising new arenas. For example, it enables normal desktop displays to be effective for individuals with visual impairment, or for content designed for 640�480 standard PC monitors to be shown without degradation on web billboards now appearing in cities like Seattle and San Francisco.
With a client of such extraordinary power packed in a tiny footprint, end user device manufacturers can free up valuable memory space for pre-fetching, caching and pre-loading content, dramatically improving performance for use in low bandwidth and portable applications. In the example of a wireless handheld device where expensive flash memory must be used instead of more cost effective bulk storage technology, the difference between consuming 10's of megabytes of flash memory with a standard browser versus running the client-side viewer described herein is dramatic.
Those "saved" megabytes of memory are now available for impressive interfaces, caching of often used content, and pre-fetching of intelligently selected linked files or pre-loading of content for targeted applications. For example, in a mapping application, the map tiles surrounding the viewed map could be downloaded and stored while the user was working with the initial tile, enabling an experience remarkably free from the current frustrations of waiting for a new map to be transferred for even the smallest change in magnification or coverage. If the user knows ahead of time what city they will visit on a business trip, maps and additional travel information in great detail could also be pre-loaded using a high bandwidth connection at home or in the office before heading out to shop or conduct business in the city. Additionally, SVF is a more efficient way to store web content. Resulting content files are reduced in size by anywhere from 20 to 80 percent over their source. SVF is also very compressible. With target file size reduction in the range of 90%, SVF files can take up as little as 1/10th the space of the web files in current use. This means that pre-translated content can be moved up to 10 times the rate of current web pages, and as much as 10 times as many pages, maps, stock charts, etc. can be stored for instant retrieval on the hand held platform as can be handled with current web technology.
When used on content created natively in SVF, additional capability can be extended to the client-side viewer.
Graphing the performance of stocks over time is only one use of SVF's ability to handle streams of data. Handling the output from financial systems, transactional systems, ERP packages, and CRM systems becomes easier and more flexible. Of course, systems integrators don't have to use these powerful capabilities to start with. If the target system provides web interfaces, these can be viewed, as designed, with no additional software to write, and no changes to the design or layout of the interface.
Server Overview
Enabling the client-side viewer to be so small and powerful is the server-side content translator. The server-side content translator rapidly translates Web content to SVF, compresses and encrypts the SVF results if desired, and transfers the vector formatted results to the client-side viewer. Alternatively, SVF files can be cached or stored in a file system for fetching and transfer at a later time. Pre-translated or cached content transfers are significantly faster as no conversion overhead is incurred, and file sizes are reduced using the more efficient SVF. Combine that with standard compression algorithms selectable for use with the client-side viewer for additional performance improvements.
During the translation process, and in the process of serving cached, pre-translated, or native SVF content, output files are "streamed" to the client-side viewer. Although this does not decrease the total time for file transfer, it can significantly improve the effective system performance for the end user. Content can be selectively streamed, with text and links coming through first, followed by graphic images and other content, for example. Should the user be accessing a link, rather than having interest in the entire file served, links can be selected early in the transfer and the next file download started immediately. In addition to streaming, the server-side content converter may also layer the content by type. This means that text can be put in one layer, links in another, GIF images in another, Javascript in another and so on. Layers can be turned on or off depending upon client capabilities, making files for less capable clients, or for users interested in a reduced functionality, higher transfer performance mode to be handled automatically.
All operational modes may be controlled through an administrative interface or accessible through a straightforward API (Application Program Interface). Furthermore, the system works with existing firewalls and within standard security protocols. In more secure modes, the server-side content converter and the client-side viewer may operate using Public/Private key authentication and encryption.
Exemplary System Infrastructures
In the following paragraphs, a description of three exemplary system infrastructures is provided. Schematic illustrations of these system infrastructures are shown in
A first of exemplary system infrastructure 10A for implementing the invention is shown in
With reference to the flowchart of
Next, in a block 102, the request is received by the proxy server and the proxy server checks its cache to see if it already has the request content in its cache. If it does, it sends this cached content back to the client. If it does not have the requested content cached, the proxy server sends out a request to retrieve the content from the network resource. For illustrative purposes, it will be assumed for the present example that the desired content comprises a web page that is stored on web server 26. Typically, when the requested content comprises a web page, the content may be retrieved using conventional web content retrieval techniques, such as that employed by various modem browser clients, including Netscape Navigator and Internet Explorer. This generally comprises providing routing information, such as the URL for the web page (URL 38) to routing services provided by Internet 24, which routes the request to an appropriate network resource (e.g., web server 26), as depicted by a transfer path 40.
Typically, the URL will correspond to a web page whose content is stored by the web server in an HTML (HyperText Markup Language) document comprising HTML code and embedded text content, in addition to other optional content languages, that may contain references to other objects (e.g., HTML documents and graphic image files) stored locally to the server or stored on a remote server. For example, the HTML content corresponding to a single-frame web page is often stored in a single file, while multiple-frame web pages may comprise content that is stored in a single file or in multiple files. These files may be stored locally on the web server (e.g., on one of the server's hard disks), or on a local storage device connected to the web server via a local area network (LAN), such as a network attached storage (NAS) filer. Optionally, some of the web page's content may comprise one or more documents that are stored at remote locations that may be accessed via a WAN (wide area network) or the Internet.
HTML is a standardized language that describes the layout of content on a web page, and attributes of that content. This layout and attribute information is defined by sets of tags contained in HTML code corresponding to the page. The tags define various HTML layout and display information, including tables, paragraph boundaries, graphic image positions and bounding box sizes, typeface styles, sizes, and colors, borders, and other presentation attributes. A portion or all of a web page's text content may be contained in the parent HTML document corresponding to the URL. In addition to basic HTML, web page documents may contain XML (eXtensable markup language) code, as well as scripting language code, such as javascript. However, for simplicity, any documents containing web page content other than only graphic content that are discussed herein will be referred to as HTML documents.
In addition to HTML and other markup and scripting language content, it is very common for web pages to include graphical content. In general, graphical content is usually stored in an image file or files that are external from the parent HTML document for the web page. For example, the parent HTML document may contain one or more embedded image tags that reference the location where those images are stored. As before, the graphic images may be stored locally, or may be stored on remote servers that are accessed by the web server via a WAN, or the Internet. These files will typically comprise data stored in one of several well-known graphic formats, including bitmap files (BMP), GIF (Graphics Interchange Format) files, and JPEG (Joint Photographic Experts Group) files.
In response to receiving the request for content, web server 26 begins sending a parent HTML document 42 back to proxy server 32 in a block 104. In a block 106, the HTML content of the parent HTML document is parsed to search for references to external objects such as HTML frames and graphics. In a decision block 108, a determination is made to whether any references are found. For each reference to an external object that is found, proxy server 32 requests to have the object retrieved from an appropriate network resource (e.g., a web server) in a block 110, and data corresponding to the object is transmitted back to the proxy server, as depicted by locally accessible HTML documents 44 and graphic images 46, as well as remotely accessible HTML documents 48 and graphic images 50, which may be accessed via web server 28. If the external object is a graphic image, there is no further processing of the object at this point. If the object is an HTML document, the functions provided by blocks 106 and 108 are repeated. Generally, this set of processing functions is repeated iteratively until all of the external objects are retrieved. However, as described below, there will be some instances in which certain objects will be retrieved at a later point in time. In addition to content stored on web servers that are accessed using HTTP, content may also be retrieved from various network sites using the File Transfer Protocol (FTP), such as FTP documents 51, which are accessed via FTP server 30.
In general, HTML documents and graphic files will be sent as packetized data streams using HTTP over one or more TCP/IP network connections, wherein the data streams will usually be asynchronous. Retrieval of HTML documents and graphic files corresponding to the embedded references will usually require additional transfer time. Furthermore, graphic content oftentimes comprises significantly larger file sizes than HTML content, leading to significant transfer times in some instances. For simplicity, the transfer of the various HTML documents and graphic files for the content request are depicted by HTML documents 52 and graphic documents 54, which are transferred over a transfer path 56.
When the HTML documents and graphic content are received by proxy server 32, a scalable vector representation of the web page is generated in a block 114 by an HTML translator 58. In brief, HTML translator 58 translates HTML, XML, and cascaded style sheet (CSS) layout content into a scalable vector representation, such as SVF. Details of the HTML translation process are contained below. In addition, the graphic images are converted into a compressed bitmap format in a block 116 by a graphics translator 60. The vectorized content 62 and compressed bitmaps 64 are then streamed back to the client (i.e., computer 18) in a block 118, as depicted by a transfer path 66. In one embodiment, the content portions are sent in separate streams using multiple connections. In another embodiment, the content portions are sent via a multiplexed stream using a single connection. As the vectorized content and compressed bitmap data are received by the client device, they are processed by a thin client 68 running on the client device, whereby a representation of the original web page content may be rendered on the client device's display screen at various user-selectable scaled resolutions and pan offsets in a block 120, thereby enabling a user to more clearly see an overview or details in the web page. Further details of the client side processing are provided below.
As discussed above, wireless clients may also access the vectorized network (e.g., web site) content provided via proxy server 24. The majority of this process is identical to that described above for land-line clients (e.g., computers 18, 20, and 22), except for provisions required for sending data to and receiving data from wireless devices. In general, most wireless devices will access the Internet via a wireless service provider (i.e., a wireless telecommunications carrier) that is particular to that wireless device. Accordingly, a portion of the transmission path to and from proxy server 24 will comprise infrastructure provided by that service provider and/or shared with other service providers. For simplicity, this infrastructure is shown as a cellular tower 70 and a service provider data center 72, although it will be understood by those skilled in the art that the connection path may comprise additional infrastructure components, including appropriate gateways and routers, that enable wireless devices to access proxy server 24.
In some implementations, there will be no special formatting/protocol services that need to be performed by proxy service 24—from the viewpoint of the proxy service, it will be immaterial whether the client is a land-based or wireless client; the special handling provisions for wireless devices will be handled entirely by the service providers infrastructure transparently at both ends of the communications path. In other instances, it may be desired or necessary to reformat the data content delivered to the wireless device at the proxy service. This will generally be dependent on the particular wireless protocol used, and what services are provided by the service provider for the wireless client.
Currently, in the United States, wireless clients generally access Internet 24 by using the Wireless Application Protocol (WAP). In Japan, the most popular access means is NTT DoCoMo's i-Mode wireless protocol. In addition to these wireless standards, new standards are anticipated to be in force in the near future, including NTT DoCoMo's FOMA (Freedom of Mobile Multimedia Access), which is transported over W-CDMA (Wideband Code Division Multiple Access), and CDMA-2000. For the purposes of the invention herein, it will be understood that those skilled in the mobile telecommunications arts will be knowledgeable about any particular format and/or transport protocol requirements that pertain to the particular protocol that is to be used.
A second exemplary system infrastructure 10B for implementing the invention is shown in
The logic implemented by the invention when providing content to a client using infrastructure 10B is illustrated in the flowchart of
As before, the retrieved HTML documents are translated into scalable vector representations by HTML translator 58 in a block 114, while the graphic images are translated into a compressed bitmap format by image translator 60 in a block 116, as depicted by vectorized content 62 and bitmap content 64. The vectorized content and bitmap content are then streamed from the web server to the client in a block 119, as depicted by a transfer path 67. Upon arriving at the client, the vectorized content and bitmap content are processed, scaled, and rendered on the client in a block 120.
A third exemplary system infrastructure 10C for implementing the invention is shown in
Attention now is focused on the functionality provided by proxy server 24 in system infrastructure 10A of
The proxy server responds to client content requests by delivering content in one of the requested formats, by retrieving the content in an appropriate format from its cache, or from an upstream content source (again using standard HTTP content negotiation features), or by translating upstream content from a supported original format to SVF or the client bitmap format.
Requests from the server installation to its cache and from the cache to upstream content sources are made in HTTP carried over TCP using simple straightforward Web content requests. For example, requests from clients to the proxy server comprise HTTP proxy requests (e.g., "GET http://www/xyz.com/some_page.html HTTP/1.0 . . . ") carried over TCP or over a lightweight multiplexing protocol over TCP. The multiplexing protocol allows the server to push image thumbnails to the client before the SVF stream is available, as well as offering a channel for control and status information, more simultaneous channels than the client operating system may support, and a mechanism for prioritizing information flow from server to client under loose client control. In addition to HTTP requests, the proxy server architecture supports other user-level protocols, such as FTP and Gopher.
Details of some of the primary components of the proxy server architecture are shown in
The various content translators used by the proxy server accept (via HTTP PUT) or request (driven by HTTP proxy GET/POST) content in supported, but client-unsupported, formats; and return (via HTTP PUT or GET/POST response) one or more representations of that content in a client-supported format. In the embodiments illustrated in
Managers at the proxy server coordinate the operations of other components. Two managers are presently defined; a client manager 73 that handles client proxy requests, and a request manager 75 that handles unproxied HTTP requests from other services. The managers accept requests, attempt to service them from HTTP cache 74, and drive HTML translator 58 and image translator 60 when content does not match the clients' requirements. Managers also handle translator requests for inline content (e.g., image dimensions for page layout), and push translated content into HTTP cache 74. Additionally, the client manager coordinates delivery of primary and inlined content, and provides process and status information to the clients.
As discussed above, HTML translator 58 creates a scalable vector representation of the original HTML content of a requested web page. In order to better explain how translation of HTML content is performed, one embodiment of a translation process is described below as applied to an exemplary web page. In addition, details of conventional web page client and server-side processing are provided so as to clarify how web content is laid out during a pre-rendering process on the client.
A horizontal group of links 236 is disposed at the top of frame 214, and includes a "QUOTES" link 238A, a "HOT PICKS" link 240A, a "CALENDARS" link 242A, and a "NEWS" link 244A. An advertisement banner 246A is displayed just below the horizontal group of links and just above a "NEWS SPARKS MARKET" headline 248A. Frame 214 also includes a pair of graphic image objects, including a DOW chart 250A and a NASDAQ chart 252A. A set of user input objects is disposed adjacent to DOW chart 250A within a graphic object 254A, including an "ACCOUNT #" input box 255A, an "ACCESS CODE" input box 256A, and a "LOGIN" button 257A. In addition to the foregoing objects, frame 214 also includes text objects 258A and 260A.
An HTML listing corresponding to web page 210 is presented below as LISTING 1. Note that LISTING 1 sometimes refers to object descriptions and link paths rather than the text or path location of actual objects for simplicity, and that other elements commonly found in HTML pages, such as META entries, are omitted for clarity.
<head><title>"MARKET HOME"</title></head>
<body bgcolor="#FFFFFF" link="0033CC" vlink="0033CC">
<frameset cols="25%,75% frameborder=0 border=0>
<img src="/directory path/logo.gif" align = left border="0" height="80" width="100">
<t3>TEXT HEADER #1 align=left</t3><br>
<table width="90%" border=0 cellspacing=10 cellpadding=0 bgcolor="#000000"
<a href="URL or path for LINK #5" <img src="/directory
path/GRAPHIC#2" height="50" width ="150></a>
<a href="URL or path for LINK #6" <img src="/directory
path/GRAPHIC#3" height="50" width ="150></a>
<a href="URL or path for LINK #7" <img src="/directory
path/GRAPHIC#4" height="50" width ="150></a>
<a href="URL or path for LINK #8" <img src="/directory
path/GRAPHIC#5" height="50" width ="150></a>
<t3>TEXT HEADER #1 align=left</t3>
<table width="90%" border=0 cellspacing=10 cellpadding=0 bgcolor="#000000"
<a href="URL or path for LINK #9" <img src="/directory
path/GRAPHIC#6" height="50" width ="150></a>
<a href="URL or path for LINK #10" <img src="/directory
path/GRAPHIC#7" height="50" width ="150></a>
<a href="URL or path for LINK #11" <img src="/directory
path/GRAPHIC#8" height="50" width ="150></a>
<table width="100%" border=0 cellspacing=15 cellpadding=0
bgcolor="#000000" align=center>
<td><a href="URL or path for link#1"> alt="QUOTES"</a>
<td><a href="URL or path for link#2"> alt="HOT PICKS"</a>
<td><a href="URL or path for link#3> alt="CALENDERS"</a>
<td><a href="URL or path for link#4>alt="NEWS"</a>
<img src="URL for GRAPHIC #9" align=center
border="0" height="80" width="325">
<br><t1>HEADLINE TEXT>/t1>
<Colgroup span="2">
<Col width = "400" align="center">
<Col width = "200" align="center">
<img src="/directory path/GRAPHIC #10" align = center
border="0" height="180" width="350">
<SCRIPT LANGUAGE ="Javascript">
[Javascript variable declarations]
<img src="/directory path/GRAPHIC #11" align = center>
<table width="150" height="25">
<font size=−2 face="arial,helvetica,verdana">Account#</font>
<tr><input type=text name="USERID" maxlength=9 size=20>
<tr><font size=−2 face="arial, helvetica">Access Code:</font>
<tr><input type=password name="PASSWORD" maxlength=10 size=20
<br><input type="button" value="Login"
OnClick="ProcessForm( )">  <input type="reset">
<img src="/directory path/GRAPHIC #12" border="0
height="200" width="350">
<p>TEXT FOR TEXT OBJECT #1</p><br>
<p>TEXT FOR TEXT OBJECT #2</p>
Web page documents comprise HTML code that is parsed, interpreted, and rendered by a browser. An HTML document comprises a plurality of HTML "markup" elements (tags) with corresponding attributes, that are used to describe the layout and formatting of various objects, including plain text and graphic objects, embedded between tag pairs. Exemplary elements include text tags (e.g., <b></b> for bolding text), links (e.g., <a href="URL"></a>), formatting (e.g., <p></p> for creating a new paragraph, graphical (e.g., <img src="name">), wherein "name" defines an absolute or relative location at where an image is stored, tables (e.g., <table></table>) creates a table, and forms (e.g., <form></form> creates all forms).
As of Netscape Navigator 3.0 (and other later browsers), web pages could include frames. When using frames, the display page is divided into multiple framed areas. Framing enables a single display page to include source code from several HTML documents (one for each frame) or optionally, enables a single document to include more complicated grouping of contents whereby different content groups are contained in separate frames. Frames are commonly found on the web pages at sites that display a great deal of text and graphical content, such as MSN.com, ESPN.com, and USAToday.com.
With reference to the flowchart of
Next, in a block 152, the content is separated into objects based on logical groupings of content portions and a page layout is built using bounding boxes that are produced for each object. As the primary HTML document is parsed, logical groupings of content will emerge. For instance, text content contained within paragraph tags <p></p> forms a logical grouping of text content. In essence, a logical grouping means the content should appear together as a logical group, such as within a substantially rectangular outline, in the rendered page. Other logical groupings include frames, table content, row content, single line entries such as headlines and headers, and user-interface objects, as well as graphic layout objects, such as separator bars, and graphic images. In addition to logically grouping content into objects, a "bounding box" is defined for each object. In general, the bounding box defines an outlined shape within which the content (text or graphic image) will appear. In most instances, the bounding box will be substantially rectangular in shape. However, bounding boxes comprising more complex shapes may also be produced.
In further detail, the following explains how objects corresponding to graphic images are produced. In HTML, objects comprising graphic content are identified by an <img src="/local directory path/graphic image file" (for a local graphic image) or "URL" (for a remote graphic image)> or <object> or other tags. In the foregoing tag, local graphic images are typically stored on the same server as the web page, or another computer that is local to the site's server, and generally are located through a local directory path (absolute or relative to the location of the present page) that points to the graphic image file. Remote images are those images that are stored on servers at sites that are remote to the web server. For example, with reference to LISTING 1, when the parser encounters line 9, the browser identifies that data comprising a graphic image corresponding to logo graphic object 1 will be arriving (or may have already been received), and the displayed image is to have a height of 80 pixels and a width of 100 pixels. The location of each object on a display page will be dependent on previous HTML layout elements, such as tables, paragraphs, line breaks, and other graphic objects. The size and location of the other graphic objects (i.e., graphic objects #2-12) on the page are determined in a similar manner. The HTML code for these objects are shown in lines 16, 19, 22, 25, 34, 37, 40, 59, 67, 78 and 96, respectively. As identified in the HTML code, data corresponding to graphic objects #9 (advertisement banner 46A) is forwarded to the browser from an external site (as indicated by the URL to GRAPHIC #9), while graphic objects 1-8 and 10-12 are sent from the web site the parent HTML document is sent from.
In a similar manner, the foregoing technique is applied to the HTML code in the primary document to identify other types of objects as well. In addition to parsing the primary HTML document, similar processing is performed on referenced documents, such as documents that include frame content that is defined and stored separate from the primary HTML document.
A representation of the results of the functions performed in block 152 are shown in
Next, in a block 154, the page layout is defined based on the bounding boxes. In actuality, generation of the page layout information is performed in conjunction with defining the boundary boxes for the objects, wherein the location of a given object is based on the location of other related (e.g., if within a table) or non-related objects corresponding to HTML content that have been previously parsed. For example, the location of a given paragraph will depend on the other content for the page that are listed prior to the definition for the paragraph in the primary HTML document or referenced document, if applicable. As the HTML content of the primary and any referenced HTML documents are parsed, the page layout is generated based on the various HTML tags and the content embedded between tag pairs and/or referenced by a tag pair statement (e.g., graphic images).
As will be recognized by those skilled in the art, the functions performed in blocks 150, 152, and 154 are commonly performed by conventional browsers during a pre-rendering process. In some browsers, these functions are performed by the Mozilla rendering engine, which comprises open source software that is readily available for use by developers. At present, the software for the Mozilla rendering engine may be accessed via the Internet at www.mozilla.org. Accordingly, in one embodiment, the present invention uses core functionality provided by the Mozilla rendering engine source code to perform the functions of block 150, 152, and 154.
At this point, the present invention deviates substantially from the prior art by using the various object layout data generated during the pre-rendering process to generate a scalable vector representation of the original page content. First, in a block 156, a datum point is defined for the page and the bounding box for each object. For example, as shown in
In general, the datum points for each object may also be located any place on the object, as long as the object datum points are used in a predictable manner. For example, as depicted in
Once the page's datum point and an object's datum point are known, a vector between these points is generated for each object in a block 158. With reference to
The scalable vector representation is completed in a block 160, wherein a reference is created for each object that includes or links an object's content and attributes, such as object type (e.g., text, image), object typeface, and boundary box parameters, to the object's vector. For example, object 250B is a graphic image having a vector 250D and a bounding box that is 180 pixels high and 350 pixels wide, while object 252B is a graphic image having a vector 252D and a bounding box that includes a height of 200 pixels and a width of 350 pixels. This enables client-side operations to be performed that only initially consider the vectors, wherein if it is determined that a vector's endpoint (and/or the bounding box corresponding to the object the vector points to) would appear off of a display, there is no need to retrieve the content and attribute data linked to the vector. This concept is explained in further detail in the following section.
It is noted that a portion of the display content produced on a client device will never contain any rendered content, as this portion is reserved for the browser's user interface. In WINDOWS™ environments, this portion will include the browser's window frame, as well as the pulldown and icon menus provided in the browser's user interface, which are depicted by a box 264 in the Figures herein.
Client-Side Software and Processing
As discussed above, the present invention supports a wide variety of clients, including land-based clients and wireless clients. Each client requires some client-side software that enables the scalable vector content data provided to it to be rendered at a user-selectable scale factor and offset on the client's display, such as a monitor or built-in LCD screen.
By enabling original content from a web site to be displaced in such a resolution-independent manner, users will be able to view content in a manner that did not previously exist, greatly enhancing the user experience. For example, in some implementations the client may be a personal computer (PC). Using a least-common denominator approach, many web pages are designed for a smaller resolution (for example 640�480 pixels, a minimum resolution commonly supported by nearly all PC's, including legacy PC's) than the resolution provided by the video output capabilities available with many of today's PC's, such as 1024�768 pixels, 1280�1024 pixels, and even 1600�1200 pixels. As a result, when these web pages are displayed on a high-resolution display, they occupy only a portion of the display, making portions of the pages, especially those portions containing small text, difficult to read. By enabling users to selectively magnify the entire page, these design flaws are easily overcome. Alternatively, the client may be a small device, such as a hand held computer or a cell phone, which has a smaller display resolution than common Web pages are designed for. As explained below, through use of the invention's scalable vector representation and client-side processing, users are enabled to view the entire content of billions of existing Web pages using hand-held devices in a simple and reasonable way.
In one embodiment, the client software may be a plug-in to a Web browser, such as Netscape Navigator or Microsoft Internet Explorer. Such a plug-in might have the browser download the data and display it in a sub-window of the browser. Alternatively, the client software may be a Java applet running in a browser. As another option, the client software may be a stand-alone program that interfaces with the proxy server or proxy software directly. The client software may bypass the proxy when requesting information that won't be translated to vectors, such as bitmaps.
With reference to
Next, in a block 166, the vectors and boundary boxes are processed based on the scale and offset, and a bounding box defining the limits of the display content is determined. The results of this step are shown in
As shown in
This foregoing process establishes a starting point (the new datum) for where the content in each object's bounding box will be rendered. At this point, each object's bounding box is then drawn from its new datum using the scaling factor. For example, in the original web page 210D (
Returning to the flowchart of
The process is completed in a block 172, wherein those portions of the scaled content falling within the display limit bounding box are rendered on the client device's display.
As discussed above, it is foreseen that the invention will be used with client devices having small, low resolution displays, such as PDAs and pocket PCs. Examples of various views of an exemplary web pages obtained from the YAHOO™ web site are shown in
In addition to directly scaling and offsetting content, the client user-interface software for PDA's provides additional functionality. For instance, a user may select to view a column (results represented in
It is further noted that that different scaling factors can be applied to the X and Y axis so as to change the aspect ratio of the display. For example, a Web page may be designed to be displayed on a computer having a resolution of 800�600 pixels, or a 4X to 3Y aspect ratio. In this case, the display corresponds to a "landscape" layout, wherein there are more pixels along the X axis than along the Y axis. Conversely, many handheld devices display images having a "portrait" layout, wherein there are more pixels along the Y axis than the X axis. By enabling different scaling factors to be applied to the X and Y axes, the present invention enables the aspect ratio of a rendered display image to be adjusted to better fit the aspect ratio of the client device.
An Exemplary Computer Architecture
An exemplary machine in the form of a computer system 500 in which features of the present invention may be implemented will now be described with reference to
A data storage device 507 such as a magnetic disk or optical disc and its corresponding drive may also be coupled to bus 501 for storing information and instructions. Computer system 500 can also be coupled via bus 501 to a display device 521, such as a cathode ray tube (CRT) or Liquid Crystal Display (LCD), for displaying information to an end user. Typically, an alphanumeric input device 522, including alphanumeric and other keys, may be coupled to bus 501 for communicating information and/or command selections to processor 502. Another type of user input device is cursor control 523, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 502 and for controlling cursor movement on display 521.
A communication device 525 is also coupled to bus 501. Depending upon the particular presentation environment implementation, the communication device 525 may include a modem, a network interface card, or other well-known interface devices, such as those used for coupling to Ethernet, token ring, or other types of physical attachment for purposes of providing a communication link to support a local or wide area network, for example. In any event, in this manner, the computer system 500 may be coupled to a number of clients and/or servers via a conventional network infrastructure, such as a company's Intranet and/or the Internet, for example.
Importantly, the present invention is not limited to having all of the routines located on the same computer system. Rather, individual objects, program elements, or portions thereof may be spread over a distributed network of computer systems. Additionally, it is appreciated that a lesser or more equipped computer system than the example described above may be desirable for certain implementations. Therefore, the configuration of computer system 500 will vary from implementation to implementation depending upon numerous factors, such as price constraints, performance requirements, and/or other circumstances. For example, according to one embodiment of the present invention, a cell phone or a hand held computer may comprise only a processor or a micro controller and a memory, such as a micro code ROM or RAM, for storing static or dynamically loaded instructions and/or data.
In the foregoing specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Cited Patent | Filing date | Publication date | Applicant | Title |
US5966135 | Oct 30, 1996 | Oct 12, 1999 | Autodesk, Inc. | Vector-based geographic data |
US6011905 | Nov 8, 1996 | Jan 4, 2000 | Xerox Corporation | Using fontless structured document image representations to render displayed and printed documents at preferred resolutions |
US6057854 | Jul 28, 1997 | May 2, 2000 | Micrografx, Inc. | System and method of providing interactive vector graphics over a network |
US6185625 | Dec 20, 1996 | Feb 6, 2001 | Intel Corporation | Scaling proxy server sending to the client a graphical user interface for establishing object encoding preferences after receiving the client's request for the object |
US6300947 | Jul 6, 1998 | Oct 9, 2001 | International Business Machines Corporation | Display screen and window size related web page adaptation system |
US6421733 | Sep 8, 1997 | Jul 16, 2002 | Intel Corporation | System for dynamically transcoding data transmitted between computers |
US6466203 | Jul 19, 2000 | Oct 15, 2002 | Koninklijke Philips Electronics N.V. | Hand-held with auto-zoom for graphical display of Web page |
US6546397 | Dec 2, 1999 | Apr 8, 2003 | Steven H. Rempell | Browser based web site generation tool and run time engine |
US6615212 | Aug 19, 1999 | Sep 2, 2003 | International Business Machines Corporation | Dynamically provided content processor for transcoded data types at intermediate stages of transcoding process |
US6642925 * | Dec 6, 2001 | Nov 4, 2003 | Autodesk, Inc. | Vector-based geographic data |
US6674445 * | Jul 31, 2000 | Jan 6, 2004 | Autodesk, Inc. | Generalized, differentially encoded, indexed raster vector data and schema for maps on a personal digital assistant |
US6857102 | Jan 29, 1999 | Feb 15, 2005 | Fuji Xerox Co., Ltd. | Document re-authoring systems and methods for providing device-independent access to the world wide web |
US6886034 * | Oct 4, 2002 | Apr 26, 2005 | Canon Kabushiki Kaisha | Method and system for viewing scalable documents |
US7219309 | Mar 14, 2003 | May 15, 2007 | Bitstream Inc. | Innovations for the display of web pages |
US20010047428 | Mar 29, 2001 | Nov 29, 2001 | Hunter Kevin D. | Method and system for simplified access to internet content on a wireless device |
US20020112237 | Dec 22, 2000 | Aug 15, 2002 | Kelts Brett R. | System and method for providing an interactive display interface for information objects |
US20040049598 | Feb 23, 2001 | Mar 11, 2004 | Dennis Tucker | Content distribution system |
US20050144256 | Feb 25, 2005 | Jun 30, 2005 | Canon Kabushiki Kaisha | Method and system for viewing scalable documents |
WO2001096985A2 | Jun 11, 2001 | Dec 20, 2001 | Softsource, Inc. | Resolution independent vector display of internet content |
Reference | ||
1 | Benjamin B. Bederson et al., A Zooming Web Browser, SPIE 1996, http://www.cs.umd.edu/hcil/jazz/learn/papers/spie-96-webbrowser.pdf. | |
2 | Benjamin B. Bederson et al., Pad++: A Zoomable Graphical Sketchpad For Exploring Alternate Interface Physics, Sep. 19, 1995, http://www.cs.unm.edu/pad++. | |
3 | Changes to SVF, (Date unknown). | |
4 | Combined Printout of HTML Help Files for Opera 3.60 (HTML pages printed to PDF docs and combined), Available on May 12, 1999. | |
5 | * | http://www.w3.org/TR/1999/WD-SVG-19990211/-Pub Feb. 11, 1999 by W3C pp. 1-7 (A complet details can be down load at by the provides URL above). |
6 | Introduction to SVG, part of WD-SVG-19990211, http://www.w3.org/TR/1999/ WD-SVG-19990211/intro. html#Document . . . . | |
7 | Janus Boye, SVG Brings Fast Vector Graphics to Web, Jul. 29, 1999 http://www.irt.org/articles/js176/. | |
8 | Precision Graphics Markup Language (PGML), World Wide Web Consortium NOTE Apr. 10, 1998, NOTE-PGML-19980410, http://www.w3.org/TR/1998/NOTE-PGML-19980410. | |
9 | Rick Graham, Mobile SVG at BitFlash Inc., May 2001, http://www.w3.org/Talks/2002/1007-DI-Helsinki/bitflash/index.html. | |
10 | Scalable Vector Graphics (SVG) 1.0 Specification, W3C Candidate Recommendation Nov. 2, 2000. | |
11 | Scalable Vector Graphics (SVG) Specification, W3C Working Draft Apr. 12, 1999 WD-SVG-19990412, http://www.w3.org/TR/1999/ WD-SVG-19990412/ (HTML format-initial page). | |
12 | Scalable Vector Graphics (SVG) Specification, W3C Working Draft Feb. 11, 1999 WD-SVG-19990211, http://www.w3.org/TR/1999/ WD-SVG-19990211/ (HTML format-initial page). | |
13 | Screenshots compilations of Web pages using Opera 3.60, including: www.Altavista.com-May 1, 1999 www.cnet.com-May 8, 1999 www.excite.com-May 8, 1999 www.nytimes.com-Apr. 22, 1999 www.softsource.com-Apr. 17, 1999 www.utexas.edu-Apr. 27, 1999 www.uspto.gov-May 5, 1999 www.yahoo.com-May 8, 1999. | |
14 | Specification for Simple Vector Format (SVF) v1.1 Jan. 16, 1995. | |
15 | Specification for Simple Vector Format (SVF) v2.0 Dec. 6, 2000, http://www.svf.org/spec.html. | |
16 | Steve Mulder, Sneak Peak at SVG, Mar. 4, 1999, http://www.webmonkey.com/99/10/index3a.html?tw=eg1999102. | |
17 | U.S. Appl. No. 60/288,287, filed May 2, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
18 | U.S. Appl. No. 60/296,224, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
19 | U.S. Appl. No. 60/296,231, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
20 | U.S. Appl. No. 60/296,237, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
21 | U.S. Appl. No. 60/296,273, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
22 | U.S. Appl. No. 60/296,274, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
23 | U.S. Appl. No. 60/296,275, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
24 | U.S. Appl. No. 60/296,281, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
25 | U.S. Appl. No. 60/296,283, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
26 | U.S. Appl. No. 60/296,284, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
27 | U.S. Appl. No. 60/296,327 Available on PAIR. | |
28 | U.S. Appl. No. 60/296,327, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
29 | U.S. Appl. No. 60/296,426, filed Jun. 5, 2001. Available on PAIR-electronic copy previously filed via IDS submission of Sep. 18, 2007. | |
30 | Vector Markup Language (VML), World Wide Web Consortium Note May 13, 1998, NOTE-VML-19980513, http://www.w3.org/TR/1998/NOTE-VML<SUB>-</SUB>19980513. |
Citing Patent | Filing date | Publication date | Applicant | Title |
US7640498 * | Jul 9, 2004 | Dec 29, 2009 | Yahoo! Inc. | Method and system for maintaining font sizes on different platforms |
US7653875 * | Apr 7, 2005 | Jan 26, 2010 | Microsoft Corporation | Browser sensitive web content delivery |
US7725815 * | Dec 12, 2005 | May 25, 2010 | Sap Ag | Method and system for ordered resizing columns in a table |
US7864163 | Sep 4, 2007 | Jan 4, 2011 | Apple Inc. | Portable electronic device, method, and graphical user interface for displaying structured electronic documents |
US7865528 * | Jun 8, 2009 | Jan 4, 2011 | Nextair Corporation | Software, devices and methods facilitating execution of server-side applications at mobile devices |
US8132109 * | May 15, 2009 | Mar 6, 2012 | International Business Machines Corporation | Webpage magnifier/formatter using CSS properties and cursor/mouse location |
US8204911 * | Dec 20, 2010 | Jun 19, 2012 | Nextair Corporation | Software, devices and methods facilitating execution of server-side applications at mobile devices |
US8214768 | Jan 5, 2007 | Jul 3, 2012 | Apple Inc. | Method, system, and graphical user interface for viewing multiple application windows |
US8346893 * | Feb 25, 2009 | Jan 1, 2013 | Research In Motion Limited | Mobile wireless communications device to display a remaining content portion of a web article and associated methods |
US8396849 * | Mar 30, 2006 | Mar 12, 2013 | Microsoft Corporation | Automatic browser search provider detection and usage |
US8418075 * | Nov 16, 2005 | Apr 9, 2013 | Open Text Inc. | Spatially driven content presentation in a cellular environment |
US8438504 | May 27, 2010 | May 7, 2013 | Apple Inc. | Device, method, and graphical user interface for navigating through multiple viewing areas |
US8448090 * | Jan 19, 2010 | May 21, 2013 | Hewlett-Packard Development Company, L.P. | Selective plug-in activation for resource-limited platforms |
US8531423 | May 4, 2012 | Sep 10, 2013 | Apple Inc. | Video manager for portable multifunction device |
US8539338 | Apr 11, 2011 | Sep 17, 2013 | Microsoft Corporation | Cooperative rendering cache for mobile browser |
US8547355 | Jun 7, 2011 | Oct 1, 2013 | Apple Inc. | Video manager for portable multifunction device |
US8669950 | Dec 29, 2010 | Mar 11, 2014 | Apple Inc. | Portable electronic device, method, and graphical user interface for displaying structured electronic documents |
US8686951 | Mar 18, 2009 | Apr 1, 2014 | HJ Laboratories, LLC | Providing an elevated and texturized display in an electronic device |
US8736561 | May 27, 2010 | May 27, 2014 | Apple Inc. | Device, method, and graphical user interface with content display modes and display rotation heuristics |
US8806331 * | Jul 16, 2010 | Aug 12, 2014 | Interactive Memories, Inc. | System and methods for creating and editing photo-based projects on a digital network |
US8839117 | Aug 24, 2009 | Sep 16, 2014 | Nintendo Of America Inc. | Internet browser |
US8842074 | Sep 5, 2007 | Sep 23, 2014 | Apple Inc. | Portable electronic device performing similar operations for different gestures |
US8863039 | Apr 18, 2011 | Oct 14, 2014 | Microsoft Corporation | Multi-dimensional boundary effects |
US8866766 | Nov 8, 2011 | Oct 21, 2014 | HJ Laboratories, LLC | Individually controlling a tactile area of an image displayed on a multi-touch display |
US8935607 * | May 26, 2010 | Jan 13, 2015 | Alibaba Group Holding Limited | Method, apparatus and system of displaying webpages |
US8965410 | Aug 27, 2014 | Feb 24, 2015 | TravelStorysGPS, LLC | Systems and methods for creating and providing location-based content |
US9053076 * | Feb 28, 2013 | Jun 9, 2015 | Interactive Memories Inc. | Autoflow in photobook development |
US9058310 * | Mar 6, 2013 | Jun 16, 2015 | Interactive Memories, Inc. | Method for determining effective core aspect ratio for display of content created in an online collage-based editor |
US9069459 | May 3, 2011 | Jun 30, 2015 | Microsoft Technology Licensing, Llc | Multi-threaded conditional processing of user interactions for gesture processing using rendering thread or gesture processing thread based on threshold latency |
US9078096 | Jan 27, 2015 | Jul 7, 2015 | TravelStorysGPS, LLC | Systems and methods for creating and providing location-based content |
US9128596 * | Sep 22, 2006 | Sep 8, 2015 | Opera Software Asa | Method and device for selecting and displaying a region of interest in an electronic document |
US9304837 | Jun 30, 2011 | Apr 5, 2016 | Open Text S.A. | Cellular user interface |
US9335824 | Sep 12, 2014 | May 10, 2016 | HJ Laboratories, LLC | Mobile device with a pressure and indentation sensitive multi-touch display |
US9367232 | Aug 27, 2013 | Jun 14, 2016 | Apple Inc. | Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display |
US9400558 | Mar 4, 2016 | Jul 26, 2016 | HJ Laboratories, LLC | Providing an elevated and texturized display in an electronic device |
US9405371 | Mar 24, 2016 | Aug 2, 2016 | HJ Laboratories, LLC | Controllable tactile sensations in a consumer device |
US9417787 | Mar 10, 2010 | Aug 16, 2016 | Microsoft Technology Licensing, Llc | Distortion effects to indicate location in a movable data collection |
US9423905 | Mar 24, 2016 | Aug 23, 2016 | Hj Laboratories Licensing, Llc | Providing an elevated and texturized display in a mobile electronic device |
US9448632 | May 3, 2016 | Sep 20, 2016 | Hj Laboratories Licensing, Llc | Mobile device with a pressure and indentation sensitive multi-touch display |
US9459728 | Mar 3, 2016 | Oct 4, 2016 | HJ Laboratories, LLC | Mobile device with individually controllable tactile sensations |
US9547368 | Aug 17, 2016 | Jan 17, 2017 | Hj Laboratories Licensing, Llc | Electronic device with a pressure sensitive multi-touch display |
US20050086599 * | Jul 9, 2004 | Apr 21, 2005 | Yahoo! Inc. | Method and system for maintaining font sizes on different platforms |
US20060156228 * | Nov 16, 2005 | Jul 13, 2006 | Vizible Corporation | Spatially driven content presentation in a cellular environment |
US20060230344 * | Apr 7, 2005 | Oct 12, 2006 | Microsoft Corporation | Browser sensitive web content delivery |
US20060282500 * | Jun 8, 2006 | Dec 14, 2006 | Yutaka Kiuchi | Information management method using a managing symbol and information management server |
US20070136654 * | Dec 12, 2005 | Jun 14, 2007 | Peters Johan C | Method and system for ordered resizing columns in a table |
US20070136655 * | Dec 12, 2005 | Jun 14, 2007 | Peters Johan C | Method and system for linearly resizing columns in a table |
US20070233646 * | Mar 30, 2006 | Oct 4, 2007 | Microsoft Corporation | Automatic Browser Search Provider Detection and Usage |
US20080040659 * | Feb 4, 2005 | Feb 14, 2008 | Stephen Doyle | Markup Language Translator System |
US20080077880 * | Sep 22, 2006 | Mar 27, 2008 | Opera Software Asa | Method and device for selecting and displaying a region of interest in an electronic document |
US20080094368 * | Sep 4, 2007 | Apr 24, 2008 | Bas Ording | Portable Electronic Device, Method, And Graphical User Interface For Displaying Structured Electronic Documents |
US20080168401 * | Jan 5, 2007 | Jul 10, 2008 | Boule Andre M J | Method, system, and graphical user interface for viewing multiple application windows |
US20080301585 * | Jun 1, 2007 | Dec 4, 2008 | Murray Austin P | Method for hotspotting the visible world using visual iconography or audio indication |
US20090066729 * | Sep 10, 2008 | Mar 12, 2009 | Steve Sabram | Real-time display of measurement array data for handheld computing devices in communication with instruments |
US20090183068 * | Jan 14, 2008 | Jul 16, 2009 | Sony Ericsson Mobile Communications Ab | Adaptive column rendering |
US20090300063 * | Jun 8, 2009 | Dec 3, 2009 | Tim Neil | Software, devices and methods facilitating execution of server-side applications at mobile devices |
US20090316777 * | Jun 19, 2009 | Dec 24, 2009 | Xin Feng | Method and Apparatus for Improved Broadcast Bandwidth Efficiency During Transmission of a Static Code Page of an Advertisement |
US20100124939 * | Nov 18, 2009 | May 20, 2010 | John Osborne | Method and system for graphical scaling and contextual delivery to mobile devices |
US20100217838 * | Feb 25, 2009 | Aug 26, 2010 | Research In Motion Limited | Mobile wireless communications device to display a remaining content portion of a web article and associated methods |
US20100238114 * | Mar 18, 2009 | Sep 23, 2010 | Harry Vartanian | Apparatus and method for providing an elevated, indented, or texturized display device |
US20100293510 * | May 15, 2009 | Nov 18, 2010 | International Business Machines Corporation | Webpage magnifier/formatter using css properties and cursor/mouse location |
US20100325533 * | Jun 19, 2009 | Dec 23, 2010 | Aol Llc | Systems and methods for improved web-based document retrieval and object manipulation |
US20110022984 * | Jan 19, 2010 | Jan 27, 2011 | Palm, Inc. | Selective Plug-In Activation For Resource-Limited Platforms |
US20110087710 * | Dec 20, 2010 | Apr 14, 2011 | Tim Neil | Software, devices and methods facilitating execution of server-side applications at mobile devices |
US20110126113 * | Nov 23, 2009 | May 26, 2011 | c/o Microsoft Corporation | Displaying content on multiple web pages |
US20110161892 * | Dec 26, 2010 | Jun 30, 2011 | Motorola-Mobility, Inc. | Display Interface and Method for Presenting Visual Feedback of a User Interaction |
US20110167353 * | Jul 16, 2010 | Jul 7, 2011 | Aryk Erwin Grosz | System and Methods for Creating and Editing Photo-Based Projects on a Digital Network |
US20110202834 * | May 4, 2010 | Aug 18, 2011 | Microsoft Corporation | Visual motion feedback for user interface |
US20110202859 * | Mar 10, 2010 | Aug 18, 2011 | Microsoft Corporation | Distortion effects to indicate location in a movable data collection |
US20120131437 * | May 26, 2010 | May 24, 2012 | Alibaba Group Holding Limited | Method, Apparatus and System of Displaying Webpages |
US20120192063 * | May 23, 2011 | Jul 26, 2012 | Koren Ziv | On-the-fly transformation of graphical representation of content |
US20130194591 * | Mar 6, 2013 | Aug 1, 2013 | Aryk Erwin Grosz | Method for Determining Effective Core Aspect Ratio for Display of Content Created in an Online Collage-Based Editor |
U.S. Classification | 715/815, 715/239, 715/249, 715/760, 715/234 |
International Classification | G06F7/00, G06F17/00, G06F, G06F17/30, G06F15/00 |
Cooperative Classification | G06F2203/04806, G06F17/30905, G06F17/30896, G06F17/2247, G06F17/2235, G06F17/211, G06F3/0488, H04L67/2823, G09G2340/0492, G06F2212/1048, G09G5/24, G06F17/30902, G06F9/4443, G06F17/3089, G09G2340/0407, G06F3/0481, G06F17/30861, H04L67/02, G06F17/30899, H04L67/04 |
European Classification | H04L29/08N3, G06F9/44W, H04L29/08N27F, G06F17/30W9V |
Date | Code | Event | Description |
Dec 9, 2007 | AS | Assignment | Owner name: ROHRABAUGH, GARY B, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SOFTSOURCE, LLC;REEL/FRAME:020217/0574 Effective date: 20041104 Owner name: SOFTSOURCE, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SOFTSOURCE CORPORATION;REEL/FRAME:020217/0569 Effective date: 20040909 Owner name: SOFTSOURCE CORPORATION, COLORADO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ROHRABAUGH, GARY B;SHERMAN, SCOTT A.;REEL/FRAME:020217/0564 Effective date: 20010608 |
Apr 21, 2009 | CC | Certificate of correction | |
May 10, 2010 | AS | Assignment | Owner name: SOFTVIEW L.L.C.,WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ROHRABAUGH, GARY B.;REEL/FRAME:024358/0179 Effective date: 20100423 Owner name: SOFTVIEW L.L.C., WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ROHRABAUGH, GARY B.;REEL/FRAME:024358/0179 Effective date: 20100423 |
Jul 12, 2011 | RR | Request for reexamination filed | Effective date: 20110520 |
Dec 9, 2011 | FPAY | Fee payment | Year of fee payment: 4 |
Jun 12, 2012 | RR | Request for reexamination filed | Effective date: 20120413 |
Oct 23, 2012 | RR | Request for reexamination filed | Effective date: 20120831 |
Jan 1, 2013 | IPR | Aia trial proceeding filed before the patent and appeal board: inter partes review | Free format text: TRIAL NO: IPR2013-00007 Opponent name: KYOCERA CORPORATION Effective date: 20121002 |
Jun 4, 2013 | IPR | Aia trial proceeding filed before the patent and appeal board: inter partes review | Free format text: TRIAL NO: IPR2013-00256 Opponent name: MOTOROLA MOBILITY LLC Effective date: 20130429 |
Jan 19, 2016 | IPRC | Trial and appeal board: inter partes review certificate | Kind code of ref document: K1 Owner name: SOFTVIEW LLC Free format text: INTER PARTES REVIEW CERTIFICATE; TRIAL NO. IPR2013-00007, OCT. 2, 2012; TRIAL NO. IPR2013-00256, APR. 29, 2013 Opponent name: KYOCERA CORPORATION; AND MOTOROLA MOBILITY LLC Effective date: 20160112 |
May 31, 2016 | FPAY | Fee payment | Year of fee payment: 8 |


text:
25th Anniversary Rock Hall now available on CD November 12, 2010 | Patrick Prince | 0 The groundbreaking and critically acclaimed 25th Anniversary Rock and Roll Hall of Fame Concerts are available for the first time in a variety of audio formats and configurations, including both CD and digital download. ►
Neil Young Archives project launches June 2 May 28, 2009 | Goldmine Staff | 0 Reprise Records will release Neil Young Archives Vol. 1 1963-1972 in three different formats June 2: Blu-ray, DVD and CD. The Blu-ray edition uses an interactive platform with music, video and text, and allows for material to be added later via the internet. ►

subset: commoncrawl


text:
You say you LOVE black? We totally feel you! You say you want something different...we give you GLITTER! The classic trucker snapback in black with yes, BLACK GLITTER logo. It's the most perfect combo ever! Why didn't we think of this sooner? You KNOW you're going to wear it every day and your BFF will try to steal it so you better grab two just in case.
Our diagonal zip sweatshirt with oversize collar in gray and mint is the perfect piece to keep you in style and comfy while we wait for the weather to make up its mind! The cozy oversize collar is perfect for the cool mornings and wear it unzipped as it warms up in the afternoon. You already know layers are key, so you're always prepared. We made this just ever-so-slightly oversize so you can comfortably layer underneath.
We have a feeling this going to be your morning-go-to so you should probably buy both colors while they're still in stock!
Our diagonal zip sweatshirt with the large collar is perfect for keeping you warm on those cooler mornings in the spring season. This is a great functioning pieces to keep you comfy and warm no matter what the weather throws at you. With the slightly over-sized sizing, it's easy to layer up with this sweatshirt if the winter cold creeps back.
We have a feeling this going to be your morning-go-to so you should probably buy both colors while they're still in stock!
Elsa conquered her fears in Frozen and so can your mini on the hill or in the skatepark! Our YOUTH trucker hat / snapback in baby blue with multi-color glitter logo reminds her to shred through life fearlessly!


text:
The conclusion...
Author | Content |
caitlyn Jan 29, 2013 5:32 PM EDT |
The conclusion, that Web meets the developers' needs but not the needs of the masses, fits not only the browser but GNOME3 as a whole. If there was ever a group of developers that just didn't want to listen to users the GNOME developers are example #1. |
Steven_Rosenber Jan 30, 2013 12:08 AM EDT |
Maybe Web is better in 3.6 and 3.8, but it's not ready for prime time in GNOME 3.4. |
slacker_mike Jan 30, 2013 12:53 AM EDT |
I saw an interesting post on planet GNOME on proposed design change for Web. I have never used Web/Epiphany for longer than 5 minutes as it just doesn't have the features Firefox, Chrome, or Opera does. http://blogs.igalia.com/femorandeira/2013/01/29/a-few-more-ideas-for-web-navigation-and-a-talk-at-fosdem/ |
r_a_trip Jan 30, 2013 7:02 AM EDT |
I saw an interesting post on planet GNOME on proposed design change for Web. Very interesting indeed. I'm not particularly fond of the presented idea, but it has given me more insight into (what seems) a major design tenet that pervades Gnome these days. If it is a hard to solve problem while using limited space, just sidestep the limited space and move the problem to a different, context breaking large space. Menu's are difficult in a limited space? Just side step the small menu on top of the desktop and move it to a different view with ample space. Multiple open pages in browsers are difficult to portray in tabs? Just ditch the tabs and move the pages to a different view with ample space. The downside with solving hard problems like this, is that it also moves application relevant information and actions away from the direct sphere of the application. It continually forces you to redirect attention to a new area and that is the opposite of "distration free" computing. |
Steven_Rosenber Jan 30, 2013 2:18 PM EDT |
It's a strange thing, but in my experience, the Epiphany browser was faster with the Gecko engine than it is now with Webkit. I used to use it a lot way back before they swapped rendering engines. Now Chromium (and by extension Chrome) is way, way faster despite all using Webkit. On a related topic, I was looking at Bodhi 2.2.0 last night, and Midori has come a long, long way since the last time I tried it. |
caitlyn Jan 30, 2013 2:25 PM EDT |
Midori has come a long way. There are still some web pages it doesn't work with and there are still some extensions lacking but generally it's a very good browser. Oh,a nd yeah, Epiphany was fast but feature poor once upon a time. Now it's just feature poor. |
Fettoosh Jan 30, 2013 2:38 PM EDT |
The browser to watch is Rekonq from KDE team. It is modeled after Chrome/Chromium and based on Webkit. It is very fast without all the hooks and snoops in Chrome. It is minimalist and still doesn't have every feature desired yet, but is very functional and works great. |
BernardSwiss Jan 30, 2013 8:27 PM EDT |
> Multiple open pages in browsers are difficult to portray in tabs? Just ditch the tabs and move the pages to a different view with ample space. But we can have (already do have) both -- no need to ditch the classic old standard. Firefox calls it "tab groups". Click on the down-arrow button for the drop-down list of open taps, and there it is -- first item on the list is "Tab Groups (Ctrl+Shft+E)" It produces a nice grid view of thumbnail open pages. The user can even divide the tabs into separate groups and move tabs between them -- almost like a browser mini-session. The "problem" comes in when the developers start insisting that users can only be permitted one "correct", developer-approved way of doing tasks, simply because that's the way the developers themselves prefer to do it -- and "ditch" the previous means in order to enforce that preference.. |
Posting in this forum is limited to members of the group: [ForumMods, SITEADMINS, MEMBERS.]
Becoming a member of LXer is easy and free. Join Us!


text:
CBPM Index: |
Dads on Duty |
Hey Dads On Duty Supporter, Join us every Sunday 9:00pm - 9:30pm for our weekly Training, Informing, Mobilization, and Education conference by calling: 218-844-8230 access code: 1070958#. You may also playback the call at your conveince (24hours a day, 7-days a week) by calling: 218.844.8799 access code 1070958#. February's topic: Teambuilding 101. "What does it take to put an effective team together?"...Developing strategies to help yourself, help your family, and help your community in any economy, any situation. Join us the last Thursday of each month for our DOD Training session. 7:00pm-9:00pm. Adamsville Recreation Center. 3201 Martin Luther KIng Jr. Drive (404-505-3181). |
What's Up Family, We are looking for a few good men to co-author a book together. That's right a book containing the ideas, and points of view of men on a variety of topics. Can you see this? Can you do this? Picture this; Dad's On Duty talking, and writing on a variety of topics? Open topics: "World Views", "Peace", "The Economy", "War", "State of the black family", The Environment, Public Safety, Joy, Pain, "Relationships", Writing a book, Organizing your life, "Etc". The subject matter is endless. Why? Good question. Glad you asked. Writing a book together will give each of us an opportunity to bond, grow, share, and document some of our experiences, and opinions with the rest of the world. We will be in position to become authors, and began to legitimize ourselves, and our organizations. We will raise the bar, and set the new standard in which other groups will soon follow. Speaking engagements, book signings, conferences, all sorts of opportunities. Hint, Hint, Clue, Clue "Make Some Extra Money Talking and Writing." (These are things we all like to do anyway.) The Advantage of writing a book together opposed to each individual doing it alone is awesome. It shows a united front, a collaboration of men utilizing a book to reach an audience of people. We have within our group many men who have already written books. Now is the time to empower each of us with this new skill set. Most of us have within us a book already, however we won't write it, unless we are encouraged to. Hint, Hint, this is why we can all rise up together each one teaching one, overcoming some of the challenges, and weaknesses that we all face. In about 90-120 days, if each of us does our part, stick with the program, complete the assignments, etc. We will have a finished product. (A book) A tangible object that if only for your edification alone would far exceed your not completing it. If we only sell one copy each, at least our opinions will be out there somewhere in the universe. I personally will approach this from a position of personal growth, and development. I see all sorts of possibilities. If we each approach this situation from a open minded position, who knows where it will lead us, or what doors it will open? The opportunities are endless. This is going to be a wonderful experience of growing, learning and experiencing something together. The time period: August 3, 2009-December 31, 2009. About 120 days. We will be focusing on orientation, organizing, brainstorming, writing, critiquing, editing, publishing, branding, marketing, promoting, public relations, fund raising, prospecting, selling, speaking, etc. The Cost? To do this project successfully, and in order is going to require some money. Our proposed budget requires an initial investment $250. It could be higher. We each will have about 90 days to acquire those funds. We will work together to assist each man in reaching his financial obligation and accomplishing this task. What do we need? Head-shots, personal biography's, domain names, websites, social media sites, pay pal accounts, marketing material, training, workshops, publishing of books, etc. To get our book writing experience off to a proper start we need to establish the purpose of our chapters within the book. Your Why? Why are you doing this? Is it to change lives, make lots of money, generate more sales for your business, or organization, give you more credibility or maybe to give you speaking opportunities? Whatever it is write it down and clarify it. Sometimes a book is a means to an end. Is there a bigger picture for you? Now is the time to determine what it is. Your purpose may change how you write, and structure your topics. Go ahead think about it and email me with your purpose. Writing changes everything for me, for you, and everybody else within our circle of influence This is an awesome group of men, with an array of talents, and capabilities. More men will come later, and that is good. However, we will have a cut off date after our orientation period. (30 days) Our homework assignment: READ the book "The Ultimate Business Card" Matthew D. Miglin. Go to the website:www.expertselfpublishing. com, download the audio presentation, tour the website, and seek out the information that is available. Our next meeting will be next Monday August 31, 2009. 7:00-9:00pm Oz Pizza Restaurant downtown East Point. We will physically meet once a month, all other training will be done over the phone, or via the Internet. I also encourage each of you to get on the DOD Sunday night call, or at least play it back on the playback line. (218-844-8799) (1070958#) We will be focusing more, and more on Training, Informing, Mobilizing, Educating ourselves, and others to the ways of executing a better life for ourselves, our families, and our communities. Our focus for weeks 1-12: Orientation, Organization, Execution Reading exercise: The Ultimate Business Card Go to various websites. www.expertselfpublishing.com, www. livinginclaritybook.com, www.iacbir.com, Finding your why? Writing your biography. Head Shots for Social sites. Setting up a social site. Writing, blogging, journeying. Recording you data (voice recorder, cell phone) Putting our writings out there.(newsletters, papers, etc) Securing web domains (Securing your name, company name) E-mail addresses (Yahoo, Gmail, Hotmail, Etc.) Website hosting (Homestead.com) Branding, Marketing, Promotions, Selling techniques Marketing Material (Business cards, brochures, posters, etc.) Fund Generators (Raising the money you are going to need) DOD Audio Book Release Weeks 13-24: Cover design Manuscript-to-print Editing, Proofing Layout and design Book Review Book Printing Book Signing, Press releases Book Pre-writing checklist: 1) Why am I writing a chapter in this book? To support Dads On Duty. Fulfill my dream of becoming an author, personal growth developer. 2) What is the purpose of this book? To assemble a group of men from various ethnic, economic, and social backgrounds and have them to come together to document their thoughts, and opinions on a variety of subjects that are on our minds. 3) What is the problem I am solving? Overcoming the fear of black men collectively working together as a group on a project, and having it come to life. 4) What pain will I be taking away? The emotional pain of allowing anger, ego, pride, and selfishness to remain bottled up and suppressed in my heart, and the hearts of other men. 5)What is my solution to the problem? To have a variety of men begin to write, talk, dialog without fear, or embarrassment. 6) What is my target market or niche? The men, women, and children in our immediate community. 7) What exactly does my market want? They want to see the man experience. His point of view. What he likes, dislikes? 8) How much will my target market spend? A lot 9) What is my most important focus? Personal growth development 10) Can I make enough money in this market? Yes 11) What are the main topics I want to cover in the book? Self Help Techniques, Personal Growth Development, State of the new family, etc. 12) Do I have client testimonies I can use in my book? Yes 13) What title will grab my audience's attention? Dads On Duty 14)What subtitle will describe the benefits of the book to them? Dads Doing T.I.M.E.(Training Informing Mobilizing And Education) 15) Who can I get to endorse my book? Me, You, and anybody else DOD Book Live Call-in Number: Mondays 9:00pm-9:30pm (712) 432-0111 Access Code: 657765# 24-Hour Playback Number: (712) 432-0211 Access Code: 657765# "ENJOY THE BLESSING'S THAT HAVE BEEN PROVIDED FOR YOU TODAY" DRUMMER (678.508.1163) 24-HOUR DRUM EMPOWERMENT SESSION: 218-339-4699 (428416#) www.drumming-up-business.com www.drumskymall.com www.tint-o- matic.com |
Contact: V-Man Reginal Drummer Dads on Duty Atlanta, Georgia 30314 Phone: 678-508-1163 Email Address: firstname.lastname@example.com Web: www.cbpm.org/dadsonduty www.drumskymall.com |
More on the Collective Black People Movement (CBPM): Contact CBPM Here Important Campaigns: all Black People must be part of the following: 1. Petition to Resist Africom 2. Nation building Time 3. Skills, Talents, and Intelligence - (Education) REVOLUTION 4. Free William J. Mayo 5. Mumia Abu Jamal Campaign 6. Stop the Execution of Troy Anthony Davis! 7. 1000 members to the Collective 8. Practice 10-10-50 9. Weekly PSU Conference Call 10. Blacks in the City Course (1865-1960's) CBPM USA: Arkansas Alabama California Florida Georgia Kentucky Illinois Louisiana Maryland Massachusetts Michigan Listings Minnesota Mississippi Missouri New Jersey New York North Carolina Ohio Pennsylvania South Carolina Tennessee Texas Virginia Washington DC Other States of the United States CBPM Africa: Angola Burkina Faso Congo Egypt Ethiopia Gabon Ghana Guinea-Bissau Kenya Namibia Nigeria South Africa Sudan Swaziland Togo Zimbabwe CBPM International: Costa Rica England Haiti Jamaica Nicaragua Thailand Trinidad And Tobago Russia Venezuela Washitaw |