US20120042270A1 - User interface visualizations - Google Patents

User interface visualizations Download PDF

Info

Publication number
US20120042270A1
US20120042270A1 US13/249,905 US201113249905A US2012042270A1 US 20120042270 A1 US20120042270 A1 US 20120042270A1 US 201113249905 A US201113249905 A US 201113249905A US 2012042270 A1 US2012042270 A1 US 2012042270A1
Authority
US
United States
Prior art keywords
content
items
visualization
subset
diagonal view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/249,905
Inventor
Elin R. Pedersen
Peter Hong
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Priority to US13/249,905 priority Critical patent/US20120042270A1/en
Assigned to GOOGLE INC. reassignment GOOGLE INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HONG, PETER, PEDERSEN, ELIN R.
Publication of US20120042270A1 publication Critical patent/US20120042270A1/en
Assigned to GOOGLE LLC reassignment GOOGLE LLC CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: GOOGLE INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/904Browsing; Visualisation therefor

Definitions

  • aspects of the invention relate generally to user interfaces. More particularly, aspects are directed to user interface visualizations that provide core information when presenting multiple images in a single view.
  • a computer system user interface may present multiple items of interest simultaneously to a user.
  • a graphical user interface may display a number of album or CD covers in a jukebox-type or carousel-type arrangement.
  • FIG. 1 illustrates such a configuration.
  • the layout 10 includes a central item of interest 12 and items of interest on the left ( 14 ) and right ( 16 ) sides.
  • the left hand side items of interest 14 are angled to face inward toward the central item of interest 12 .
  • the right hand side items of interest 16 also are angled to face inward toward the central item of interest 12 .
  • such configurations may conceal important elements of the items of interest.
  • a content visualization method for use in a computer system comprises selecting electronic content for presentation on a display device; assigning a viewing axis for displaying the content; selecting a place of focus along the viewing axis; determining a content viewport, the content viewport setting an amount of the content viewable on the display device; constructing a content visualization to display at least a portion of the selected content on the display device; and displaying the content visualization on the display device based upon the content viewport, viewing axis and place of focus.
  • the viewing axis comprises a chronological representation of the selected electronic content. In another example, the viewing axis comprises a ranked list of the selected electronic content. In an alternative, the method further comprises re-constructing the content visualization based upon user feedback to the displayed content visualization.
  • the content visualization includes a plurality of sets of items of interest, a first one of the sets being arranged along a first portion of the display device and a second one of the sets being arranged adjacent to the first set, and wherein the first set is presented in full frontal format while the second set is presented in a diagonal view giving an appearance that the items in the second set are facing towards the items in the first set.
  • the second set includes a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset and remote from the first set, and wherein the first subset is presented having a transitional diagonal view.
  • the transitional diagonal view of the first subset is between 5°-15° and the diagonal view of the second subset is at least 15°.
  • the transitional diagonal view is less than 15° and the diagonal view is on the order of 15°-45°.
  • a third one of the plurality of sets is arranged adjacent to the first set and opposite the second set, the third set being presented in the diagonal view giving the appearance that the items in the third set are facing away from the items in the first set.
  • the third set may include a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset of the third set and remote from the first set.
  • the first subset of the third set is presented having a transitional diagonal view.
  • a content visualization apparatus comprises memory for storing content visualization data and a processor operatively coupled to the memory.
  • the processor is configured to select electronic content for presentation, assign a viewing axis for displaying the content, select a place of focus along the viewing axis, determine a content viewport, the content viewport setting an amount of the content that is viewable, and construct a content visualization to display at least a portion of the selected content on the display device.
  • the apparatus also includes a display device operatively coupled to the processor. The display device is configured to display the content visualization based upon the content viewport, viewing axis and place of focus.
  • the viewing axis comprises a chronological representation of the selected electronic content. In another example, the viewing axis comprises a ranked list of the selected electronic content. In a further example, the processor is also configured to re-construct the content visualization based upon user feedback to the content visualization displayed on the display device.
  • the content visualization includes a plurality of sets of items of interest.
  • a first one of the sets is arranged along a first portion of the display device and a second one of the sets being arranged adjacent to the first set.
  • the display device is configured to present the first set in full frontal format while the second set is presented in a diagonal view giving an appearance that the items in the second set are facing towards the items in the first set.
  • the second set desirably includes a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset and remote from the first set.
  • the display device is configured to present the first subset having a transitional diagonal view.
  • a content visualization system comprises a processor for processing application data for displaying on a display device and a user interface module managed by the processor.
  • the user interface module includes an input section for storing selected content and a content management section for manipulating visualizations of the selected content.
  • the selected content includes a plurality of items of interest.
  • a given one of the visualizations includes a first one of the items of interest being arranged in full frontal format and second and third ones of the items of interest being arranged in a diagonal view.
  • the second item is arranged in the diagonal view along one side of the first item and the third item is arranged in the diagonal view along the other side of the first item.
  • the system also includes a display section for displaying the given visualization of the first, second and third items of interest on a display.
  • the content management section is operable to manipulate the visualizations by modifying an angle or tile of one or more pages of the first, second or third items of interest.
  • the content management section is operable to manipulate the given visualization by emphasizing at least one critical layout or utility zone (CLuZ) of the selected content while deemphasizing at least one supplemental layout and optional zone (SLoz) of the selected content.
  • CLuZ critical layout or utility zone
  • SLoz supplemental layout and optional zone
  • the at least one CLuZ may be displayable at an angle toward a user.
  • the at least one SLoZ is displayable at an angle away from the user.
  • the at least one SLoZ is deemphasized by shading or graying thereof.
  • At least one of the second and third items includes a plurality of pages.
  • the diagonal view includes a full diagonal view and a transitional diagonal view. A first one of the plurality of pages is arranged in the full diagonal view while a second one of the plurality of pages is arranged in the transitional diagonal view between the first item and the first page.
  • FIG. 1 illustrates a convention jukebox-type graphical user interface display.
  • FIG. 2 illustrates a graphical user interface visualization in accordance with aspects of the invention.
  • FIGS. 3A-F illustrate content visualizations emphasizing certain regions of interest within the content according to aspects of the invention.
  • FIG. 4 illustrates another graphical user interface visualization in accordance with aspects of the invention.
  • FIGS. 5A-D illustrate additional content visualizations in accordance with aspects of the invention.
  • FIGS. 6A-D illustrate content overlapping in accordance with aspects of the invention.
  • FIG. 7 illustrates content resizing in accordance with aspects of the invention.
  • FIGS. 8A-B illustrate computer systems for use in the invention.
  • FIG. 9 is a flow diagram illustrating a process for implementing content visualizations according to aspects of the invention.
  • FIG. 10 illustrates a user interface system in accordance with aspects of the invention.
  • FIGS. 11A-I illustrate additional graphical user interface visualizations in accordance with aspects of the invention.
  • FIGS. 12A-G illustrate another set of graphical user interface visualizations in accordance with aspects of the invention.
  • FIGS. 13A-B illustrate additional graphical user interface visualizations in accordance with aspects of the invention.
  • FIGS. 14A-G illustrate further graphical user interface visualizations in accordance with aspects of the invention.
  • FIGS. 15A-F illustrate another set of graphical user interface visualizations in accordance with aspects of the invention.
  • aspects of the invention employ graphical representations for optimal browsing or presentation of structured, laid-out electronic information, such as web pages, to enable a user to parse and compare content quickly and efficiently. This is accomplished by consistently emphasizing the differently weighted visual characteristics of structured content. The user's attention is focused on more important parts of the content while minimizing distractions from less important areas.
  • FIG. 2 illustrates one embodiment of the invention in which a number of items of interest are presented in a linear arrangement 100 .
  • a set of primary items of interest 102 are arranged side by side in a planar or frontal configuration.
  • each item in the set 102 is presented in a full frontal configuration with a 0° angle relative to the plane of the display.
  • a set of secondary items of interest 104 are arranged adjacent to the first set. Each item in the set 104 is presented with a diagonal (i.e., non-0°) view, giving the appearance that these items are turned to face the items in the set 102 .
  • the items in the first and second sets may be, for example, results from a user-directed search.
  • the items in the sets 102 and 104 may be ordered chronologically, ranked according to likelihood of matching the search criteria, ranked according to recently viewed information, or other ordering techniques.
  • the second set 104 preferably includes a first subset 104 a and a second subset 104 b.
  • the items of interest in the first subset 104 a are presented at a first or “transitional” diagonal view. This transitional view may be tilted, for example, between 5°-15° relative to the 0° of the primary items of interest 102 .
  • the items of interest in the second subset 104 b are presented with a second diagonal view greater than that of the first subset 104 a.
  • the second subset 104 b may be tilted, for example, at an angle on the order of 15°-45°. While only two subsets are illustrated, any number of additional subsets may also be employed.
  • Each item of interest in a given subset may be tilted at the same angle, or at different angles.
  • the items in the set 104 are incrementally tilted starting at an initial angle of, e.g., less than 10° for a first item in the first subset 104 a to a final angle of, e.g., greater than 45° for a last item in the second subset 104 b.
  • FIGS. 3A-C illustrate an exemplary web page 200 which may be displayed according to the embodiments of the invention.
  • the web page may contain one or more critical layout or utility zones (“CLuZ”) 202 and one or more supplemental layout and optional information zones (“SLoZ”) 204 .
  • CLuZ critical layout or utility zones
  • SLoZ supplemental layout and optional information zones
  • the CLuZ zone(s) can provide representative clues to effectively communicate the identity, brand and/or structure of the content on the web page.
  • the SLoZ zone(s) may also provide information about the web page, but to a lesser extent than the CLuZ.
  • the high contrast and clarity of the CLuZ zones may be maintained while the SLoZ zones may be deemphasized, e.g., grayed out, partially concealed or fully concealed/removed. Even with data in the SLoZ zones obscured or removed, the user is able to identify and infer the page structure from the CLuZ zones.
  • FIG. 4 illustrates a variation of the embodiment in FIG. 2 .
  • a third set of items of interest 106 are arranged on the opposite side of the first set 102 .
  • the set 106 is arranged similarly to the set 104 . While each item in the set 104 is presented with a diagonal view to give the appearance that these items are turned to face towards the items in the set 102 , each item in the set 106 is presented with a diagonal view to give the appearance that these items are turned to face away from the items in the set 102 . Nonetheless, both sets 104 and 106 are arranged so that the CLuZ zones of the items in each are clearly visible.
  • the third set 106 preferably includes a first subset 106 a and a second subset 106 b.
  • the items of interest in the first subset 106 a are presented at a first or “transitional” diagonal view. This transitional view may be tilted away from the items in the set 102 at a given angle, for example, between 5°-15° relative to the 0° of the primary items of interest in the set 102 .
  • the items of interest in the second subset 106 b are presented with a second diagonal view greater than that of the first subset 106 a.
  • the second subset 106 b may be tilted, for example, at an angle on the order of 15°-45° away from the primary items of interest in set 102 .
  • the subsets 104 a and 106 a are arranged at the same angle and the subsets 104 b and 106 b are arranged at the same angle.
  • the overall appearance of the sets 102 , 104 and/or 106 is a venetian blind-type arrangement.
  • each item of interest in a given subset may be tilted at the same angle, or at different angles.
  • the items in the set 106 are incrementally tilted starting at an initial angle of, e.g., less than 10° for a first item in the first subset 106 a to a final angle of, e.g., greater than 45° for a last item in the second subset 106 b.
  • the first set 102 includes about 3-5 frontal views, and the second and/or third sets 104 and 106 each include about 2-6 additional diagonal views.
  • FIGS. 2 and 4 may include any number of items of interest.
  • these arrangements provide unobstructed views of the critical layout zones CLuZs, which identify each page using logos, brand information, navigation information and/or starts of headers or sentences.
  • CLuZs critical layout zones
  • the upper left region of the page often contains the most important or most recognizable content.
  • the left hand side of each page is the side appearing to be angled toward the user.
  • the items in the sets 102 , 104 and/or 106 are top-aligned. This normalizes the consistent elements in the CLuZ of each page and accommodates both the user's reading pattern and cases where the items, such as web pages, are of different lengths.
  • the SLoZ areas may be obscured by darkening and/or distorting, e.g., by making the right hand side of the page appear to be smaller than the left hand side by angling it. Deemphasizing the SLoZ areas helps the user quickly scan each image without focusing on less important details. The result may be a magazine rack-type feel, with the CLuZ areas providing easy scanning for the user.
  • the user may rapidly scan the CLuZ of the various items in sets 104 and 106 and, using the user interface, may select a particular item in one of these sets for further evaluation. In this case, the selected item may be centered in the display and presented with a flat frontal view. In other words, the selected item may now be part of the set 102 .
  • FIGS. 5A-D present an alternate scenario for analyzing content.
  • content in the form of a number of web pages is positioned in a linear array.
  • Each web page is presented in a full frontal (0°) view.
  • five full web pages and two partial web pages are presented. In this presentation, all portions of each page are presented equally to the user.
  • FIG. 5B presents the web pages arranged at an angle of approximately 45°. In this example, 9 full web pages are presented. The pages are ordered along a single dimension such as in FIG. 5A ; however, tilting the pages increases the number available for display and emphasizes important content in the CLuZ zones while de-emphasizing content in the SLoZ zones. Based upon information in a CLuZ zone, the user may select one or more given web pages for further consideration.
  • FIG. 5C Upon selection, additional emphasis may be placed on the selected web page(s).
  • selected web pages are now presented untilted in the full frontal view.
  • the other web pages remain set at the 45° angle. This provides a side-by-side comparison of a few central web pages while the other web pages on the periphery are presented with the CLuZ zones emphasized over the SLoZ zones. In this manner, the user can readily analyze the three central web pages while scanning the peripheral web pages. If one of the selected web pages is chosen for additional evaluation, the thumbnail of that web page may be enlarged as shown in FIG. 5D .
  • FIG. 6A illustrates an exemplary web page thumbnail image.
  • the web page takes up one standard preview width.
  • FIG. 6B by tilting web pages (or other content) at a 45° angle, two web pages may occupy nearly the same space as the single web page in FIG. 6A .
  • the adjacent pages are spaced with a 10 pixel gap between them, resulting in approximately 1.8 pages fitting into the standard preview width. If there is no gap between the adjacent pages, then both pages will fit into the standard preview width, as shown in FIG. 6C .
  • FIG. 6D using a 20 pixel overlap between adjacent thumbnails, then approximately 2.5 pages will fit into the standard preview width.
  • the number of images available for display depends on the size of the images.
  • larger size thumbnail images promote increased legibility of content but reduce the number of images that can be displayed.
  • more smaller-sized images can be displayed by sacrificing readability.
  • FIG. 7 where five representations of the same exemplary web page are provided.
  • the thumbnail sizes range from 50% of the original page size down to 20% of the original page size. While it may be challenging to read the text of the 20% thumbnail, this size shows the overall page structure and relative content patterns, which may be sufficient for certain types of user evaluation.
  • thumbnail size For instance, if content has been previously viewed, then a smaller thumbnail size on the order of 20%-32% may be selected. On the other hand, if the user is first being exposed to the content, then a thumbnail size of 40%-50% may be selected. The size may vary dynamically as the user scans through the content on the display.
  • FIG. 8A presents a schematic diagram of a computer system depicting various computing devices that can be used alone or in a networked configuration in the invention.
  • this figure illustrates a computer network 300 having a plurality of computers 302 , 304 , 306 and 308 as well as other types of devices such as portable electronic devices such as a mobile phone 310 and a PDA 312 .
  • Such devices may be interconnected via a local or direct connection 314 and/or may be coupled via a communications network 316 such as a LAN, WAN, the Internet, etc. and which may be wired or wireless.
  • Each device may include, for example, one or more processing devices and have user inputs such as a keyboard 318 and mouse 320 and/or various other types of input devices such as pen-inputs, joysticks, buttons, touch screens, etc., as well as a display 322 , which could include, for instance, a CRT, LCD, plasma screen monitor, TV, projector, etc.
  • Each computer 302 , 304 , 306 and 308 may be a personal computer, server, etc.
  • computers 302 and 306 may be personal computers while computer 304 may be a server and computer 308 may be a laptop.
  • each computer such as computers 302 and 304 contains a processor 324 , memory/storage 326 and other components typically present in a computer.
  • memory/storage 326 stores information accessible by processor 324 , including instructions 128 that may be executed by the processor 324 and data 330 that may be retrieved, manipulated or stored by the processor.
  • the memory/storage may be of any type or any device capable of storing information accessible by the processor, such as a hard-drive, ROM, RAM, CD-ROM, flash memories, write-capable or read-only memories.
  • the processor 324 may comprise any number of well known processors, such as processors from Intel Corporation. Alternatively, the processor may be a dedicated controller for executing operations, such as an ASIC.
  • the instructions 328 may comprise any set of instructions to be executed directly (such as machine code) or indirectly (such as scripts) by the processor(s).
  • the terms “instructions,” “steps” and “programs” may be used interchangeably herein.
  • the instructions may be stored in any computer language or format, such as in object code or modules of source code. The functions, methods and routines of instructions in accordance with the present invention are explained in more detail below.
  • Data 330 may be retrieved, stored or modified by processor 324 in accordance with the instructions 328 .
  • the data may be stored as a collection of data.
  • the data may be stored in computer registers, in a relational database as a table having a plurality of different fields and records, in a web page cache, as XML documents, or as flat files.
  • the data may also be formatted in any computer readable format such as, but not limited to, binary values, ASCII or Unicode.
  • the data may include images stored in a variety of formats such as vector-based images or bitmap images using lossless (e.g., PNG) or lossy (e.g., JPEG) encoding.
  • the data may include any information sufficient to identify the relevant information, such as descriptive text, proprietary codes, pointers, references to data stored in other memories (including other network locations) or information which is used by a function to calculate the relevant data.
  • the data may comprise electronic content such as web pages.
  • a given item may comprise one or more files, a data set stored in a database, a web cache, etc.
  • parts of the content may be stored or otherwise maintained separately.
  • processors 324 and memory 326 are functionally illustrated in FIG. 8B as being within the same block, it will be understood that the processor and memory may actually comprise multiple processors and memories that may or may not be stored within the same physical housing or location. For example, some or all of the instructions and data may be stored on a removable CD-ROM, DVD-ROM or flash drive, and others within a read-only computer chip. Some or all of the instructions and data may be stored in a location physically remote from, yet still accessible by, the processor. Similarly, the processor may actually comprise a collection of processors which may or may not operate in parallel. Data may be distributed and stored across multiple memories 326 such as hard drives or the like.
  • server 304 may communicate with one or more client computers 302 , 306 and/or 308 , as well as devices such as mobile phone 310 and PDA 312 .
  • Each client computer or other client device may be configured similarly to the server 304 , with a processor, memory and instructions, as well as one or more user input devices 318 , 320 and a user output device, such as display 322 .
  • Each client computer may be a general purpose computer, intended for use by a person, having all the components normally found in a personal computer such as a central processing unit (“CPU”), display, CD-ROM or DVD drive, hard-drive, mouse, keyboard, touch-sensitive screen, speakers, microphone, modem and/or router (telephone, cable or otherwise) and all of the components used for connecting these elements to one another.
  • CPU central processing unit
  • display CD-ROM or DVD drive
  • hard-drive keyboard
  • keyboard keyboard
  • touch-sensitive screen keyboard
  • speakers microphone
  • modem and/or router telephone, cable or otherwise
  • the server 304 and user computers and other devices are capable of direct and indirect communication with other computers, such as over network 316 .
  • network 316 may comprise various configurations and protocols including the Internet, intranets, virtual private networks, wide area networks, local networks, private networks using communication protocols proprietary to one or more companies, Ethernet, WiFi, Bluetooth or TCP/IP.
  • Server 304 may be a web server.
  • the information may be sent via a medium such as a disk, tape, CD-ROM, or directly between two computer systems via a dial-up modem.
  • the information may be transmitted in a non-electronic format and manually entered into the system.
  • computers and user devices in accordance with the systems and methods described herein may comprise any device capable of processing instructions and transmitting data to and from humans and other computers, including network computers lacking local storage capability, PDA's with modems such as PDA 312 and Internet-capable wireless phones such as mobile phone 310 .
  • the network 300 may also include a content storage entity 332 , which may be directly or indirectly coupled to server 304 .
  • the content storage entity 332 may be part of or otherwise logically associated with the server 304 .
  • Content storage entity 334 may be part of or logically associated with a user device such as computer 302 .
  • the content storage entity 334 may be directly or indirectly coupled to the computer 302 .
  • the content storage entity 334 comprises data memory 330 of the computer 302 .
  • the content storage entity 334 may securely store content such as web page information in a native (raw), compressed or encrypted format.
  • the content storage entity 334 may be configured so that it is only accessible to selected users or devices. For instance, content stored on the content storage entity 334 may only be accessible to authenticated users of computer 302 .
  • the content storage entity 332 and the server 304 may comprise a content web server.
  • the content to present is selected as shown in block 400 .
  • the content may be selected by a user or as part of a pre-defined application.
  • the content is taken from a specific time period within a user's web browser history.
  • the invention is not limited to any particular type of web browser.
  • the content is derived from the search results from a user's query.
  • the content may be stored in one of the content storage entities 332 or 334 of FIG. 8A .
  • the content may be stored locally on the user's device, such as in a cache memory within memory 326 of FIG. 8B .
  • a viewing axis is selected, imposed or otherwise assigned as shown in block 402 .
  • the viewing axis may be a timeline, for instance to show all web pages visited in the last X minutes, hours or days.
  • the viewing axis may rank the content based on how closely it corresponds to a given search or other criteria.
  • the orientation of the viewing axis may also be chosen based upon the type of content. Thus, English-language web pages may be placed on a viewing axis as shown in FIGS. 2 and 4 .
  • a place of focus along the viewing axis is selected.
  • the focus may be on the most recent content, on web pages visited on a specific date, a specific time, etc.
  • a content “viewport” is determined. The viewport sets a subset or amount of content which is viewable on the display.
  • the content visualization is constructed in view of the content, viewing axis, place of focus and the viewport.
  • the content visualization is constructed, it is presented on the display.
  • the user may evaluate the content, including selecting content for further study, act on the content, etc. as shown in block 410 .
  • the user interface may provide an option for the user to scan or scroll through the presented content using a mouse or other input device. For instance, a slider bar on the display may allow the user to scroll across the content.
  • the user may identify an item of interest by actively selecting it or by placing a pointer on the item.
  • the process may return to block 408 for modification of the content visualization, or may return to block 400 if additional or different content is chosen.
  • the content at the place of focus is shown in the full frontal format.
  • the content on either side of the place of focus is presented at an angle or series of angles as shown in FIGS. 2 and 4 .
  • the process may construct the content visualization based upon various factors. One factor is whether the content has been viewed before or whether it will be presented for the first time. As discussed above with regard to FIG. 7 , the size of the content may be changed depending upon whether it has been previously viewed.
  • FIGS. 6A-D were discussed above, and show how content may be angled with spacing between adjacent items, or overlap of such items. Spatial optimization may be performed based upon user feedback or selections, size and resolution of the display(s), etc.
  • the amount of the angle/tilt may vary as shown in FIGS. 2 and 4 .
  • the first subsets 104 a and 106 a may be tilted at a relatively shallow angle on the order of 5°-20°
  • the second subsets 104 b and 106 b may be tilted at a steeper angle on the order of 30°-60°.
  • the number of items shown in full frontal format in the place of focus may be varied. As shown in FIGS. 2 , 4 and 5 C, three or four (or more) items may be centered in full frontal format. However, upon selection, an item of interest may be enlarged as shown in FIG. 5D . This may be done while placing the adjacent items at an angle as shown in the figure.
  • the CLuZ parts of a webpage or other content are emphasized while the SLoZ parts of the content are deemphasized.
  • the CLuZ part(s) should be presented angled towards the user while the SLoZ parts may be angled away from the user and/or otherwise deemphasized such as by shading or graying the information, or via overlap with an adjacent webpage.
  • the processes of FIG. 9 may be done by a single computing device with a single display, in a distributed system, or in a client-server model.
  • the display unit may be part of a user/client device, such as computers 302 and 308 , or part of a portable electronic device such as the mobile phone 310 or the PDA 312 of FIG. 8A .
  • the processor may be local to the client device and may access content stored locally or remotely. Alternatively, the processing may be done remotely by a processor such as at server 304 of FIG. 8A . In this case, the content visualizations are sent via the network 316 to the user's device and displayed on the display.
  • FIG. 10 shows a system 500 including a processor 502 in operative communication with user interface module 504 .
  • One or both of the processor 502 and the user interface module 504 may communicate with memory 506 .
  • the user interface module 504 is in communication with one or more user interface devices 508 and at least one display 510 .
  • the user interface module 504 may include an input section 512 for requesting, receiving and/or maintaining (e.g., caching or otherwise storing) selected content.
  • the user interface module may also include a content management section 514 functioning in conjunction with the processor 502 for manipulating various visualizations of the content, such as modifying the angle/tilt of one or more web pages, emphasizing the CLuZ zones, deemphasizing the SLoZ zones, etc. as disclosed herein.
  • the user interface module may further include a display section 516 for displaying the content on the display.
  • Additional user interface visualizations may be employed using the features discussed here. For instance, some web browsers use separate tabs for each web page. In this case, the user navigates between different web pages by selecting different tabs.
  • One fundamental problem with this approach is that the tabs do not allow the user to “see” the page represented by the tab until the user selects/focuses the tab. This is shown in FIG. 11A .
  • tabs do not support a lot of text.
  • the tabs may be resized if other tabs are added or removed. Therefore, the text may be cut off when trying to fit too many tabs (e.g., on the order of 20 tabs) on the browser bar.
  • Such text is metadata that attempts to describe the web page. This may force the user to interpret the text to see if it meets what the user thinks the page actually is.
  • One solution according to an aspect of the invention is to allow the user to navigate the entire set of pages by creating the experience of “stepping back” to get a view of many pages concurrently.
  • the user may move from side to side (or up and down) to reveal more pages.
  • the user can quickly see the actual page, which may be a preview that is somewhat smaller that the actual page.
  • the user may zoom in. Zooming may continue until the page take up the full browser view.
  • Any page/content that is in the center or focal point of the display may show the associated tab directly above (or to the side of) it on the browser bar.
  • the user may interact with the web page representations directly, or click/select any tabs displayed in the browser bar for additional navigation.
  • FIG. 11B illustrates a visualization according to this aspect of the invention in which the web page of interest for the currently selected tab is presented in full frontal format.
  • FIG. 11B illustrates a visualization according to this aspect of the invention in which the web page of interest for the currently selected tab is presented in full frontal format.
  • several web pages associated with the tabs to the left of the currently selected tab are shown on the display in the tilted/angled format facing toward the full frontal web page.
  • FIG. 11C presents an alternative presentation to that of FIG. 11B , again with the pages to the left of the currently selected tab tilted/angled toward the full frontal page.
  • the angled pages may be spaced apart, e.g., with a 10 pixel gap between adjacent pages. They may also be shaded to deemphasize them relative to the full frontal page.
  • FIG. 11D and the subsequent figures shown one scenario using visualizations to enhance or replace tabbed browsing.
  • a number of web pages are shown in the tilted/angled format with corresponding tabs above them.
  • the pages may be arranged in chronological order.
  • the most recent web page e.g., 1 pm
  • the oldest web page e.g., 11 am
  • FIG. 11E the central web page and its two adjacent pages are shown in full frontal format while the other pages to the left and right are presented in the tiled/angled format discussed herein.
  • FIG. 11F additional chronological information may be displayed for the full frontal displayed pages. And as shown, these pages may be extended to show additional details not viewable in a single page format. For instance, the central page may be presented so that the viewer can see comments posted below the primary content. This avoids requiring the user to scroll down each individual page or to tab between individual pages.
  • FIG. 11F shows another visualization where the central page of interest is enlarged/zoomed.
  • the time the web page was visited may be shown.
  • this web page may partly or fully obscure the adjacent full frontal pages.
  • the page may be zoomed in to fill the screen—while still presenting the tabs on the browser bar—as shown in FIG. 11H .
  • FIG. 11I presents an alternative visualization wherein the content of the central page is overlayed with the three full frontal pages.
  • FIGS. 12A-G Additional tab-type visualizations are presented in FIGS. 12A-G .
  • the page visualizations may be shown in a scrolling-type view such as with scanning through a rolodex until the content of interest is reached.
  • the page associated with the selected tab may be shown in full frontal format along with the two adjacent pages.
  • FIGS. 12C-D illustrate additional visualizations when scanning content.
  • FIGS. 12E-G show how selected content may be presented on the display.
  • visualizations may provide easy manipulation of related/recent sessions and history viewing.
  • FIGS. 13A-B show how the user may browse related sessions.
  • the user may be given the option to “Browse Related Sessions” as shown at the bottom. If this is selected, then related sessions may be displayed as presented in FIG. 13B . The user may then scan/access the content using any of the tools as described herein.
  • FIGS. 14A-G illustrate a further embodiment for management of recent sessions.
  • various time-sorted sessions may be displayed, e.g., for this afternoon, this morning, yesterday and last week.
  • the display's visualization may change.
  • FIGS. 14B-G illustrate changes to the visualizations based upon the user's selection(s).
  • the user is able to save and resume work that was previously done.
  • the content management section of the user interface module of FIG. 10 may keep track of previously visited web pages or other content that has been accessed.
  • FIGS. 15A-F illustrate various visualizations using history information.
  • the tab browsing and other browsing features presented herein may be used in any browsing application such as a web browser, as well as other indexed search tools. This includes, but is not limited to, file manager-type applications, multimedia content applications, etc.

Abstract

Aspects of the invention pertain to user interface visualizations, enabling efficient display of content on a display device. At least some content is presented having diagonal views to emphasize certain portions of the content while deemphasizing other portions of the content.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. application Ser. No. 12/818,222, filed Jun. 18, 2010, which claims the benefit of U.S. Provisional Application No. 61/269,089, entitled “User Interface Visualizations,” attorney docket GOOGLE 3.8-064, filed Jun. 19, 2009, the entire disclosures of which, including the drawings and appendices, are hereby incorporated by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • Aspects of the invention relate generally to user interfaces. More particularly, aspects are directed to user interface visualizations that provide core information when presenting multiple images in a single view.
  • 2. Description of Related Art
  • Depending upon the application, a computer system user interface may present multiple items of interest simultaneously to a user. For instance, a graphical user interface may display a number of album or CD covers in a jukebox-type or carousel-type arrangement. FIG. 1 illustrates such a configuration. As shown, the layout 10 includes a central item of interest 12 and items of interest on the left (14) and right (16) sides. The left hand side items of interest 14 are angled to face inward toward the central item of interest 12. The right hand side items of interest 16 also are angled to face inward toward the central item of interest 12. Unfortunately, such configurations may conceal important elements of the items of interest.
  • Systems and methods which provide enhanced visualizations for multiple items in a single interface presentation are disclosed.
  • SUMMARY OF THE INVENTION
  • According to one embodiment of the invention, a content visualization method for use in a computer system comprises selecting electronic content for presentation on a display device; assigning a viewing axis for displaying the content; selecting a place of focus along the viewing axis; determining a content viewport, the content viewport setting an amount of the content viewable on the display device; constructing a content visualization to display at least a portion of the selected content on the display device; and displaying the content visualization on the display device based upon the content viewport, viewing axis and place of focus.
  • In one example, the viewing axis comprises a chronological representation of the selected electronic content. In another example, the viewing axis comprises a ranked list of the selected electronic content. In an alternative, the method further comprises re-constructing the content visualization based upon user feedback to the displayed content visualization.
  • In another example, the content visualization includes a plurality of sets of items of interest, a first one of the sets being arranged along a first portion of the display device and a second one of the sets being arranged adjacent to the first set, and wherein the first set is presented in full frontal format while the second set is presented in a diagonal view giving an appearance that the items in the second set are facing towards the items in the first set. In one alternative, the second set includes a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset and remote from the first set, and wherein the first subset is presented having a transitional diagonal view. In one case, the transitional diagonal view of the first subset is between 5°-15° and the diagonal view of the second subset is at least 15°. In another case, the transitional diagonal view is less than 15° and the diagonal view is on the order of 15°-45°.
  • In a further example, a third one of the plurality of sets is arranged adjacent to the first set and opposite the second set, the third set being presented in the diagonal view giving the appearance that the items in the third set are facing away from the items in the first set. Here, the third set may include a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset of the third set and remote from the first set. In this case, the first subset of the third set is presented having a transitional diagonal view.
  • In another embodiment of the invention, a content visualization apparatus comprises memory for storing content visualization data and a processor operatively coupled to the memory. The processor is configured to select electronic content for presentation, assign a viewing axis for displaying the content, select a place of focus along the viewing axis, determine a content viewport, the content viewport setting an amount of the content that is viewable, and construct a content visualization to display at least a portion of the selected content on the display device. The apparatus also includes a display device operatively coupled to the processor. The display device is configured to display the content visualization based upon the content viewport, viewing axis and place of focus.
  • In one example, the viewing axis comprises a chronological representation of the selected electronic content. In another example, the viewing axis comprises a ranked list of the selected electronic content. In a further example, the processor is also configured to re-construct the content visualization based upon user feedback to the content visualization displayed on the display device.
  • In yet another example, the content visualization includes a plurality of sets of items of interest. Here, a first one of the sets is arranged along a first portion of the display device and a second one of the sets being arranged adjacent to the first set. The display device is configured to present the first set in full frontal format while the second set is presented in a diagonal view giving an appearance that the items in the second set are facing towards the items in the first set. In this case, the second set desirably includes a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset and remote from the first set. The display device is configured to present the first subset having a transitional diagonal view.
  • In another embodiment of the invention, a content visualization system comprises a processor for processing application data for displaying on a display device and a user interface module managed by the processor. The user interface module includes an input section for storing selected content and a content management section for manipulating visualizations of the selected content. The selected content includes a plurality of items of interest. A given one of the visualizations includes a first one of the items of interest being arranged in full frontal format and second and third ones of the items of interest being arranged in a diagonal view. The second item is arranged in the diagonal view along one side of the first item and the third item is arranged in the diagonal view along the other side of the first item. The system also includes a display section for displaying the given visualization of the first, second and third items of interest on a display.
  • In one example, the content management section is operable to manipulate the visualizations by modifying an angle or tile of one or more pages of the first, second or third items of interest. In another example, the content management section is operable to manipulate the given visualization by emphasizing at least one critical layout or utility zone (CLuZ) of the selected content while deemphasizing at least one supplemental layout and optional zone (SLoz) of the selected content. In this case, the at least one CLuZ may be displayable at an angle toward a user. In one alternative, the at least one SLoZ is displayable at an angle away from the user. In another alternative, the at least one SLoZ is deemphasized by shading or graying thereof.
  • And in a further example, at least one of the second and third items includes a plurality of pages. Here, the diagonal view includes a full diagonal view and a transitional diagonal view. A first one of the plurality of pages is arranged in the full diagonal view while a second one of the plurality of pages is arranged in the transitional diagonal view between the first item and the first page.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 illustrates a convention jukebox-type graphical user interface display.
  • FIG. 2 illustrates a graphical user interface visualization in accordance with aspects of the invention.
  • FIGS. 3A-F illustrate content visualizations emphasizing certain regions of interest within the content according to aspects of the invention.
  • FIG. 4 illustrates another graphical user interface visualization in accordance with aspects of the invention.
  • FIGS. 5A-D illustrate additional content visualizations in accordance with aspects of the invention.
  • FIGS. 6A-D illustrate content overlapping in accordance with aspects of the invention.
  • FIG. 7 illustrates content resizing in accordance with aspects of the invention.
  • FIGS. 8A-B illustrate computer systems for use in the invention.
  • FIG. 9 is a flow diagram illustrating a process for implementing content visualizations according to aspects of the invention.
  • FIG. 10 illustrates a user interface system in accordance with aspects of the invention.
  • FIGS. 11A-I illustrate additional graphical user interface visualizations in accordance with aspects of the invention.
  • FIGS. 12A-G illustrate another set of graphical user interface visualizations in accordance with aspects of the invention.
  • FIGS. 13A-B illustrate additional graphical user interface visualizations in accordance with aspects of the invention.
  • FIGS. 14A-G illustrate further graphical user interface visualizations in accordance with aspects of the invention.
  • And FIGS. 15A-F illustrate another set of graphical user interface visualizations in accordance with aspects of the invention.
  • DETAILED DESCRIPTION
  • Aspects, features and advantages of the invention will be appreciated when considered with reference to the following description of preferred embodiments and accompanying figures. The same reference numbers in different drawings may identify the same or similar elements. Furthermore, the following description is not limiting; the scope of the invention is defined by the appended claims and equivalents.
  • Viewers of electronic content such as web pages are often faced with large quantities of information to consider. Individual items may be briefly scanned, with the viewer seeing only a few salient features of each item. The more content that is available, the more challenging it is to identify particular items of interest.
  • Aspects of the invention employ graphical representations for optimal browsing or presentation of structured, laid-out electronic information, such as web pages, to enable a user to parse and compare content quickly and efficiently. This is accomplished by consistently emphasizing the differently weighted visual characteristics of structured content. The user's attention is focused on more important parts of the content while minimizing distractions from less important areas.
  • FIG. 2 illustrates one embodiment of the invention in which a number of items of interest are presented in a linear arrangement 100. As shown, a set of primary items of interest 102 are arranged side by side in a planar or frontal configuration. In particular, each item in the set 102 is presented in a full frontal configuration with a 0° angle relative to the plane of the display.
  • A set of secondary items of interest 104 are arranged adjacent to the first set. Each item in the set 104 is presented with a diagonal (i.e., non-0°) view, giving the appearance that these items are turned to face the items in the set 102. The items in the first and second sets may be, for example, results from a user-directed search. The items in the sets 102 and 104 may be ordered chronologically, ranked according to likelihood of matching the search criteria, ranked according to recently viewed information, or other ordering techniques.
  • The second set 104 preferably includes a first subset 104 a and a second subset 104 b. As shown, the items of interest in the first subset 104 a are presented at a first or “transitional” diagonal view. This transitional view may be tilted, for example, between 5°-15° relative to the 0° of the primary items of interest 102. The items of interest in the second subset 104 b are presented with a second diagonal view greater than that of the first subset 104 a. Thus, the second subset 104 b may be tilted, for example, at an angle on the order of 15°-45°. While only two subsets are illustrated, any number of additional subsets may also be employed. Each item of interest in a given subset may be tilted at the same angle, or at different angles. In one example, the items in the set 104 are incrementally tilted starting at an initial angle of, e.g., less than 10° for a first item in the first subset 104 a to a final angle of, e.g., greater than 45° for a last item in the second subset 104 b.
  • As discussed above, the items of interest may be web pages, although other text and/or graphics based items of interest can be displayed according to the embodiments of the invention. Depending upon the type of item, certain areas may be of more significance than others. For instance, FIGS. 3A-C illustrate an exemplary web page 200 which may be displayed according to the embodiments of the invention. As shown in FIG. 3B, the web page may contain one or more critical layout or utility zones (“CLuZ”) 202 and one or more supplemental layout and optional information zones (“SLoZ”) 204. In this example of an English-language web page, the CLuZ zone 202 is on the left side of the web page 200, and the SLoZ zone 204 is on the right side of the web page 200.
  • The CLuZ zone(s) can provide representative clues to effectively communicate the identity, brand and/or structure of the content on the web page. The SLoZ zone(s) may also provide information about the web page, but to a lesser extent than the CLuZ. Thus, as shown in FIGS. 3B-D, the high contrast and clarity of the CLuZ zones may be maintained while the SLoZ zones may be deemphasized, e.g., grayed out, partially concealed or fully concealed/removed. Even with data in the SLoZ zones obscured or removed, the user is able to identify and infer the page structure from the CLuZ zones.
  • Using this knowledge, individual web pages such as those in the secondary items of interest 104 of FIG. 1 are rotated to emphasize the CLuZ zone(s) while deemphasizing the SLoZ zone(s). Thus, as shown in FIG. 3E, the CLuZ zone 202 is angled, tilted or otherwise turned to appear closer to the user, while the SLoZ zone 204 is angled/tilted/turned to appear farther from the user. And as shown in FIG. 3F, the SLoZ zone 204 may be additionally deemphasized by darkening, shading and/or distorting to appear farther away on the display. It should be understood that web pages in different languages (or different types of content) may have different arrangements of the CLuZ and SLoZ zones. Thus, different content may be arranged differently on the display to optimally present the CLuZ zones while deemphasizing the SLoZ zones.
  • FIG. 4 illustrates a variation of the embodiment in FIG. 2. In FIG. 4, in addition to the set of secondary items of interest 104, a third set of items of interest 106 are arranged on the opposite side of the first set 102. The set 106 is arranged similarly to the set 104. While each item in the set 104 is presented with a diagonal view to give the appearance that these items are turned to face towards the items in the set 102, each item in the set 106 is presented with a diagonal view to give the appearance that these items are turned to face away from the items in the set 102. Nonetheless, both sets 104 and 106 are arranged so that the CLuZ zones of the items in each are clearly visible.
  • The third set 106 preferably includes a first subset 106 a and a second subset 106 b. As with the first subset 104 a, the items of interest in the first subset 106 a are presented at a first or “transitional” diagonal view. This transitional view may be tilted away from the items in the set 102 at a given angle, for example, between 5°-15° relative to the 0° of the primary items of interest in the set 102.
  • And as with the second subset 104 b, the items of interest in the second subset 106 b are presented with a second diagonal view greater than that of the first subset 106 a. Thus, the second subset 106 b may be tilted, for example, at an angle on the order of 15°-45° away from the primary items of interest in set 102. Preferably, the subsets 104 a and 106 a are arranged at the same angle and the subsets 104 b and 106 b are arranged at the same angle. The overall appearance of the sets 102, 104 and/or 106 is a venetian blind-type arrangement.
  • While only two subsets 106 a and 106 b are illustrated, any number of additional subsets may also be employed. Each item of interest in a given subset may be tilted at the same angle, or at different angles. In one example, the items in the set 106 are incrementally tilted starting at an initial angle of, e.g., less than 10° for a first item in the first subset 106 a to a final angle of, e.g., greater than 45° for a last item in the second subset 106 b. In one example, the first set 102 includes about 3-5 frontal views, and the second and/or third sets 104 and 106 each include about 2-6 additional diagonal views.
  • The linear arrangements of FIGS. 2 and 4 may include any number of items of interest. In the case of web pages or similar items, these arrangements provide unobstructed views of the critical layout zones CLuZs, which identify each page using logos, brand information, navigation information and/or starts of headers or sentences. For instance, in English language web pages, the upper left region of the page often contains the most important or most recognizable content. Thus, the left hand side of each page is the side appearing to be angled toward the user. Preferably, the items in the sets 102, 104 and/or 106 are top-aligned. This normalizes the consistent elements in the CLuZ of each page and accommodates both the user's reading pattern and cases where the items, such as web pages, are of different lengths.
  • Of course, other languages such as Arabic, Hebrew, Chinese and Japanese may be presented in non-left to right arrangements. The presentation of content in such languages may be changed to accommodate this. For instance, for web pages written in a right-to-left language, the CLuZ may be on the right side of each page, and thus the angles would be the opposite of what is presented in the examples of FIGS. 2 and 4. Other presentation formats may provide the text in a top to bottom listing or other configuration. As above, the content presentation may be changed to accommodate such presentation formats. And instead of vertically aligning the tops of each page in the venetian blind views of FIGS. 2 and 4, the pages may be aligned, e.g., horizontally along the left or right side of each page, or vertically along the bottoms of each page.
  • As discussed above with regard to FIGS. 3A-F, the SLoZ areas may be obscured by darkening and/or distorting, e.g., by making the right hand side of the page appear to be smaller than the left hand side by angling it. Deemphasizing the SLoZ areas helps the user quickly scan each image without focusing on less important details. The result may be a magazine rack-type feel, with the CLuZ areas providing easy scanning for the user. The user may rapidly scan the CLuZ of the various items in sets 104 and 106 and, using the user interface, may select a particular item in one of these sets for further evaluation. In this case, the selected item may be centered in the display and presented with a flat frontal view. In other words, the selected item may now be part of the set 102.
  • FIGS. 5A-D present an alternate scenario for analyzing content. As shown in FIG. 5A, content in the form of a number of web pages is positioned in a linear array. Each web page is presented in a full frontal (0°) view. As shown, five full web pages and two partial web pages are presented. In this presentation, all portions of each page are presented equally to the user.
  • FIG. 5B presents the web pages arranged at an angle of approximately 45°. In this example, 9 full web pages are presented. The pages are ordered along a single dimension such as in FIG. 5A; however, tilting the pages increases the number available for display and emphasizes important content in the CLuZ zones while de-emphasizing content in the SLoZ zones. Based upon information in a CLuZ zone, the user may select one or more given web pages for further consideration.
  • Upon selection, additional emphasis may be placed on the selected web page(s). As shown in FIG. 5C, selected web pages are now presented untilted in the full frontal view. The other web pages remain set at the 45° angle. This provides a side-by-side comparison of a few central web pages while the other web pages on the periphery are presented with the CLuZ zones emphasized over the SLoZ zones. In this manner, the user can readily analyze the three central web pages while scanning the peripheral web pages. If one of the selected web pages is chosen for additional evaluation, the thumbnail of that web page may be enlarged as shown in FIG. 5D.
  • Another aspect of the invention involves spatial optimization of the items of interest on the display. FIG. 6A illustrates an exemplary web page thumbnail image. When viewed untilted in full frontal format, the web page takes up one standard preview width. As shown in FIG. 6B, by tilting web pages (or other content) at a 45° angle, two web pages may occupy nearly the same space as the single web page in FIG. 6A. In FIG. 6B, the adjacent pages are spaced with a 10 pixel gap between them, resulting in approximately 1.8 pages fitting into the standard preview width. If there is no gap between the adjacent pages, then both pages will fit into the standard preview width, as shown in FIG. 6C. And as shown in FIG. 6D, using a 20 pixel overlap between adjacent thumbnails, then approximately 2.5 pages will fit into the standard preview width.
  • The number of images available for display depends on the size of the images. On the one hand, larger size thumbnail images promote increased legibility of content but reduce the number of images that can be displayed. On the other hand, more smaller-sized images can be displayed by sacrificing readability. This is illustrated in FIG. 7, where five representations of the same exemplary web page are provided. Here, the thumbnail sizes range from 50% of the original page size down to 20% of the original page size. While it may be challenging to read the text of the 20% thumbnail, this size shows the overall page structure and relative content patterns, which may be sufficient for certain types of user evaluation.
  • For instance, if content has been previously viewed, then a smaller thumbnail size on the order of 20%-32% may be selected. On the other hand, if the user is first being exposed to the content, then a thumbnail size of 40%-50% may be selected. The size may vary dynamically as the user scans through the content on the display.
  • The visual presentations and user manipulation of content according to the invention may be implemented with a graphical user as part of a computer system. FIG. 8A presents a schematic diagram of a computer system depicting various computing devices that can be used alone or in a networked configuration in the invention. For example, this figure illustrates a computer network 300 having a plurality of computers 302, 304, 306 and 308 as well as other types of devices such as portable electronic devices such as a mobile phone 310 and a PDA 312. Such devices may be interconnected via a local or direct connection 314 and/or may be coupled via a communications network 316 such as a LAN, WAN, the Internet, etc. and which may be wired or wireless.
  • Each device may include, for example, one or more processing devices and have user inputs such as a keyboard 318 and mouse 320 and/or various other types of input devices such as pen-inputs, joysticks, buttons, touch screens, etc., as well as a display 322, which could include, for instance, a CRT, LCD, plasma screen monitor, TV, projector, etc. Each computer 302, 304, 306 and 308 may be a personal computer, server, etc. By way of example only, computers 302 and 306 may be personal computers while computer 304 may be a server and computer 308 may be a laptop.
  • As shown in FIG. 8B, each computer such as computers 302 and 304 contains a processor 324, memory/storage 326 and other components typically present in a computer. For instance, memory/storage 326 stores information accessible by processor 324, including instructions 128 that may be executed by the processor 324 and data 330 that may be retrieved, manipulated or stored by the processor. The memory/storage may be of any type or any device capable of storing information accessible by the processor, such as a hard-drive, ROM, RAM, CD-ROM, flash memories, write-capable or read-only memories. The processor 324 may comprise any number of well known processors, such as processors from Intel Corporation. Alternatively, the processor may be a dedicated controller for executing operations, such as an ASIC.
  • The instructions 328 may comprise any set of instructions to be executed directly (such as machine code) or indirectly (such as scripts) by the processor(s). In that regard, the terms “instructions,” “steps” and “programs” may be used interchangeably herein. The instructions may be stored in any computer language or format, such as in object code or modules of source code. The functions, methods and routines of instructions in accordance with the present invention are explained in more detail below.
  • Data 330 may be retrieved, stored or modified by processor 324 in accordance with the instructions 328. The data may be stored as a collection of data. For instance, although the invention is not limited by any particular data structure, the data may be stored in computer registers, in a relational database as a table having a plurality of different fields and records, in a web page cache, as XML documents, or as flat files.
  • The data may also be formatted in any computer readable format such as, but not limited to, binary values, ASCII or Unicode. Similarly, the data may include images stored in a variety of formats such as vector-based images or bitmap images using lossless (e.g., PNG) or lossy (e.g., JPEG) encoding. Moreover, the data may include any information sufficient to identify the relevant information, such as descriptive text, proprietary codes, pointers, references to data stored in other memories (including other network locations) or information which is used by a function to calculate the relevant data.
  • In accordance with aspects of the invention, the data may comprise electronic content such as web pages. Furthermore, a given item may comprise one or more files, a data set stored in a database, a web cache, etc. Depending on the size and content of the document, parts of the content may be stored or otherwise maintained separately.
  • Although the processor 324 and memory 326 are functionally illustrated in FIG. 8B as being within the same block, it will be understood that the processor and memory may actually comprise multiple processors and memories that may or may not be stored within the same physical housing or location. For example, some or all of the instructions and data may be stored on a removable CD-ROM, DVD-ROM or flash drive, and others within a read-only computer chip. Some or all of the instructions and data may be stored in a location physically remote from, yet still accessible by, the processor. Similarly, the processor may actually comprise a collection of processors which may or may not operate in parallel. Data may be distributed and stored across multiple memories 326 such as hard drives or the like.
  • In one aspect, server 304 may communicate with one or more client computers 302, 306 and/or 308, as well as devices such as mobile phone 310 and PDA 312. Each client computer or other client device may be configured similarly to the server 304, with a processor, memory and instructions, as well as one or more user input devices 318, 320 and a user output device, such as display 322. Each client computer may be a general purpose computer, intended for use by a person, having all the components normally found in a personal computer such as a central processing unit (“CPU”), display, CD-ROM or DVD drive, hard-drive, mouse, keyboard, touch-sensitive screen, speakers, microphone, modem and/or router (telephone, cable or otherwise) and all of the components used for connecting these elements to one another.
  • The server 304 and user computers and other devices are capable of direct and indirect communication with other computers, such as over network 316. Although only a few computing devices are depicted in FIGS. 8A-B, it should be appreciated that a typical system can include a large number of connected servers and clients, with each different computer being at a different node of the network. The network 316, and intervening nodes, may comprise various configurations and protocols including the Internet, intranets, virtual private networks, wide area networks, local networks, private networks using communication protocols proprietary to one or more companies, Ethernet, WiFi, Bluetooth or TCP/IP.
  • Communication across the network, including any intervening nodes, may be facilitated by any device capable of transmitting data to and from other computers, such as modems (e.g., dial-up or cable), network interfaces and wireless interfaces. Server 304 may be a web server. Although certain advantages are obtained when information is transmitted or received as noted above, other aspects of the invention are not limited to any particular manner of transmission of information. For example, in some aspects, the information may be sent via a medium such as a disk, tape, CD-ROM, or directly between two computer systems via a dial-up modem. In other aspects, the information may be transmitted in a non-electronic format and manually entered into the system.
  • Moreover, computers and user devices in accordance with the systems and methods described herein may comprise any device capable of processing instructions and transmitting data to and from humans and other computers, including network computers lacking local storage capability, PDA's with modems such as PDA 312 and Internet-capable wireless phones such as mobile phone 310.
  • As shown in FIG. 8A, the network 300 may also include a content storage entity 332, which may be directly or indirectly coupled to server 304. In an alternative, the content storage entity 332 may be part of or otherwise logically associated with the server 304. Content storage entity 334 may be part of or logically associated with a user device such as computer 302. In an alternative, the content storage entity 334 may be directly or indirectly coupled to the computer 302. In an example, the content storage entity 334 comprises data memory 330 of the computer 302.
  • The content storage entity 334 may securely store content such as web page information in a native (raw), compressed or encrypted format. The content storage entity 334 may be configured so that it is only accessible to selected users or devices. For instance, content stored on the content storage entity 334 may only be accessible to authenticated users of computer 302. The content storage entity 332 and the server 304 may comprise a content web server.
  • An exemplary process for implementing content visualizations according to the invention is provided with regard to FIG. 9. Initially, the content to present is selected as shown in block 400. The content may be selected by a user or as part of a pre-defined application. In one scenario, the content is taken from a specific time period within a user's web browser history. The invention is not limited to any particular type of web browser. In another scenario, the content is derived from the search results from a user's query. The content may be stored in one of the content storage entities 332 or 334 of FIG. 8A. Alternatively, the content may be stored locally on the user's device, such as in a cache memory within memory 326 of FIG. 8B.
  • Next, a viewing axis is selected, imposed or otherwise assigned as shown in block 402. The viewing axis may be a timeline, for instance to show all web pages visited in the last X minutes, hours or days. In an alternative example, the viewing axis may rank the content based on how closely it corresponds to a given search or other criteria. The orientation of the viewing axis may also be chosen based upon the type of content. Thus, English-language web pages may be placed on a viewing axis as shown in FIGS. 2 and 4.
  • As shown in block 404, a place of focus along the viewing axis is selected. Thus, in the timeline example above, the focus may be on the most recent content, on web pages visited on a specific date, a specific time, etc. Next, as shown in block 406, a content “viewport” is determined. The viewport sets a subset or amount of content which is viewable on the display.
  • As shown in block 408, the content visualization is constructed in view of the content, viewing axis, place of focus and the viewport. Once the content visualization is constructed, it is presented on the display. At this point, the user may evaluate the content, including selecting content for further study, act on the content, etc. as shown in block 410. By way of example, the user interface may provide an option for the user to scan or scroll through the presented content using a mouse or other input device. For instance, a slider bar on the display may allow the user to scroll across the content. The user may identify an item of interest by actively selecting it or by placing a pointer on the item. The process may return to block 408 for modification of the content visualization, or may return to block 400 if additional or different content is chosen.
  • In one example, the content at the place of focus is shown in the full frontal format. The content on either side of the place of focus is presented at an angle or series of angles as shown in FIGS. 2 and 4. The process may construct the content visualization based upon various factors. One factor is whether the content has been viewed before or whether it will be presented for the first time. As discussed above with regard to FIG. 7, the size of the content may be changed depending upon whether it has been previously viewed.
  • Another factor is whether the content visualization is optimized for identification or recognition. Material that is to be quickly scanned can be presented with smaller sized thumbnails such as on the order of 15%-35%. Material that is to be more fully considered may be presented with a thumbnail size on the order of 35%-60%.
  • A further factor is spatial optimization. FIGS. 6A-D were discussed above, and show how content may be angled with spacing between adjacent items, or overlap of such items. Spatial optimization may be performed based upon user feedback or selections, size and resolution of the display(s), etc.
  • The amount of the angle/tilt may vary as shown in FIGS. 2 and 4. For instance, the first subsets 104 a and 106 a may be tilted at a relatively shallow angle on the order of 5°-20°, while the second subsets 104 b and 106 b may be tilted at a steeper angle on the order of 30°-60°.
  • In addition, the number of items shown in full frontal format in the place of focus may be varied. As shown in FIGS. 2, 4 and 5C, three or four (or more) items may be centered in full frontal format. However, upon selection, an item of interest may be enlarged as shown in FIG. 5D. This may be done while placing the adjacent items at an angle as shown in the figure.
  • Yet another factor is cognitive optimization. As discussed above with regard to FIGS. 3A-F, the CLuZ parts of a webpage or other content are emphasized while the SLoZ parts of the content are deemphasized. The CLuZ part(s) should be presented angled towards the user while the SLoZ parts may be angled away from the user and/or otherwise deemphasized such as by shading or graying the information, or via overlap with an adjacent webpage.
  • The processes of FIG. 9 may be done by a single computing device with a single display, in a distributed system, or in a client-server model. The display unit may be part of a user/client device, such as computers 302 and 308, or part of a portable electronic device such as the mobile phone 310 or the PDA 312 of FIG. 8A. The processor may be local to the client device and may access content stored locally or remotely. Alternatively, the processing may be done remotely by a processor such as at server 304 of FIG. 8A. In this case, the content visualizations are sent via the network 316 to the user's device and displayed on the display.
  • Web pages and/or other content may be visualized as disclosed herein using a user interface module managed or executed by the processor. FIG. 10 shows a system 500 including a processor 502 in operative communication with user interface module 504. One or both of the processor 502 and the user interface module 504 may communicate with memory 506. The user interface module 504 is in communication with one or more user interface devices 508 and at least one display 510.
  • As shown, the user interface module 504 may include an input section 512 for requesting, receiving and/or maintaining (e.g., caching or otherwise storing) selected content. The user interface module may also include a content management section 514 functioning in conjunction with the processor 502 for manipulating various visualizations of the content, such as modifying the angle/tilt of one or more web pages, emphasizing the CLuZ zones, deemphasizing the SLoZ zones, etc. as disclosed herein. The user interface module may further include a display section 516 for displaying the content on the display.
  • Additional user interface visualizations may be employed using the features discussed here. For instance, some web browsers use separate tabs for each web page. In this case, the user navigates between different web pages by selecting different tabs. One fundamental problem with this approach is that the tabs do not allow the user to “see” the page represented by the tab until the user selects/focuses the tab. This is shown in FIG. 11A.
  • Another problem with such a conventional tab format is that the tabs do not support a lot of text. The tabs may be resized if other tabs are added or removed. Therefore, the text may be cut off when trying to fit too many tabs (e.g., on the order of 20 tabs) on the browser bar. Such text is metadata that attempts to describe the web page. This may force the user to interpret the text to see if it meets what the user thinks the page actually is.
  • One solution according to an aspect of the invention is to allow the user to navigate the entire set of pages by creating the experience of “stepping back” to get a view of many pages concurrently. The user may move from side to side (or up and down) to reveal more pages. Here, the user can quickly see the actual page, which may be a preview that is somewhat smaller that the actual page. When the user wants to focus in on a page, the user may zoom in. Zooming may continue until the page take up the full browser view.
  • This permits the user to zoom in and out while navigating all open pages. The user is able to control the visualization, focusing/zooming in on an item of interest to observe all its details. Any page/content that is in the center or focal point of the display may show the associated tab directly above (or to the side of) it on the browser bar. In one example, the user may interact with the web page representations directly, or click/select any tabs displayed in the browser bar for additional navigation.
  • FIG. 11B illustrates a visualization according to this aspect of the invention in which the web page of interest for the currently selected tab is presented in full frontal format. In this example, several web pages associated with the tabs to the left of the currently selected tab are shown on the display in the tilted/angled format facing toward the full frontal web page.
  • FIG. 11C presents an alternative presentation to that of FIG. 11B, again with the pages to the left of the currently selected tab tilted/angled toward the full frontal page. As discussed above, the angled pages may be spaced apart, e.g., with a 10 pixel gap between adjacent pages. They may also be shaded to deemphasize them relative to the full frontal page.
  • FIG. 11D and the subsequent figures shown one scenario using visualizations to enhance or replace tabbed browsing. As shown in FIG. 11D, a number of web pages are shown in the tilted/angled format with corresponding tabs above them. Here, the pages may be arranged in chronological order. In this example, the most recent web page (e.g., 1 pm) is placed on the right side of the display while the oldest web page (e.g., 11 am) is placed on the left side of the display.
  • In FIG. 11E, the central web page and its two adjacent pages are shown in full frontal format while the other pages to the left and right are presented in the tiled/angled format discussed herein. In FIG. 11F, additional chronological information may be displayed for the full frontal displayed pages. And as shown, these pages may be extended to show additional details not viewable in a single page format. For instance, the central page may be presented so that the viewer can see comments posted below the primary content. This avoids requiring the user to scroll down each individual page or to tab between individual pages.
  • FIG. 11F shows another visualization where the central page of interest is enlarged/zoomed. Here, the time the web page was visited may be shown. In addition, this web page may partly or fully obscure the adjacent full frontal pages. And if the user selects this page for additional consideration, the page may be zoomed in to fill the screen—while still presenting the tabs on the browser bar—as shown in FIG. 11H. And FIG. 11I presents an alternative visualization wherein the content of the central page is overlayed with the three full frontal pages.
  • Additional tab-type visualizations are presented in FIGS. 12A-G. As shown in FIG. 12A, if the user selects a tab the page visualizations may be shown in a scrolling-type view such as with scanning through a rolodex until the content of interest is reached. Then as shown in FIG. 12B, the page associated with the selected tab may be shown in full frontal format along with the two adjacent pages. FIGS. 12C-D illustrate additional visualizations when scanning content. And FIGS. 12E-G show how selected content may be presented on the display.
  • In accordance with another embodiment, visualizations may provide easy manipulation of related/recent sessions and history viewing. For instance, FIGS. 13A-B show how the user may browse related sessions. In FIG. 13A, while viewing the web page of FIG. 12G the user may be given the option to “Browse Related Sessions” as shown at the bottom. If this is selected, then related sessions may be displayed as presented in FIG. 13B. The user may then scan/access the content using any of the tools as described herein.
  • FIGS. 14A-G illustrate a further embodiment for management of recent sessions. As shown in FIG. 14A, various time-sorted sessions may be displayed, e.g., for this afternoon, this morning, yesterday and last week. As discussed above, once the user selects an item of interest, the display's visualization may change. For instance, FIGS. 14B-G illustrate changes to the visualizations based upon the user's selection(s).
  • In yet another embodiment, the user is able to save and resume work that was previously done. For instance, the content management section of the user interface module of FIG. 10 may keep track of previously visited web pages or other content that has been accessed. FIGS. 15A-F illustrate various visualizations using history information.
  • The tab browsing and other browsing features presented herein may be used in any browsing application such as a web browser, as well as other indexed search tools. This includes, but is not limited to, file manager-type applications, multimedia content applications, etc.
  • Although aspects of the invention herein have been described with reference to particular embodiments, it is to be understood that these embodiments are merely illustrative of the principles and applications of the present invention. It is therefore to be understood that numerous modifications may be made to the illustrative embodiments and that other arrangements may be devised without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (23)

1. A content visualization method for use in a computer system, the method comprising:
selecting electronic content for presentation on a display device;
assigning a viewing axis for displaying the content;
selecting a place of focus along the viewing axis;
determining a content viewport, the content viewport setting an amount of the content viewable on the display device;
constructing a content visualization to display at least a portion of the selected content on the display device; and
displaying the content visualization on the display device based upon the content viewport, viewing axis and place of focus.
2. The content visualization method of claim 1, wherein the viewing axis comprises a chronological representation of the selected electronic content.
3. The content visualization method of claim 1, wherein the viewing axis comprises a ranked list of the selected electronic content.
4. The content visualization method of claim 1, further comprising re-constructing the content visualization based upon user feedback to the displayed content visualization.
5. The content visualization method of claim 1, wherein the content visualization includes a plurality of sets of items of interest, a first one of the sets being arranged along a first portion of the display device and a second one of the sets being arranged adjacent to the first set, and wherein the first set is presented in full frontal format while the second set is presented in a diagonal view giving an appearance that the items in the second set are facing towards the items in the first set.
6. The content visualization method of claim 5, wherein the second set includes a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset and remote from the first set, and wherein the first subset is presented having a transitional diagonal view.
7. The content visualization method of claim 6, wherein the transitional diagonal view of the first subset is between 5°-15° and the diagonal view of the second subset is at least 15°.
8. The content visualization method of claim 6, wherein the transitional diagonal view is less than 15° and the diagonal view is on the order of 15°-45°.
9. The content visualization method of claim 5, wherein a third one of the plurality of sets is arranged adjacent to the first set and opposite the second set, the third set being presented in the diagonal view giving the appearance that the items in the third set are facing away from the items in the first set.
10. The content visualization method of claim 9, wherein the third set includes a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset of the third set and remote from the first set, and wherein the first subset of the third set is presented having a transitional diagonal view.
11. A content visualization apparatus, comprising:
memory for storing content visualization data;
a processor operatively coupled to the memory, the processor being configured to:
select electronic content for presentation,
assign a viewing axis for displaying the content,
select a place of focus along the viewing axis,
determine a content viewport, the content viewport setting an amount of the content that is viewable, and
construct a content visualization to display at least a portion of the selected content on the display device; and
a display device operatively coupled to the processor, the display device being configured to display the content visualization based upon the content viewport, viewing axis and place of focus.
12. The content visualization apparatus of claim 11, wherein the viewing axis comprises a chronological representation of the selected electronic content.
13. The content visualization apparatus of claim 11, wherein the viewing axis comprises a ranked list of the selected electronic content.
14. The content visualization apparatus of claim 11, wherein the processor is further configured to re-construct the content visualization based upon user feedback to the content visualization displayed on the display device.
15. The content visualization apparatus of claim 11, wherein the content visualization includes a plurality of sets of items of interest, a first one of the sets being arranged along a first portion of the display device and a second one of the sets being arranged adjacent to the first set, and wherein the display device is configured to present the first set in full frontal format while the second set is presented in a diagonal view giving an appearance that the items in the second set are facing towards the items in the first set.
16. The content visualization apparatus of claim 15, wherein the second set includes a first subset arranged adjacent to the first set and a second subset arranged adjacent to the first subset and remote from the first set, and wherein the display device is configured to present the first subset having a transitional diagonal view.
17. A content visualization system, comprising:
a processor for processing application data for displaying on a display device; and
a user interface module managed by the processor, the user interface module including:
an input section for storing selected content;
a content management section for manipulating visualizations of the selected content, the selected content including a plurality of items of interest, and a given one of the visualizations includes a first one of the items of interest being arranged in full frontal format and second and third ones of the items of interest being arranged in a diagonal view, the second item being arranged in the diagonal view along one side of the first item and the third item being arranged in the diagonal view along the other side of the first item; and
a display section for displaying the given visualization of the first, second and third items of interest on a display.
18. The content visualization system of claim 17, wherein the content management section is operable to manipulate the visualizations by modifying an angle or tile of one or more pages of the first, second or third items of interest.
19. The content visualization system of claim 17, wherein the content management section is operable to manipulate the given visualization by emphasizing at least one critical layout or utility zone (CLuZ) of the selected content while deemphasizing at least one supplemental layout and optional zone (SLoz) of the selected content.
20. The content visualization system of claim 19, wherein the at least one CLuZ is displayable at an angle toward a user.
21. The content visualization system of claim 20, wherein the at least one SLoZ is displayable at an angle away from the user.
22. The content visualization system of claim 20, wherein the at least one SLoZ is deemphasized by shading or graying thereof.
23. The content visualization system of claim 17, wherein at least one of the second and third items includes a plurality of pages, the diagonal view includes a full diagonal view and a transitional diagonal view, and a first one of the plurality of pages is arranged in the full diagonal view while a second one of the plurality of pages is arranged in the transitional diagonal view between the first item and the first page.
US13/249,905 2009-06-19 2011-09-30 User interface visualizations Abandoned US20120042270A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/249,905 US20120042270A1 (en) 2009-06-19 2011-09-30 User interface visualizations

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US26908909P 2009-06-19 2009-06-19
US12/818,222 US8140990B2 (en) 2009-06-19 2010-06-18 User interface visualizations
US13/249,905 US20120042270A1 (en) 2009-06-19 2011-09-30 User interface visualizations

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/818,222 Continuation US8140990B2 (en) 2009-06-19 2010-06-18 User interface visualizations

Publications (1)

Publication Number Publication Date
US20120042270A1 true US20120042270A1 (en) 2012-02-16

Family

ID=43355387

Family Applications (2)

Application Number Title Priority Date Filing Date
US12/818,222 Active US8140990B2 (en) 2009-06-19 2010-06-18 User interface visualizations
US13/249,905 Abandoned US20120042270A1 (en) 2009-06-19 2011-09-30 User interface visualizations

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US12/818,222 Active US8140990B2 (en) 2009-06-19 2010-06-18 User interface visualizations

Country Status (5)

Country Link
US (2) US8140990B2 (en)
EP (1) EP2443542A4 (en)
AU (1) AU2010262875B2 (en)
CA (1) CA2765956C (en)
WO (1) WO2010148167A2 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014059337A1 (en) * 2012-10-11 2014-04-17 Yahoo! Inc. Visual presentation of customized content
USD731526S1 (en) * 2012-04-17 2015-06-09 Hon Hai Precision Industry Co., Ltd. Display screen with graphical user interface of an electronic program guide
USD733720S1 (en) * 2012-07-25 2015-07-07 Johnson Controls Technology Company Display screen with graphical user interface
USD734763S1 (en) * 2012-01-09 2015-07-21 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD737314S1 (en) * 2012-10-19 2015-08-25 Google Inc. Portion of a display panel with an animated computer icon
USD742901S1 (en) * 2012-08-07 2015-11-10 Samsung Electronics Co., Ltd. TV display screen displaying GUI
USD749605S1 (en) * 2012-08-07 2016-02-16 Samsung Electronics Co., Ltd. TV display screen displaying GUI

Families Citing this family (203)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9060770B2 (en) 2003-05-20 2015-06-23 Ethicon Endo-Surgery, Inc. Robotically-driven surgical instrument with E-beam driver
US20070084897A1 (en) 2003-05-20 2007-04-19 Shelton Frederick E Iv Articulating surgical stapling instrument incorporating a two-piece e-beam firing mechanism
US11890012B2 (en) 2004-07-28 2024-02-06 Cilag Gmbh International Staple cartridge comprising cartridge body and attached support
US7669746B2 (en) 2005-08-31 2010-03-02 Ethicon Endo-Surgery, Inc. Staple cartridges for forming staples having differing formed staple heights
US10159482B2 (en) 2005-08-31 2018-12-25 Ethicon Llc Fastener cartridge assembly comprising a fixed anvil and different staple heights
US11246590B2 (en) 2005-08-31 2022-02-15 Cilag Gmbh International Staple cartridge including staple drivers having different unfired heights
US11793518B2 (en) 2006-01-31 2023-10-24 Cilag Gmbh International Powered surgical instruments with firing system lockout arrangements
US8186555B2 (en) 2006-01-31 2012-05-29 Ethicon Endo-Surgery, Inc. Motor-driven surgical cutting and fastening instrument with mechanical closure system
US8708213B2 (en) 2006-01-31 2014-04-29 Ethicon Endo-Surgery, Inc. Surgical instrument having a feedback system
US7845537B2 (en) 2006-01-31 2010-12-07 Ethicon Endo-Surgery, Inc. Surgical instrument having recording capabilities
US10568652B2 (en) 2006-09-29 2020-02-25 Ethicon Llc Surgical staples having attached drivers of different heights and stapling instruments for deploying the same
US8684253B2 (en) 2007-01-10 2014-04-01 Ethicon Endo-Surgery, Inc. Surgical instrument with wireless communication between a control unit of a robotic system and remote sensor
US20080169332A1 (en) 2007-01-11 2008-07-17 Shelton Frederick E Surgical stapling device with a curved cutting member
US8931682B2 (en) 2007-06-04 2015-01-13 Ethicon Endo-Surgery, Inc. Robotically-controlled shaft based rotary drive systems for surgical instruments
US11857181B2 (en) 2007-06-04 2024-01-02 Cilag Gmbh International Robotically-controlled shaft based rotary drive systems for surgical instruments
US11849941B2 (en) 2007-06-29 2023-12-26 Cilag Gmbh International Staple cartridge having staple cavities extending at a transverse angle relative to a longitudinal cartridge axis
JP5410110B2 (en) 2008-02-14 2014-02-05 エシコン・エンド−サージェリィ・インコーポレイテッド Surgical cutting / fixing instrument with RF electrode
US11648005B2 (en) 2008-09-23 2023-05-16 Cilag Gmbh International Robotically-controlled motorized surgical instrument with an end effector
US8210411B2 (en) 2008-09-23 2012-07-03 Ethicon Endo-Surgery, Inc. Motor-driven surgical cutting instrument
US9386983B2 (en) 2008-09-23 2016-07-12 Ethicon Endo-Surgery, Llc Robotically-controlled motorized surgical instrument
US9005230B2 (en) 2008-09-23 2015-04-14 Ethicon Endo-Surgery, Inc. Motorized surgical instrument
US8608045B2 (en) 2008-10-10 2013-12-17 Ethicon Endo-Sugery, Inc. Powered surgical cutting and stapling apparatus with manually retractable firing system
US9329746B2 (en) * 2009-11-27 2016-05-03 Lg Electronics Inc. Method for managing contents and display apparatus thereof
US9788834B2 (en) 2010-09-30 2017-10-17 Ethicon Llc Layer comprising deployable attachment members
US11812965B2 (en) 2010-09-30 2023-11-14 Cilag Gmbh International Layer of material for a surgical end effector
US10945731B2 (en) 2010-09-30 2021-03-16 Ethicon Llc Tissue thickness compensator comprising controlled release and expansion
US9320523B2 (en) 2012-03-28 2016-04-26 Ethicon Endo-Surgery, Llc Tissue thickness compensator comprising tissue ingrowth features
US9629814B2 (en) 2010-09-30 2017-04-25 Ethicon Endo-Surgery, Llc Tissue thickness compensator configured to redistribute compressive forces
US11925354B2 (en) 2010-09-30 2024-03-12 Cilag Gmbh International Staple cartridge comprising staples positioned within a compressible portion thereof
US8949736B2 (en) * 2010-10-15 2015-02-03 Sap Se System and method for immersive process design collaboration on mobile devices
KR101788049B1 (en) * 2010-12-15 2017-10-19 엘지전자 주식회사 Mobile terminal and method for controlling thereof
JP2012163925A (en) * 2011-02-09 2012-08-30 Seiko Epson Corp Display control method, display device and electronic apparatus
JP5691593B2 (en) * 2011-02-09 2015-04-01 セイコーエプソン株式会社 Display control method, display device, and electronic apparatus
BR112013027794B1 (en) 2011-04-29 2020-12-15 Ethicon Endo-Surgery, Inc CLAMP CARTRIDGE SET
US20120284671A1 (en) * 2011-05-06 2012-11-08 Htc Corporation Systems and methods for interface mangement
US20130055078A1 (en) * 2011-08-24 2013-02-28 Salesforce.Com, Inc. Systems and methods for improved navigation of a multi-page display
US10289657B2 (en) 2011-09-25 2019-05-14 9224-5489 Quebec Inc. Method of retrieving information elements on an undisplayed portion of an axis of information elements
US8760474B2 (en) 2011-11-02 2014-06-24 Microsoft Corporation Virtualized data presentation in a carousel panel
USD731506S1 (en) * 2011-11-17 2015-06-09 Axell Corporation Display screen with graphical user interface
USD728578S1 (en) * 2011-11-17 2015-05-05 Jtekt Corporation Control board device with graphical user interface
USD731507S1 (en) * 2011-11-17 2015-06-09 Axell Corporation Display screen with animated graphical user interface
USD731503S1 (en) * 2011-11-17 2015-06-09 Axell Corporation Display screen with graphical user interface
USD731504S1 (en) * 2011-11-17 2015-06-09 Axell Corporation Display screen with graphical user interface
RU2480831C1 (en) * 2011-11-24 2013-04-27 Общество с ограниченной ответственностью "КБК Групп" Method of sampling images from image base
RU2014143258A (en) 2012-03-28 2016-05-20 Этикон Эндо-Серджери, Инк. FABRIC THICKNESS COMPENSATOR CONTAINING MANY LAYERS
CN104334098B (en) 2012-03-28 2017-03-22 伊西康内外科公司 Tissue thickness compensator comprising capsules defining a low pressure environment
USD735741S1 (en) * 2012-04-27 2015-08-04 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
EP2662762B1 (en) * 2012-05-11 2020-01-15 Open Text S.A. Document manager and browser
USD719188S1 (en) * 2012-06-08 2014-12-09 Apple Inc. Display screen or portion thereof with graphical user interface
US9519693B2 (en) * 2012-06-11 2016-12-13 9224-5489 Quebec Inc. Method and apparatus for displaying data element axes
US9101358B2 (en) 2012-06-15 2015-08-11 Ethicon Endo-Surgery, Inc. Articulatable surgical instrument comprising a firing drive
US20140001231A1 (en) 2012-06-28 2014-01-02 Ethicon Endo-Surgery, Inc. Firing system lockout arrangements for surgical instruments
US9289256B2 (en) 2012-06-28 2016-03-22 Ethicon Endo-Surgery, Llc Surgical end effectors having angled tissue-contacting surfaces
US9700310B2 (en) 2013-08-23 2017-07-11 Ethicon Llc Firing member retraction devices for powered surgical instruments
USD712426S1 (en) 2012-09-13 2014-09-02 Sony Computer Enertainment, Inc. Display screen or portion thereof with animated graphical user interface for a portable information terminal
USD736807S1 (en) * 2012-11-26 2015-08-18 Lg Electronics Inc. Display of a multimedia terminal with transitional graphic image
USD736236S1 (en) * 2012-11-26 2015-08-11 Lg Electronics Inc. Display of a multimedia terminal with transitional graphic image
USD736237S1 (en) * 2012-11-26 2015-08-11 Lg Electronics Inc. Display of a multimedia terminal with transitional graphic image
USD743980S1 (en) * 2012-11-30 2015-11-24 Axell Corporation Display screen with graphical user interface
USD752104S1 (en) * 2012-11-30 2016-03-22 Lg Electronics Inc. Multimedia terminal having transitional graphic user interface
USD754687S1 (en) * 2012-11-30 2016-04-26 Axell Corporation Display screen with graphical user interface
USD752105S1 (en) * 2012-11-30 2016-03-22 Lg Electronics Inc. Multimedia terminal having transitional graphical user interface
USD744509S1 (en) * 2012-11-30 2015-12-01 Axell Corporation Display screen with graphical user interface
USD741895S1 (en) * 2012-12-18 2015-10-27 2236008 Ontario Inc. Display screen or portion thereof with graphical user interface
US9345960B2 (en) * 2012-12-21 2016-05-24 Igt Gaming system and method providing an enhanced winning hand display feature
USD745028S1 (en) * 2013-01-04 2015-12-08 Samsung Electronics Co., Ltd. Display screen or portion thereof with animated graphical user interface
USD742400S1 (en) * 2013-01-04 2015-11-03 Samsung Electronics Co., Ltd. Display screen or portion thereof with animated graphical user interface
USD742399S1 (en) * 2013-01-04 2015-11-03 Samsung Electronics Co., Ltd. Display screen or portion thereof with animated graphical user interface
USD745543S1 (en) * 2013-02-22 2015-12-15 Samsung Electronics Co., Ltd. Display screen with animated user interface
USD745024S1 (en) * 2013-02-22 2015-12-08 Samsung Electronics Co., Ltd. Display screen or a portion thereof with graphic user interface
TWD165571S (en) * 2013-02-22 2015-01-21 三星電子股份有限公司 Graphic user interface for a display screen or a portion thereof
AU349903S (en) * 2013-02-23 2013-07-26 Samsung Electronics Co Ltd Display screen for an electronic device
USD737835S1 (en) * 2013-02-23 2015-09-01 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD736809S1 (en) * 2013-02-23 2015-08-18 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
AU349900S (en) * 2013-02-23 2013-07-26 Samsung Electronics Co Ltd Display screen for an electronic device
USD737298S1 (en) * 2013-02-23 2015-08-25 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD737295S1 (en) * 2013-02-23 2015-08-25 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
AP00554S1 (en) * 2013-02-23 2014-04-11 Samsung Electronics Co Ltd Display screen or portion thereof with animated graphical user interface
USD737297S1 (en) * 2013-02-23 2015-08-25 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
AU349902S (en) * 2013-02-23 2013-07-26 Samsung Electronics Co Ltd Display screen for an electronic device
USD737296S1 (en) * 2013-02-23 2015-08-25 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
AU349939S (en) * 2013-02-23 2013-07-29 Samsung Electronics Co Ltd Display screen for an electronic device
USD740306S1 (en) * 2013-03-14 2015-10-06 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
BR112015026109B1 (en) 2013-04-16 2022-02-22 Ethicon Endo-Surgery, Inc surgical instrument
USD749608S1 (en) * 2013-04-24 2016-02-16 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD755212S1 (en) * 2013-04-24 2016-05-03 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD744521S1 (en) * 2013-05-10 2015-12-01 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD751097S1 (en) 2013-05-14 2016-03-08 Google Inc. Display screen with graphical user interface
AU353202S (en) * 2013-06-05 2014-01-08 Samsung Electronics Co Ltd Display screen with graphical user interface
USD755815S1 (en) * 2013-06-05 2016-05-10 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
AU353081S (en) * 2013-06-05 2013-12-23 Samsung Electronics Co Ltd Display screen with graphical user interface
USD758396S1 (en) * 2013-06-05 2016-06-07 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD753158S1 (en) * 2013-06-06 2016-04-05 Caresource Portion on a display screen with transitional user interface
USD757785S1 (en) * 2013-06-06 2016-05-31 Huawei Technologies Co., Ltd. Display screen with changeable graphical user interface
USD726219S1 (en) 2013-06-09 2015-04-07 Apple Inc. Display screen or portion thereof with animated graphical user interface
USD738394S1 (en) 2013-06-09 2015-09-08 Apple Inc. Display screen or portion thereof with animated graphical user interface
USD741350S1 (en) 2013-06-10 2015-10-20 Apple Inc. Display screen or portion thereof with animated graphical user interface
USD772278S1 (en) 2013-12-18 2016-11-22 Apple Inc. Display screen or portion thereof with animated graphical user interface
USD752636S1 (en) * 2013-12-23 2016-03-29 Samsung Electronics Co., Ltd. Display screen or portion thereof with animated graphical user interface
USD766279S1 (en) * 2013-12-26 2016-09-13 Sony Corporation Display panel or screen with graphical user interface
USD754171S1 (en) * 2013-12-30 2016-04-19 Samsung Electronics Co., Ltd. Display screen or portion thereof with animated graphical user interface
USD755220S1 (en) * 2014-01-03 2016-05-03 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD754153S1 (en) * 2014-01-07 2016-04-19 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD771658S1 (en) * 2014-04-14 2016-11-15 Samsung Electronics Co., Ltd. Display screen or portion thereof with animated graphical user interface
US20150297223A1 (en) 2014-04-16 2015-10-22 Ethicon Endo-Surgery, Inc. Fastener cartridges including extensions having different configurations
JP6636452B2 (en) 2014-04-16 2020-01-29 エシコン エルエルシーEthicon LLC Fastener cartridge including extension having different configurations
BR112016023807B1 (en) 2014-04-16 2022-07-12 Ethicon Endo-Surgery, Llc CARTRIDGE SET OF FASTENERS FOR USE WITH A SURGICAL INSTRUMENT
USD764487S1 (en) 2014-05-30 2016-08-23 Apple Inc. Display screen or portion thereof with graphical user interface
USD769892S1 (en) 2014-05-30 2016-10-25 Apple Inc. Display screen or portion thereof with graphical user interface
USD813242S1 (en) * 2014-05-30 2018-03-20 Maria Francisca Jones Display screen with graphical user interface
USD765113S1 (en) * 2014-07-23 2016-08-30 Asustek Computer Inc. Display screen or portion thereof with transitional graphical user interface
USD761286S1 (en) * 2014-09-02 2016-07-12 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
BR112017004361B1 (en) 2014-09-05 2023-04-11 Ethicon Llc ELECTRONIC SYSTEM FOR A SURGICAL INSTRUMENT
US10111679B2 (en) 2014-09-05 2018-10-30 Ethicon Llc Circuitry and sensors for powered medical device
USD770521S1 (en) * 2014-09-11 2016-11-01 Samsung Electronics Co., Ltd. Display screen or portion thereof with animated graphical user interface
US9924944B2 (en) 2014-10-16 2018-03-27 Ethicon Llc Staple cartridge comprising an adjunct material
US10085748B2 (en) 2014-12-18 2018-10-02 Ethicon Llc Locking arrangements for detachable shaft assemblies with articulatable surgical end effectors
BR112017012996B1 (en) 2014-12-18 2022-11-08 Ethicon Llc SURGICAL INSTRUMENT WITH AN ANvil WHICH IS SELECTIVELY MOVABLE ABOUT AN IMMOVABLE GEOMETRIC AXIS DIFFERENT FROM A STAPLE CARTRIDGE
US10466663B2 (en) * 2015-01-22 2019-11-05 Siemens Industry, Inc. Systems, methods and apparatus for an improved interface to energy management systems
USD801354S1 (en) * 2015-02-12 2017-10-31 Lg Electronics Inc. Display panel with animated graphical user interface
US11154301B2 (en) 2015-02-27 2021-10-26 Cilag Gmbh International Modular stapling assembly
US10213201B2 (en) 2015-03-31 2019-02-26 Ethicon Llc Stapling end effector configured to compensate for an uneven gap between a first jaw and a second jaw
USD765699S1 (en) 2015-06-06 2016-09-06 Apple Inc. Display screen or portion thereof with graphical user interface
US10105139B2 (en) 2015-09-23 2018-10-23 Ethicon Llc Surgical stapler having downstream current-based motor control
US10736633B2 (en) 2015-09-30 2020-08-11 Ethicon Llc Compressible adjunct with looping members
US11890015B2 (en) 2015-09-30 2024-02-06 Cilag Gmbh International Compressible adjunct with crossing spacer fibers
USD796528S1 (en) 2015-11-19 2017-09-05 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
US10292704B2 (en) 2015-12-30 2019-05-21 Ethicon Llc Mechanisms for compensating for battery pack failure in powered surgical instruments
US11213293B2 (en) 2016-02-09 2022-01-04 Cilag Gmbh International Articulatable surgical instruments with single articulation link arrangements
US10448948B2 (en) 2016-02-12 2019-10-22 Ethicon Llc Mechanisms for compensating for drivetrain failure in powered surgical instruments
US20170296173A1 (en) 2016-04-18 2017-10-19 Ethicon Endo-Surgery, Llc Method for operating a surgical instrument
US10310778B2 (en) * 2016-09-14 2019-06-04 Agfa Healthcare N.V. System and methods for printing medical images from an internet browser
USD829743S1 (en) * 2016-10-28 2018-10-02 Spotify Ab Display screen or portion thereof with transitional graphical user interface
JP7010956B2 (en) 2016-12-21 2022-01-26 エシコン エルエルシー How to staple tissue
US10675026B2 (en) 2016-12-21 2020-06-09 Ethicon Llc Methods of stapling tissue
USD846587S1 (en) 2017-06-04 2019-04-23 Apple Inc. Display screen or portion thereof with animated graphical user interface
US10881399B2 (en) 2017-06-20 2021-01-05 Ethicon Llc Techniques for adaptive control of motor velocity of a surgical stapling and cutting instrument
US10307170B2 (en) 2017-06-20 2019-06-04 Ethicon Llc Method for closed loop control of motor velocity of a surgical stapling and cutting instrument
US10779820B2 (en) 2017-06-20 2020-09-22 Ethicon Llc Systems and methods for controlling motor speed according to user input for a surgical instrument
US11058424B2 (en) 2017-06-28 2021-07-13 Cilag Gmbh International Surgical instrument comprising an offset articulation joint
US10932772B2 (en) 2017-06-29 2021-03-02 Ethicon Llc Methods for closed loop velocity control for robotic surgical instrument
USD861704S1 (en) 2017-09-11 2019-10-01 Apple Inc. Electronic device with graphical user interface
US10779826B2 (en) 2017-12-15 2020-09-22 Ethicon Llc Methods of operating surgical end effectors
US10682134B2 (en) 2017-12-21 2020-06-16 Ethicon Llc Continuous use self-propelled stapling instrument
USD906364S1 (en) * 2018-02-13 2020-12-29 Samsung Electronics Co., Ltd. Display screen or portion thereof with transitional graphical user interface
USD877175S1 (en) 2018-06-04 2020-03-03 Apple Inc. Electronic device with graphical user interface
CA186536S (en) * 2018-09-18 2020-09-15 Sony Interactive Entertainment Inc Display screen with transitional graphical user interface
JP1628737S (en) * 2018-09-18 2019-04-08
USD913320S1 (en) * 2018-09-18 2021-03-16 Sony Interactive Entertainment Inc. Display screen or portion thereof with transitional graphical user interface
USD883319S1 (en) 2018-10-29 2020-05-05 Apple Inc. Electronic device with graphical user interface
USD902947S1 (en) * 2019-03-25 2020-11-24 Apple Inc. Electronic device with graphical user interface
US11696761B2 (en) 2019-03-25 2023-07-11 Cilag Gmbh International Firing drive arrangements for surgical systems
US11903581B2 (en) 2019-04-30 2024-02-20 Cilag Gmbh International Methods for stapling tissue using a surgical instrument
USD913324S1 (en) * 2019-05-29 2021-03-16 Apple Inc. Display screen or portion thereof with animated graphical user interface
USD937858S1 (en) 2019-05-31 2021-12-07 Apple Inc. Display screen or portion thereof with graphical user interface
US11771419B2 (en) 2019-06-28 2023-10-03 Cilag Gmbh International Packaging for a replaceable component of a surgical stapling system
US11241235B2 (en) 2019-06-28 2022-02-08 Cilag Gmbh International Method of using multiple RFID chips with a surgical assembly
US11660163B2 (en) 2019-06-28 2023-05-30 Cilag Gmbh International Surgical system with RFID tags for updating motor assembly parameters
US11684434B2 (en) 2019-06-28 2023-06-27 Cilag Gmbh International Surgical RFID assemblies for instrument operational setting control
US11844520B2 (en) 2019-12-19 2023-12-19 Cilag Gmbh International Staple cartridge comprising driver retention members
US11701111B2 (en) 2019-12-19 2023-07-18 Cilag Gmbh International Method for operating a surgical stapling instrument
USD937295S1 (en) 2020-02-03 2021-11-30 Apple Inc. Display screen or portion thereof with graphical user interface
US20220031351A1 (en) 2020-07-28 2022-02-03 Cilag Gmbh International Surgical instruments with differential articulation joint arrangements for accommodating flexible actuators
USD934902S1 (en) * 2020-09-14 2021-11-02 Apple Inc. Display or portion thereof with graphical user interface
US11896217B2 (en) 2020-10-29 2024-02-13 Cilag Gmbh International Surgical instrument comprising an articulation lock
USD1013170S1 (en) 2020-10-29 2024-01-30 Cilag Gmbh International Surgical instrument assembly
US11844518B2 (en) 2020-10-29 2023-12-19 Cilag Gmbh International Method for operating a surgical instrument
US11779330B2 (en) 2020-10-29 2023-10-10 Cilag Gmbh International Surgical instrument comprising a jaw alignment system
US11890010B2 (en) 2020-12-02 2024-02-06 Cllag GmbH International Dual-sided reinforced reload for surgical instruments
US11849943B2 (en) 2020-12-02 2023-12-26 Cilag Gmbh International Surgical instrument with cartridge release mechanisms
US11744581B2 (en) 2020-12-02 2023-09-05 Cilag Gmbh International Powered surgical instruments with multi-phase tissue treatment
US11653920B2 (en) 2020-12-02 2023-05-23 Cilag Gmbh International Powered surgical instruments with communication interfaces through sterile barrier
US11653915B2 (en) 2020-12-02 2023-05-23 Cilag Gmbh International Surgical instruments with sled location detection and adjustment features
US11737751B2 (en) 2020-12-02 2023-08-29 Cilag Gmbh International Devices and methods of managing energy dissipated within sterile barriers of surgical instrument housings
US11701113B2 (en) 2021-02-26 2023-07-18 Cilag Gmbh International Stapling instrument comprising a separate power antenna and a data transfer antenna
US11723657B2 (en) 2021-02-26 2023-08-15 Cilag Gmbh International Adjustable communication based on available bandwidth and power capacity
US11696757B2 (en) 2021-02-26 2023-07-11 Cilag Gmbh International Monitoring of internal systems to detect and track cartridge motion status
US11730473B2 (en) 2021-02-26 2023-08-22 Cilag Gmbh International Monitoring of manufacturing life-cycle
US11925349B2 (en) 2021-02-26 2024-03-12 Cilag Gmbh International Adjustment to transfer parameters to improve available power
US11749877B2 (en) 2021-02-26 2023-09-05 Cilag Gmbh International Stapling instrument comprising a signal antenna
US11744583B2 (en) 2021-02-26 2023-09-05 Cilag Gmbh International Distal communication array to tune frequency of RF systems
US11751869B2 (en) 2021-02-26 2023-09-12 Cilag Gmbh International Monitoring of multiple sensors over time to detect moving characteristics of tissue
US11812964B2 (en) 2021-02-26 2023-11-14 Cilag Gmbh International Staple cartridge comprising a power management circuit
US11793514B2 (en) 2021-02-26 2023-10-24 Cilag Gmbh International Staple cartridge comprising sensor array which may be embedded in cartridge body
US11737749B2 (en) 2021-03-22 2023-08-29 Cilag Gmbh International Surgical stapling instrument comprising a retraction system
US11806011B2 (en) 2021-03-22 2023-11-07 Cilag Gmbh International Stapling instrument comprising tissue compression systems
US11717291B2 (en) 2021-03-22 2023-08-08 Cilag Gmbh International Staple cartridge comprising staples configured to apply different tissue compression
US11759202B2 (en) 2021-03-22 2023-09-19 Cilag Gmbh International Staple cartridge comprising an implantable layer
US11826042B2 (en) 2021-03-22 2023-11-28 Cilag Gmbh International Surgical instrument comprising a firing drive including a selectable leverage mechanism
US11723658B2 (en) 2021-03-22 2023-08-15 Cilag Gmbh International Staple cartridge comprising a firing lockout
US11826012B2 (en) 2021-03-22 2023-11-28 Cilag Gmbh International Stapling instrument comprising a pulsed motor-driven firing rack
US11849945B2 (en) 2021-03-24 2023-12-26 Cilag Gmbh International Rotary-driven surgical stapling assembly comprising eccentrically driven firing member
US11896219B2 (en) 2021-03-24 2024-02-13 Cilag Gmbh International Mating features between drivers and underside of a cartridge deck
US11857183B2 (en) 2021-03-24 2024-01-02 Cilag Gmbh International Stapling assembly components having metal substrates and plastic bodies
US11744603B2 (en) 2021-03-24 2023-09-05 Cilag Gmbh International Multi-axis pivot joints for surgical instruments and methods for manufacturing same
US11832816B2 (en) 2021-03-24 2023-12-05 Cilag Gmbh International Surgical stapling assembly comprising nonplanar staples and planar staples
US11903582B2 (en) 2021-03-24 2024-02-20 Cilag Gmbh International Leveraging surfaces for cartridge installation
US11896218B2 (en) 2021-03-24 2024-02-13 Cilag Gmbh International Method of using a powered stapling device
US11849944B2 (en) 2021-03-24 2023-12-26 Cilag Gmbh International Drivers for fastener cartridge assemblies having rotary drive screws
US11786239B2 (en) 2021-03-24 2023-10-17 Cilag Gmbh International Surgical instrument articulation joint arrangements comprising multiple moving linkage features
US11786243B2 (en) 2021-03-24 2023-10-17 Cilag Gmbh International Firing members having flexible portions for adapting to a load during a surgical firing stroke
US11793516B2 (en) 2021-03-24 2023-10-24 Cilag Gmbh International Surgical staple cartridge comprising longitudinal support beam
US20220378424A1 (en) 2021-05-28 2022-12-01 Cilag Gmbh International Stapling instrument comprising a firing lockout

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5754809A (en) * 1995-12-12 1998-05-19 Dell U.S.A., L.P. Perspective windowing technique for computer graphical user interface
US20060080342A1 (en) * 2004-10-07 2006-04-13 Goro Takaki Contents management system, contents management method, and computer program
US20060268100A1 (en) * 2005-05-27 2006-11-30 Minna Karukka Mobile communications terminal and method therefore
US20070070066A1 (en) * 2005-09-13 2007-03-29 Bakhash E E System and method for providing three-dimensional graphical user interface
US20070226645A1 (en) * 2005-05-27 2007-09-27 Nokia Corporation Mobile Communication Terminal and Method Therefore
US20080062141A1 (en) * 2006-09-11 2008-03-13 Imran Chandhri Media Player with Imaged Based Browsing
US20090300473A1 (en) * 2008-05-31 2009-12-03 Randy Adams Systems and Methods for Displaying Albums Having Links to Documents

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6573907B1 (en) * 1997-07-03 2003-06-03 Obvious Technology Network distribution and management of interactive video and multi-media containers
JP3504467B2 (en) * 1997-08-12 2004-03-08 松下電器産業株式会社 Multi-window display device
US6577330B1 (en) * 1997-08-12 2003-06-10 Matsushita Electric Industrial Co., Ltd. Window display device with a three-dimensional orientation of windows
JP3123501B2 (en) * 1998-03-16 2001-01-15 日本電気株式会社 Space viewpoint controller
US6938218B1 (en) * 2000-04-28 2005-08-30 James Nolen Method and apparatus for three dimensional internet and computer file interface
ATE531009T1 (en) * 2001-05-22 2011-11-15 Yoav Shefi METHOD AND SYSTEM FOR VISUAL CONTENT DISPLAY IN A VIRTUAL THREE-DIMENSIONAL SPACE
US20050204306A1 (en) * 2003-09-15 2005-09-15 Hideya Kawahara Enhancements for manipulating two-dimensional windows within a three-dimensional display model
JP4341408B2 (en) * 2004-01-15 2009-10-07 パナソニック株式会社 Image display method and apparatus
KR101002807B1 (en) * 2005-02-23 2010-12-21 삼성전자주식회사 Apparatus and method for controlling menu navigation in a terminal capable of displaying menu screen
JP4982065B2 (en) * 2005-09-26 2012-07-25 株式会社東芝 Video content display system, video content display method and program thereof
US9001047B2 (en) * 2007-01-07 2015-04-07 Apple Inc. Modal change based on orientation of a portable multifunction device
JP4883791B2 (en) * 2007-04-04 2012-02-22 キヤノン株式会社 Information processing apparatus and display method
US20090158214A1 (en) * 2007-12-13 2009-06-18 Nokia Corporation System, Method, Apparatus and Computer Program Product for Providing Presentation of Content Items of a Media Collection

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5754809A (en) * 1995-12-12 1998-05-19 Dell U.S.A., L.P. Perspective windowing technique for computer graphical user interface
US20060080342A1 (en) * 2004-10-07 2006-04-13 Goro Takaki Contents management system, contents management method, and computer program
US20060268100A1 (en) * 2005-05-27 2006-11-30 Minna Karukka Mobile communications terminal and method therefore
US20070226645A1 (en) * 2005-05-27 2007-09-27 Nokia Corporation Mobile Communication Terminal and Method Therefore
US20070070066A1 (en) * 2005-09-13 2007-03-29 Bakhash E E System and method for providing three-dimensional graphical user interface
US20080062141A1 (en) * 2006-09-11 2008-03-13 Imran Chandhri Media Player with Imaged Based Browsing
US20090300473A1 (en) * 2008-05-31 2009-12-03 Randy Adams Systems and Methods for Displaying Albums Having Links to Documents

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD734763S1 (en) * 2012-01-09 2015-07-21 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD731526S1 (en) * 2012-04-17 2015-06-09 Hon Hai Precision Industry Co., Ltd. Display screen with graphical user interface of an electronic program guide
USD733720S1 (en) * 2012-07-25 2015-07-07 Johnson Controls Technology Company Display screen with graphical user interface
USD742901S1 (en) * 2012-08-07 2015-11-10 Samsung Electronics Co., Ltd. TV display screen displaying GUI
USD749605S1 (en) * 2012-08-07 2016-02-16 Samsung Electronics Co., Ltd. TV display screen displaying GUI
WO2014059337A1 (en) * 2012-10-11 2014-04-17 Yahoo! Inc. Visual presentation of customized content
USD737314S1 (en) * 2012-10-19 2015-08-25 Google Inc. Portion of a display panel with an animated computer icon

Also Published As

Publication number Publication date
WO2010148167A2 (en) 2010-12-23
US8140990B2 (en) 2012-03-20
US20100325568A1 (en) 2010-12-23
CA2765956A1 (en) 2010-12-23
EP2443542A4 (en) 2014-07-23
AU2010262875B2 (en) 2014-01-30
AU2010262875A1 (en) 2012-02-02
WO2010148167A3 (en) 2011-04-21
EP2443542A2 (en) 2012-04-25
CA2765956C (en) 2015-10-06

Similar Documents

Publication Publication Date Title
US8140990B2 (en) User interface visualizations
US11281843B2 (en) Method of displaying axis of user-selectable elements over years, months, and days
JP5990180B2 (en) Browsing related image search result sets
Büring et al. User interaction with scatterplots on small screens-a comparative evaluation of geometric-semantic zoom and fisheye distortion
US9495454B2 (en) User apparatus, system and method for dynamically reclassifying and retrieving target information object
JP5270063B2 (en) Wave lens system and method for search results
JP4799414B2 (en) System and method for navigating content within an item
US20060288280A1 (en) User-defined changing of page representations
US20140317104A1 (en) Computer-Implemented System And Method For Visual Search Construction, Document Triage, and Coverage Tracking
US20130179777A1 (en) Method of reducing computing time and apparatus thereof
US20060193538A1 (en) Graphical user interface system and process for navigating a set of images
US20080028308A1 (en) Visual display method for sequential data
US10180773B2 (en) Method of displaying axes in an axis-based interface
KR20060069497A (en) Improved presentation of large objects on small displays
WO2019165055A1 (en) Browser for mixed reality systems
US20200301555A1 (en) Method of transversally aligning information elements along axes
US20070136348A1 (en) Screen-wise presentation of search results
JP4205935B2 (en) Content search device, program, and recording medium
US20190027119A1 (en) Navigation by changing screen orientation
US20130125040A1 (en) Interstitial navigation panel for navigating data representing content and applications
JP2007233752A (en) Retrieval device, computer program and recording medium
AU2014202325A1 (en) User interface visualizations
Liu Learning users' interest to assist image browsing and searching

Legal Events

Date Code Title Description
AS Assignment

Owner name: GOOGLE INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PEDERSEN, ELIN R.;HONG, PETER;REEL/FRAME:027022/0506

Effective date: 20100615

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: GOOGLE LLC, CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:GOOGLE INC.;REEL/FRAME:044142/0357

Effective date: 20170929