US20090094556A1 - User defined scenarios in a three dimensional geo-spatial system - Google Patents

User defined scenarios in a three dimensional geo-spatial system Download PDF

Info

Publication number
US20090094556A1
US20090094556A1 US12/245,562 US24556208A US2009094556A1 US 20090094556 A1 US20090094556 A1 US 20090094556A1 US 24556208 A US24556208 A US 24556208A US 2009094556 A1 US2009094556 A1 US 2009094556A1
Authority
US
United States
Prior art keywords
user
plug
ins
scenario
receiving input
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/245,562
Other versions
US8914750B2 (en
Inventor
Richard D. Howard
Jarrod Lopiccolo
Grant Anderson
Roy Lindauer
Thomas Helman
Matthew Larsen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Autodesk Inc
Original Assignee
Autodesk Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Autodesk Inc filed Critical Autodesk Inc
Priority to US12/245,562 priority Critical patent/US8914750B2/en
Assigned to AUTODESK, INC. reassignment AUTODESK, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HOWARD, RICHARD D., LARSEN, MATTHEW, LINDAUER, ROY, HELMAN, THOMAS, ANDERSON, GRANT, LOPICCOLO, JARROD
Publication of US20090094556A1 publication Critical patent/US20090094556A1/en
Application granted granted Critical
Publication of US8914750B2 publication Critical patent/US8914750B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics

Definitions

  • the present invention relates generally to three-dimensional (3D) applications, and in particular, to a method, apparatus, and article of manufacture for a framework for aggregating design models and geographic information system (GIS) data within an immersive 3D geospatial environment (i.e., a digital city). Further, the invention provides the ability for a user to define a scenario in a 3D geo-spatial system.
  • 3D three-dimensional
  • GIS geographic information system
  • GIS Geographic information systems
  • GIS systems are commonly used and generally refer to an information system that integrates hardware, software and data in order to capture, store, analyze, manage, and display/present data that is spatially referenced (i.e., linked to location or is geographically referenced).
  • GIS systems commonly provide a two dimensional (2D) visualization of data in the form of maps, globes, reports, and charts.
  • 2D two dimensional
  • prior art GIS systems fail to provide the capability to merge GIS data with additional information in order to visualize, analyze, and simulate trends, phenomena, states, and events.
  • three-dimensional (3D) systems also fail to provide such capabilities.
  • prior art systems fail to provide the ability for a user to easily establish a defined scenario using a set of plug-ins and settings for such plug-ins. Accordingly, the user has no mechanism to easily compare, contrast, and/or simulate a desired scenario and is respective visualization in a three-dimensional/four-dimensional manner.
  • embodiments of the invention allow users to define “what-if” scenarios using a type of visual bookmarking.
  • Each scenario captures specific model and linked data overrides supplied by the user, a set of plug-ins and their settings, and visualization parameters and traits.
  • FIG. 1 is an exemplary hardware and software environment used to implement one or more embodiments of the invention
  • FIG. 2 schematically illustrates a further hardware and software environment in accordance with one or more embodiments of the invention
  • FIG. 3 is a block diagram that illustrates the components of the graphics program of FIG. 2 in accordance with one or more embodiments of the invention
  • FIG. 4 illustrates an example panel containing multiple plug-ins in accordance with one or more embodiments of the invention
  • FIG. 5 is an enlargement of a panel of FIG. 4 illustrating several plug-ins available to analyze the currently selected object in accordance with one or more embodiments of the invention
  • FIG. 6 illustrates various bookmarked scenarios that are selectable by a user in accordance with one or more embodiments of the invention.
  • FIG. 7 illustrates the logical flow for storing user defined scenarios in a three-dimensional system in accordance with one or more embodiments of the invention.
  • One or more embodiments of the invention provide an application and development framework for aggregating design models and GIS data within an immersive 3D geospatial environment for the purposes of visualizing, analyzing, and simulating trends, phenomena, state, and events in ways that are not possible within conventional 2D GIS or existing 3D application software.
  • embodiments of the invention provide the ability to view, analyze, simulate trends, phenomena, states, and events in a digital city.
  • 3D Geospatial Environment containing both simplified and fully textured rendition based on high resolution lidar and ortho-photography for content such as Digital Terrain Models, Streets and Roadways, Water Features, Railways, Buildings, Utility Infrastructure, and Street Furniture;
  • Real-time 3D rendering and animation including transparency, reflections, lights, shadows, and atmospheric effects
  • a plug-in architecture for analysis and simulation modules A plug-in architecture for analysis and simulation modules
  • FIG. 1 is an exemplary hardware and software environment used to implement one or more embodiments of the invention.
  • Embodiments of the invention are typically implemented using a computer 100 , which generally includes, inter alia, a display device 102 , data storage devices 104 , cursor control devices 106 , and other devices.
  • a computer 100 which generally includes, inter alia, a display device 102 , data storage devices 104 , cursor control devices 106 , and other devices.
  • a display device 102 generally includes, inter alia, a display device 102 , data storage devices 104 , cursor control devices 106 , and other devices.
  • cursor control devices 106 Those skilled in the art will recognize that any combination of the above components, or any number of different components, peripherals, and other devices, may be used with the computer 100 .
  • One or more embodiments of the invention are implemented by a computer-implemented graphics program 108 , wherein the graphics program 108 is represented by a window displayed on the display device 102 .
  • the graphics program 108 comprises logic and/or data embodied in or readable from a device, media, carrier, or signal, e.g., one or more fixed and/or removable data storage devices 104 connected directly or indirectly to the computer 100 , one or more remote devices coupled to the computer 100 via a data communications device, etc.
  • instructions implementing the graphics program 108 are tangibly embodied in a computer-readable medium, e.g., data storage device 104 , which could include one or more fixed or removable data storage devices, such as a zip drive, floppy disc drive, hard drive, CD-ROM drive, DVD drive, tape drive, etc.
  • the graphics program 108 is comprised of instructions which, when read and executed by the computer 100 , causes the computer 100 to perform the steps necessary to implement and/or use the present invention.
  • Graphics program 108 and/or operating instructions may also be tangibly embodied in a memory and/or data communications devices of computer 100 , thereby making a computer program product or article of manufacture according to the invention.
  • the terms “article of manufacture” and “computer program product” as used herein are intended to encompass a computer program accessible from any computer readable device or media.
  • FIG. 2 schematically illustrates a further hardware and software environment in accordance with one or more embodiments of the invention, and more particularly, illustrates a typical distributed computer system 200 using a network 202 to connect client computers 100 to server computers 204 .
  • a typical combination of resources may include a network 202 comprising the Internet, LANs (local area networks), WANs (wide area networks), SNA (systems network architecture) networks, or the like, clients 100 that are personal computers or workstations (e.g., as described above), and servers 204 that are personal computers, workstations, minicomputers, or mainframes. Additionally, both client 100 and server 204 may receive input (e.g., cursor location input) and display a cursor in response to an input device such as cursor control device 106 .
  • input e.g., cursor location input
  • a network 202 such as the Internet connects clients 100 to server computers 204 . Additionally, network 202 may utilize radio frequency (RF) to connect and provide the communication between clients 100 and servers 204 .
  • Clients 100 may execute a client application or Web browser 108 (e.g., as described above) and communicate with server computers 204 executing Web servers 206 .
  • the software executing on clients 100 may be downloaded from server computer 204 to client computers 100 and installed as a plug in or ActiveX control of a Web browser. Accordingly, clients 100 may utilize ActiveX components/component object model (COM) or distributed COM (DCOM) components to provide a user interface on a display of client 100 .
  • COM component object model
  • DCOM distributed COM
  • Web server 206 may host an Active Server Page (ASP) or Internet Server Application Programming Interface (ISAPI) application 208 , which may be executing scripts.
  • the scripts invoke objects that execute business logic (referred to as business objects).
  • the business objects then manipulate data in database 212 through a database management system (DBMS) 210 .
  • database 212 may be part of or connected directly to client 100 instead of communicating/obtaining the information from database 212 across network 202 .
  • DBMS database management system
  • DBMS database management system
  • database 212 may be part of or connected directly to client 100 instead of communicating/obtaining the information from database 212 across network 202 .
  • COM component object model
  • the scripts executing on web server 206 (and/or application 208 ) invoke COM objects that implement the business logic.
  • server 204 may utilize Microsoft's Transaction Server (MTS)TM to access required data stored in database 212 via an interface such as ADO (Active Data Objects), OLE DB (Object Linking and Embedding DataBase), or ODBC (Open DataBase Connectivity).
  • MTS Transaction Server
  • ADO Active Data Objects
  • OLE DB Object Linking and Embedding DataBase
  • ODBC Open DataBase Connectivity
  • FIG. 3 is a block diagram that illustrates the components of the graphics program 108 in accordance with one or more embodiments of the invention.
  • There are three main components to the graphics program 108 including: a Graphical User Interface (GUI) 300 , an Image Engine (IME) 302 , and a DataBase (DB) 212 for storing objects in Drawing (DWG) files 304 .
  • GUI Graphical User Interface
  • IME Image Engine
  • DB DataBase
  • DWG Drawing
  • the Graphical User Interface 300 displays information to the operator and provides the functionality for the operator's interaction with the graphics program 108 .
  • the Image Engine 302 processes the DWG files 304 and delivers the resulting graphics to the monitor 102 for display.
  • the Image Engine 302 provides a complete application programming interface (API) that allows other computer programs to interface to the graphics program 108 as needed.
  • API application programming interface
  • the Database 212 is comprised of two separate types of databases: (1) a 3D database 306 known as the “3D world space” that stores 3D information; and (2) one or more 2D databases 308 known as the “2D view ports” that stores 2D information derived from the 3D information.
  • a 3D database 306 known as the “3D world space” that stores 3D information
  • 2D databases 308 known as the “2D view ports” that stores 2D information derived from the 3D information.
  • the graphics program 108 may consist of a variety of different type of applications including GIS, CAD (computer aided design), solid modeling systems, animation products, rendering systems, etc. Embodiments of the invention are not limited to those software applications explicitly described herein but by the limitations set forth in the claims.
  • Embodiments of the invention provide an architecture and method of using plug-in modules for user defined 3D/4D visualization, analysis, and simulation.
  • Users/clients 100 are provided with the ability to search for, download, and immediately use plug-ins from an online catalog offered by one or more servers 204 .
  • These plug-ins can be supplied by software developers and enable users 100 to visualize, analyze, and simulate trends, phenomena, state, and events via software application 108 .
  • Plug-in environment allows many different types of applications 108 to load specific data types and allows interaction between those data types. Most “traditional” plug-in environments do not allow this. Plug-ins for different data types may include textures, 3D models, 2D models, particle systems, and geo-based behavior systems (behaviors based on specific geo information).
  • plug-in architecture allows user to load models seamlessly without having to go through the lengthy steps of importing files. Accordingly, a full 3D environment and real-time rendering capability of embodiments of the invention combined with the analytic capabilities supplied by a plug-in developer allows user to visualize their data in ways not formerly possible.
  • Plug-ins are loaded and associated with specific models and scenarios within the digital city of embodiments of the invention.
  • a user can override model and linked data values, enter plug-in parameters, and control the visualization of results.
  • Plug-ins have the ability to automatically add themselves or make calculations based on the data of a particular file making up a digital city environment.
  • an earthquake preparedness drill particle system could be suggested and/or instantiated.
  • Another example would be a recommended parking configuration based on the number of roads, or total lanes adjacent to a particular structure.
  • a road configuration could be suggested based on the parking structures and parking places in a given city block.
  • FIG. 4 illustrates an example panel containing multiple plug-ins. As illustrated, there is a location plug-in, a utilities plug-in, and a greenhouse emissions plug-in. Each plug-in can interact with data established in other plug-ins and use such data in conducting calculations. Panel 400 of FIG. 4 illustrates the resulting display when three plug-ins are utilized together to analyze greenhouse gas emissions based on building occupancy and utility consumption for a selected building in accordance with one or more embodiments of the invention. Panel 400 allows the user to set various options in the various plug-ins for analyzing the green house emissions of building A 402 .
  • FIG. 5 is an enlargement of panel 400 of FIG. 4 illustrating several plug-ins available to analyze the currently selected object (i.e., Building A) in accordance with one or more embodiments of the invention.
  • the location plug-in 502 contains the display and overrides to the geospatial location and position information for the building.
  • the user would have the option of specifying where Building A is located.
  • the user can specify the latitude, longitude, and elevation.
  • the user can enter an address (e.g., number, street, city, state, and/or zip, etc.).
  • entering information in one field of the location panel 502 may automatically retrieve and output information in another field (e.g., entry of an address may automatically fill in the corresponding latitude, longitude, and elevation.
  • the object e.g., Building A 402
  • the resulting visualization from the location plug-in 502 provides a visual representation of Building A 402 in a 3D environment.
  • the occupancy plug-in 504 allows the user to establish the current number of occupants 504 A to be displayed and overrides 504 B (i.e., the maximum number of occupants) to the number of occupants for Building A 402 .
  • the visualization of the occupancy plug-in 504 would provide for multiple dots indicative of persons in Building A 402 (or distributed throughout building A 402 ).
  • the utilities plug-in 506 contains the display and overrides to the utility usage (i.e., water and power) for Building A 402 .
  • the visualization of the utilities plug-in results in line or effect simulating power and water usage in Building A 402 .
  • the greenhouse emissions plug-in 508 contains the display and overrides to the LEED (Leadership in Energy and Environmental Design green building rating system) emissions impact score for the Building A 402 .
  • the values on greenhouse emissions panel 508 are automatically (i.e., without additional user input) updated based on the occupancy (panel 504 ) and utility consumption (panel 506 ) for a selected building.
  • the user may have the options of setting the greenhouse emissions values in panel 508 and the system can automatically adjust either the occupancy values 504 or utility values 506 that are necessary to reach the greenhouse emissions values set forth in panel 508 .
  • the user can determine which values/panels ( 502 , 504 , 506 , and 508 ) are locked and which can be adjusted depending on the values specified in the other panels.
  • the visualization of greenhouse emissions plug-in 508 would result in a halo type effect displayed around and emanating from Building A 402 .
  • the 3D simulation illustrated in FIG. 4 may change its coloring or areas displayed based on the visualizations resulting from plug-ins 402 - 508 .
  • Check boxes 502 C- 508 C may be utilized to determine whether a resulting visualization for the respective plug-in 502 - 508 is displayed in the 3D rendering of FIG. 4 .
  • the user may check boxes (e.g., check boxes 502 C, 504 C, 506 C, and 508 C) within panel 400 to determine which plug-ins will be reflected in the display of building A 402 of FIG. 4 . This allows users to visualize and analyze their data in new and powerful ways.
  • plug-ins to create animations that simulate results over time (4D).
  • plug-ins can be used to simulate human behavior in the 3D environment. Given some human interaction and a stimulus in that environment, the plug-in architecture allows a user to predict and visualize certain human behaviors. The architecture also allows the user to visualize different temporal simulations like the sun and moon, weather patterns and phenomena such as tornadoes and snowfall (see detailed examples below).
  • One or more embodiments of the invention all the user to define scenarios that incorporate specific model and linked data overrides, plug-ins and their settings, and visualization traits.
  • a group of settings are stored into a type of visual “bookmark” that allows the user to define specific “what-if” scenarios.
  • Each scenario or “bookmark” captures specific model and linked data overrides supplied by the user, a set of plug-ins and their settings, and visualization parameters and traits.
  • bookmarking scenarios and sub-scenarios with different settings the user can quickly compare and analyze their information and make informed decisions. This essentially allows a user to save certain data sets, apply them to scenes ⁇ environments, geoviews>, recall them and compare and contrast.
  • the users were required to modify a file, save it with a certain criteria, render it and repeat the process for each different scenario and comparing the final renderings.
  • the ability to store the various settings into a bookmark is faster and interactive so the user is not required to save files using different settings.
  • FIG. 6 illustrates various bookmarked scenarios that are selectable by a user in accordance with one or more embodiments of the invention.
  • the user first establishes all of the desired settings by selecting a particular data set, plug-ins and their settings, properties, data overrides, visualization traits, etc. in dialog box 602 .
  • Such values may be entered directly or can be linked by establishing a link between a property and an external file (e.g., a spreadsheet that contains values).
  • the user can select the scenario bookmark 604 in panel 602 which allows the user to select a set of predefined settings.
  • the desired properties for a bookmark have been established (i.e., in dialog box/panel 602 )
  • the user can opt to create a bookmark to associate all of the settings with a bookmark, placeholder, or thumbnail for those settings using dialog box 606 .
  • the user may be presented with a group of selectable icons or menu options representative of the various bookmarks that have been established.
  • icons 608 , 610 , 612 , and 614 are representative of various bookmarked scenarios that have been established by a user.
  • each scenario represented by bookmarked icons 608 - 614 provides a selection of one or more plug-ins, and properties/settings that permit the user to define a particular visualization in a 3D/4D environment.
  • bookmarked scenarios can be viewed as a way of storing both a set of data (a specific set of models that have been loaded into a server) into a name, a set, with a series of plug-ins and potentially some overriding information for those plug-ins.
  • FIG. 7 illustrates the logical flow for storing user defined scenarios in a three-dimensional system in accordance with one or more embodiments of the invention.
  • a three-dimensional (3D) view of a real world scene is displayed on a display device using a 3D graphics application.
  • one or more plug-ins are installed into the 3D graphics application.
  • the plug-ins may be viewed as an application that enables a user to visualize, analyze, and simulate a particular user-defined scenario in the 3D view.
  • step 704 input is received from a user selecting a subset of the one or more plug-ins.
  • step 706 input is received from a user defining one or more settings for the subset of plug-ins.
  • settings may include particular calculations or values that are specified.
  • Step 708 input is received from the user defining a visualization trait for each plug-in in the subset of plug-ins.
  • the user specifies whether the visualization for the plug-in should be displayed in the 3D view.
  • Steps 706 and 708 may further include receiving additional input from the user defining a linked data override.
  • a linked data override may consist of a link to an external file that contains values for the one or more settings.
  • step 710 input is received from the user associating an identification of the selected subset of plug-ins, the one or more settings, and the visualization trait with a scenario bookmark. If a linked data override is specified as part of steps 706 and 708 , such a linked data override is also including the association of the information with the scenario bookmark at step 710 .
  • Step 712 may further include the displaying of multiple scenario bookmarks on a display device that the user can dynamically select from.
  • a scenario bookmark(s) may be displayed in the form of a thumbnail icon.
  • multiple thumbnails may be displayed (e.g., as illustrated in FIG. 6 ), and the user can elect to quickly, dynamically, and easily view a particular scenario that the user (or another user) has defined.
  • Such a capability allows the user to easily compare and contrast different scenarios as desired.
  • any type of computer such as a mainframe, minicomputer, or personal computer, or computer configuration, such as a timesharing mainframe, local area network, or standalone personal computer, could be used with the present invention.

Abstract

A method, apparatus, and article of manufacture provide the ability to store user defined scenarios in a three-dimensional system. A 3D view of a real world scene is displayed, using a three-dimensional (3D) graphics application. Plug-ins are installed into the 3D graphics application. A user selects a subset of the plug-ins, defines settings for the subset of plug-ins, and defines a visualization trait for each plug-in in the subset. The user associates an identification of the selected subset, the settings, and the visualization trait with a scenario bookmark that is saved. The bookmark can be selected by a user to display a visualization of a scenario based on the selected subset, settings, and visualization trait.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit under 35 U.S.C. Section 119(e) of the following co-pending and commonly-assigned U.S. provisional patent application(s), which is/are incorporated by reference herein:
  • Provisional Application Ser. No. 60/997,868, filed Oct. 5, 2007, by RICHARD D. HOWARD, JARROD LOPICCOLO, GRANT ANDERSON, ROY LINDAUER, THOMAS HELMAN, and MATTHEW LARSEN, entitled “FRAMEWORK FOR AGGREGATING DESIGN MODELS AND GIS DATA IN A GEOSPATIAL ENVIRONMENT,” attorneys' docket number 30566.420-US-P1
  • This application is related to the following co-pending and commonly-assigned patent application, which application is incorporated by reference herein:
  • U.S. patent application Ser. No. __/______, entitled “SUN-SHADOW SIMULATION IN A GEOSPATIAL SYSTEM”, by Richard D. Howard, Attorney Docket No. 30566.442-US-U1, filed on the same date herewith; and
  • U.S. patent application Ser. No. __/______, entitled “VIEWPORT OVERLAYS TO EXPOSE ALTERNATE DATA REPRESENTATIONS”, by Richard D. Howard, Attorney Docket No. 30566.443-US-U1, filed on the same date herewith.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention.
  • The present invention relates generally to three-dimensional (3D) applications, and in particular, to a method, apparatus, and article of manufacture for a framework for aggregating design models and geographic information system (GIS) data within an immersive 3D geospatial environment (i.e., a digital city). Further, the invention provides the ability for a user to define a scenario in a 3D geo-spatial system.
  • 2. Description of the Related Art.
  • Geographic information systems (GIS) are commonly used and generally refer to an information system that integrates hardware, software and data in order to capture, store, analyze, manage, and display/present data that is spatially referenced (i.e., linked to location or is geographically referenced). GIS systems commonly provide a two dimensional (2D) visualization of data in the form of maps, globes, reports, and charts. However, prior art GIS systems fail to provide the capability to merge GIS data with additional information in order to visualize, analyze, and simulate trends, phenomena, states, and events. Further, three-dimensional (3D) systems also fail to provide such capabilities.
  • In addition, prior art systems fail to provide the ability for a user to easily establish a defined scenario using a set of plug-ins and settings for such plug-ins. Accordingly, the user has no mechanism to easily compare, contrast, and/or simulate a desired scenario and is respective visualization in a three-dimensional/four-dimensional manner.
  • SUMMARY OF THE INVENTION
  • To overcome the problems of the prior art, embodiments of the invention allow users to define “what-if” scenarios using a type of visual bookmarking. Each scenario captures specific model and linked data overrides supplied by the user, a set of plug-ins and their settings, and visualization parameters and traits.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Referring now to the drawings in which like reference numbers represent corresponding parts throughout:
  • FIG. 1 is an exemplary hardware and software environment used to implement one or more embodiments of the invention;
  • FIG. 2 schematically illustrates a further hardware and software environment in accordance with one or more embodiments of the invention;
  • FIG. 3 is a block diagram that illustrates the components of the graphics program of FIG. 2 in accordance with one or more embodiments of the invention;
  • FIG. 4 illustrates an example panel containing multiple plug-ins in accordance with one or more embodiments of the invention;
  • FIG. 5 is an enlargement of a panel of FIG. 4 illustrating several plug-ins available to analyze the currently selected object in accordance with one or more embodiments of the invention;
  • FIG. 6 illustrates various bookmarked scenarios that are selectable by a user in accordance with one or more embodiments of the invention; and
  • FIG. 7 illustrates the logical flow for storing user defined scenarios in a three-dimensional system in accordance with one or more embodiments of the invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • In the following description, reference is made to the accompanying drawings which form a part hereof, and which is shown, by way of illustration, several embodiments of the present invention. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
  • Overview
  • One or more embodiments of the invention provide an application and development framework for aggregating design models and GIS data within an immersive 3D geospatial environment for the purposes of visualizing, analyzing, and simulating trends, phenomena, state, and events in ways that are not possible within conventional 2D GIS or existing 3D application software. In other words, embodiments of the invention provide the ability to view, analyze, simulate trends, phenomena, states, and events in a digital city.
  • The benefits of the embodiments of the invention include:
  • 3D Geospatial Environment containing both simplified and fully textured rendition based on high resolution lidar and ortho-photography for content such as Digital Terrain Models, Streets and Roadways, Water Features, Railways, Buildings, Utility Infrastructure, and Street Furniture;
  • Importation, storage, and data mapping of full 3D design models from various software (e.g., software available from the assignee of the present invention including AutoCAD™, Map3D™, Revit™, Architecture™, Civil3D™, and Inventor™, as well as support for GIS formats via Autodesk™ Feature Data Objects (FDO)™ technology);
  • Real-time 3D rendering and animation including transparency, reflections, lights, shadows, and atmospheric effects;
  • Smooth motion control and 6-axis navigation;
  • Object visibility, stylization, and transparency for all content;
  • Linking to tabular information and ODBC data sources;
  • Ability to apply local override of any model, data, or visualization attribute or setting;
  • A plug-in architecture for analysis and simulation modules;
  • An online catalog that provides search, download, and immediate use of models, data, and plug-ins;
  • “What If” scenario creation using a combination of models, data, plug-ins, and overrides;
  • Tabular reports and charting of data values; and
  • Publishing of specific scenarios for viewing on the web.
  • Hardware and Software Environment
  • FIG. 1 is an exemplary hardware and software environment used to implement one or more embodiments of the invention. Embodiments of the invention are typically implemented using a computer 100, which generally includes, inter alia, a display device 102, data storage devices 104, cursor control devices 106, and other devices. Those skilled in the art will recognize that any combination of the above components, or any number of different components, peripherals, and other devices, may be used with the computer 100.
  • One or more embodiments of the invention are implemented by a computer-implemented graphics program 108, wherein the graphics program 108 is represented by a window displayed on the display device 102. Generally, the graphics program 108 comprises logic and/or data embodied in or readable from a device, media, carrier, or signal, e.g., one or more fixed and/or removable data storage devices 104 connected directly or indirectly to the computer 100, one or more remote devices coupled to the computer 100 via a data communications device, etc.
  • In one or more embodiments, instructions implementing the graphics program 108 are tangibly embodied in a computer-readable medium, e.g., data storage device 104, which could include one or more fixed or removable data storage devices, such as a zip drive, floppy disc drive, hard drive, CD-ROM drive, DVD drive, tape drive, etc. Further, the graphics program 108 is comprised of instructions which, when read and executed by the computer 100, causes the computer 100 to perform the steps necessary to implement and/or use the present invention. Graphics program 108 and/or operating instructions may also be tangibly embodied in a memory and/or data communications devices of computer 100, thereby making a computer program product or article of manufacture according to the invention. As such, the terms “article of manufacture” and “computer program product” as used herein are intended to encompass a computer program accessible from any computer readable device or media.
  • FIG. 2 schematically illustrates a further hardware and software environment in accordance with one or more embodiments of the invention, and more particularly, illustrates a typical distributed computer system 200 using a network 202 to connect client computers 100 to server computers 204. A typical combination of resources may include a network 202 comprising the Internet, LANs (local area networks), WANs (wide area networks), SNA (systems network architecture) networks, or the like, clients 100 that are personal computers or workstations (e.g., as described above), and servers 204 that are personal computers, workstations, minicomputers, or mainframes. Additionally, both client 100 and server 204 may receive input (e.g., cursor location input) and display a cursor in response to an input device such as cursor control device 106.
  • A network 202 such as the Internet connects clients 100 to server computers 204. Additionally, network 202 may utilize radio frequency (RF) to connect and provide the communication between clients 100 and servers 204. Clients 100 may execute a client application or Web browser 108 (e.g., as described above) and communicate with server computers 204 executing Web servers 206. The software executing on clients 100 may be downloaded from server computer 204 to client computers 100 and installed as a plug in or ActiveX control of a Web browser. Accordingly, clients 100 may utilize ActiveX components/component object model (COM) or distributed COM (DCOM) components to provide a user interface on a display of client 100.
  • Web server 206 may host an Active Server Page (ASP) or Internet Server Application Programming Interface (ISAPI) application 208, which may be executing scripts. The scripts invoke objects that execute business logic (referred to as business objects). The business objects then manipulate data in database 212 through a database management system (DBMS) 210. Alternatively, database 212 may be part of or connected directly to client 100 instead of communicating/obtaining the information from database 212 across network 202. When a developer encapsulates the business functionality into objects, the system may be referred to as a component object model (COM) system. Accordingly, the scripts executing on web server 206 (and/or application 208) invoke COM objects that implement the business logic. Further, server 204 may utilize Microsoft's Transaction Server (MTS)™ to access required data stored in database 212 via an interface such as ADO (Active Data Objects), OLE DB (Object Linking and Embedding DataBase), or ODBC (Open DataBase Connectivity).
  • Those skilled in the art will recognize many modifications may be made to this exemplary environment without departing from the scope of the present invention. For example, those skilled in the art will recognize that any combination of the above components, or any number of different components, including different logic, data, different peripherals, and different devices, may be used to implement the present invention, so long as similar functions are performed thereby.
  • Computer-Implemented Graphics Program
  • FIG. 3 is a block diagram that illustrates the components of the graphics program 108 in accordance with one or more embodiments of the invention. There are three main components to the graphics program 108, including: a Graphical User Interface (GUI) 300, an Image Engine (IME) 302, and a DataBase (DB) 212 for storing objects in Drawing (DWG) files 304.
  • The Graphical User Interface 300 displays information to the operator and provides the functionality for the operator's interaction with the graphics program 108.
  • The Image Engine 302 processes the DWG files 304 and delivers the resulting graphics to the monitor 102 for display. In one or more embodiments, the Image Engine 302 provides a complete application programming interface (API) that allows other computer programs to interface to the graphics program 108 as needed.
  • The Database 212 is comprised of two separate types of databases: (1) a 3D database 306 known as the “3D world space” that stores 3D information; and (2) one or more 2D databases 308 known as the “2D view ports” that stores 2D information derived from the 3D information.
  • As used herein, the graphics program 108 may consist of a variety of different type of applications including GIS, CAD (computer aided design), solid modeling systems, animation products, rendering systems, etc. Embodiments of the invention are not limited to those software applications explicitly described herein but by the limitations set forth in the claims.
  • Plug-In Modules
  • Embodiments of the invention provide an architecture and method of using plug-in modules for user defined 3D/4D visualization, analysis, and simulation. Users/clients 100 are provided with the ability to search for, download, and immediately use plug-ins from an online catalog offered by one or more servers 204. These plug-ins can be supplied by software developers and enable users 100 to visualize, analyze, and simulate trends, phenomena, state, and events via software application 108.
  • Such a plug-in environment allows many different types of applications 108 to load specific data types and allows interaction between those data types. Most “traditional” plug-in environments do not allow this. Plug-ins for different data types may include textures, 3D models, 2D models, particle systems, and geo-based behavior systems (behaviors based on specific geo information).
  • Another advantage of the plug-in architecture is that it allows user to load models seamlessly without having to go through the lengthy steps of importing files. Accordingly, a full 3D environment and real-time rendering capability of embodiments of the invention combined with the analytic capabilities supplied by a plug-in developer allows user to visualize their data in ways not formerly possible.
  • Plug-ins are loaded and associated with specific models and scenarios within the digital city of embodiments of the invention. A user can override model and linked data values, enter plug-in parameters, and control the visualization of results. Plug-ins have the ability to automatically add themselves or make calculations based on the data of a particular file making up a digital city environment.
  • For example, based on GIS fault data, an earthquake preparedness drill particle system could be suggested and/or instantiated. Another example would be a recommended parking configuration based on the number of roads, or total lanes adjacent to a particular structure. Alternatively, a road configuration could be suggested based on the parking structures and parking places in a given city block.
  • FIG. 4 illustrates an example panel containing multiple plug-ins. As illustrated, there is a location plug-in, a utilities plug-in, and a greenhouse emissions plug-in. Each plug-in can interact with data established in other plug-ins and use such data in conducting calculations. Panel 400 of FIG. 4 illustrates the resulting display when three plug-ins are utilized together to analyze greenhouse gas emissions based on building occupancy and utility consumption for a selected building in accordance with one or more embodiments of the invention. Panel 400 allows the user to set various options in the various plug-ins for analyzing the green house emissions of building A 402.
  • FIG. 5 is an enlargement of panel 400 of FIG. 4 illustrating several plug-ins available to analyze the currently selected object (i.e., Building A) in accordance with one or more embodiments of the invention.
  • The location plug-in 502 contains the display and overrides to the geospatial location and position information for the building. In this regard, if location panel 502 were expanded, the user would have the option of specifying where Building A is located. For example, the user can specify the latitude, longitude, and elevation. Alternatively, the user can enter an address (e.g., number, street, city, state, and/or zip, etc.). Further, entering information in one field of the location panel 502 may automatically retrieve and output information in another field (e.g., entry of an address may automatically fill in the corresponding latitude, longitude, and elevation. In addition, once the location information is entered, the object (e.g., Building A 402) would automatically move to the location specified. The resulting visualization from the location plug-in 502 provides a visual representation of Building A 402 in a 3D environment.
  • The occupancy plug-in 504 allows the user to establish the current number of occupants 504A to be displayed and overrides 504B (i.e., the maximum number of occupants) to the number of occupants for Building A 402. The visualization of the occupancy plug-in 504 would provide for multiple dots indicative of persons in Building A 402 (or distributed throughout building A 402).
  • The utilities plug-in 506 contains the display and overrides to the utility usage (i.e., water and power) for Building A 402. The visualization of the utilities plug-in results in line or effect simulating power and water usage in Building A 402.
  • The greenhouse emissions plug-in 508 contains the display and overrides to the LEED (Leadership in Energy and Environmental Design green building rating system) emissions impact score for the Building A 402. The values on greenhouse emissions panel 508 are automatically (i.e., without additional user input) updated based on the occupancy (panel 504) and utility consumption (panel 506) for a selected building. Alternatively, the user may have the options of setting the greenhouse emissions values in panel 508 and the system can automatically adjust either the occupancy values 504 or utility values 506 that are necessary to reach the greenhouse emissions values set forth in panel 508. In this regard, the user can determine which values/panels (502, 504, 506, and 508) are locked and which can be adjusted depending on the values specified in the other panels. The visualization of greenhouse emissions plug-in 508 would result in a halo type effect displayed around and emanating from Building A 402.
  • Accordingly, developers and plug-in authors can harness to the full power of 3D rendering to convey the results of their calculations. In this regard, the 3D simulation illustrated in FIG. 4 may change its coloring or areas displayed based on the visualizations resulting from plug-ins 402-508. Check boxes 502C-508C may be utilized to determine whether a resulting visualization for the respective plug-in 502-508 is displayed in the 3D rendering of FIG. 4. For example, the user may check boxes (e.g., check boxes 502C, 504C, 506C, and 508C) within panel 400 to determine which plug-ins will be reflected in the display of building A 402 of FIG. 4. This allows users to visualize and analyze their data in new and powerful ways.
  • One or more embodiments of the invention use plug-ins to create animations that simulate results over time (4D). In addition, plug-ins can be used to simulate human behavior in the 3D environment. Given some human interaction and a stimulus in that environment, the plug-in architecture allows a user to predict and visualize certain human behaviors. The architecture also allows the user to visualize different temporal simulations like the sun and moon, weather patterns and phenomena such as tornadoes and snowfall (see detailed examples below).
  • Visual Bookmarking
  • One or more embodiments of the invention all the user to define scenarios that incorporate specific model and linked data overrides, plug-ins and their settings, and visualization traits. In other words, a group of settings are stored into a type of visual “bookmark” that allows the user to define specific “what-if” scenarios. Each scenario or “bookmark” captures specific model and linked data overrides supplied by the user, a set of plug-ins and their settings, and visualization parameters and traits.
  • By bookmarking scenarios and sub-scenarios with different settings, the user can quickly compare and analyze their information and make informed decisions. This essentially allows a user to save certain data sets, apply them to scenes <environments, geoviews>, recall them and compare and contrast. In the prior art, to visualize and compare different scenarios, the users were required to modify a file, save it with a certain criteria, render it and repeat the process for each different scenario and comparing the final renderings. The ability to store the various settings into a bookmark is faster and interactive so the user is not required to save files using different settings.
  • FIG. 6 illustrates various bookmarked scenarios that are selectable by a user in accordance with one or more embodiments of the invention. The user first establishes all of the desired settings by selecting a particular data set, plug-ins and their settings, properties, data overrides, visualization traits, etc. in dialog box 602. Such values may be entered directly or can be linked by establishing a link between a property and an external file (e.g., a spreadsheet that contains values).
  • Alternatively, the user can select the scenario bookmark 604 in panel 602 which allows the user to select a set of predefined settings. Once the desired properties for a bookmark have been established (i.e., in dialog box/panel 602), the user can opt to create a bookmark to associate all of the settings with a bookmark, placeholder, or thumbnail for those settings using dialog box 606. Once created and if in the appropriate mode, the user may be presented with a group of selectable icons or menu options representative of the various bookmarks that have been established. For example, icons 608, 610, 612, and 614 are representative of various bookmarked scenarios that have been established by a user. Thus, each scenario represented by bookmarked icons 608-614 provides a selection of one or more plug-ins, and properties/settings that permit the user to define a particular visualization in a 3D/4D environment.
  • In view of the above, bookmarked scenarios can be viewed as a way of storing both a set of data (a specific set of models that have been loaded into a server) into a name, a set, with a series of plug-ins and potentially some overriding information for those plug-ins.
  • Logical Flow
  • FIG. 7 illustrates the logical flow for storing user defined scenarios in a three-dimensional system in accordance with one or more embodiments of the invention.
  • At step 700, a three-dimensional (3D) view of a real world scene is displayed on a display device using a 3D graphics application.
  • At step 702, one or more plug-ins are installed into the 3D graphics application. The plug-ins may be viewed as an application that enables a user to visualize, analyze, and simulate a particular user-defined scenario in the 3D view.
  • At step 704, input is received from a user selecting a subset of the one or more plug-ins.
  • At step 706, input is received from a user defining one or more settings for the subset of plug-ins. As described above, such settings may include particular calculations or values that are specified.
  • At step 708, input is received from the user defining a visualization trait for each plug-in in the subset of plug-ins. In other words, the user specifies whether the visualization for the plug-in should be displayed in the 3D view. Steps 706 and 708 may further include receiving additional input from the user defining a linked data override. Such a linked data override may consist of a link to an external file that contains values for the one or more settings.
  • At step 710, input is received from the user associating an identification of the selected subset of plug-ins, the one or more settings, and the visualization trait with a scenario bookmark. If a linked data override is specified as part of steps 706 and 708, such a linked data override is also including the association of the information with the scenario bookmark at step 710.
  • At step 712, input is received from the user saving the scenario bookmark such that a user can select the saved scenario bookmark and display a visualization of a scenario based on the selected set of plug-ins, one or more settings, and the visualization trait for each plug-in in the subset. Such saving of the scenario bookmark may be to persistent storage (e.g., a hard drive, compact disk, digital video disk [DVD], etc.). Accordingly, based on the stored/saved scenario bookmark, the user has the option of later selecting the bookmark and displaying a visualization based on all of the information and settings contained in the bookmark. Such a visualization represents a particular scenario defined by the user based on the information in the bookmark.
  • Step 712 may further include the displaying of multiple scenario bookmarks on a display device that the user can dynamically select from. Such a scenario bookmark(s) may be displayed in the form of a thumbnail icon. Thus, multiple thumbnails may be displayed (e.g., as illustrated in FIG. 6), and the user can elect to quickly, dynamically, and easily view a particular scenario that the user (or another user) has defined. Such a capability allows the user to easily compare and contrast different scenarios as desired.
  • CONCLUSION
  • This concludes the description of the preferred embodiment of the invention. The following describes some alternative embodiments for accomplishing the present invention. For example, any type of computer, such as a mainframe, minicomputer, or personal computer, or computer configuration, such as a timesharing mainframe, local area network, or standalone personal computer, could be used with the present invention.
  • The foregoing description of the preferred embodiment of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.

Claims (18)

1. A computer implemented method for storing user defined scenarios in a three-dimensional system, comprising:
displaying, using a three-dimensional (3D) graphics application, a 3D view of a real world scene on a display device;
installing one or more plug-ins into the 3D graphics application;
receiving input from a user selecting a subset of the one or more plug-ins;
receiving input from a user defining one or more settings for the subset of plug-ins;
receiving input from the user defining a visualization trait for each plug-in in the subset of plug-ins;
receiving input from the user associating an identification of the selected subset of plug-ins, the one or more settings, and the visualization trait with a scenario bookmark; and
receiving input from the user saving the scenario bookmark such that a user can select the saved scenario bookmark and display a visualization of a scenario based on the selected set of plug-ins, one or more settings, and the visualization trait for each plug-in in the subset.
2. The method of claim 1, further comprising:
receiving input from the user defining a linked data override; and
receiving input from the user associating the linked data override with the bookmark.
3. The method of claim 2, wherein the linked data override comprises a link to an external file that contains values for the one or more settings.
4. The method of claim 1, further comprising displaying multiple scenario bookmarks on a display device that the user can select.
5. The method of claim 1, wherein the scenario bookmark is displayed in a thumbnail icon on the display device.
6. The method of claim 1, wherein each of the one or more plug-ins comprises an application that enables a user to visualize, analyze, and simulate a particular user-defined scenario in the 3D view.
7. An apparatus for storing user defined scenarios in a three-dimensional system in a computer system comprising:
(a) a computer having a memory;
(b) an application executing on the computer, wherein the application is configured to:
(i) displaying, using a three-dimensional (3D) graphics application, a 3D view of a real world scene on a display device;
(ii) installing one or more plug-ins into the 3D graphics application;
(iii) receiving input from a user selecting a subset of the one or more plug-ins;
(iv) receiving input from a user defining one or more settings for the subset of plug-ins;
(v) receiving input from the user defining a visualization trait for each plug-in in the subset of plug-ins;
(vi) receiving input from the user associating an identification of the selected subset of plug-ins, the one or more settings, and the visualization trait with a scenario bookmark; and
(vii) receiving input from the user saving the scenario bookmark such that a user can select the saved scenario bookmark and display a visualization of a scenario based on the selected set of plug-ins, one or more settings, and the visualization trait for each plug-in in the subset.
8. The apparatus of claim 7, further comprising:
receiving input from the user defining a linked data override; and
receiving input from the user associating the linked data override with the bookmark.
9. The apparatus of claim 8, wherein the linked data override comprises a link to an external file that contains values for the one or more settings.
10. The apparatus of claim 7, further comprising displaying multiple scenario bookmarks on a display device that the user can select.
11. The apparatus of claim 7, wherein the scenario bookmark is displayed in a thumbnail icon on the display device.
12. The apparatus of claim 7, wherein each of the one or more plug-ins comprises an application that enables a user to visualize, analyze, and simulate a particular user-defined scenario in the 3D view.
13. An article of manufacture comprising a program storage device readable by a computer, tangibly embodying at least one program of instructions executable by the computer to perform method steps of storing user defined scenarios in a three-dimensional system, the method steps comprising the steps of:
displaying, using a three-dimensional (3D) graphics application, a 3D view of a real world scene on a display device;
installing one or more plug-ins into the 3D graphics application;
receiving input from a user selecting a subset of the one or more plug-ins;
receiving input from a user defining one or more settings for the subset of plug-ins;
receiving input from the user defining a visualization trait for each plug-in in the subset of plug-ins;
receiving input from the user associating an identification of the selected subset of plug-ins, the one or more settings, and the visualization trait with a scenario bookmark; and
receiving input from the user saving the scenario bookmark such that a user can select the saved scenario bookmark and display a visualization of a scenario based on the selected set of plug-ins, one or more settings, and the visualization trait for each plug-in in the subset.
14. The article of manufacture of claim 13, further comprising:
receiving input from the user defining a linked data override; and
receiving input from the user associating the linked data override with the bookmark.
15. The article of manufacture of claim 14, wherein the linked data override comprises a link to an external file that contains values for the one or more settings.
16. The article of manufacture of claim 13, further comprising displaying multiple scenario bookmarks on a display device that the user can select.
17. The article of manufacture of claim 13, wherein the scenario bookmark is displayed in a thumbnail icon on the display device.
18. The article of manufacture of claim 13, wherein each of the one or more plug-ins comprises an application that enables a user to visualize, analyze, and simulate a particular user-defined scenario in the 3D view.
US12/245,562 2007-10-05 2008-10-03 User defined scenarios in a three dimensional geo-spatial system Active 2032-09-23 US8914750B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/245,562 US8914750B2 (en) 2007-10-05 2008-10-03 User defined scenarios in a three dimensional geo-spatial system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US99786807P 2007-10-05 2007-10-05
US12/245,562 US8914750B2 (en) 2007-10-05 2008-10-03 User defined scenarios in a three dimensional geo-spatial system

Publications (2)

Publication Number Publication Date
US20090094556A1 true US20090094556A1 (en) 2009-04-09
US8914750B2 US8914750B2 (en) 2014-12-16

Family

ID=40524384

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/245,562 Active 2032-09-23 US8914750B2 (en) 2007-10-05 2008-10-03 User defined scenarios in a three dimensional geo-spatial system
US12/286,911 Active 2030-09-25 US8549439B2 (en) 2007-10-05 2008-10-03 Viewport overlays to expose alternate data representations
US12/245,568 Active 2031-05-28 US8291345B2 (en) 2007-10-05 2008-10-03 Sun-shadow simulation in a geospatial system

Family Applications After (2)

Application Number Title Priority Date Filing Date
US12/286,911 Active 2030-09-25 US8549439B2 (en) 2007-10-05 2008-10-03 Viewport overlays to expose alternate data representations
US12/245,568 Active 2031-05-28 US8291345B2 (en) 2007-10-05 2008-10-03 Sun-shadow simulation in a geospatial system

Country Status (2)

Country Link
US (3) US8914750B2 (en)
WO (3) WO2009046331A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090094558A1 (en) * 2007-10-05 2009-04-09 Howard Richard D Viewport overlays to expose alternate data representations
US20100229121A1 (en) * 2009-03-09 2010-09-09 Telcordia Technologies, Inc. System and method for capturing, aggregating and presenting attention hotspots in shared media
US20110122132A1 (en) * 2009-11-25 2011-05-26 Electronics And Telecommunications Research Institute Apparatus and method of managing objects and events with vector-based geographic information system
US20110202326A1 (en) * 2010-02-17 2011-08-18 Lockheed Martin Corporation Modeling social and cultural conditions in a voxel database
US20120330623A1 (en) * 2011-06-24 2012-12-27 Siemens Product Lifecycle Management Software Inc. Modeled physical environment for information delivery

Families Citing this family (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8620635B2 (en) * 2008-06-27 2013-12-31 Microsoft Corporation Composition of analytics models
US8411085B2 (en) * 2008-06-27 2013-04-02 Microsoft Corporation Constructing view compositions for domain-specific environments
US8314793B2 (en) * 2008-12-24 2012-11-20 Microsoft Corporation Implied analytical reasoning and computation
US7912807B2 (en) 2009-04-30 2011-03-22 Integrated Environmental Solutions, Ltd. Method and system for modeling energy efficient buildings using a plurality of synchronized workflows
US8866818B2 (en) 2009-06-19 2014-10-21 Microsoft Corporation Composing shapes and data series in geometries
US8531451B2 (en) * 2009-06-19 2013-09-10 Microsoft Corporation Data-driven visualization transformation
US8692826B2 (en) * 2009-06-19 2014-04-08 Brian C. Beckman Solver-based visualization framework
US8788574B2 (en) * 2009-06-19 2014-07-22 Microsoft Corporation Data-driven visualization of pseudo-infinite scenes
US8493406B2 (en) * 2009-06-19 2013-07-23 Microsoft Corporation Creating new charts and data visualizations
US9330503B2 (en) 2009-06-19 2016-05-03 Microsoft Technology Licensing, Llc Presaging and surfacing interactivity within data visualizations
US20100325564A1 (en) * 2009-06-19 2010-12-23 Microsoft Corporation Charts in virtual environments
KR101588733B1 (en) * 2009-07-21 2016-01-26 엘지전자 주식회사 Mobile terminal
US8352397B2 (en) * 2009-09-10 2013-01-08 Microsoft Corporation Dependency graph in data-driven model
DE202011110891U1 (en) * 2010-04-12 2017-01-27 Google Inc. Scroll in extensive hosted dataset
US9043296B2 (en) 2010-07-30 2015-05-26 Microsoft Technology Licensing, Llc System of providing suggestions based on accessible and contextual information
US8878871B2 (en) * 2010-08-09 2014-11-04 Thermopylae Sciences and Technology Methods and apparatus for geospatial management and visualization of events
CN101980134B (en) * 2010-10-29 2013-09-25 北京播思软件技术有限公司 Device and method for realizing intelligent three-dimensional table top
US20130067379A1 (en) * 2011-09-13 2013-03-14 General Electric Company Graphical comparison of geographic information system data
US10282055B2 (en) 2012-03-06 2019-05-07 Apple Inc. Ordered processing of edits for a media editing application
US9202433B2 (en) 2012-03-06 2015-12-01 Apple Inc. Multi operation slider
US9131192B2 (en) 2012-03-06 2015-09-08 Apple Inc. Unified slider control for modifying multiple image properties
US9041727B2 (en) 2012-03-06 2015-05-26 Apple Inc. User interface tools for selectively applying effects to image
US8888002B2 (en) * 2012-09-18 2014-11-18 Sensormatic Electronics, LLC Access control reader enabling remote applications
KR102186548B1 (en) * 2013-08-21 2020-12-07 삼성전자주식회사 Method, apparatus and recovering medium for screen display by executing scroll
US10096296B2 (en) 2013-11-13 2018-10-09 Red Hat, Inc. Temporally adjusted application window drop shadows
US20150248211A1 (en) * 2014-02-28 2015-09-03 Nemetschek Vectorworks, Inc. Method for instantaneous view-based display and selection of obscured elements of object models
US9530244B2 (en) 2014-11-11 2016-12-27 Intergraph Corporation Method and apparatus for shadow estimation and spreading
EP3611632A1 (en) * 2015-03-16 2020-02-19 Palantir Technologies Inc. Displaying attribute and event data along paths
US9721366B2 (en) 2015-03-17 2017-08-01 International Business Machines Corporation Data interpretation overlay mechanism
US11874716B2 (en) 2015-08-05 2024-01-16 Suunto Oy Embedded computing device management
DE102016113417A1 (en) * 2015-08-05 2017-02-09 Suunto Oy TIME BLOCKS USER INTERFACE
US10621778B2 (en) 2015-10-30 2020-04-14 Faraday & Future Inc. Methods and systems for generating dynamic user interface effects
US11210299B2 (en) 2015-12-01 2021-12-28 Amer Sports Digital Services Oy Apparatus and method for presenting thematic maps
US11144107B2 (en) 2015-12-01 2021-10-12 Amer Sports Digital Services Oy Apparatus and method for presenting thematic maps
US11137820B2 (en) 2015-12-01 2021-10-05 Amer Sports Digital Services Oy Apparatus and method for presenting thematic maps
US11215457B2 (en) 2015-12-01 2022-01-04 Amer Sports Digital Services Oy Thematic map based route optimization
US11284807B2 (en) 2015-12-21 2022-03-29 Amer Sports Digital Services Oy Engaging exercising devices with a mobile device
US11587484B2 (en) 2015-12-21 2023-02-21 Suunto Oy Method for controlling a display
FI127926B (en) 2015-12-21 2019-05-31 Suunto Oy Sensor based context management
US11838990B2 (en) 2015-12-21 2023-12-05 Suunto Oy Communicating sensor data in wireless communication systems
DE102016015695A1 (en) 2015-12-21 2017-06-22 Suunto Oy Activity intensity level determination
US11541280B2 (en) 2015-12-21 2023-01-03 Suunto Oy Apparatus and exercising device
US10466854B2 (en) * 2016-06-10 2019-11-05 Hexagon Technology Center Gmbh Systems and methods for accessing visually obscured elements of a three-dimensional model
US10002454B2 (en) 2016-09-16 2018-06-19 International Business Machines Corporation Reactive overlays of multiple representations using augmented reality
DE102017009171A1 (en) 2016-10-17 2018-04-19 Amer Sports Digital Services Oy EMBEDDED APPENDIX
US11703938B2 (en) 2016-10-17 2023-07-18 Suunto Oy Embedded computing device
EP3590096A4 (en) 2017-03-03 2020-12-23 Intergraph Corporation Shadow casting for an elevation data grid
US11164031B2 (en) 2018-06-26 2021-11-02 Here Global B.V. System and method for analyzing an image of a vehicle
US10762681B2 (en) * 2018-06-26 2020-09-01 Here Global B.V. Map generation system and method for generating an accurate building shadow
US10908593B1 (en) 2020-06-08 2021-02-02 Factory Os, Inc. Systems and methods for fabrication of a volumetric module
CN111982147A (en) * 2020-08-26 2020-11-24 上海博泰悦臻网络技术服务有限公司 Vehicle-mounted instrument shadow effect display method and system, storage medium and vehicle-mounted terminal

Citations (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5148154A (en) * 1990-12-04 1992-09-15 Sony Corporation Of America Multi-dimensional user interface
US5226109A (en) * 1990-04-26 1993-07-06 Honeywell Inc. Three dimensional computer graphic symbol generator
US5295243A (en) * 1989-12-29 1994-03-15 Xerox Corporation Display of hierarchical three-dimensional structures with rotating substructures
US5461709A (en) * 1993-02-26 1995-10-24 Intergraph Corporation 3D input system for CAD systems
US5473747A (en) * 1993-02-08 1995-12-05 International Business Machines Corporation Method and apparatus for identifying features in a multidimensional data set
US5767854A (en) * 1996-09-27 1998-06-16 Anwar; Mohammed S. Multidimensional data display and manipulation system and methods for using same
US5767855A (en) * 1997-05-19 1998-06-16 International Business Machines Corporation Selectively enlarged viewer interactive three-dimensional objects in environmentally related virtual three-dimensional workspace displays
US5999165A (en) * 1996-03-27 1999-12-07 Nec Corporation Three-dimensional display system
US6018350A (en) * 1996-10-29 2000-01-25 Real 3D, Inc. Illumination and shadow simulation in a computer graphics/imaging system
US6147686A (en) * 1998-02-24 2000-11-14 Entrada Technologies, Ltd. Method and system for real-time manipulation of merchandise layout and data collection
US6339429B1 (en) * 1999-06-04 2002-01-15 Mzmz Technology Innovations Llc Dynamic art form display apparatus
US20030057887A1 (en) * 1997-08-26 2003-03-27 Dowling Kevin J. Systems and methods of controlling light systems
US20030164827A1 (en) * 2001-05-18 2003-09-04 Asaf Gottesman System and method for displaying search results in a three-dimensional virtual environment
US20050091596A1 (en) * 2003-10-23 2005-04-28 Microsoft Corporation Graphical user interface for 3-dimensional view of a data collection based on an attribute of the data
US20050110788A1 (en) * 2001-11-23 2005-05-26 Turner David N. Handling of image data created by manipulation of image data sets
US6915310B2 (en) * 2002-03-28 2005-07-05 Harris Corporation Three-dimensional volumetric geo-spatial querying
US20050190199A1 (en) * 2001-12-21 2005-09-01 Hartwell Brown Apparatus and method for identifying and simultaneously displaying images of musical notes in music and producing the music
US6950791B1 (en) * 2000-09-13 2005-09-27 Antartica Systems, Inc. Method for describing objects in a virtual space
US20050223337A1 (en) * 2004-03-16 2005-10-06 Wheeler Mark D Browsers for large geometric data visualization
US20060075356A1 (en) * 2004-10-04 2006-04-06 Faulkner Lawrence Q Three-dimensional cartographic user interface system
US7058896B2 (en) * 2002-01-16 2006-06-06 Silicon Graphics, Inc. System, method and computer program product for intuitive interactive navigation control in virtual environments
US20060176303A1 (en) * 2005-02-04 2006-08-10 Windward Mark Interactive, Llc. Systems and methods for the real-time and realistic simulation of natural atmospheric lighting phenomenon
US20060209061A1 (en) * 2005-03-18 2006-09-21 Microsoft Corporation Generating 2D transitions using a 3D model
US7170510B2 (en) * 2003-11-14 2007-01-30 Sun Microsystems, Inc. Method and apparatus for indicating a usage context of a computational resource through visual effects
US7181362B2 (en) * 2003-04-16 2007-02-20 Massachusetts Institute Of Technology Three dimensional tangible interface for interacting with spatial-temporal data using infrared light sources and infrared detectors
US20070132779A1 (en) * 2004-05-04 2007-06-14 Stephen Gilbert Graphic element with multiple visualizations in a process environment
US20070143345A1 (en) * 2005-10-12 2007-06-21 Jones Michael T Entity display priority in a distributed geographic information system
US20070150198A1 (en) * 2005-12-28 2007-06-28 Solmetric Corporation Solar access measurement device
US20070176926A1 (en) * 2006-01-31 2007-08-02 Garcia Jose M D Lighting states in a computer aided design
US7263667B1 (en) * 1999-06-09 2007-08-28 Microsoft Corporation Methods, apparatus and data structures for providing a user interface which facilitates decision making
US20070219645A1 (en) * 2006-03-17 2007-09-20 Honeywell International Inc. Building management system
US20070276901A1 (en) * 2006-05-23 2007-11-29 Bhp Billiton Innovation Pty Ltd. Method and system for providing a graphical workbench environment with intelligent plug-ins
US20080016472A1 (en) * 2006-06-12 2008-01-17 Google Inc. Markup Language for Interactive Geographic Information System
US20080140271A1 (en) * 2006-01-10 2008-06-12 Harris Corporation, Corporation Of The State Of Delaware Geospatial image change detecting system and associated methods
US20080215414A1 (en) * 2006-11-27 2008-09-04 Hntb Holdings Ltd. Resource forecasting and scheduling
US20080215415A1 (en) * 2006-12-07 2008-09-04 Paul Willms Mobile advertising
US20080292213A1 (en) * 2007-05-25 2008-11-27 Google Inc. Annotations in panoramic images, and applications thereof
US20090019366A1 (en) * 2007-07-12 2009-01-15 Fatdoor, Inc. Character expression in a geo-spatial environment
US20090254912A1 (en) * 2008-02-12 2009-10-08 Nuance Communications, Inc. System and method for building applications, such as customized applications for mobile devices
US7693702B1 (en) * 2002-11-01 2010-04-06 Lockheed Martin Corporation Visualizing space systems modeling using augmented reality
US7856312B2 (en) * 2003-12-18 2010-12-21 1626628 Ontario Limited System, apparatus and method for mapping
US7865836B1 (en) * 2007-07-27 2011-01-04 The United States Of America As Represented By The Secretary Of The Navy Geospatial prioritized data acquisition analysis and presentation
US7933395B1 (en) * 2005-06-27 2011-04-26 Google Inc. Virtual tour of user-defined paths in a geographic information system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009046331A1 (en) 2007-10-05 2009-04-09 Autodesk, Inc. Sun-shadow simulation in a geospatial system

Patent Citations (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5295243A (en) * 1989-12-29 1994-03-15 Xerox Corporation Display of hierarchical three-dimensional structures with rotating substructures
US5226109A (en) * 1990-04-26 1993-07-06 Honeywell Inc. Three dimensional computer graphic symbol generator
US5148154A (en) * 1990-12-04 1992-09-15 Sony Corporation Of America Multi-dimensional user interface
US5473747A (en) * 1993-02-08 1995-12-05 International Business Machines Corporation Method and apparatus for identifying features in a multidimensional data set
US5461709A (en) * 1993-02-26 1995-10-24 Intergraph Corporation 3D input system for CAD systems
US5999165A (en) * 1996-03-27 1999-12-07 Nec Corporation Three-dimensional display system
US5767854A (en) * 1996-09-27 1998-06-16 Anwar; Mohammed S. Multidimensional data display and manipulation system and methods for using same
US6018350A (en) * 1996-10-29 2000-01-25 Real 3D, Inc. Illumination and shadow simulation in a computer graphics/imaging system
US5767855A (en) * 1997-05-19 1998-06-16 International Business Machines Corporation Selectively enlarged viewer interactive three-dimensional objects in environmentally related virtual three-dimensional workspace displays
US20030057887A1 (en) * 1997-08-26 2003-03-27 Dowling Kevin J. Systems and methods of controlling light systems
US6147686A (en) * 1998-02-24 2000-11-14 Entrada Technologies, Ltd. Method and system for real-time manipulation of merchandise layout and data collection
US6339429B1 (en) * 1999-06-04 2002-01-15 Mzmz Technology Innovations Llc Dynamic art form display apparatus
US7263667B1 (en) * 1999-06-09 2007-08-28 Microsoft Corporation Methods, apparatus and data structures for providing a user interface which facilitates decision making
US6950791B1 (en) * 2000-09-13 2005-09-27 Antartica Systems, Inc. Method for describing objects in a virtual space
US20030164827A1 (en) * 2001-05-18 2003-09-04 Asaf Gottesman System and method for displaying search results in a three-dimensional virtual environment
US20050110788A1 (en) * 2001-11-23 2005-05-26 Turner David N. Handling of image data created by manipulation of image data sets
US20050190199A1 (en) * 2001-12-21 2005-09-01 Hartwell Brown Apparatus and method for identifying and simultaneously displaying images of musical notes in music and producing the music
US7058896B2 (en) * 2002-01-16 2006-06-06 Silicon Graphics, Inc. System, method and computer program product for intuitive interactive navigation control in virtual environments
US6915310B2 (en) * 2002-03-28 2005-07-05 Harris Corporation Three-dimensional volumetric geo-spatial querying
US7693702B1 (en) * 2002-11-01 2010-04-06 Lockheed Martin Corporation Visualizing space systems modeling using augmented reality
US7181362B2 (en) * 2003-04-16 2007-02-20 Massachusetts Institute Of Technology Three dimensional tangible interface for interacting with spatial-temporal data using infrared light sources and infrared detectors
US20050091596A1 (en) * 2003-10-23 2005-04-28 Microsoft Corporation Graphical user interface for 3-dimensional view of a data collection based on an attribute of the data
US7170510B2 (en) * 2003-11-14 2007-01-30 Sun Microsystems, Inc. Method and apparatus for indicating a usage context of a computational resource through visual effects
US7856312B2 (en) * 2003-12-18 2010-12-21 1626628 Ontario Limited System, apparatus and method for mapping
US20050223337A1 (en) * 2004-03-16 2005-10-06 Wheeler Mark D Browsers for large geometric data visualization
US20070132779A1 (en) * 2004-05-04 2007-06-14 Stephen Gilbert Graphic element with multiple visualizations in a process environment
US20060075356A1 (en) * 2004-10-04 2006-04-06 Faulkner Lawrence Q Three-dimensional cartographic user interface system
US20100164974A1 (en) * 2005-02-04 2010-07-01 Fairclough Matthew P Systems and methods for the real-time and realistic simulation of natural atmospheric lighting phenomenon
US7710418B2 (en) * 2005-02-04 2010-05-04 Linden Acquisition Corporation Systems and methods for the real-time and realistic simulation of natural atmospheric lighting phenomenon
US20060176303A1 (en) * 2005-02-04 2006-08-10 Windward Mark Interactive, Llc. Systems and methods for the real-time and realistic simulation of natural atmospheric lighting phenomenon
US20110279470A1 (en) * 2005-02-04 2011-11-17 Fairclough Matthew P Systems and methods for the real-time and realistic simulation of natural atmospheric lighting phenomenon
US20060209061A1 (en) * 2005-03-18 2006-09-21 Microsoft Corporation Generating 2D transitions using a 3D model
US7933395B1 (en) * 2005-06-27 2011-04-26 Google Inc. Virtual tour of user-defined paths in a geographic information system
US20070143345A1 (en) * 2005-10-12 2007-06-21 Jones Michael T Entity display priority in a distributed geographic information system
US20070150198A1 (en) * 2005-12-28 2007-06-28 Solmetric Corporation Solar access measurement device
US20080140271A1 (en) * 2006-01-10 2008-06-12 Harris Corporation, Corporation Of The State Of Delaware Geospatial image change detecting system and associated methods
US7528938B2 (en) * 2006-01-10 2009-05-05 Harris Corporation Geospatial image change detecting system and associated methods
US20070176926A1 (en) * 2006-01-31 2007-08-02 Garcia Jose M D Lighting states in a computer aided design
US7567844B2 (en) * 2006-03-17 2009-07-28 Honeywell International Inc. Building management system
US20070219645A1 (en) * 2006-03-17 2007-09-20 Honeywell International Inc. Building management system
US20070276901A1 (en) * 2006-05-23 2007-11-29 Bhp Billiton Innovation Pty Ltd. Method and system for providing a graphical workbench environment with intelligent plug-ins
US20080016472A1 (en) * 2006-06-12 2008-01-17 Google Inc. Markup Language for Interactive Geographic Information System
US20080215414A1 (en) * 2006-11-27 2008-09-04 Hntb Holdings Ltd. Resource forecasting and scheduling
US20080215415A1 (en) * 2006-12-07 2008-09-04 Paul Willms Mobile advertising
US20080292213A1 (en) * 2007-05-25 2008-11-27 Google Inc. Annotations in panoramic images, and applications thereof
US20090019366A1 (en) * 2007-07-12 2009-01-15 Fatdoor, Inc. Character expression in a geo-spatial environment
US7865836B1 (en) * 2007-07-27 2011-01-04 The United States Of America As Represented By The Secretary Of The Navy Geospatial prioritized data acquisition analysis and presentation
US20090254912A1 (en) * 2008-02-12 2009-10-08 Nuance Communications, Inc. System and method for building applications, such as customized applications for mobile devices

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090094558A1 (en) * 2007-10-05 2009-04-09 Howard Richard D Viewport overlays to expose alternate data representations
US20090094557A1 (en) * 2007-10-05 2009-04-09 Autodesk, Inc. Sun-shadow simulation in a geospatial system
US8291345B2 (en) * 2007-10-05 2012-10-16 Autodesk, Inc. Sun-shadow simulation in a geospatial system
US8549439B2 (en) 2007-10-05 2013-10-01 Autodesk, Inc. Viewport overlays to expose alternate data representations
US20100229121A1 (en) * 2009-03-09 2010-09-09 Telcordia Technologies, Inc. System and method for capturing, aggregating and presenting attention hotspots in shared media
US8296675B2 (en) * 2009-03-09 2012-10-23 Telcordia Technologies, Inc. System and method for capturing, aggregating and presenting attention hotspots in shared media
US20110122132A1 (en) * 2009-11-25 2011-05-26 Electronics And Telecommunications Research Institute Apparatus and method of managing objects and events with vector-based geographic information system
US20110202326A1 (en) * 2010-02-17 2011-08-18 Lockheed Martin Corporation Modeling social and cultural conditions in a voxel database
US20120330623A1 (en) * 2011-06-24 2012-12-27 Siemens Product Lifecycle Management Software Inc. Modeled physical environment for information delivery
US9911257B2 (en) * 2011-06-24 2018-03-06 Siemens Product Lifecycle Management Software Inc. Modeled physical environment for information delivery

Also Published As

Publication number Publication date
WO2009046351A1 (en) 2009-04-09
US20090094558A1 (en) 2009-04-09
US8549439B2 (en) 2013-10-01
US20090094557A1 (en) 2009-04-09
US8914750B2 (en) 2014-12-16
US8291345B2 (en) 2012-10-16
WO2009046333A1 (en) 2009-04-09
WO2009046331A1 (en) 2009-04-09

Similar Documents

Publication Publication Date Title
US8914750B2 (en) User defined scenarios in a three dimensional geo-spatial system
Batty et al. Geographical information systems and urban design
KR100915209B1 (en) Automatic Modeling And Navigation System for Solid Builing Plane And Internal in Base of XML, And Method Thereof
CN112053130A (en) Pumped storage power station integrated management method, platform, system, equipment and medium
Li et al. Webvrgis based city bigdata 3d visualization and analysis
Bishop et al. Linking modelling and visualisation for natural resources management
Ellul et al. Investigating approaches to improving rendering performance of 3D city models on mobile devices
CN114359501B (en) Configurable 3D visualization platform and scene construction method
San José et al. Advances in 3D visualization of air quality data
Yu et al. A hybrid system of expanding 2D GIS into 3D space
Kolomeec et al. Methodological Primitives for Phased Construction of Data Visualization Models.
WO2023159595A9 (en) Method and device for constructing and configuring three-dimensional space scene model, and computer program product
Havenith 3D Landslide Models in VR
Klein Managing the scalability of visual exploration using game engines to analyse UHI scenarios
Zheng et al. Comparison of characteristics of BIM visualization and interactive application based on WebGL and game engine
Ellul et al. LOD 1 VS. LOD 2–Preliminary investigations into differences in mobile rendering performance
Samad et al. Web GIS solution and 3D visualization towards sustainability of Georgetown as world heritage site
Lei et al. 3D Digital Campus System Based on WebGL and API
Ghani et al. Developing A 3-D GIS model for urban planning. Case study: Ampang Jaya, Malaysia
Shiode et al. Spatiotemporal visualization of built environments
Wang et al. Research on 3D Terminal Rendering Technology Based on Power Equipment Business Features
Zang et al. Design and Application of 3D Geographic Information Visualization System Based on Skyline
CN103914319B (en) Remote sensing figure implementation method is loaded according to red line scope
CN116070392A (en) Three-dimensional visualization method and system for data center
Li et al. Design and preliminary realization of component installation scheme generation system in virtual EAST

Legal Events

Date Code Title Description
AS Assignment

Owner name: AUTODESK, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HOWARD, RICHARD D.;LOPICCOLO, JARROD;ANDERSON, GRANT;AND OTHERS;REEL/FRAME:021997/0116;SIGNING DATES FROM 20081114 TO 20081212

Owner name: AUTODESK, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HOWARD, RICHARD D.;LOPICCOLO, JARROD;ANDERSON, GRANT;AND OTHERS;SIGNING DATES FROM 20081114 TO 20081212;REEL/FRAME:021997/0116

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551)

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8