US20120084672A1 - Methods and systems for sharing images synchronized across a distributed computing interface - Google Patents

Methods and systems for sharing images synchronized across a distributed computing interface Download PDF

Info

Publication number
US20120084672A1
US20120084672A1 US13/316,845 US201113316845A US2012084672A1 US 20120084672 A1 US20120084672 A1 US 20120084672A1 US 201113316845 A US201113316845 A US 201113316845A US 2012084672 A1 US2012084672 A1 US 2012084672A1
Authority
US
United States
Prior art keywords
interface
collaborative
collaborative interface
distributed computing
client device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/316,845
Inventor
Stanislav Vonog
Vladimir Kuznestov
Gilman Louie
Nikolay Surin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Amazon Technologies Inc
Original Assignee
Net Power and Light Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Net Power and Light Inc filed Critical Net Power and Light Inc
Priority to US13/316,845 priority Critical patent/US20120084672A1/en
Publication of US20120084672A1 publication Critical patent/US20120084672A1/en
Assigned to MUSIGY USA, INC. reassignment MUSIGY USA, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KUZNETSOV, VLADIMIR, LOUIE, GILMAN, SURIN, NIKOLAY, VONOG, STANISLAV
Assigned to NET POWER AND LIGHT, INC. reassignment NET POWER AND LIGHT, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: MUSIGY USA, INC.
Assigned to ALSOP LOUIE CAPITAL, L.P., SINGTEL INNOV8 PTE. LTD. reassignment ALSOP LOUIE CAPITAL, L.P. SECURITY AGREEMENT Assignors: NET POWER AND LIGHT, INC.
Assigned to NET POWER AND LIGHT, INC. reassignment NET POWER AND LIGHT, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: ALSOP LOUIE CAPITAL, L.P., SINGTEL INNOV8 PTE. LTD.
Assigned to ALSOP LOUIE CAPITAL I, L.P., PENINSULA TECHNOLOGY VENTURES, L.P., PENINSULA VENTURE PRINCIPALS, L.P. reassignment ALSOP LOUIE CAPITAL I, L.P. SECURITY INTEREST Assignors: NET POWER AND LIGHT, INC.
Assigned to ALSOP LOUIE CAPITAL 1, L.P., BROWN, JOHN SEELY, PENINSULA TECHNOLOGY VENTURES, L.P., LOW, LAWRENCE B., SHIN, JEANNIE, PENINSULA VENTURE PRINCIPALS, L.P., ORRICK INVESTMENTS 2010, LLC, ORRICK INVESTMENTS 2011, LLC, WANG, TA-HUI TY, TWB INVESTMENT PARTNERSHIP II, LP, SINGTEL INNOV8 PTE. LTD., THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I) reassignment ALSOP LOUIE CAPITAL 1, L.P. SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NET POWER & LIGHT, INC.
Assigned to ALSOP LOUIE CAPITAL 1, L.P., BROWN, JOHN SEELY, LOW, LAWRENCE B., ORRICK INVESTMENTS 2010, LLC, ORRICK INVESTMENTS 2011, LLC, THE BOARD OF TRUSTEES OF THE LELAND STANFORD UNIVERSITY (DAPER I), PENINSULA TECHNOLOGY VENTURES, L.P., PENSULA VENTURE PRINCIPALS, L.P., SHIN, JEANNIE, WANG, TA-HUITY, TWB INVESTMENT PARTNERSHIP II, LP, SINGTEL INNOVS PTE. LTD. reassignment ALSOP LOUIE CAPITAL 1, L.P. SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NET POWER AND LIGHT, INC.
Assigned to ALSOP LOUIE CAPITAL 1, L.P., LOW, LAWRENCE B., ORRICK INVESTMENTS 2010, LLC, ORRICK INVESTMENTS 2011, LLC, PENINSULA TECHNOLOGY VENTURES, L.P., PENINSULA VENTURE PRINCIPALS, L.P., SHIN, JEANNIE, WANG, TA-HUITY, TWB INVESTMENT PARTNERSHIP II, LP, SINGTEL INNOV8 PTE. LTD., BROWN, JOHN SEELY, THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I) reassignment ALSOP LOUIE CAPITAL 1, L.P. CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Assignors: NET POWER AND LIGHT, INC.
Assigned to PENINSULA VENTURE PRINCIPALS, L.P., SINGTEL INNOV8 PTE. LTD., ORRICK INVESTMENTS 2010, LLC, LOW, LAWRENCE B., ALSOP LOUIE CAPITAL 1, L.P., TWB INVESTMENT PARTNERSHIP II, LP, ORRICK INVESTMENTS 2011, LLC, WANG, TA-HUI TY, BROWN, JOHN SEELY, PENINSULA TECHNOLOGY VENTURES, L.P., SHINE, JEANNIE, THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I) reassignment PENINSULA VENTURE PRINCIPALS, L.P. SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NET POWER AND LIGHT, INC.
Assigned to NET POWER & LIGHT, INC. reassignment NET POWER & LIGHT, INC. NOTE AND WARRANT CONVERSION AGREEMENT Assignors: ALSOP LOUIE CAPITAL 1, L.P., PENINSULA TECHNOLOGY VENTURES, L.P., PENINSULA VENTURE PRINCIPALS, L.P.
Assigned to NET POWER & LIGHT, INC. reassignment NET POWER & LIGHT, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: NET POWER & LIGHT, INC.
Assigned to NET POWER & LIGHT, INC. reassignment NET POWER & LIGHT, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: NET POWER & LIGHT, INC.
Assigned to NET POWER & LIGHT, INC. reassignment NET POWER & LIGHT, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: NET POWER & LIGHT, INC.
Assigned to NET POWER & LIGHT, INC. reassignment NET POWER & LIGHT, INC. NOTE AND WARRANT CONVERSION AGREEMENT Assignors: ALSOP LOUIE CAPITAL 1, L.P., BROWN, JOHN SEELY, LOW, LAWRENCE B., ORRICK INVESTMENTS 2010, LLC, ORRICK INVESTMENTS 2011, LLC, PENINSULA TECHNOLOGY VENTURES, L.P., PENINSULA VENTURE PRINCIPALS, L.P., SHIN, JEANNIE, SINGTEL INNOV8 PTE. LTD., THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I), TWB INVESTMENT PARTNERSHIP II, LP, WANG, TA-HUI TY
Assigned to NET POWER & LIGHT, INC. reassignment NET POWER & LIGHT, INC. NOTE AND WARRANT CONVERSION AGREEMENT Assignors: ALSOP LOUIE CAPITAL 1, L.P., BROWN, JOHN SEELY, LOW, LAWRENCE B., ORRICK INVESTMENTS 2010, LLC, ORRICK INVESTMENTS 2011, LLC, PENINSULA TECHNOLOGY VENTURES, L.P., PENINSULA VENTURE PRINCIPALS, L.P., SHIN, JEANNIE, SINGTEL INNOV8 PTE. LTD., THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I), TWB INVESTMENT PARTNERSHIP II, LP, WANG, TA-HUI TY
Assigned to NET POWER AND LIGHT, INC. reassignment NET POWER AND LIGHT, INC. MERGER (SEE DOCUMENT FOR DETAILS). Assignors: NET POWER AND LIGHT, INC.
Assigned to Wickr Inc. reassignment Wickr Inc. MERGER (SEE DOCUMENT FOR DETAILS). Assignors: NET POWER AND LIGHT, INC.
Assigned to Wickr Inc. reassignment Wickr Inc. CORRECTIVE ASSIGNMENT TO CORRECT THE ADDRESS FROM 71 S. WACKER DR. SUITE 2385 CHICAGO, ILLINOIS 60606 TO 459 18TH ST., #313, SAN FRANCISCO, CALIFORNIA 94107 PREVIOUSLY RECORDED ON REEL 039810 FRAME 0277. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Assignors: NET POWER AND LIGHT, INC.
Assigned to AMAZON TECHNOLOGIES, INC. reassignment AMAZON TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: WICKR LLC
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827Network arrangements for conference optimisation or adaptation

Definitions

  • the present system relates in general to computer applications and, more specifically to a method and system for distributed computing interface.
  • the web browser has become the most commonly used human interface for using computing.
  • Cloud computing Companies in the cloud computing field are building infrastructure for cloud computing. As computing and storage have gotten cheaper hosting internet applications with massive usage (millions of simultaneous users) within a centralized data center has become possible. Such applications and data centers have been built by companies like Google (search, email), Yahoo (email), Salesforce.com (CRM). The next step was to build a set of application programming interfaces (APIs) around these datacenters to allow third party developers to host their applications on the robust infrastructures built and supported by large industry players. This new way of developing, deploying, providing and using Internet services and applications was named “cloud computing.” Cloud computing was pioneered by companies such as Amazon with their Amazon Web Services initiative which started with S3 (APIs and service for cloud storage) and EC2 (computing). The followers included Google (Google Application Engine) and Microsoft (Live Mesh initiative).
  • the web browser used to access cloud applications uses http and https-based protocols, placing a number of limitations on the capabilities of cloud computing.
  • the current cloud computing platforms fail to enable data synchronization between multiple application users, real-time streaming capabilities, and real-time collaboration capabilities.
  • User interface is lacking to utilize capabilities provided by rich applications running in the cloud (cloud-based applications).
  • a browser cannot naturally offload data processing to the cloud (e.g. graphic rendering or CPU intensive jobs) and there is no way to make offloading transparent and seamless for the end user.
  • the web browser's underlying technological principles of operation and its architecture can no longer provide the best solution for certain crucial usage scenarios like—for example—sharing data, real-time collaboration around documents and media, working with applications executing in a distributed computing environment.
  • the web browser architecture places limitations on performance, user experience richness and ease of development of modern Internet applications.
  • the web browser architecture is not well-suited to work with cloud-based applications. In particular with those cloud-based applications including real-time communication functionality, data sharing and data synchronization among multiple users.
  • the web browser does not address the need of emerging rich Internet applications and cloud-based Internet applications which include complex functionality on mobile device platforms
  • FTP for document sharing does not enable real-time communication and collaboration.
  • a method and system for distributed computing interface are disclosed.
  • One embodiment involves sharing pictures among a plurality of clients within a collaborative work space with a plurality of client devices.
  • Each client device has a local instantiation of the collaborative work space including a collaborative interface.
  • a presentation corresponding to the image object happens with the work space in a manner synchronized across the collaborative interfaces.
  • Other objects such as audio objects, can be brought into the work space and synchronized accordingly.
  • FIGS. 1 a - h illustrate single-action drag-in interfaces for sharing data objects among several users and storing the data in a distributed computing system according to various embodiments.
  • FIG. 2 illustrates a single-action drag-out interface for storing shared data on a local computer, according to one embodiment.
  • FIGS. 3 a - c illustrate single-action drag-in interfaces for starting a shared data manipulation session with multiple users around an application running on a local computer of one of the participants, according to one embodiment.
  • FIGS. 4 a - b illustrate single-action drag-in interfaces for starting a shared data manipulation session with multiple users around an application running in a distributed computing system, according to one embodiment.
  • FIG. 5 illustrates viewing and managing multiple objects in a data sharing and manipulation session, according to one embodiment.
  • FIG. 6 illustrates accessing data objects stored in a distributed computing system and sharing them in a data sharing and manipulation session, according to one embodiment.
  • FIG. 7 is a block diagram illustrating an embodiment of the present system.
  • FIG. 8 is a block diagram of a routine that enables single-action drag-in sharing of data and automatic storing the shared data in a distributed computing system, according to one embodiment.
  • FIG. 9 is a flow diagram that represents single-action drag-in sharing of data objects and applications, according to one embodiment.
  • FIG. 10 is a flow diagram of a routine that enables synchronous manipulation of data in a communication/collaboration session around application which is running in a distributed computing system, according to one embodiment.
  • FIG. 11 is a flow diagram of a routine that enables single-action drag-out interface for storing shared data on a local computer, according to one embodiment.
  • FIG. 12 is a flow diagram of a routine that enables synchronization of the C-Space distributed computing interface and of the state of data objects during a data sharing session, according to one embodiment.
  • a computer implemented method comprises accessing a collaborative interface, wherein the collaborative interface comprises persistent shared space, wherein visual representation of the collaborative interface is identical for each client accessing the collaborative interface.
  • an object is dragged into the collaborative interface and the object is displayed in real time in the collaborative interface.
  • the object is accessible to other clients in the collaborative interface and the state of the object is continuously synchronized.
  • the object is manipulated in the collaborative interface and other clients accessing the collaborative interface are viewed.
  • the present method and system also relates to apparatus for performing the operations herein.
  • This apparatus may be specially constructed for the required purposes, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer.
  • a computer program may be stored in a computer readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, and magnetic-optical disks, read-only memories (“ROMs”), random access memories (“RAMs”), EPROMs, EEPROMs, magnetic or optical cards, or any type of media suitable for storing electronic instructions, and each coupled to a computer system bus.
  • FIG. 1 a illustrates a personal computer desktop ( 101 ) on which a C-Space shared space area ( 105 ) is open, according to one embodiment.
  • the shared space 105 includes images or videos representing Users ( 102 , 103 , 104 ) participating in a data sharing and manipulation session.
  • Users 102 , 103 , 104
  • the shared space 105 includes images or videos representing Users ( 102 , 103 , 104 ) participating in a data sharing and manipulation session.
  • a number of files and documents are represented, all of which can be shared by participating users during a sharing session in a shared space:
  • Rich text document e.g. a Microsoft Word .doc file or an Open Office document
  • Presentation e.g. a Microsoft PowerPoint file or an Open Office presentation
  • Spreadsheet e.g. a Microsoft Excel file or an Open Office spreadsheet
  • the shared space ( 105 ) may provide various ease of use functionality.
  • the shared space 105 may be resized using the resize control in the lower right corner ( 105 a .)
  • the shared space 105 may also be minimized, closed or maximized to occupy all the available viewing area of the shared space ( 105 ) using controls ( 105 b ) on the upper right corner.
  • a flip control ( 105 f ) can be used to see the files stored in a distributed computing system, as well as using these stored files in a distributed data session.
  • FIG. 1 b illustrates a single-action dragging interface for sharing data objects among several users in a data-sharing session, according to one embodiment.
  • User 102 wishes to share the Word document ( 106 ) on his personal computer desktop.
  • User 102 selects the document and drags it from the PC desktop into the open shared space ( 105 .)
  • the path of the dragged file is shown by images 106 a i c.
  • the other documents shown ( 107 - 111 ) can be shared in a similar way.
  • the user drags a document into their shared space ( 105 ), and it occupies the available viewing area of the shared space ( 105 ) and presents to each shared space session participant as shown in FIG. 1 c.
  • dragging is one embodiment for introducing an object into the sharing space, the user may be provided additional and/or alternative mechanisms for initiating a sharing session.
  • FIG. 1 c illustrates a data-sharing and data-manipulation session among multiple users with a Word document shared in a C-Space, according to one embodiment.
  • Users 102 - 104 are sharing a Word document in shared space 105 .
  • the document is represented as a viewer ( 112 ) and occupies the entire available shared-space ( 105 ) to maximize the shared experience.
  • Each User here Users 102 - 104 , see exactly the same content and exactly the same view of the document as the other users participating in the session; the view of the shared space is also synchronized over time among the participants of data sharing and manipulation session.
  • Other embodiments of the present invention may enable asynchronous operations, or support security measures which place limits on information sharing, and/or provide other ways of sharing data not necessarily in an absolutely synchronous manner.
  • the file viewer ( 112 ) can include the following parts:
  • 112 f toolbar which allows the document to be dragged around within the shared space, as well as allowing the document to be dragged out of the shared space
  • FIG. 1 d illustrates the functionality of including additional files within a C-Space data-sharing and data-manipulation session, according to one embodiment.
  • Users 102 - 104 represented by images or videos
  • User 103 wishes to share the PowerPoint document ( 107 ) on her personal computer desktop while a Word document is already being shared and occupying the shared space ( 105 ).
  • User 103 selects the PowerPoint presentation and drags it from the PC desktop into the open shared space ( 105 .)
  • the path of the dragged file is shown by images 107 a - b.
  • the PowerPoint viewer is presented synchronously to all participants of the data-sharing session.
  • the Word document previously being shared is no longer visible.
  • the PowerPoint viewer occupies all the available viewing area of the shared space ( 105 ) and presents to each shared space session participant as shown below in FIG. 1 d.
  • other embodiments could simultaneously display multiple simultaneously shared documents, and/or a user could be involved in multiple C-Space sessions simultaneously.
  • FIG. 1 e illustrates a data-sharing and data manipulation session with a PowerPoint presentation shared among session users 102 - 104 , according to one embodiment.
  • the PowerPoint presentation has been dragged into the session over a previously shared Word document.
  • the PowerPoint presentation viewer ( 113 ) occupies the entire shared space.
  • the word document is obscured from view and represented as a small tab ( 105 c ) labeled with, the document's name.
  • the newly shared PowerPoint presentation is also represented by a tab ( 105 d ). On mouse-over, such file tabs display a close button.
  • FIG. 1 f illustrates a single-action dragging interface for sharing a browser session among multiple participants in a C-Space data-sharing session, according to one embodiment.
  • the shared space contains images or videos representing Users ( 102 , 103 , 104 ) participating in a data sharing and manipulation session.
  • User ( 104 ) wants to share a web browser session and opens a web browser and navigates to a web page on his personal computer desktop.
  • User 104 initiates shared browsing by dragging the Internet address link ( 115 ) into the shared space, shown with figures 115 a - b.
  • a shared browser viewer directed to the desired Internet address, opens.
  • the shared viewer is constantly synchronizing among the data-sharing and data-manipulating session participants.
  • the Internet browser viewer shows navigation buttons ( 117 a ), a URL address field ( 117 b ) and a bookmarks bar ( 117 c .)
  • FIG. 1 g illustrates a shared browsing session using C-Space, according to one embodiment.
  • Three users ( 102 - 104 ) are participating in the data-sharing and data-manipulation session, though C-Space allows for fewer or many more participants.
  • the shared space which is in a state of constant synchronization among participants of the shared session, is labeled 105 .
  • the browser viewer ( 117 ) is a simplified browser distinct from standard browsers in that it is hosted within the shared session. Each time a user clicks a web page element within the browser viewer, the view is synchronized among the shared session participants.
  • the browser viewer ( 117 ) can include the following parts:
  • buttons which may include back and forward buttons, a refresh button, and other standard buttons.
  • the browser itself is synchronized across participants of the collaborative session and can display audio files, video files, and flash animations; can process JavaScript as well as regular HTML pages and.
  • FIG. 1 h illustrates sharing sessions for the following types of content, according to one embodiment:
  • All the listed data object types are shared within C-Space data-sharing and data-manipulation sessions by a simple single-action dragging interface.
  • a User can drag a file or a folder of files from his PC desktop into the shared space and it will open with a viewer of the corresponding data type.
  • these objects can be activated from a storage location on a distributed computing system (shown in subsequent examples).
  • FIG. 2 represents the single-action drag-out interface for storing shared data from a data-sharing and data-manipulation on a local computer, according to one embodiment.
  • the shared space contains images or videos representing Users ( 102 , 103 , 104 ) participating in a data sharing and data manipulation session in a shared space ( 105 ).
  • the Users are sharing a Word document ( 112 ) which is visible to all session participants from the viewer in the shared space. As always, this document is synchronized between the participants of the session.
  • FIG. 3 a represents the first variant of the single-action dragging interface for starting a shared data-manipulation session with multiple users around an application running on a local computer of one of the participants, according to one embodiment.
  • a user accesses a Windows desktop 101 .
  • a User ( 103 ) participating in a collaborative session has Adobe Photoshop running on his local personal computer ( 303 ), which is represented on the local taskbar ( 304 ) by an icon ( 301 .)
  • the active C-space session is also represented by an icon ( 302 ) on the taskbar.
  • a visual representation of the Photoshop application opens immediately within the shared space ( 105 ,) where all session participants ( 102 - 104 ) can see the open Photoshop application.
  • Each user will be able to manipulate and control the open application in synchronized real time. In this way, they can collaborate using the open application; for example, running a tutorial, collaborating on a design project, or otherwise collaborating using the application.
  • FIG. 3 b illustrates a single-action dragging interface for starting a shared-data manipulation session around an application running on the local computer of one of the session participants, according to one embodiment.
  • Participants of the session ( 102 - 104 ) are collaborating using shared space ( 105 ) and one of them wants to start an application sharing session, which they can initiate by dragging an object that represents the application, labeled ( 307 ), into the shared space.
  • the object can be a short-cut, an executable file, or a flash file which can be interpreted as an application by the shared space.
  • User 104 drags an object ( 307 ) into the shared space ( 105 ,) shown as dragging path 307 a.
  • the application begins to run in an application viewer 306 .
  • FIG. 3 c illustrates a variant of the single-action dragging interface for starting a shared data-manipulation session using an application which is running on the local computer of one of the participants, according to one embodiment.
  • one of the Users ( 102 ) has an application running, such as an Adobe Photoshop file ( 308 .)
  • User 102 also has a C-Space collaborative session ( 105 ) running.
  • User 102 selects the Photoshop application ( 308 ) and drags it (illustrated by figure 309 ) into the C-Space session ( 105 .) User 102 continues to have the application running locally. In addition a visual representation of the Photoshop application is visible to all session participants ( 102 - 104 ) and the application is fully operational and constantly synchronized among all the participants.
  • FIG. 4 a illustrates a single-action dragging interface for starting a shared data-manipulation session using an application which is running on a distributed computing system, according to one embodiment.
  • a C-Space is running with Users 102 - 104 participating in a collaborative session using C-Space 105 .
  • One of the users wants to start a data-manipulation session which would utilize an application running in a distributed computer system, and activates an application repository user interface control ( 401 .)
  • This control includes all of the applications which are working in a distributed application system which is used by the C-Space interface.
  • the applications shown here are represented as figures 402 - 404 and can include a visual representation of the application as well as textual descriptions.
  • the application repository control can have a search element ( 405 ) that allows session participants to search all of the available applications running in the distributed computing system.
  • the application activates and begins the data-manipulation session in which Users 102 - 104 are participating.
  • the view inside the application shared space ( 407 ) is synchronized among all the collaborative session participants.
  • the application is working in a distributed computing system, rather than locally. Though some resources may run locally on session participants' local computers, a significant portion of resources run on the distributed computing system.
  • FIG. 4 b illustrates a single-action dragging interface for starting a shared data-manipulation session using an application which is running on a distributed computing system, according to one embodiment.
  • a URL which can be used to access an application via a browser in many applications that support access thru the Internet and web browsers. It can be used to access them as a web service using send protocols.
  • the application can be shared in a collaborative session in which Users ( 102 - 104 ) are collaborating by dragging URL ( 409 ) from a local web browser ( 408 ) into collaborative shared space ( 105 .)
  • the dragging path is illustrated in figure 410 .
  • FIG. 5 illustrates viewing and managing multiple objects in a data-sharing and manipulation session within a shared space, according to one embodiment.
  • the shared space ( 105 ) which contains multiple objects ( 501 - 504 ) such as media types, data objects, pictures, audio, video, and applications: such as java and flash apps.
  • the shared space also has a flip button, 506 .
  • Icons in the shared space are shared among all the participants of the shared session: all the participants see how icons are arranged in the shared space, can move them around, can change display size and can activate them. Objects or applications are activated when a session participant clicks on the icon in the shared space. A viewer for the appropriate data object opens, represented here as 505 .
  • Users can delete data objects from the shared space by right clicking on icons representing these objects in shared space ( 105 ) and selecting Remove option from the context menu. Users can also move them around within the shared space, and can move them in and out of the shared space ( 105 ). Copy on desktop icon remains in shared space ( 105 ). User can access data files stored in the storage subsystem of the distributed computing system in a data sharing session through C-Space interface.
  • FIG. 6 Accessing data objects stored within a distributed computing system and sharing them in a data manipulation session, according to one embodiment.
  • the shared space presents remote files and data as if they were on the User's local machine.
  • a shared space 105 has an application ( 601 ) running inside of it.
  • the application may access data stored in the distributed computing system, which the shared space allows it to do seamlessly.
  • An area 602 exists where a User chooses files they want to manipulate.
  • the files are data objects.
  • Figures 603 - 604 illustrate files or objects located in a remote distributed computing system.
  • Objects can be activated to add to a data-sharing and data-manipulation session in progress by right-clicking the object and selecting from the menu. Once activated within the session, all participants can synchronously see, edit and otherwise manipulate the file.
  • FIG. 7 is a block diagram illustrating an embodiment of the present invention in the form of an architectural diagram, according to one embodiment.
  • a shared space ( 105 ) has an application ( 707 ) running.
  • the client running on a shared space User's PC is shown.
  • On the right is a diagram of the cloud, a distributed computing system with multiple processing units ( 701 - 706 ) which can be actually separate computers, which can be hosted in a data center, networked, talking to each other and/or having attached storage ( 722 .)
  • the distributed computing system has the following components/subsystems:
  • the distributed computing system interprets these as natural devices, such as input devices (like a mouse, keyboard, or microphone) or output devices (monitor, speakers—mainly graphical and sound output.)
  • Data Transfer Encoding Compression Layers ( 731 - 732 ) make communication between the distributed computing system and the client using it more efficient, more secure and generally operating very well.
  • the Client has a shared space ( 105 ), is a paradigm of operation in applications using the distributed computing system ( 707 )
  • the applications can be launched and activated.
  • Data objects can be started which can be utilized.
  • the client UI for data manipulation and data synchronization has the following capabilities, according to one embodiment:
  • a Virtualization Layer ( 708 ) consists of the following components:
  • Synchronization layer ( 717 ) consists of the four components that enable the synchronization of the several user interfaces working around the same data objects or the same application.
  • the four components are as follow:
  • FIG. 8 is a block and flow diagram of single-action drag-in sharing of data and automatic storing of the shared data in a distributed computing system, according to one embodiment.
  • Step 1 A user is engaged in a data-sharing and data-manipulation session with aim to share Word document data object ( 801 ). User initiates sharing of a data object by dragging it ( 802 ) into the shared space ( 105 ). A viewer for the appropriate data object is activated, in this case a viewer for Word documents.
  • Step 2 The moment it is activated, an event system of the client computer of a user participating in the data sharing and manipulation session sends an event to the event synchronization server that the new data object is being shared.
  • the event synchronization server requests the list of session participants from the session component in the distributed computing system and the session component discovers that two participants are working with the user in collaborative session 105 .
  • the events 805 - 806 that the data is being shared with them are sent to the participants of the sharing session by event synchronization server.
  • clients Upon receiving events 805 - 806 clients start displaying animation to notify the users that synchronization is starting.
  • Step 3 The data synchronization components on the clients start exchanging messages and event between each other and the data synchronization server according to data synchronization protocol.
  • the data object itself is split into chunks and are synchronized chunk by chunk.
  • the parts of the file or data object that arrive in the distributed computing system are synchronized with the data synchronization component to participants 807 - 808 , shown by path 813 - 814 .
  • a local copy of the data ( 820 ) is stored seamlessly and transparently at the event of sharing.
  • De-duplication system is in place which makes sure no two copies of identical files are stored in the storage system.
  • Step 4 When all the bits of data that have been transferred to the participants of the data sharing session, the participants tell the event synchronization server that the synchronization has been completed. Upon receiving all of these events the server sends out confirmation events and the clients make the data object available for manipulation, sharing and collaboration for the users.
  • FIG. 9 is a flow diagram of single-action drag-in sharing of data objects and applications, according to one embodiment.
  • FIG. 10 is a block diagram synchronization and synchronous manipulation of the data among multiple participants in a data manipulation session based on an application working in a distributed computing system, according to one embodiment.
  • a distributed computing system ( 1401 ) has all of the computing units ( 1404 - 1407 ,) and timed synchronization component, timed synchronization server ( 1402 ) and has an application running in a distributed computing system ( 1403 .) This application has been launched and is actually working for the user interface for data manipulation and data sharing, which was initiated by the client. This application is working through the cloud.
  • the application working in a distributed computing system is receiving its input (like mouse movement or keyboard strokes) from a virtual input layer which in fact receives those commands from the C-Space User interface over the network.
  • the application outputs graphics to a virtual graphic device. That output, which represents a set of commands such as triangles or low-level graphic primitives, is captured by the system and encoded and compressed to minimize traffic. It is transmitted over network to client, where it is decompressed, decoded and put to the virtual output device.
  • timestamp of the frames of the graphic output are compared.
  • the time is always synchronized among all of the participants of the collaboration session.
  • the synchronization is tight, resulting in each session participant's viewing and/or hearing the same thing. It is synchronized by an algorithm, which is referenced in our previous patent.
  • T Prime is less than T by significant amount (>T threshold , which varies by application according to its latency requirements) the frame is discarded. Whichever user has the fastest computer receives the best picture, the best output. A user with a slower computer or connection experiences skipped frames in order to keep them at the same level of synchronization, at the same frame of the graphical output.
  • This graphical output is decompressed, decoded.
  • a frame can be cut or dropped if it is out of time, but it can also remain there.
  • Everything else goes to the virtual output device, which actually redirects the output to the hardware output device, which can be the screen of a mobile phone, a plasma TV connected to a home entertainment center, or a laptop display.
  • FIG. 11 is a flow diagram of single-action drag-out interface for storing shared data on a local computer, according to one embodiment.
  • FIG. 12 is a flow diagram of synchronization of the C-Space distributed computing interface and of the state of data objects during a data sharing session, according to one embodiment.
  • Users A, B, C are participating in a data sharing and manipulation session by using C-Space interface. They have shared spaces 106 , 107 , 108 open respectively. All the C-Space clients in the session in question are running the same application App 1 . Different instances of the applications are represented as App 1 , App 1 ′ and App 1 ′′ running inside application viewer plug-ins 1209 , 1210 , 1211 .
  • Distributed computing system 1201 is running the following components used in this client synching session, according to one embodiment:
  • Each of C-Space User Interface clients have the following 3 components involved in the synchronization process, according to one embodiment:
  • Event Synchronization Client Component 1214 Event Synchronization Client Component 1214 .
  • Time synchronization server and time synchronization components implement algorithm and protocol for precise continuous time synchronization among multiple participants in a communication session described in sections 0041-0076 of the previously filed patent application #2008/0181260 A1 “Method and system for precise synchronization of audio and video streams during a distributed communication session with multiple participants”.
  • the implementation of these methods introduces a common time system which is synchronized to the order of milliseconds or tens of milliseconds.
  • the synchronization occurs by exchanging time stamped events encoded in messages which also carry payload data between clients and distributed computing system.
  • a sample seven-step sequence of exchange is illustrated in the figure and described below.
  • Step 1 An event that needs to be synchronized (e.g. a mouse click or a drag in of a data object into C-Space session) is generated by Event Synchronization Client Component 1214 . It contains a timestamp provided by Time Synchronization Client Component 1212 on Step 1 a, synchronization state (all variables, etc.) and payload data object supplied by Data Synchronization Client Component 1213 (i.e. a chunk of a file that is being synchronized).
  • Event Synchronization Client Component 1214 It contains a timestamp provided by Time Synchronization Client Component 1212 on Step 1 a, synchronization state (all variables, etc.) and payload data object supplied by Data Synchronization Client Component 1213 (i.e. a chunk of a file that is being synchronized).
  • Event Synchronization Server 1204 places a request to Session Management Server Component 1203 to get all the participants of the data sharing and manipulation session unless it has the list cached in its memory stack.
  • Step 3 Session Management Component returns the addresses of the users and request Time Synchronization Server to put a timestamp on the event.
  • Step 4 Notification events time stamped by Time Synchronization server 1205 are sent out to clients and are processed by their event synchronization components.
  • Step 5 Payload data objects are sent as separate messages with timestamps and synchronization state associated with the initial event that was generated.
  • Step 6 Event synchronization Client Component on the cloud discards event and modifications that originated by time T earlier before the actual arrival because that data may become irrelevant. Constant T varies per application. All events that arrive within a given timeframe un-discarded, state and payload data are applied and “mixed”.
  • Step 7 The modified state content and payload data is sent back to the event and data synchronization servers with their timestamp and the process completes the loop of perpetual synchronization.
  • Synchronization of live data, audio and video streams during a data manipulation session can be accomplished through any suitable mechanism.
  • One example technique is described in U.S. Published Patent Application No. 2008/0181260 A1 entitled “Method and system for precise synchronization of audio and video streams during a distributed communication session with multiple participants,” the contents of which are incorporated herein by reference.

Abstract

Computer implemented methods and systems for sharing pictures among a plurality of clients within a collaborative work space are disclosed. Each client device has a local instantiation of the collaborative work space including a collaborative interface. In response to receiving or dragging an image object into the collaborative interface or work space, a presentation corresponding to the image object happens with the work space in a manner synchronized across the collaborative interfaces. Other objects, such as audio objects, can be brought into the work space and synchronized accordingly.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • The present application is a continuation of co-pending U.S. patent application Ser. No. 12/564,010 entitled “Method and System for Distributed Computing Interface”, filed Sep. 21, 2009, which claims the benefit of and priority to U.S. Provisional Patent Application No. 61/098,682 entitled “Method and System for Distributed Computing Interface for Sharing, Synchronizing, Manipulating, Storing, and Transporting Data” filed on Sep. 19, 2008, both of which are hereby, incorporated by reference.
  • FIELD
  • The present system relates in general to computer applications and, more specifically to a method and system for distributed computing interface.
  • BACKGROUND
  • According to Opera Software ASA in 1997 around 85% of the time spent at a computer was spent using desktop applications. In 2007, about 70% of the
  • time was spent using a web browser. The web browser has become the most commonly used human interface for using computing.
  • However, the ways people are using internet services and the ways the internet services are provided in terms of underlying technology are changing. The three strong trends that demonstrate this ongoing change are Rich Internet Applications, Cloud Computing, and Mobile Internet Services.
  • Rich Internet Applications
  • As the browser is used for the majority of the time spent at a computer, users demand rich functionality of complex software to be available through the web browser. Examples of the functionalities include image editing, video processing, document processing, VoIP telecommunications, video conferencing, and distributed collaboration systems. Existing technologies (Adobe Flex, AJAX, and/or Java Applets) enable the browser to run complex applications. Although such applications were developed for the web browser by a number of startup and large companies, the architecture and legacy of the web browser place several limitations on application performance, development ease and the user interface richness.
  • Cloud Computing
  • Companies in the cloud computing field are building infrastructure for cloud computing. As computing and storage have gotten cheaper hosting internet applications with massive usage (millions of simultaneous users) within a centralized data center has become possible. Such applications and data centers have been built by companies like Google (search, email), Yahoo (email), Salesforce.com (CRM). The next step was to build a set of application programming interfaces (APIs) around these datacenters to allow third party developers to host their applications on the robust infrastructures built and supported by large industry players. This new way of developing, deploying, providing and using Internet services and applications was named “cloud computing.” Cloud computing was pioneered by companies such as Amazon with their Amazon Web Services initiative which started with S3 (APIs and service for cloud storage) and EC2 (computing). The followers included Google (Google Application Engine) and Microsoft (Live Mesh initiative).
  • Mobile Internet Services
  • With the introduction of convenient zoom-in/zoom-out multi-touch user interfaces on mobile devices with small screens, affordable pricing for unlimited Internet usage, fast data transfer capabilities on cellular networks (3G), built-in global positioning devices, photo and video cameras, powerful processors and large storage mobile devices are becoming the new and great platform for rich mobile Internet applications and services including cloud-based applications. No standard way of utilizing the computing and storage power of the cloud is available on mobile devices. The internet is accessed via custom web browsers built into mobile devices (Opera, iPhone) or third party applications that lack a standard approach for using internet services.
  • The web browser used to access cloud applications uses http and https-based protocols, placing a number of limitations on the capabilities of cloud computing. In particular the current cloud computing platforms fail to enable data synchronization between multiple application users, real-time streaming capabilities, and real-time collaboration capabilities. User interface is lacking to utilize capabilities provided by rich applications running in the cloud (cloud-based applications). Also, a browser cannot naturally offload data processing to the cloud (e.g. graphic rendering or CPU intensive jobs) and there is no way to make offloading transparent and seamless for the end user.
  • The web browser's underlying technological principles of operation and its architecture can no longer provide the best solution for certain crucial usage scenarios like—for example—sharing data, real-time collaboration around documents and media, working with applications executing in a distributed computing environment.
  • The web browser architecture places limitations on performance, user experience richness and ease of development of modern Internet applications.
  • The web browser architecture is not well-suited to work with cloud-based applications. In particular with those cloud-based applications including real-time communication functionality, data sharing and data synchronization among multiple users. The web browser does not address the need of emerging rich Internet applications and cloud-based Internet applications which include complex functionality on mobile device platforms
  • Beyond the browser, there are a few methods that are commonly used by users to share the documents and collaborate. However, most of these methods/applications are even less convenient then the browser.
  • Users utilize email as the way to share documents as attachments but email has limitations such as the attachment size and difficulty of tracking document versions. FTP for document sharing does not enable real-time communication and collaboration.
  • Tools exist that work with one or a few file types, but do not address the sharing and collaborating around many rich media types such as pictures, music, videos, games, or applications. Existing collaboration tools do not provide support for cloud-based Internet applications.
  • Based on the above there is a need for an improved base application for using Internet services with a different user interface and architecture better suited to answer the emerging needs such as the richness of Internet applications, support for and taking advantage of cloud computing applications and utilizing these two trends on the emerging mass market mobile device platforms.
  • SUMMARY
  • A method and system for distributed computing interface are disclosed. One embodiment involves sharing pictures among a plurality of clients within a collaborative work space with a plurality of client devices. Each client device has a local instantiation of the collaborative work space including a collaborative interface. In response to receiving or dragging an image object into the collaborative interface or work space, a presentation corresponding to the image object happens with the work space in a manner synchronized across the collaborative interfaces. Other objects, such as audio objects, can be brought into the work space and synchronized accordingly.
  • BRIEF DESCRIPTION
  • The accompanying drawings, which are included as part of the present specification, illustrate the presently preferred embodiment and together with the general description given above and the detailed description of the preferred embodiment given below serve to explain and teach the principles of the present invention.
  • FIGS. 1 a-h illustrate single-action drag-in interfaces for sharing data objects among several users and storing the data in a distributed computing system according to various embodiments.
  • FIG. 2 illustrates a single-action drag-out interface for storing shared data on a local computer, according to one embodiment.
  • FIGS. 3 a-c illustrate single-action drag-in interfaces for starting a shared data manipulation session with multiple users around an application running on a local computer of one of the participants, according to one embodiment.
  • FIGS. 4 a-b illustrate single-action drag-in interfaces for starting a shared data manipulation session with multiple users around an application running in a distributed computing system, according to one embodiment.
  • FIG. 5 illustrates viewing and managing multiple objects in a data sharing and manipulation session, according to one embodiment.
  • FIG. 6 illustrates accessing data objects stored in a distributed computing system and sharing them in a data sharing and manipulation session, according to one embodiment.
  • FIG. 7 is a block diagram illustrating an embodiment of the present system.
  • FIG. 8 is a block diagram of a routine that enables single-action drag-in sharing of data and automatic storing the shared data in a distributed computing system, according to one embodiment.
  • FIG. 9 is a flow diagram that represents single-action drag-in sharing of data objects and applications, according to one embodiment.
  • FIG. 10 is a flow diagram of a routine that enables synchronous manipulation of data in a communication/collaboration session around application which is running in a distributed computing system, according to one embodiment.
  • FIG. 11 is a flow diagram of a routine that enables single-action drag-out interface for storing shared data on a local computer, according to one embodiment.
  • FIG. 12 is a flow diagram of a routine that enables synchronization of the C-Space distributed computing interface and of the state of data objects during a data sharing session, according to one embodiment.
  • DETAILED DESCRIPTION
  • A method and system for distributed computing interface are disclosed. According to one embodiment, a computer implemented method comprises accessing a collaborative interface, wherein the collaborative interface comprises persistent shared space, wherein visual representation of the collaborative interface is identical for each client accessing the collaborative interface. In a single action, an object is dragged into the collaborative interface and the object is displayed in real time in the collaborative interface. The object is accessible to other clients in the collaborative interface and the state of the object is continuously synchronized. The object is manipulated in the collaborative interface and other clients accessing the collaborative interface are viewed.
  • In the following description, a new term “c-space” is utilized when referring to a shared collaboration space.
  • In the following description, for purposes of explanation, specific nomenclature is set forth to provide a thorough understanding of the various inventive concepts disclosed herein. However, it will be apparent to one skilled in the art that these specific details are not required in order to practice the various inventive concepts disclosed herein.
  • Some portions of the detailed descriptions that follow are presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. A method is here, and generally, conceived to be a self-consistent process leading to a desired result. The process involves physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
  • It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussion, it is appreciated that throughout the description, discussions utilizing terms such as “processing” or “computing” or “calculating” or “determining” or “displaying” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
  • The present method and system also relates to apparatus for performing the operations herein. This apparatus may be specially constructed for the required purposes, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a computer readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, and magnetic-optical disks, read-only memories (“ROMs”), random access memories (“RAMs”), EPROMs, EEPROMs, magnetic or optical cards, or any type of media suitable for storing electronic instructions, and each coupled to a computer system bus.
  • The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose systems may be used with programs in accordance with the teachings herein, or it may prove convenient to construct more specialized apparatus to perform the required method steps. The required structure for a variety of these systems will appear from the description below. In addition, the present invention is not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the method and system as described herein.
  • As will be appreciated, the teachings of the present invention can be readily implemented on a variety of computing platforms including mobile and portable platforms, the personal desktop simply being a convenient paradigm for discussion. Additionally, the wide variety of features and functionality described below are optional and implementation dependent. Those skilled in the art will readily understand which features are suitable and required for any specific implementation.
  • FIG. 1 a illustrates a personal computer desktop (101) on which a C-Space shared space area (105) is open, according to one embodiment.
  • The shared space 105 includes images or videos representing Users (102, 103, 104) participating in a data sharing and manipulation session. By way of example, a number of files and documents are represented, all of which can be shared by participating users during a sharing session in a shared space:
  • 106 Rich text document (e.g. a Microsoft Word .doc file or an Open Office document)
  • 107 Presentation (e.g. a Microsoft PowerPoint file or an Open Office presentation)
  • 108 Spreadsheet (e.g. a Microsoft Excel file or an Open Office spreadsheet)
  • 109 video file (in this case, mp4)
  • 110 image file (in this case, jpg format)
  • 111 audio file (in this case, mp3)
  • The shared space (105) may provide various ease of use functionality. For example, the shared space 105 may be resized using the resize control in the lower right corner (105 a.) The shared space 105 may also be minimized, closed or maximized to occupy all the available viewing area of the shared space (105) using controls (105 b) on the upper right corner. A flip control (105 f) can be used to see the files stored in a distributed computing system, as well as using these stored files in a distributed data session.
  • FIG. 1 b illustrates a single-action dragging interface for sharing data objects among several users in a data-sharing session, according to one embodiment.
  • In the scenario depicted above, User 102 wishes to share the Word document (106) on his personal computer desktop. User 102 selects the document and drags it from the PC desktop into the open shared space (105.) The path of the dragged file is shown by images 106 ai c. The other documents shown (107-111) can be shared in a similar way.
  • The user drags a document into their shared space (105), and it occupies the available viewing area of the shared space (105) and presents to each shared space session participant as shown in FIG. 1 c. As will be appreciated, dragging is one embodiment for introducing an object into the sharing space, the user may be provided additional and/or alternative mechanisms for initiating a sharing session.
  • FIG. 1 c illustrates a data-sharing and data-manipulation session among multiple users with a Word document shared in a C-Space, according to one embodiment.
  • In this example, Users 102-104 (represented by images or videos) are sharing a Word document in shared space 105. Once the document has been dragged or otherwise brought in, the document is represented as a viewer (112) and occupies the entire available shared-space (105) to maximize the shared experience. Each User, here Users 102-104, see exactly the same content and exactly the same view of the document as the other users participating in the session; the view of the shared space is also synchronized over time among the participants of data sharing and manipulation session. Other embodiments of the present invention may enable asynchronous operations, or support security measures which place limits on information sharing, and/or provide other ways of sharing data not necessarily in an absolutely synchronous manner.
  • The file viewer (112) can include the following parts:
  • 112 a—resizing element
  • 112 b—elements that allow the document to be maximized, minimized or closed within the shared space
  • 112 f—toolbar which allows the document to be dragged around within the shared space, as well as allowing the document to be dragged out of the shared space
  • 112 c—bar showing the document file name
  • 112 d—toolbar with controls for basic document manipulation and editing
  • 112 e—document content
  • FIG. 1 d illustrates the functionality of including additional files within a C-Space data-sharing and data-manipulation session, according to one embodiment. In this example, Users 102-104 (represented by images or videos) participate in a data-sharing and data-manipulation session. User 103 wishes to share the PowerPoint document (107) on her personal computer desktop while a Word document is already being shared and occupying the shared space (105). User 103 selects the PowerPoint presentation and drags it from the PC desktop into the open shared space (105.) The path of the dragged file is shown by images 107 a-b.
  • Once the dragging is complete, the PowerPoint viewer is presented synchronously to all participants of the data-sharing session. In addition, the Word document previously being shared is no longer visible. As with the shared Word document, the PowerPoint viewer occupies all the available viewing area of the shared space (105) and presents to each shared space session participant as shown below in FIG. 1 d. Of course, other embodiments could simultaneously display multiple simultaneously shared documents, and/or a user could be involved in multiple C-Space sessions simultaneously.
  • FIG. 1 e illustrates a data-sharing and data manipulation session with a PowerPoint presentation shared among session users 102-104, according to one embodiment. In this scenario, the PowerPoint presentation has been dragged into the session over a previously shared Word document. The PowerPoint presentation viewer (113) occupies the entire shared space. The word document is obscured from view and represented as a small tab (105 c) labeled with, the document's name. The newly shared PowerPoint presentation is also represented by a tab (105 d). On mouse-over, such file tabs display a close button.
  • FIG. 1 f illustrates a single-action dragging interface for sharing a browser session among multiple participants in a C-Space data-sharing session, according to one embodiment.
  • The shared space contains images or videos representing Users (102, 103, 104) participating in a data sharing and manipulation session. User (104) wants to share a web browser session and opens a web browser and navigates to a web page on his personal computer desktop. User 104 initiates shared browsing by dragging the Internet address link (115) into the shared space, shown with figures 115 a-b.
  • Within the shared space, a shared browser viewer, directed to the desired Internet address, opens. The shared viewer is constantly synchronizing among the data-sharing and data-manipulating session participants.
  • Note that the Internet browser viewer shows navigation buttons (117 a), a URL address field (117 b) and a bookmarks bar (117 c.)
  • FIG. 1 g illustrates a shared browsing session using C-Space, according to one embodiment. Three users (102-104) are participating in the data-sharing and data-manipulation session, though C-Space allows for fewer or many more participants. The shared space, which is in a state of constant synchronization among participants of the shared session, is labeled 105.
  • The browser viewer (117) is a simplified browser distinct from standard browsers in that it is hosted within the shared session. Each time a user clicks a web page element within the browser viewer, the view is synchronized among the shared session participants.
  • The browser viewer (117) can include the following parts:
  • 117 a—navigation buttons, which may include back and forward buttons, a refresh button, and other standard buttons.
  • 117 b—address bar, which also serves as a search bar
  • 117 c—bookmark bar
  • 117 f—scroll bar
  • The browser itself is synchronized across participants of the collaborative session and can display audio files, video files, and flash animations; can process JavaScript as well as regular HTML pages and.
  • FIG. 1 h illustrates sharing sessions for the following types of content, according to one embodiment:
  • 118—video
  • 119—music
  • 120—image
  • 121—folder of images
  • All the listed data object types are shared within C-Space data-sharing and data-manipulation sessions by a simple single-action dragging interface. A User can drag a file or a folder of files from his PC desktop into the shared space and it will open with a viewer of the corresponding data type. Additionally, these objects can be activated from a storage location on a distributed computing system (shown in subsequent examples).
  • FIG. 2 represents the single-action drag-out interface for storing shared data from a data-sharing and data-manipulation on a local computer, according to one embodiment.
  • The shared space contains images or videos representing Users (102, 103, 104) participating in a data sharing and data manipulation session in a shared space (105). The Users are sharing a Word document (112) which is visible to all session participants from the viewer in the shared space. As always, this document is synchronized between the participants of the session.
  • User (104) wants to save a copy of this shared document (112) to the local PC desktop for reference. He clicks the document header and then drags it from the shared space onto his PC desktop, shown with figures 122-123.
  • While the shared document remains available to the session participants in the viewer, User 104 will have saved a local copy of the file on his own computer desktop.
  • FIG. 3 a represents the first variant of the single-action dragging interface for starting a shared data-manipulation session with multiple users around an application running on a local computer of one of the participants, according to one embodiment.
  • A user accesses a Windows desktop 101. A User (103) participating in a collaborative session has Adobe Photoshop running on his local personal computer (303), which is represented on the local taskbar (304) by an icon (301.) The active C-space session is also represented by an icon (302) on the taskbar.
  • To begin sharing the local Photoshop application among other C-space session, User 103 selects the C-Space icon in the taskbar (302) and drags it into shared C-Space session (305.) A visual representation of the Photoshop application opens immediately within the shared space (105,) where all session participants (102-104) can see the open Photoshop application. Each user will be able to manipulate and control the open application in synchronized real time. In this way, they can collaborate using the open application; for example, running a tutorial, collaborating on a design project, or otherwise collaborating using the application.
  • FIG. 3 b illustrates a single-action dragging interface for starting a shared-data manipulation session around an application running on the local computer of one of the session participants, according to one embodiment. Participants of the session (102-104) are collaborating using shared space (105) and one of them wants to start an application sharing session, which they can initiate by dragging an object that represents the application, labeled (307), into the shared space. The object can be a short-cut, an executable file, or a flash file which can be interpreted as an application by the shared space.
  • User 104 drags an object (307) into the shared space (105,) shown as dragging path 307 a. The application begins to run in an application viewer 306.
  • FIG. 3 c illustrates a variant of the single-action dragging interface for starting a shared data-manipulation session using an application which is running on the local computer of one of the participants, according to one embodiment.
  • On computer desktop (101,) one of the Users (102) has an application running, such as an Adobe Photoshop file (308.) User 102 also has a C-Space collaborative session (105) running.
  • User 102 selects the Photoshop application (308) and drags it (illustrated by figure 309) into the C-Space session (105.) User 102 continues to have the application running locally. In addition a visual representation of the Photoshop application is visible to all session participants (102-104) and the application is fully operational and constantly synchronized among all the participants.
  • FIG. 4 a illustrates a single-action dragging interface for starting a shared data-manipulation session using an application which is running on a distributed computing system, according to one embodiment.
  • A C-Space is running with Users 102-104 participating in a collaborative session using C-Space 105. One of the users wants to start a data-manipulation session which would utilize an application running in a distributed computer system, and activates an application repository user interface control (401.) This control includes all of the applications which are working in a distributed application system which is used by the C-Space interface.
  • The applications shown here are represented as figures 402-404 and can include a visual representation of the application as well as textual descriptions. The application repository control can have a search element (405) that allows session participants to search all of the available applications running in the distributed computing system.
  • To share an application running on a distributed computing system, the User clicks the application icon on their local desktop and drags it into shared space (105): the dragging path is shown as figure 406. As the application is dragged into the shared space, the application activates and begins the data-manipulation session in which Users 102-104 are participating. The view inside the application shared space (407) is synchronized among all the collaborative session participants. The application is working in a distributed computing system, rather than locally. Though some resources may run locally on session participants' local computers, a significant portion of resources run on the distributed computing system.
  • FIG. 4 b illustrates a single-action dragging interface for starting a shared data-manipulation session using an application which is running on a distributed computing system, according to one embodiment.
  • One way to access an application which is running on a distributed computing system is via a unique resource locator a URL, which can be used to access an application via a browser in many applications that support access thru the Internet and web browsers. It can be used to access them as a web service using send protocols.
  • The application can be shared in a collaborative session in which Users (102-104) are collaborating by dragging URL (409) from a local web browser (408) into collaborative shared space (105.) The dragging path is illustrated in figure 410. Once the URL is dragged in to the collaborative space, if C-Space recognizes and is able to work within the application's standard protocols, the URL link expands into an application running within the collaborative session. All users see a synchronized view of this application and they can work with and manipulate data within this application.
  • FIG. 5 illustrates viewing and managing multiple objects in a data-sharing and manipulation session within a shared space, according to one embodiment. The shared space (105) which contains multiple objects (501-504) such as media types, data objects, pictures, audio, video, and applications: such as java and flash apps. The shared space also has a flip button, 506.
  • Icons in the shared space are shared among all the participants of the shared session: all the participants see how icons are arranged in the shared space, can move them around, can change display size and can activate them. Objects or applications are activated when a session participant clicks on the icon in the shared space. A viewer for the appropriate data object opens, represented here as 505.
  • Users can delete data objects from the shared space by right clicking on icons representing these objects in shared space (105) and selecting Remove option from the context menu. Users can also move them around within the shared space, and can move them in and out of the shared space (105). Copy on desktop icon remains in shared space (105). User can access data files stored in the storage subsystem of the distributed computing system in a data sharing session through C-Space interface.
  • FIG. 6: Accessing data objects stored within a distributed computing system and sharing them in a data manipulation session, according to one embodiment.
  • The shared space presents remote files and data as if they were on the User's local machine. A shared space 105 has an application (601) running inside of it. The application may access data stored in the distributed computing system, which the shared space allows it to do seamlessly.
  • An area 602 exists where a User chooses files they want to manipulate. In this case the files are data objects. Figures 603-604 illustrate files or objects located in a remote distributed computing system.
  • Another way for Users to access and manipulate data files stored in a remote distributed computing system while in a C-Space shared session is to use the “flip” button (Figure. b, 605). Clicking it makes the C-Space appear to flip and shows the file structure of stored objects and files (Word documents, Excel spreadsheets, PowerPoint presentations, images, movies, etc) within the C-Space's cloud storage system. Not only can Users can navigate this file storage system as with any standard file storage structure, but its use is full incorporated into the data-sharing and data-manipulation functionality of the C-Space.
  • Users can use a search field 606 to find a specific object stored in the cloud storage system. Objects can be activated to add to a data-sharing and data-manipulation session in progress by right-clicking the object and selecting from the menu. Once activated within the session, all participants can synchronously see, edit and otherwise manipulate the file.
  • FIG. 7 is a block diagram illustrating an embodiment of the present invention in the form of an architectural diagram, according to one embodiment.
  • A shared space (105) has an application (707) running. On the left, the client running on a shared space User's PC is shown. On the right is a diagram of the cloud, a distributed computing system with multiple processing units (701-706) which can be actually separate computers, which can be hosted in a data center, networked, talking to each other and/or having attached storage (722.)
  • The distributed computing system has the following components/subsystems:
      • 105 Shared space
      • 707 Application running in shared space
      • 725 Host Manipulation System 725 manages the computing instances of the distributed computing system. HMS which would spawn and stop computers from running and stopping execution
      • 726 Application Loader, which would load the code to execute in the distributed computing system and can enforce data security and shared access requirements for the code being executed execute
      • 727 Virtual File System—however each of the processing units have their own OS, their own file systems, memory and graphics cards—but this is a virtual file system with can be used by an application which is working in the cloud, so they would use this like layers of an OS.
      • 728 Directory Service—to be able to find software and capabilities and APIs available in the distributed computing system. So this is like an API (application programming interface) not a human interface but an interface for a machine to be able to operate, to use the distributed computing system.
      • 729 Messaging System
  • There are also a number of important components that are crucial in synchronizing the UI to the distributed computing system:
      • 723 Advanced Synchronization Server
      • 724 Time Synchronization Server
      • 730 Data Synchronization Server
  • There is also a range of virtual devices and applications that can be running in the distributed computing system. The distributed computing system interprets these as natural devices, such as input devices (like a mouse, keyboard, or microphone) or output devices (monitor, speakers—mainly graphical and sound output.)
      • 728 Virtual Input Devices
      • 729 Virtual Output Devices
  • Data Transfer Encoding Compression Layers (731-732) make communication between the distributed computing system and the client using it more efficient, more secure and generally operating very well.
  • The Client has a shared space (105), is a paradigm of operation in applications using the distributed computing system (707) The applications can be launched and activated. Data objects can be started which can be utilized. The client UI for data manipulation and data synchronization has the following capabilities, according to one embodiment:
  • A Virtualization Layer (708) consists of the following components:
      • 709 Computing Unit
      • 710 Memory
      • 711 Virtual Storage—virtual storage which can really be unlimited. The application treats it as a local hard drive, but in fact it is storage that is relying on the distributed computing system
      • 712 Real-Time Data Pipes (Duplex)—Uses a very complex and precise algorithm and results in very tight synchronization
      • 713 Asynchronous Data Pipes—for loading and transferring data, as well as communicating. Very secure, but neither built for speed nor synchronization.
      • 714 Virtual Memory—not the memory of the computer but that of the distributed computing system —715—Virtual Input/Output Devices—captures output from an
      • 716 application running in a distributed computing system and captures input from C-Space user interface clients.
  • Synchronization layer (717) consists of the four components that enable the synchronization of the several user interfaces working around the same data objects or the same application. The four components are as follow:
      • 718 Time Synchronization—Crucial for all parts of the process. It is very precise, synchronizing every five seconds
      • 719 Data Object Synchronization—Working in conjunction with Data Stream Synchronization (see below), ensures that the data objects that are being manipulated are being synchronous and that multiple participants.
      • 720 Data Stream Synchronization—Working in conjunction with Data Object Synchronization (see above), ensures that the data objects that are being manipulated are being synchronous and that multiple participants.
      • 721 State Synchronization—the synchronization of the UI
  • FIG. 8 is a block and flow diagram of single-action drag-in sharing of data and automatic storing of the shared data in a distributed computing system, according to one embodiment.
  • Step 1: A user is engaged in a data-sharing and data-manipulation session with aim to share Word document data object (801). User initiates sharing of a data object by dragging it (802) into the shared space (105). A viewer for the appropriate data object is activated, in this case a viewer for Word documents.
  • Step 2: The moment it is activated, an event system of the client computer of a user participating in the data sharing and manipulation session sends an event to the event synchronization server that the new data object is being shared. The event synchronization server requests the list of session participants from the session component in the distributed computing system and the session component discovers that two participants are working with the user in collaborative session 105. The events 805-806 that the data is being shared with them are sent to the participants of the sharing session by event synchronization server. Upon receiving events 805-806 clients start displaying animation to notify the users that synchronization is starting.
  • Step 3: The data synchronization components on the clients start exchanging messages and event between each other and the data synchronization server according to data synchronization protocol. The data object itself is split into chunks and are synchronized chunk by chunk. Immediately, without waiting for the entire file to be uploaded into the distributed computing system, the parts of the file or data object that arrive in the distributed computing system are synchronized with the data synchronization component to participants 807-808, shown by path 813-814.
  • At the same time, all the copies of these bits of data are stored in the distributed computing system's storage area. A local copy of the data (820) is stored seamlessly and transparently at the event of sharing. De-duplication system is in place which makes sure no two copies of identical files are stored in the storage system.
  • Step 4: When all the bits of data that have been transferred to the participants of the data sharing session, the participants tell the event synchronization server that the synchronization has been completed. Upon receiving all of these events the server sends out confirmation events and the clients make the data object available for manipulation, sharing and collaboration for the users.
  • FIG. 9 is a flow diagram of single-action drag-in sharing of data objects and applications, according to one embodiment.
  • FIG. 10 is a block diagram synchronization and synchronous manipulation of the data among multiple participants in a data manipulation session based on an application working in a distributed computing system, according to one embodiment.
  • A distributed computing system (1401) has all of the computing units (1404-1407,) and timed synchronization component, timed synchronization server (1402) and has an application running in a distributed computing system (1403.) This application has been launched and is actually working for the user interface for data manipulation and data sharing, which was initiated by the client. This application is working through the cloud.
  • The application working in a distributed computing system is receiving its input (like mouse movement or keyboard strokes) from a virtual input layer which in fact receives those commands from the C-Space User interface over the network. The application outputs graphics to a virtual graphic device. That output, which represents a set of commands such as triangles or low-level graphic primitives, is captured by the system and encoded and compressed to minimize traffic. It is transmitted over network to client, where it is decompressed, decoded and put to the virtual output device.
  • Before that, timestamp of the frames of the graphic output are compared. The time is always synchronized among all of the participants of the collaboration session. The synchronization is tight, resulting in each session participant's viewing and/or hearing the same thing. It is synchronized by an algorithm, which is referenced in our previous patent.
  • Consider a frame of graphics data to be displayed on a client computer being received in the moment of time “T” and let's assume that the frame is time-stamped “T Prime”. If T Prime is less than T by significant amount (>Tthreshold, which varies by application according to its latency requirements) the frame is discarded. Whichever user has the fastest computer receives the best picture, the best output. A user with a slower computer or connection experiences skipped frames in order to keep them at the same level of synchronization, at the same frame of the graphical output.
  • This graphical output is decompressed, decoded. A frame can be cut or dropped if it is out of time, but it can also remain there. Everything else goes to the virtual output device, which actually redirects the output to the hardware output device, which can be the screen of a mobile phone, a plasma TV connected to a home entertainment center, or a laptop display.
  • FIG. 11 is a flow diagram of single-action drag-out interface for storing shared data on a local computer, according to one embodiment.
  • FIG. 12: is a flow diagram of synchronization of the C-Space distributed computing interface and of the state of data objects during a data sharing session, according to one embodiment.
  • Users A, B, C are participating in a data sharing and manipulation session by using C-Space interface. They have shared spaces 106, 107, 108 open respectively. All the C-Space clients in the session in question are running the same application App1. Different instances of the applications are represented as App1, App1′ and App1″ running inside application viewer plug- ins 1209, 1210, 1211.
  • Distributed computing system 1201 is running the following components used in this client synching session, according to one embodiment:
  • Data Synchronization Server 1202
  • Session Management Server Component 1203
  • Event Synchronization Server 1204
  • Time Synchronization Server 1205
  • Storage subsystem 1206.
  • Each of C-Space User Interface clients have the following 3 components involved in the synchronization process, according to one embodiment:
  • Time Synchronization Client Component 1212
  • Data Synchronization Client Component 1213
  • Event Synchronization Client Component 1214.
  • Time synchronization server and time synchronization components implement algorithm and protocol for precise continuous time synchronization among multiple participants in a communication session described in sections 0041-0076 of the previously filed patent application #2008/0181260 A1 “Method and system for precise synchronization of audio and video streams during a distributed communication session with multiple participants”. The implementation of these methods introduces a common time system which is synchronized to the order of milliseconds or tens of milliseconds.
  • The synchronization occurs by exchanging time stamped events encoded in messages which also carry payload data between clients and distributed computing system. A sample seven-step sequence of exchange is illustrated in the figure and described below.
  • Step 1. An event that needs to be synchronized (e.g. a mouse click or a drag in of a data object into C-Space session) is generated by Event Synchronization Client Component 1214. It contains a timestamp provided by Time Synchronization Client Component 1212 on Step 1 a, synchronization state (all variables, etc.) and payload data object supplied by Data Synchronization Client Component 1213 (i.e. a chunk of a file that is being synchronized).
  • Step 2. Event Synchronization Server 1204 places a request to Session Management Server Component 1203 to get all the participants of the data sharing and manipulation session unless it has the list cached in its memory stack.
  • Step 3: Session Management Component returns the addresses of the users and request Time Synchronization Server to put a timestamp on the event.
  • Step 4. Notification events time stamped by Time Synchronization server 1205 are sent out to clients and are processed by their event synchronization components.
  • Step 5: Payload data objects are sent as separate messages with timestamps and synchronization state associated with the initial event that was generated.
  • Step 6: Event synchronization Client Component on the cloud discards event and modifications that originated by time T earlier before the actual arrival because that data may become irrelevant. Constant T varies per application. All events that arrive within a given timeframe un-discarded, state and payload data are applied and “mixed”.
  • Step 7: The modified state content and payload data is sent back to the event and data synchronization servers with their timestamp and the process completes the loop of perpetual synchronization.
  • Synchronization of live data, audio and video streams during a data manipulation session can be accomplished through any suitable mechanism. One example technique is described in U.S. Published Patent Application No. 2008/0181260 A1 entitled “Method and system for precise synchronization of audio and video streams during a distributed communication session with multiple participants,” the contents of which are incorporated herein by reference.
  • A method and system for distributed computing interface are disclosed. It is understood that the embodiments described herein are for the purpose of elucidation and should not be considered limiting the subject matter of the present embodiments. Various modifications, uses, substitutions, recombinations, improvements, methods of productions without departing from the scope or spirit of the present invention would be evident to a person skilled in the art.

Claims (24)

1. A computer-implemented method for sharing pictures within a distributed computing interface among a plurality of clients, the method comprising:
accessing a collaborative interface, wherein the collaborative interface comprises persistent shared space, and wherein a visual representation of the collaborative interface is equivalent for each client accessing the collaborative interface;
dragging a picture object into the collaborative interface in a single action, the picture object representing a collection of pictures, wherein the collection of pictures are displayed in real time in the collaborative interface, wherein the picture object is accessible to other clients in the collaborative interface, wherein the state of the picture object is continuously substantially synchronized the distributed computing interface;
manipulating the picture object in the collaborative interface; and
viewing other clients accessing the collaborative interface.
2. The method of claim 1, further comprising editing the picture object in the collaborative interface.
3. The method of claim 1, further comprising deleting the picture object from the collaborative interface.
4. The method of claim 1, further comprising exporting the picture object to a client system from the collaborative interface.
5. The method of claim 1 further comprising:
dragging an audio object into the collaborative interface;
playing audio associated with the audio object in the collaborative interface while displaying the collection of pictures.
6. The method of claim 1, wherein the collaborative interface comprises a video chat interface.
7. A computer implemented method for sharing pictures among a plurality of clients within a distributed computing interface, the method comprising:
providing a collaborative interface at each of a plurality of client devices;
wherein each specific collaborative interface represents a specific instantiation of the distributed computing interface local to a corresponding specific client device, each specific interface suited for the corresponding specific client device;
at a first client device having a first collaborative interface, receiving instructions from a first client to engage an image object within the first collaborative interface;
initiating a presentation of the image object within the collaborative workspace;
displaying, in a synchronized manner, the presentation within each collaborative interface at each client device.
8. A computer implemented method as recited in claim 7, further comprising:
providing controls to at least one of the plurality of clients enabling manipulation of the image object within at least one collaborative interface.
9. A computer implemented method as recited in claim 7, further comprising:
in each collaborative interface, providing video-chat capability with other clients.
10. A computer implemented method as recited in claim 7, further comprising:
at a second client device having a second collaborative interface, receiving instructions from a second client to engage an audio object within the second collaborative interface;
playing audio associated with the audio object within the distributed computing interface;
synchronizing audio across the distributed computing interface and within each collaborative interface at each client device.
11. A computer implemented method as recited in claim 10, wherein the first client device and the second client device are a same device.
12. A computer implemented method as recited in claim 7, further comprising
providing controls to at least one of the plurality of clients enabling manipulation of the image object within at least one collaborative interface;
in each collaborative interface, providing video-chat capability with other clients;
at a second client device having a second collaborative interface, receiving instructions from a second client to engage an audio object within the second collaborative interface;
playing audio associated with the audio object within the distributed computing interface;
synchronizing audio across the distributed computing interface and within each collaborative interface at each client device.
13. A system for sharing pictures among a plurality of clients within a distributed computing interface, the system comprising:
a plurality of client devices, wherein each client device includes a processor, memory, a display, and a network interface;
a server including a server processor, a server memory, and a server network interface;
a network coupling the plurality of client devices and the server;
wherein the system is arranged to provide a collaborative interface displayed on each display at each of the plurality of client devices;
wherein each specific collaborative interface represents a specific instantiation of the distributed computing interface local to a corresponding specific client device, each specific interface suited for the corresponding specific client device;
wherein the distributed computing interface is implemented across the server and the plurality of client devices;
wherein a first client device includes a first collaborative interface, and the distributed computing interface is configured for:
receiving instructions from a first client to engage a picture object within the first collaborative interface;
initiating a presentation of the picture object within the collaborative workspace; and
displaying, in a synchronized manner, the presentation within each collaborative interface at each client device.
14. A system as recited in claim 13, wherein the system is further configured for providing controls to at least one of the plurality of clients enabling manipulation of the picture object within at least one collaborative interface.
15. A system as recited in claim 13, wherein the system is further configured for, in each collaborative interface, providing video-chat capability with other clients.
16. A system as recited in claim 13, wherein the system is further configured for:
at a second client device having a second collaborative interface, receiving instructions from a second client to engage an audio object within the second collaborative interface;
playing audio associated with the audio object within the distributed computing interface;
synchronizing audio across the distributed computing interface and within each collaborative interface at each client device.
17. A system as recited in claim 16, wherein the first client device and the second client device are a same device.
18. A system as recited in claim 13, wherein the system is further configured for:
providing controls to at least one of the plurality of clients enabling manipulation of the picture object within at least one collaborative interface;
in each collaborative interface, providing video-chat capability with other clients;
at a second client device having a second collaborative interface, receiving instructions from a second client to engage an audio object within the second collaborative interface;
playing audio associated with the audio object within the distributed computing interface;
synchronizing audio across the distributed computing interface and within each collaborative interface at each client device.
19. A computer system for sharing pictures within a distributed computing interface, the system comprising:
means for accessing a collaborative interface, wherein the collaborative interface comprises persistent shared space, and wherein a visual representation of the collaborative interface is identical for each client accessing the collaborative interface;
means for dragging a picture object into the collaborative interface in a single action, the picture object representing a collection of pictures, wherein the collection of pictures are displayed in real time in the collaborative interface, wherein the picture object is accessible to other clients in the collaborative interface, wherein the state of the picture object is continuously synchronized;
means for manipulating the object in the collaborative interface; and
means for viewing other clients accessing the collaborative interface.
20. The system of claim 19, further comprising means for editing the picture object in the collaborative interface.
21. The system of claim 19, further comprising means for deleting the picture object from the collaborative interface.
22. The system of claim 19, further comprising means for exporting the picture object to a client system from the collaborative interface.
23. The system of claim 19 further comprising:
means for dragging an audio object into the collaborative interface;
means for playing audio associated with the audio object in the collaborative interface in conjunction with displaying the collection of objects.
24. The system of claim 19, wherein the collaborative interface comprises means for a video chat interface.
US13/316,845 2008-09-19 2011-12-12 Methods and systems for sharing images synchronized across a distributed computing interface Abandoned US20120084672A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/316,845 US20120084672A1 (en) 2008-09-19 2011-12-12 Methods and systems for sharing images synchronized across a distributed computing interface

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US9868208P 2008-09-19 2008-09-19
US12/564,010 US8689115B2 (en) 2008-09-19 2009-09-21 Method and system for distributed computing interface
US13/316,845 US20120084672A1 (en) 2008-09-19 2011-12-12 Methods and systems for sharing images synchronized across a distributed computing interface

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/564,010 Continuation US8689115B2 (en) 2008-09-19 2009-09-21 Method and system for distributed computing interface

Publications (1)

Publication Number Publication Date
US20120084672A1 true US20120084672A1 (en) 2012-04-05

Family

ID=42166315

Family Applications (2)

Application Number Title Priority Date Filing Date
US12/564,010 Active 2030-09-27 US8689115B2 (en) 2008-09-19 2009-09-21 Method and system for distributed computing interface
US13/316,845 Abandoned US20120084672A1 (en) 2008-09-19 2011-12-12 Methods and systems for sharing images synchronized across a distributed computing interface

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US12/564,010 Active 2030-09-27 US8689115B2 (en) 2008-09-19 2009-09-21 Method and system for distributed computing interface

Country Status (1)

Country Link
US (2) US8689115B2 (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100088277A1 (en) * 2008-10-07 2010-04-08 Ocarina Networks Object deduplication and application aware snapshots
US20100251142A1 (en) * 2009-03-30 2010-09-30 Avaya Inc. System and method for persistent multimedia conferencing services
US20130290855A1 (en) * 2012-04-29 2013-10-31 Britt C. Ashcraft Virtual shared office bulletin board
US20140129948A1 (en) * 2012-11-08 2014-05-08 Bank Of America Corporation Method and apparatus for simultaneous display of information from multiple portable devices on a single screen
US8902272B1 (en) 2008-11-24 2014-12-02 Shindig, Inc. Multiparty communications systems and methods that employ composite communications
US20140379586A1 (en) * 2013-06-25 2014-12-25 Box, Inc. Systems and methods for providing shell communication in a cloud-based platform
US20150046834A1 (en) * 2013-08-09 2015-02-12 Lenovo (Beijing) Co., Ltd. Information processing apparatus and information processing method
EP2887193A1 (en) * 2013-12-20 2015-06-24 General Electric Company Systems and methods for sharing a user interface element based on user gestures
WO2015138709A2 (en) 2014-03-12 2015-09-17 Rechargeable Battery Corporation Thermoformable medical member with heater and method of manufacturing same
US9401937B1 (en) 2008-11-24 2016-07-26 Shindig, Inc. Systems and methods for facilitating communications amongst multiple users
US9459786B2 (en) 2013-05-28 2016-10-04 General Electric Company Systems and methods for sharing a user interface element based on user gestures
US9712579B2 (en) 2009-04-01 2017-07-18 Shindig. Inc. Systems and methods for creating and publishing customizable images from within online events
US9711181B2 (en) 2014-07-25 2017-07-18 Shindig. Inc. Systems and methods for creating, editing and publishing recorded videos
US9734410B2 (en) 2015-01-23 2017-08-15 Shindig, Inc. Systems and methods for analyzing facial expressions within an online classroom to gauge participant attentiveness
US9733333B2 (en) 2014-05-08 2017-08-15 Shindig, Inc. Systems and methods for monitoring participant attentiveness within events and group assortments
US9779708B2 (en) 2009-04-24 2017-10-03 Shinding, Inc. Networks of portable electronic devices that collectively generate sound
US9782675B2 (en) 2008-11-24 2017-10-10 Shindig, Inc. Systems and methods for interfacing video games and user communications
US9947366B2 (en) 2009-04-01 2018-04-17 Shindig, Inc. Group portraits composed using video chat systems
US9952751B2 (en) 2014-04-17 2018-04-24 Shindig, Inc. Systems and methods for forming group communications within an online event
US10133916B2 (en) 2016-09-07 2018-11-20 Steven M. Gottlieb Image and identity validation in video chat events
US10235366B2 (en) * 2016-08-16 2019-03-19 Microsoft Technology Licensing, Llc Activity gallery view in communication platforms
US10271010B2 (en) 2013-10-31 2019-04-23 Shindig, Inc. Systems and methods for controlling the display of content
US11330026B1 (en) * 2021-07-31 2022-05-10 Zoom Video Communications, Inc. Concurrent screen sharing by multiple users within a communication session

Families Citing this family (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8613673B2 (en) * 2008-12-15 2013-12-24 Sony Computer Entertainment America Llc Intelligent game loading
US9501329B2 (en) * 2009-05-08 2016-11-22 Rackspace Us, Inc. Methods and systems for cloud computing management
US20110047501A1 (en) * 2009-08-21 2011-02-24 Avaya Inc. Sequenced applications with user playback or other user controls utilizing a single window or dialog box
US8060560B2 (en) * 2009-08-27 2011-11-15 Net Power And Light, Inc. System and method for pervasive computing
JP2011070511A (en) * 2009-09-28 2011-04-07 Sony Corp Terminal device, server device, display control method, and program
KR20110083176A (en) * 2010-01-13 2011-07-20 삼성전자주식회사 Apparatus and method for combining cloud instance with resource of a plurality of device
EP2383984B1 (en) * 2010-04-27 2019-03-06 LG Electronics Inc. Image display apparatus and method for operating the same
WO2012011630A1 (en) 2010-07-20 2012-01-26 Lg Electronics Inc. Selective interaction between networked smart devices
WO2012011635A1 (en) * 2010-07-20 2012-01-26 Lg Electronics Inc. Computing device and displaying method at the computing device
CN103098500B (en) 2010-07-20 2016-10-12 Lg电子株式会社 Its method that information is provided of electronic equipment, electronic system and use
WO2012011636A1 (en) 2010-07-20 2012-01-26 Lg Electronics Inc. User profile based configuration of user experience environment
WO2012102416A1 (en) * 2011-01-24 2012-08-02 Lg Electronics Inc. Data sharing between smart devices
JP5857443B2 (en) * 2011-05-12 2016-02-10 ソニー株式会社 Content sharing system
GB2505589A (en) * 2011-06-17 2014-03-05 Smart Internet Technology Crc A system, method and computer program for interacting with data
EP2729877A4 (en) * 2011-07-08 2015-06-17 Box Inc Desktop application for access and interaction with workspaces in a cloud-based content management system and synchronization mechanisms thereof
JP5853464B2 (en) * 2011-07-27 2016-02-09 キヤノンマーケティングジャパン株式会社 Information processing apparatus, control method, and program
US8861937B2 (en) * 2011-08-31 2014-10-14 The Nielsen Company (Us), Llc Methods and apparatus to access media
US20130125009A1 (en) * 2011-11-16 2013-05-16 International Business Machines Corporation Remote desktop localized content sharing
US9773051B2 (en) 2011-11-29 2017-09-26 Box, Inc. Mobile platform file and folder selection functionalities for offline access and synchronization
USD757735S1 (en) * 2012-01-19 2016-05-31 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
US10055419B2 (en) * 2012-02-03 2018-08-21 Apple Inc. User interface for accessing documents from a computing device
CN102638567B (en) * 2012-03-02 2015-05-20 深圳市朗科科技股份有限公司 Multi-application cloud storage platform and cloud storage terminal
US9575981B2 (en) 2012-04-11 2017-02-21 Box, Inc. Cloud service enabled to handle a set of files depicted to a user as a single file in a native operating system
US9396216B2 (en) 2012-05-04 2016-07-19 Box, Inc. Repository redundancy implementation of a system which incrementally updates clients with events that occurred via a cloud-enabled platform
US9794256B2 (en) 2012-07-30 2017-10-17 Box, Inc. System and method for advanced control tools for administrators in a cloud-based service
GB2513671A (en) 2012-08-27 2014-11-05 Box Inc Server side techniques for reducing database workload in implementing selective subfolder synchronization in a cloud-based environment
US20140075377A1 (en) 2012-09-10 2014-03-13 Samsung Electronics Co. Ltd. Method for connecting mobile terminal and external display and apparatus implementing the same
US9553758B2 (en) 2012-09-18 2017-01-24 Box, Inc. Sandboxing individual applications to specific user folders in a cloud-based service
US10235383B2 (en) 2012-12-19 2019-03-19 Box, Inc. Method and apparatus for synchronization of items with read-only permissions in a cloud-based environment
US9396245B2 (en) 2013-01-02 2016-07-19 Box, Inc. Race condition handling in a system which incrementally updates clients with events that occurred in a cloud-based collaboration platform
US9953036B2 (en) 2013-01-09 2018-04-24 Box, Inc. File system monitoring in a system which incrementally updates clients with events that occurred in a cloud-based collaboration platform
US9507795B2 (en) 2013-01-11 2016-11-29 Box, Inc. Functionalities, features, and user interface of a synchronization client to a cloud-based environment
US10599671B2 (en) 2013-01-17 2020-03-24 Box, Inc. Conflict resolution, retry condition management, and handling of problem files for the synchronization client to a cloud-based platform
US10725968B2 (en) 2013-05-10 2020-07-28 Box, Inc. Top down delete or unsynchronization on delete of and depiction of item synchronization with a synchronization client to a cloud-based platform
US10846074B2 (en) 2013-05-10 2020-11-24 Box, Inc. Identification and handling of items to be ignored for synchronization with a cloud-based platform by a synchronization client
US9451456B2 (en) 2013-06-03 2016-09-20 The Aerospace Corporation Smart phone server sleeve
GB2515192B (en) 2013-06-13 2016-12-14 Box Inc Systems and methods for synchronization event building and/or collapsing by a synchronization component of a cloud-based platform
US9805050B2 (en) 2013-06-21 2017-10-31 Box, Inc. Maintaining and updating file system shadows on a local device by a synchronization client of a cloud-based platform
US20150012831A1 (en) * 2013-07-08 2015-01-08 Jacoh, Llc Systems and methods for sharing graphical user interfaces between multiple computers
US9535924B2 (en) 2013-07-30 2017-01-03 Box, Inc. Scalability improvement in a system which incrementally updates clients with events that occurred in a cloud-based collaboration platform
KR101475462B1 (en) * 2013-08-14 2014-12-23 브레인즈스퀘어(주) System for synchronizing cloud storage and files encrypted with an encryption key of the user
KR102184269B1 (en) * 2013-09-02 2020-11-30 삼성전자 주식회사 Display apparatus, portable apparatus and method for displaying a screen thereof
US9679331B2 (en) 2013-10-10 2017-06-13 Shindig, Inc. Systems and methods for dynamically controlling visual effects associated with online presentations
US10530854B2 (en) 2014-05-30 2020-01-07 Box, Inc. Synchronization of permissioned content in cloud-based environments
US10649634B2 (en) * 2014-06-06 2020-05-12 International Business Machines Corporation Indexing and annotating a usability test recording
US10824291B2 (en) 2014-07-31 2020-11-03 Samsung Electronics Co., Ltd. Device and method of displaying windows by using work group
US10462194B2 (en) * 2015-02-10 2019-10-29 Cisco Technology, Inc. Minimizing productivity loss in a collaborative sharing environment
US9767305B2 (en) * 2015-03-13 2017-09-19 Facebook, Inc. Systems and methods for sharing media content with recognized social connections
WO2016197257A1 (en) * 2015-06-12 2016-12-15 Nureva, Inc. System, apparatus, and method for facilitating and perpetuating a collaborative ideation session
US10768803B2 (en) * 2015-09-21 2020-09-08 Motorola Solutions, Inc. User interface system with active and passive display spaces
US10375074B2 (en) 2016-03-11 2019-08-06 Postoak. Today Llc Methods and apparatus for establishing shared memory spaces for data access and distribution
US10469438B2 (en) 2017-02-27 2019-11-05 Salesforce.Com, Inc. Facilitating integration of collaborative communication platform and document collaboration tool
US11163616B2 (en) * 2017-03-07 2021-11-02 Polyjuice Ab Systems and methods for enabling interoperation of independent software applications
US20190121899A1 (en) * 2017-10-23 2019-04-25 Electronics And Telecommunications Research Institute Apparatus and method for managing integrated storage
US11892996B1 (en) 2019-07-16 2024-02-06 Splunk Inc. Identifying an indexing node to process data using a resource catalog
US10592363B2 (en) * 2018-06-04 2020-03-17 International Business Machines Corporation Asynchronous remote mirror cloud archival
US11099942B2 (en) * 2019-03-21 2021-08-24 International Business Machines Corporation Archival to cloud storage while performing remote backup of data
US11829415B1 (en) 2020-01-31 2023-11-28 Splunk Inc. Mapping buckets and search peers to a bucket map identifier for searching
US11615082B1 (en) 2020-07-31 2023-03-28 Splunk Inc. Using a data store and message queue to ingest data for a data intake and query system
US11609913B1 (en) 2020-10-16 2023-03-21 Splunk Inc. Reassigning data groups from backup to searching for a processing node
US11711493B1 (en) 2021-03-04 2023-07-25 Meta Platforms, Inc. Systems and methods for ephemeral streaming spaces
US11507399B1 (en) 2021-05-25 2022-11-22 Cisco Technology, Inc. Enabling screen-share in online meeting platform based on virtual desktop
US11620307B2 (en) * 2021-06-07 2023-04-04 Snowflake Inc. Stage replication in a cloud data lake
US11809395B1 (en) 2021-07-15 2023-11-07 Splunk Inc. Load balancing, failover, and reliable delivery of data in a data intake and query system

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793365A (en) * 1996-01-02 1998-08-11 Sun Microsystems, Inc. System and method providing a computer user interface enabling access to distributed workgroup members
US6191807B1 (en) * 1994-05-27 2001-02-20 Canon Kabushiki Kaisha Communication apparatus and method for performing a file transfer operation
US6343313B1 (en) * 1996-03-26 2002-01-29 Pixion, Inc. Computer conferencing system with real-time multipoint, multi-speed, multi-stream scalability
US20020065741A1 (en) * 1999-08-31 2002-05-30 Baum Daniel R. Distributing images to multiple recipients
US20050251462A1 (en) * 2004-05-04 2005-11-10 Paul Nykamp Systems and methods for interactively displaying product information and for collaborative product design
US7246367B2 (en) * 2000-06-30 2007-07-17 Nokia Corporation Synchronized service provision in a communications network
US20070186178A1 (en) * 2006-02-06 2007-08-09 Yahoo! Inc. Method and system for presenting photos on a website
US7840650B2 (en) * 2006-05-09 2010-11-23 Imageshack Corp. Sharing of digital media on a network
US7853886B2 (en) * 2007-02-27 2010-12-14 Microsoft Corporation Persistent spatial collaboration
US7979550B2 (en) * 2007-05-24 2011-07-12 Sihai Xiao Methods and apparatuses for adjusting bandwidth allocation during a collaboration session

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE60033164T2 (en) * 2000-12-22 2007-10-25 Sun Microsystems, Inc., Palo Alto Server-side execution of application modules in a client / server system
US20030097410A1 (en) * 2001-10-04 2003-05-22 Atkins R. Travis Methodology for enabling multi-party collaboration across a data network
US7676542B2 (en) * 2002-12-02 2010-03-09 Sap Ag Establishing a collaboration environment
US7681136B2 (en) * 2003-01-08 2010-03-16 Oracle International Corporation Methods and systems for collaborative whiteboarding and content management
US7702730B2 (en) * 2004-09-03 2010-04-20 Open Text Corporation Systems and methods for collaboration
JP4738805B2 (en) * 2004-12-16 2011-08-03 株式会社リコー Screen sharing system, screen sharing method, screen sharing program
US7693958B2 (en) * 2005-06-20 2010-04-06 Microsoft Corporation Instant messaging with data sharing
US8190707B2 (en) * 2007-10-20 2012-05-29 Citrix Systems, Inc. System and method for transferring data among computing environments
US20090119604A1 (en) * 2007-11-06 2009-05-07 Microsoft Corporation Virtual office devices
US8291079B1 (en) * 2008-06-04 2012-10-16 Appcelerator, Inc. System and method for developing, deploying, managing and monitoring a web application in a single environment
US8336047B2 (en) * 2008-08-25 2012-12-18 International Business Machines Corporation Provisioning virtual resources using name resolution

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6191807B1 (en) * 1994-05-27 2001-02-20 Canon Kabushiki Kaisha Communication apparatus and method for performing a file transfer operation
US5793365A (en) * 1996-01-02 1998-08-11 Sun Microsystems, Inc. System and method providing a computer user interface enabling access to distributed workgroup members
US6343313B1 (en) * 1996-03-26 2002-01-29 Pixion, Inc. Computer conferencing system with real-time multipoint, multi-speed, multi-stream scalability
US20020065741A1 (en) * 1999-08-31 2002-05-30 Baum Daniel R. Distributing images to multiple recipients
US7246367B2 (en) * 2000-06-30 2007-07-17 Nokia Corporation Synchronized service provision in a communications network
US20050251462A1 (en) * 2004-05-04 2005-11-10 Paul Nykamp Systems and methods for interactively displaying product information and for collaborative product design
US20070186178A1 (en) * 2006-02-06 2007-08-09 Yahoo! Inc. Method and system for presenting photos on a website
US7840650B2 (en) * 2006-05-09 2010-11-23 Imageshack Corp. Sharing of digital media on a network
US7853886B2 (en) * 2007-02-27 2010-12-14 Microsoft Corporation Persistent spatial collaboration
US7979550B2 (en) * 2007-05-24 2011-07-12 Sihai Xiao Methods and apparatuses for adjusting bandwidth allocation during a collaboration session

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100088277A1 (en) * 2008-10-07 2010-04-08 Ocarina Networks Object deduplication and application aware snapshots
US9251161B2 (en) 2008-10-07 2016-02-02 Dell Products L.P. Object deduplication and application aware snapshots
US9613043B2 (en) 2008-10-07 2017-04-04 Quest Software Inc. Object deduplication and application aware snapshots
US8694466B2 (en) * 2008-10-07 2014-04-08 Dell Products L.P. Object deduplication and application aware snapshots
US9041768B1 (en) 2008-11-24 2015-05-26 Shindig, Inc. Multiparty communications systems and methods that utilize multiple modes of communication
US9215412B2 (en) 2008-11-24 2015-12-15 Shindig, Inc. Multiparty communications systems and methods that optimize communications based on mode and available bandwidth
US8917310B2 (en) 2008-11-24 2014-12-23 Shindig, Inc. Multiparty communications systems and methods that optimize communications based on mode and available bandwidth
US10542237B2 (en) 2008-11-24 2020-01-21 Shindig, Inc. Systems and methods for facilitating communications amongst multiple users
US9661270B2 (en) 2008-11-24 2017-05-23 Shindig, Inc. Multiparty communications systems and methods that optimize communications based on mode and available bandwidth
US9401937B1 (en) 2008-11-24 2016-07-26 Shindig, Inc. Systems and methods for facilitating communications amongst multiple users
US9357169B2 (en) 2008-11-24 2016-05-31 Shindig, Inc. Multiparty communications and methods that utilize multiple modes of communication
US8902272B1 (en) 2008-11-24 2014-12-02 Shindig, Inc. Multiparty communications systems and methods that employ composite communications
US9782675B2 (en) 2008-11-24 2017-10-10 Shindig, Inc. Systems and methods for interfacing video games and user communications
US9900280B2 (en) 2009-03-30 2018-02-20 Avaya Inc. System and method for managing incoming requests for a communication session using a graphical connection metaphor
US20100251142A1 (en) * 2009-03-30 2010-09-30 Avaya Inc. System and method for persistent multimedia conferencing services
US9325661B2 (en) 2009-03-30 2016-04-26 Avaya Inc. System and method for managing a contact center with a graphical call connection metaphor
US9344396B2 (en) * 2009-03-30 2016-05-17 Avaya Inc. System and method for persistent multimedia conferencing services
US11460985B2 (en) 2009-03-30 2022-10-04 Avaya Inc. System and method for managing trusted relationships in communication sessions using a graphical metaphor
US10574623B2 (en) 2009-03-30 2020-02-25 Avaya Inc. System and method for graphically managing a communication session with a context based contact set
US8938677B2 (en) 2009-03-30 2015-01-20 Avaya Inc. System and method for mode-neutral communications with a widget-based communications metaphor
US9947366B2 (en) 2009-04-01 2018-04-17 Shindig, Inc. Group portraits composed using video chat systems
US9712579B2 (en) 2009-04-01 2017-07-18 Shindig. Inc. Systems and methods for creating and publishing customizable images from within online events
US9779708B2 (en) 2009-04-24 2017-10-03 Shinding, Inc. Networks of portable electronic devices that collectively generate sound
US20130290855A1 (en) * 2012-04-29 2013-10-31 Britt C. Ashcraft Virtual shared office bulletin board
US20140129948A1 (en) * 2012-11-08 2014-05-08 Bank Of America Corporation Method and apparatus for simultaneous display of information from multiple portable devices on a single screen
US9459786B2 (en) 2013-05-28 2016-10-04 General Electric Company Systems and methods for sharing a user interface element based on user gestures
US20140379586A1 (en) * 2013-06-25 2014-12-25 Box, Inc. Systems and methods for providing shell communication in a cloud-based platform
US10110656B2 (en) * 2013-06-25 2018-10-23 Box, Inc. Systems and methods for providing shell communication in a cloud-based platform
US20150046834A1 (en) * 2013-08-09 2015-02-12 Lenovo (Beijing) Co., Ltd. Information processing apparatus and information processing method
US9608944B2 (en) * 2013-08-09 2017-03-28 Beijing Lenovo Software Ltd. Information processing apparatus and information processing method
US10271010B2 (en) 2013-10-31 2019-04-23 Shindig, Inc. Systems and methods for controlling the display of content
EP2887193A1 (en) * 2013-12-20 2015-06-24 General Electric Company Systems and methods for sharing a user interface element based on user gestures
WO2015138709A2 (en) 2014-03-12 2015-09-17 Rechargeable Battery Corporation Thermoformable medical member with heater and method of manufacturing same
US9952751B2 (en) 2014-04-17 2018-04-24 Shindig, Inc. Systems and methods for forming group communications within an online event
US9733333B2 (en) 2014-05-08 2017-08-15 Shindig, Inc. Systems and methods for monitoring participant attentiveness within events and group assortments
US9711181B2 (en) 2014-07-25 2017-07-18 Shindig. Inc. Systems and methods for creating, editing and publishing recorded videos
US9734410B2 (en) 2015-01-23 2017-08-15 Shindig, Inc. Systems and methods for analyzing facial expressions within an online classroom to gauge participant attentiveness
US10235366B2 (en) * 2016-08-16 2019-03-19 Microsoft Technology Licensing, Llc Activity gallery view in communication platforms
US10133916B2 (en) 2016-09-07 2018-11-20 Steven M. Gottlieb Image and identity validation in video chat events
US11330026B1 (en) * 2021-07-31 2022-05-10 Zoom Video Communications, Inc. Concurrent screen sharing by multiple users within a communication session

Also Published As

Publication number Publication date
US8689115B2 (en) 2014-04-01
US20100122184A1 (en) 2010-05-13

Similar Documents

Publication Publication Date Title
US8689115B2 (en) Method and system for distributed computing interface
US11895184B2 (en) Peer to peer remote application discovery
US20210194994A1 (en) Publication of Applications Using Server-Side Virtual Screen Change Capture
JP6700254B2 (en) Real-time sharing during a call
JP6159338B2 (en) Real-time document presentation data synchronization through general-purpose services
RU2611041C9 (en) Methods and systems for collaborative application sharing and conferencing
Paternò et al. A logical framework for multi-device user interfaces
US9549007B2 (en) User interface widget unit sharing for application user interface distribution
US9992253B2 (en) Non-invasive remote access to an application program
US20080307324A1 (en) Sharing content in a videoconference session
EP2487871A1 (en) Method and system for transmission of application status between different devices
US10237344B2 (en) Copy/paste files between remote agent and local machine in HTML5 view desktop
US20200126513A1 (en) System and method for web enabled application execution and management
US10685169B2 (en) Messaging application with presentation window
US10504277B1 (en) Communicating within a VR environment
Kovachev et al. DireWolf Framework for Widget-based Distributed User Interfaces.
JP2023523065A (en) INTERACTION METHOD, APPARATUS AND ELECTRONICS
US10514959B2 (en) Distributed virtual local operating system stored in cloud and its method
US10511644B2 (en) Joining executable component to online conference
US11704175B2 (en) Bridging virtual desktops under nested mode
JP2009205197A (en) Cgm distribution system and cgm distribution method
US11461168B1 (en) Data loss protection with continuity
US9547694B1 (en) Aggregated search
CN115048191A (en) Method for switching display equipment by fast application and related equipment
KR20190064970A (en) Method and application for applying shared contents to electronic imaging

Legal Events

Date Code Title Description
AS Assignment

Owner name: NET POWER AND LIGHT, INC., CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:MUSIGY USA, INC.;REEL/FRAME:031416/0841

Effective date: 20100503

Owner name: MUSIGY USA, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:VONOG, STANISLAV;SURIN, NIKOLAY;LOUIE, GILMAN;AND OTHERS;SIGNING DATES FROM 20091214 TO 20100121;REEL/FRAME:031416/0728

AS Assignment

Owner name: SINGTEL INNOV8 PTE. LTD., SINGAPORE

Free format text: SECURITY AGREEMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:031868/0927

Effective date: 20131223

Owner name: ALSOP LOUIE CAPITAL, L.P., CALIFORNIA

Free format text: SECURITY AGREEMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:031868/0927

Effective date: 20131223

AS Assignment

Owner name: NET POWER AND LIGHT, INC., CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNORS:ALSOP LOUIE CAPITAL, L.P.;SINGTEL INNOV8 PTE. LTD.;REEL/FRAME:032158/0112

Effective date: 20140131

AS Assignment

Owner name: ALSOP LOUIE CAPITAL I, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:033086/0001

Effective date: 20140603

Owner name: PENINSULA VENTURE PRINCIPALS, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:033086/0001

Effective date: 20140603

Owner name: PENINSULA TECHNOLOGY VENTURES, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:033086/0001

Effective date: 20140603

AS Assignment

Owner name: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIO

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: BROWN, JOHN SEELY, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: ORRICK INVESTMENTS 2011, LLC, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: TWB INVESTMENT PARTNERSHIP II, LP, WASHINGTON

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: PENINSULA TECHNOLOGY VENTURES, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: SHIN, JEANNIE, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: LOW, LAWRENCE B., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: ORRICK INVESTMENTS 2010, LLC, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: SINGTEL INNOV8 PTE. LTD., SINGAPORE

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: ALSOP LOUIE CAPITAL 1, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: WANG, TA-HUI TY, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

Owner name: PENINSULA VENTURE PRINCIPALS, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:036740/0252

Effective date: 20150930

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: SHIN, JEANNIE, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: PENINSULA TECHNOLOGY VENTURES, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: ALSOP LOUIE CAPITAL 1, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: WANG, TA-HUITY, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: LOW, LAWRENCE B., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: ORRICK INVESTMENTS 2011, LLC, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: TWB INVESTMENT PARTNERSHIP II, LP, WASHINGTON

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: ORRICK INVESTMENTS 2010, LLC, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: SINGTEL INNOVS PTE. LTD., SINGAPORE

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: PENSULA VENTURE PRINCIPALS, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: THE BOARD OF TRUSTEES OF THE LELAND STANFORD UNIVE

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

Owner name: BROWN, JOHN SEELY, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037333/0680

Effective date: 20151218

AS Assignment

Owner name: ALSOP LOUIE CAPITAL 1, L.P., CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: WANG, TA-HUITY, CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: SINGTEL INNOV8 PTE. LTD., SINGAPORE

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: ORRICK INVESTMENTS 2010, LLC, CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: PENINSULA VENTURE PRINCIPALS, L.P., CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: BROWN, JOHN SEELY, CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: PENINSULA TECHNOLOGY VENTURES, L.P., CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIO

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: TWB INVESTMENT PARTNERSHIP II, LP, WASHINGTON

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: SHIN, JEANNIE, CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: LOW, LAWRENCE B., CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

Owner name: ORRICK INVESTMENTS 2011, LLC, CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037394/0150

Effective date: 20151218

AS Assignment

Owner name: PENINSULA VENTURE PRINCIPALS, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: WANG, TA-HUI TY, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: SHINE, JEANNIE, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIO

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: LOW, LAWRENCE B., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: BROWN, JOHN SEELY, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: SINGTEL INNOV8 PTE. LTD., SINGAPORE

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: ORRICK INVESTMENTS 2010, LLC, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: TWB INVESTMENT PARTNERSHIP II, LP, WASHINGTON

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: ORRICK INVESTMENTS 2011, LLC, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: ALSOP LOUIE CAPITAL 1, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

Owner name: PENINSULA TECHNOLOGY VENTURES, L.P., CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:037786/0090

Effective date: 20160219

AS Assignment

Owner name: NET POWER & LIGHT, INC., CALIFORNIA

Free format text: NOTE AND WARRANT CONVERSION AGREEMENT;ASSIGNORS:PENINSULA TECHNOLOGY VENTURES, L.P.;PENINSULA VENTURE PRINCIPALS, L.P.;ALSOP LOUIE CAPITAL 1, L.P.;REEL/FRAME:038543/0839

Effective date: 20160427

Owner name: NET POWER & LIGHT, INC., CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:038543/0831

Effective date: 20160427

AS Assignment

Owner name: NET POWER & LIGHT, INC., CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:038398/0958

Effective date: 20160427

Owner name: NET POWER & LIGHT, INC., CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:NET POWER & LIGHT, INC.;REEL/FRAME:038398/0946

Effective date: 20160427

Owner name: NET POWER & LIGHT, INC., CALIFORNIA

Free format text: NOTE AND WARRANT CONVERSION AGREEMENT;ASSIGNORS:PENINSULA TECHNOLOGY VENTURES, L.P.;PENINSULA VENTURE PRINCIPALS, L.P.;ALSOP LOUIE CAPITAL 1, L.P.;AND OTHERS;REEL/FRAME:038543/0966

Effective date: 20160427

Owner name: NET POWER & LIGHT, INC., CALIFORNIA

Free format text: NOTE AND WARRANT CONVERSION AGREEMENT;ASSIGNORS:PENINSULA TECHNOLOGY VENTURES, L.P.;PENINSULA VENTURE PRINCIPALS, L.P.;ALSOP LOUIE CAPITAL 1, L.P.;AND OTHERS;REEL/FRAME:038543/0942

Effective date: 20160427

AS Assignment

Owner name: NET POWER AND LIGHT, INC., CALIFORNIA

Free format text: MERGER;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:039809/0346

Effective date: 20160427

AS Assignment

Owner name: WICKR INC., ILLINOIS

Free format text: MERGER;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:039810/0277

Effective date: 20160721

AS Assignment

Owner name: WICKR INC., CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ADDRESS FROM 71 S. WACKER DR. SUITE 2385 CHICAGO, ILLINOIS 60606 TO 459 18TH ST., #313, SAN FRANCISCO, CALIFORNIA 94107 PREVIOUSLY RECORDED ON REEL 039810 FRAME 0277. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER;ASSIGNOR:NET POWER AND LIGHT, INC.;REEL/FRAME:040267/0459

Effective date: 20160721

AS Assignment

Owner name: AMAZON TECHNOLOGIES, INC., WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WICKR LLC;REEL/FRAME:058573/0904

Effective date: 20210621