US20020188592A1 - Outboard data storage management system and method - Google Patents

Outboard data storage management system and method Download PDF

Info

Publication number
US20020188592A1
US20020188592A1 US09/878,696 US87869601A US2002188592A1 US 20020188592 A1 US20020188592 A1 US 20020188592A1 US 87869601 A US87869601 A US 87869601A US 2002188592 A1 US2002188592 A1 US 2002188592A1
Authority
US
United States
Prior art keywords
data storage
data
storage
virtual
physical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US09/878,696
Inventor
Michael Leonhardt
Stephen Blendermann
Alan Sutton
Charles Milligan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Storage Technology Corp
Original Assignee
Storage Technology Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Storage Technology Corp filed Critical Storage Technology Corp
Priority to US09/878,696 priority Critical patent/US20020188592A1/en
Assigned to STORAGE TECHNOLOGY CORPORATION reassignment STORAGE TECHNOLOGY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MILLIGAN, CHARLES A., SUTTON, ALAN R., BLENDERMANN, STEPHEN H., LEONHARDT, MICHAEL L.
Priority to PCT/US2002/018700 priority patent/WO2002101535A2/en
Priority to AU2002303998A priority patent/AU2002303998A1/en
Priority to JP2003504230A priority patent/JP2005501317A/en
Priority to EP02732068A priority patent/EP1438653A2/en
Publication of US20020188592A1 publication Critical patent/US20020188592A1/en
Priority to US10/803,137 priority patent/US7136801B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers

Definitions

  • the present invention relates generally to data storage management systems and, more particularly, to an outboard data storage management system and method which present to host processors a virtual data storage image having a desired storage attribute for a particular data storage application by combining physical data storage devices in an arrangement suitable for providing the desired storage attribute.
  • Data storage subsystems include a plurality of different types of data storage devices for storing data for host processors. Each type of data storage device has different storage attributes that are suitable for storing data having certain data attributes.
  • Data storage management systems route the data from the host processors to selected data storage devices. The data storage devices for storing the data are selected as a function of the data attributes.
  • data storage management systems make available to the host processors the actual data storage devices which are to store the data. That is, the data is directly routed from the host processors to the selected data storage device.
  • a problem with this arrangement is that a selected data storage device may be unavailable at the time a host processor needs to access the selected data storage device or the data storage subsystem may not even have the selected data storage device.
  • Another problem with this arrangement is that none of the data storage devices in the data storage subsystem may have the storage attributes suitable for storing the data.
  • the virtual data storage image can be, for example, a device image (e.g., disk, tape, etc.) or a file system image (e.g., NFS, GFS, etc.), a database image, or an object based storage device image.
  • a device image e.g., disk, tape, etc.
  • a file system image e.g., NFS, GFS, etc.
  • database image e.g., a database image
  • object based storage device image e.g., a device image, file, database, and object.
  • the present invention provides a data storage system for storing data for a host processor.
  • the data storage system includes a plurality of physical data storage devices each having data storage attributes.
  • An outboard storage manager is operable with the plurality of physical data storage devices for presenting to the host processor a virtual data storage image having a desired data storage attribute for a particular data storage application by organizing the physical data storage devices in an arrangement suitable for providing the desired data storage attribute irrespective of the data storage attributes of the physical data storage devices such that the organized physical data storage device arrangement emulates the virtual data storage image.
  • the outboard storage manager is operable to transfer data between the host processor and the organized physical data storage device arrangement via the virtual data storage image.
  • the outboard storage manager organizes the physical data storage devices in the arrangement suitable for providing the desired data storage attributes as a function of attributes of the data for the particular data application.
  • the virtual data storage image presented by the outboard storage manager may be a virtual data storage device image, a virtual data storage file image, a virtual data storage database image, a virtual disk component, a virtual tape component, a virtual library component, a virtual server component, a virtual database component, or a virtual object component.
  • a storage manager client is resident on the host processor.
  • the storage manager client is operable with the outboard storage manager for transferring information indicative of the desired data storage attribute and for transferring information indicative of the attributes of the data for the particular data application to the outboard storage manager.
  • the outboard storage manager may further includes interim storage for storing data transferred between the host processor and the combined physical data storage device arrangement via the virtual data storage device.
  • the outboard storage manager includes a front end and a back end.
  • the front end is operable for presenting to the host processor the virtual data storage image having the desired data storage attribute for the particular data application.
  • the back end is operable for organizing the physical storage devices in the suitable arrangement.
  • the front end is connected by a data channel function and a control path function to the host processor for receiving the data and information indicative of the desired data storage attribute.
  • the back end is connected to each of the plurality of physical data storage devices by respective data channels for transferring the received data to the organized physical data storage device arrangement providing the desired data storage attribute.
  • the plurality of physical data storage devices may include a disk subsystem, a tape subsystem, an optical subsystem, a solid state subsystem, and a probe storage subsystem.
  • the outboard storage manager may arrange the combined physical data storage device arrangement emulating the virtual data storage image in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application.
  • the outboard storage manager may promote and demote storage levels in the storage hierarchy without knowledge by the host processor for the particular data application.
  • the outboard storage manager may remove and restore storage levels in the storage hierarchy without knowledge by the host processor for the particular data application.
  • the outboard storage manager may transfer the data from the host processor directly to intermediate storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
  • the outboard storage manager may transfer respective portions of the data from the host processor to respective storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
  • the outboard storage manager may transfer data simultaneously to different storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
  • the outboard storage manager may transfer data simultaneously from different storage levels to the virtual data storage image without knowledge by the host processor for the particular data application.
  • the outboard storage manager may arrange a physical data storage device in the combined physical data storage device arrangement in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application.
  • the outboard storage manager may arrange a portion of a physical data storage device in the combined physical data storage device arrangement in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application.
  • the present invention provides a data storage method for storing data for a host processor.
  • the data storage method includes providing a plurality of physical data storage devices each having data storage attributes.
  • a virtual data storage image having a desired data storage attribute for a particular data storage application is then presented to the host processor by organizing the physical data storage devices in an arrangement suitable for providing the desired data storage attribute irrespective of the data storage attributes of the physical data storage devices such that the organized physical data storage device arrangement emulates the virtual data storage image.
  • Data is then transferred between the host processor and the organized physical data storage device arrangement via the virtual data storage image.
  • FIGURE illustrates a block diagram of an outboard storage manager in accordance with the outboard storage management system and method of the present invention.
  • Data is user information which is to be stored or retrieved.
  • the content or meaning of the user information is not known and the user information does not depend on physical storage device formatting attributes for content or meaning.
  • a data path is an interface over which data is transferred.
  • a data set or data file is an end user named and defined grouping of data. The names do not have to be unique across the host processors in the data storage subsystem.
  • a volume is an identified collection of data sets.
  • a host or virtual volume is a uniquely identified collection of data sets.
  • a host or virtual volume typically includes a single physical data storage device or a portion of a single physical data storage device.
  • a physical volume includes a single physical data storage device which may contain a portion of a host volume, all of a host volume, or many host volumes stored thereon.
  • a physical or real data storage device is the actual read/write data storage device which stores data on a physical volume.
  • Random access is a method of storing data on a data storage device that permits the user to access any of the data sets stored on the data storage device in any order that the user desires. The user is typically unaware of the sequences which provide access to the desired data set. Sequential access is a method of storing data on a data storage device in a predetermined sequential order such that the user can access a desired data set only if all the sequentially prior data sets on the sequentially written data storage device have been accessed.
  • outboard storage manager 10 is an outboard channel subsystem with front end data storage device virtualization, management of data per user specified data storage rules, back end data path management, and physical data storage.
  • Outboard storage manager 10 includes a storage manager component portion 12 having a front end 14 and a back end 16 .
  • Front end 14 generally refers to the virtual device side of storage manager component portion 12 .
  • Back end 16 generally refers to the physical device side of storage manager component portion 12 .
  • Host processors 18 and 20 of a host processor complex are individually connected to front end 14 of storage manager component portion 12 .
  • host processor 18 is a multiple virtual storage (MVS) host processor and host processor 20 is a non-MVS host processor.
  • MVS multiple virtual storage
  • Each of host processors 18 and 20 is connected by a respective data channel 19 and 21 and a respective control path 23 and 25 to front end 14 of storage manager component portion 12 .
  • Data channels 19 and 21 are interfaces over which data is communicated between host processors 18 and 20 and outboard storage manager 10 .
  • the data interface types include FIPS, ESCON, SCSI, etc.
  • Control paths 23 and 25 are interfaces over which control information is communicated between host processors 18 , 20 and outboard storage manager 10 .
  • Storage manager component portion 12 is connected to host processors 18 and 20 to provide data storage capacity for host processor data on a plurality of physical data storage subsystems 22 , 24 , 26 , 28 , and 39 .
  • Data storage subsystems 22 , 24 , 26 , 28 , and 39 are individually connected to a data storage device controller 43 located in back end 16 of storage manager component portion 12 by respective back end data paths 27 , 29 , 31 , 33 , and 35 .
  • Data storage subsystems 22 , 24 , 26 , 28 , and 39 are generally comprised of physical data storage devices.
  • the data storage subsystems include disk data storage subsystems 22 having a plurality of disk storage devices, tape data storage subsystems 24 having a plurality of tape storage devices, optical data storage subsystems 26 having a plurality of optical storage devices, new data storage subsystems 28 such as probe storage subsystems and solid state storage subsystems, and library subsystems 39 operable for managing removable media for each of the other data storage subsystems.
  • Outboard storage manager 10 appears to host processors 18 and 20 as either an attached physical data storage device or a data file repository.
  • Outboard storage manager 10 is generally a system of cooperatively executing processes located in a processing system that interconnects host processor data channels 19 and 21 and the physical data storage devices 22 , 24 , 26 , 28 , and 39 .
  • From the view of host processors 18 and 20 outboard storage manager 10 represents a plurality of physical data storage devices.
  • outboard storage manager 10 represents an associated data storage device controller, i.e., device controller 43 .
  • Outboard storage manager 10 accomplishes this by providing front end data storage device virtualization in which a virtual data storage device 30 , 32 , 34 , 36 , 50 , and 52 representing one or more different physical data storage devices and/or a file server are presented at front end 14 to host processors 18 and 20 .
  • virtual data storage devices 30 , 32 , 34 , 36 , 50 , and 52 include a virtual disk component (VDC) 30 , a virtual tape component (VTC) 32 , a virtual file server component 34 , a virtual library component (VLC) 36 , a virtual database server component 50 , and a virtual object server component 52 .
  • VDC virtual disk component
  • VTC virtual tape component
  • VLC virtual library component
  • Virtual data storage devices 30 , 32 , and 36 provide physical data storage device emulation and also provide for new representations of physical data storage devices that have yet to be designed or sold. For instance, virtual data storage devices 30 , 32 , and 36 each appear to host processors 18 and 20 as a separate entity, but each virtual data storage device is actually a shared portion of a physical data storage device(s) 22 , 24 , 26 , 28 , and 39 .
  • outboard storage manager 10 manages the received user data based on user provided data storage rules, data attributes, and data policies. Outboard storage manager 10 further manages the physical data storage capacity of physical data storage devices 22 , 24 , 26 , 28 , and 39 and back end data paths 27 , 29 , 31 , 33 , and 35 that interconnect the physical data storage devices with storage manager component portion 12 .
  • Outboard storage manager 10 further includes storage manager clients 38 and 40 resident on respective host processors 18 and 20 .
  • Storage manager clients 38 and 40 are software products which function to direct data sets to an appropriate one of the virtual data storage device components 30 , 32 , or 36 , virtual file server component 34 , virtual database server component 50 , or virtual object server component 52 .
  • Storage manager clients 38 and 40 communicate data storage rules from respective host processors 18 and 20 to storage manager component portion 12 via respective control paths 23 and 25 .
  • the data storage rules specify in high level terms how the accompanying data sets are to be stored by storage manager 10 .
  • Management software 42 residing in storage manage component portion 12 uses the data storage rules to determine how the received data sets transferred via data channels 19 and 21 are to be treated.
  • the data storage rules contain information such as what data transfer and data access characteristics are needed by the user and when these defined characteristics can be relaxed to reduce the impact on expensive effected data storage devices 22 , 24 , 26 , 28 , and 39 served by storage manager 10 . If data storage rules do not exist, as in the case of most non-MVS host processors, then outboard storage manager 10 provides a single point of control for the user to specify the data storage rules.
  • outboard storage manager 10 controls the selection of data storage devices 22 , 24 , 26 , 28 , and 39 and data paths 27 , 29 , 31 , 33 , and 35 used for the storage of each data set received from host processors 18 and 20 to maximize data throughput and storage media utilization.
  • the user and host processors 18 and 20 are unaware of the selected data storage device on which the data sets are stored.
  • a host processor 18 or 20 When a host processor 18 or 20 needs to create a data set and the data storage rules indicate that this data set should reside on managed resources of outboard storage manager 10 storage manager clients 38 and 40 initiate the data set transfer by causing the host processor operating system to select a physical data storage device and transfer any control information (i.e., data storage rules) via control paths 23 and 25 to storage manager component portion 12 . Host processor 18 or 20 then transfers the identified data set to the virtual data storage device 30 , 32 , or 36 that corresponds to the selected physical data storage device. The transfer appears to host processors 18 or 20 as if it were occurring to the selected data storage device.
  • control information i.e., data storage rules
  • Interim storage 44 is data storage space which is used as a temporary storage area when either the initial data management rules cannot be satisfied or when speed matching or masking of data transfers is needed.
  • Interim memory 44 may include solid state memory, DASD, or other suitable memory technologies.
  • Interim memory 44 may be dedicated memory located within storage manager component portion 12 or shared space on one of the back end physical data storage devices.
  • Storage manager management software 42 determines which physical data storage device(s) 22 , 24 , 26 , 28 , and 39 and physical volume(s) on the selected physical data storage device(s) the data set is written to.
  • Storage management data space 46 of outboard storage manager 10 catalogs the correlation between the host volume and the physical volume(s).
  • interim storage 44 must be of sufficient reliability to immediately verify the write when the data set is stored in the interim storage, or the verification must await the destaging of the received data set from the interim storage to a selected back end physical data storage device 22 , 24 , 26 , 28 , or 39 .
  • the writing of the received data set on to a back end physical storage device 22 , 24 , 26 , 28 , or 39 may be dependent on the mounting of the selected physical media on the selected physical storage device via library subsystem 39 .
  • outboard storage manager 10 When a data set stored by outboard storage manager 10 must be retrieved for access by one of host processors 18 or 20 , the host operating system in conjunction with storage manager clients 38 or 40 initiates a data set access based on unique volume or data set identification information.
  • Storage manager management software 42 uses the host processor provided identification information to retrieve the corresponding physical volume data from storage manager management data space 46 .
  • Storage manager management software 42 also causes the identified physical volume to be mounted on a selected physical device to thereby enable the data stored on the physical volume to be accessed by host processors 18 and 20 .
  • Outboard storage manager 10 can initiate a data transfer from the mounted physical volume to interim storage 44 while concurrently transmitting control information to the requesting host processor 18 or 20 via the control path 23 or 25 that the requested volume is available.
  • Host processor 18 or 20 begins the data set transfer from the virtual data storage device 30 , 32 , or 36 by transmitting control information to the virtual data storage device over control paths 23 or 25 .
  • Outboard storage manager 10 transfers the staged data set from interim storage 44 to the requesting host processor 18 or 20 via the selected virtual data storage device interface 30 , 32 , or 36 using the specified front end device format. If host processor 18 or 20 requests the data set before it is staged into interim storage 44 , outboard storage manager 10 causes the host processor to wait until the data set is available from the physical data storage devices 22 , 24 , 26 , 28 , and 39 storing the requested data set.
  • outboard storage manager 10 generally presents images of a virtual data storage device 30 , 32 , and 36 to host processors 18 and 20 , but in reality, the physical data storage devices 22 , 24 , 26 , 28 , and 39 implemented to effect the virtual data storage device may be completely different physical data storage devices than the effected virtual data storage device.
  • the physical data storage devices 22 , 24 , 26 , 28 , and 39 may even be a different class of storage (tape, disk, optical, etc.) than the class of storage of the virtual data storage device 30 , 32 , and 36 .
  • Outboard storage manager 10 generally combines selected physical data storage devices in an arrangement suitable for emulating a virtual data storage device having certain data storage attributes. Outboard storage manager 10 combines the selected physical data storage devices as a function of data storage policies for a particular data storage application or as set by a user.
  • outboard storage manager 10 The capability of outboard storage manager 10 to store incoming data, migrate the data between different types of data storage devices 22 , 24 , 26 , 28 , and 39 , and deliver the data back to a host processor 18 or 20 depends on information which normally does not come down the I/O data interface as the data is written.
  • the attributes or storage policies of the individual data sets must be understood by outboard storage manager 10 in order to make intelligent decisions about placement and movement of the data sets.
  • Some relevant data set attributes and policies are: data set size, the time interval between data set creation and next sequential access, level of performance expected by the applications which use the data set, acceptable data retrieval delay, change in data set performance over time, backup status of the data set, and number of active backup copies of the data set.
  • Some of these data attributes and policies are categorized into data class, storage class, storage group, and management class.
  • the host processor resident operating system permits the user to assign one of these attributes and policies to a data set when the data set is initially created.
  • Outboard storage manager 10 decides where the data set resides when it is initially created.
  • the user can initially designate data set attributes and policies for a selected virtual data storage device 30 , 32 , and 36 to write data to and the virtual volume for storing the data, but outboard storage manager 10 automatically assigns a physical data storage device 22 , 24 , 26 , 28 , and 39 or combination thereof and physical volume(s) based on the user identified attributes and data storage rules.
  • the transmission of the data set attributes can be accomplished by the use of control paths 23 and 25 that interconnect storage manager clients 38 and 40 of host processors 18 and 20 with front end 14 of outboard storage manager component portion 12 .
  • This out of band control signaling is associated by outboard storage manager 10 with a data set stream transmitted via data paths 19 and 21 that interconnect host processors 18 and 20 with front end 14 of outboard storage manager component portion 12 .
  • the received data set is temporarily stored in interim storage 44 and the control information is used to select a physical device and physical volume for the destaging of the received data set from the interim storage to the selected storage location.
  • storage manager clients 38 and 40 can create a preamble that contains this attribute information and prepend this preamble to the data set for in band transmission to outboard storage manager component portion 12 via data paths 19 and 21 .
  • the host software in question is responsible for obtaining the definition of those attributes and sending them to the outboard storage manager at the right time.
  • Outboard storage manager 10 decides when and where data is to be migrated. Many data sets have initial performance requirements which are much higher than the performance required when the data sets are a few days old. Additionally, some data sets have rather sporadic time periods of reference and reside on lower performing less expensive data storage devices during periods of infrequent use. Outboard storage manager 10 automatically performs these functions based on the data set attributes.
  • Outboard storage manager 10 performs space reclamation when data sets are to be deleted.
  • the data set attributes define when a data set is no longer needed, but the storage space used by that data set needs to be made available for new data. The action of reclaiming the storage space cannot occur until it is certain that the data set in question has been deleted by host processors 18 or 20 . When that determination has been made outboard storage manager 10 will control the space reclamation process by itself.
  • outboard storage manager 10 implements a native mode file system (i.e., virtual file server component 34 ) which can be concurrently shared by host processors 18 and 20 .
  • the data storage and retrieval access to this file system is accomplished through storage manager clients 38 and 40 resident on host processors 18 and 20 , which translate logical data set requests received from application programs also resident on the host processors into the appropriate command sequences and dialogs with services contained in outboard storage manager 10 .
  • the application programs are unaware of the actual physical storage devices which are used to implement virtual file server component 34 and data set access can be either sequential or random.
  • outboard storage manager 10 also implements a virtual database server component 50 and a virtual object server component 52 which can be concurrently shared by host processors 18 and 20 .
  • Virtual tape component (VTC) 32 of outboard storage manager 10 component portion 12 presents to host processors 18 and 20 the virtual image of a set of zero or more tape storage subsystems. With respect to the command set, statuses, and other programming interfaces from the point of view of host processors 18 and 20 each of the virtual tape storage subsystems has the full capabilities of a corresponding actual tape storage subsystem. For example, a host processor restricting itself to the documented actual tape storage subsystem would be unable to distinguish the virtual tape storage subsystem presented by VTC 32 from the actual tape storage subsystem.
  • Actual tape storage devices emulated by VTC 32 include Storage Technology Corporation and IBM tape storage device models 3490 and 3490E. All of the features available on the actual tape storage devices that are being emulated by VTC 32 are available on the VTC. The emulated devices can be arbitrarily arranged to give the appearance of an actual tape storage subsystem.
  • VDC 30 of outboard storage manager component portion 12 presents to host processors 18 and 20 the virtual image of a set of zero or more direct access storage device (DASD) subsystems.
  • DASD direct access storage device
  • the extent of the virtualization is the same as that previously stated for virtual tape storage subsystems.
  • Actual DASD subsystems emulated by VDC 30 include Storage Technology Corporation models 3380 , 3390 , and RAMAC and IBM DASD model 3990 . All of the features available on the actual DASD subsystem will be available on the emulated device, i.e., VDC 30 .
  • the emulated devices can be arbitrarily grouped to give the appearance of an actual DASD subsystem.
  • Virtual library component (VLC) 36 of outboard storage manager component portion 12 presents to host processors 18 and 20 the virtual image of a set of zero or more tape storage libraries.
  • Actual tape storage libraries emulated by VLC 36 include Storage Technology Corporation models 3494 and 3495.
  • the virtualized devices can be configured in any configuration that would be valid for the read devices that are being emulated.
  • Physical data storage devices which can be supported by back end 16 of outboard storage manager component portion 12 include Storage Technology Corporation data storage device models Timberline, Iceberg, 4430 LMU, 9330/15 LMU, Nordique, 4480 and 4490, RedWood, SnoCap, and commodity SCSI tape and disk drives and IBM models 3490, 3390, and NTL.
  • Data storage devices are attached to back end 16 by data channels 27 , 29 , 31 , 33 , and 35 which support ESCON, SCSI, FIPS, and fiberchannel data communications.
  • Management software 42 performs data flow management for outboard storage manager 10 .
  • Data flow management refers to the set of processes which deal with: the management of interim storage 44 for virtual data storage devices 30 , 32 , and 36 and virtual file system objects 34 ; the scheduling and control of data transfers between interim storage 44 and physical data storage devices 22 , 24 , 26 , 28 , and 39 (i.e., stage and destage operations); the scheduling and control of data migration through the physical data storage device hierarchy; the application of techniques such as data striping to achieve the appropriate level of performance for a given data set; the management of data channels 27 , 29 , 31 , 33 , and 35 and control paths between storage manager component portion 12 and physical data storage devices 22 , 24 , 26 , 28 , and 39 ; the association of virtual data storage devices to the corresponding physical data storage devices; and overall workload management.
  • Management software 42 further controls physical volume management.
  • outboard storage manager 10 decides to move a data set from interim storage 44 to a back end physical storage device(s) 22 , 24 , 26 , 28 , and 39 then some decisions need to be made as to where to put them. If the data attributes as defined by storage management policy indicates that the data set is a candidate to reside on a tape cartridge, then a tape cartridge with expired data on it must be selected to write the data set to.
  • the tape cartridge selected can be one which is completely void of data sets, or the tape cartridge could contain some data sets which have not yet expired and the space available on that tape cartridge can be used to write the current data.
  • Management software 42 further performs data expiration processing. It is typical for data sets to have an inherent expiration date which defines a point in time at which the data contained in the data set is no longer valid. When data sets reach their expiration data and have been deleted by the user the memory space that these data sets occupy should be reclaimed so that media usage is as high as possible. On sequential media, such as magnetic tape, partial reclamation of space for a given piece of media demands that all space from the data set to the end of the tape be reclaimed. If this segment of tape contains valid data sets a judgement must be made regarding the cost to relocate these valid data sets to another media element so that this segment of tape can be reclaimed.
  • Management software 42 further performs virtual volume management.
  • a host system creates a new data set the serial number of the is remembered by the host system that created the data set.
  • the combination of the data set name and the volume serial number is the identifier that is used in the future when the data set is read.
  • the volume represented by this serial number is an illusion to host processors 18 and 20 , but the outboard storage manager must remember what that host known serial number is when the data set is created so that it can respond to subsequent requests to read that data set as if the data set resides on that volume.
  • outboard storage manager 10 In addition to the serial number of the volume that the host processor believed the data set was created on, outboard storage manager 10 must keep the position of the data set relative to the beginning of that volume.
  • positioning commands are issued to the virtual device to move to the place on the volume where the host processor thinks the data set was created.
  • the outboard storage manager virtual device front end 14 will accept and portray the illusion that these commands are executed.
  • outboard storage manager 10 generally presents images of a virtual data storage device 30 , 32 , and 36 to host processors 18 and 20 , but in reality, the physical data storage devices 22 , 24 , 26 , 28 , and 39 implemented to effect the virtual data storage device may be completely different physical data storage devices than the effected virtual data storage device.
  • Outboard storage manager 10 is further operable to perform a variety of functions with respect to physical data storage devices 22 , 24 , 26 , 28 , and 39 for emulating virtual data storage devices 30 , 32 , and 36 .
  • outboard storage manager 10 arranges physical data storage devices 22 , 24 , 26 , 28 , and 39 in a hierarchical fashion with multiple storage levels for a particular data application. The existence and the management of these storage levels is performed solely by outboard storage manager 10 without the knowledge of host processors 18 and 20 .
  • the multiple storage levels includes several intermediate storage levels between a fast and expensive random access top storage level and a removable inexpensive sequential access bottom storage level.
  • outboard storage manager 10 can logically demount (e.g., remove and restore) individual storage levels of the storage level organization for a particular data application without affecting host processors 18 and 20 .
  • outboard storage manager 10 can promote and demote a particular storage level in the storage level organization without affecting host processors 18 and 20 .
  • outboard storage manager 10 can transfer data sets directly between host processors 18 and 20 to the lowest or intermediate storage levels without requiring the data sets be staged through higher storage levels for a particular data application. That is, outboard storage manager 10 can establish a virtual storage hierarchy for each data set transfer.
  • outboard storage manager 10 can split data set residency between storage levels with some data set portion (e.g., an index, the first n bytes, etc.) resident on faster more expensive higher storage level such as DASD and the remaining data set bulk on a removable media lower storage level such as tape for a particular data application. That is, outboard storage manager 10 can split the data comprising a data set between different storage levels without knowledge by host processors 18 and 20 .
  • some data set portion e.g., an index, the first n bytes, etc.
  • Sixth, outboard storage manager 10 can simultaneously transfer data sets during writes to more than one storage level in accordance with attributes of the data sets for a particular data application.
  • the data sets can be forked so that it goes to several storage levels at once or split so that some of the data set is transferred to one storage level and the remaining data set is transferred to another storage level.
  • similarly outboard storage manager 10 can simultaneously transfer data sets during reads to host processors 18 and 20 for a particular data application by joining the data sets from the different storage levels for transfer to the host processors.
  • outboard storage manager 10 may use the storage on one data storage device as more than one storage level for a particular data application. Eighth, the outboard storage manager may use the media of a single level as more than one level for a particular data application.

Abstract

A data storage system for storing data for a host processor includes physical data storage devices each having data storage attributes and an outboard storage manager. The outboard storage manager is operable with the physical data storage devices for presenting to the host processor a virtual data storage image having a desired data storage attribute for a particular data storage application by organizing the physical data storage devices in an arrangement suitable for providing the desired data storage attribute irrespective of the data storage attributes of the physical data storage devices such that the combined physical data storage device arrangement emulates the virtual data storage image. The outboard storage manager is operable to transfer data between the host processor and the organized physical data storage device arrangement via the virtual data storage image.

Description

    TECHNICAL FIELD
  • The present invention relates generally to data storage management systems and, more particularly, to an outboard data storage management system and method which present to host processors a virtual data storage image having a desired storage attribute for a particular data storage application by combining physical data storage devices in an arrangement suitable for providing the desired storage attribute. [0001]
    • BACKGROUND ART
  • Data storage subsystems include a plurality of different types of data storage devices for storing data for host processors. Each type of data storage device has different storage attributes that are suitable for storing data having certain data attributes. Data storage management systems route the data from the host processors to selected data storage devices. The data storage devices for storing the data are selected as a function of the data attributes. Typically, data storage management systems make available to the host processors the actual data storage devices which are to store the data. That is, the data is directly routed from the host processors to the selected data storage device. [0002]
  • A problem with this arrangement is that a selected data storage device may be unavailable at the time a host processor needs to access the selected data storage device or the data storage subsystem may not even have the selected data storage device. Another problem with this arrangement is that none of the data storage devices in the data storage subsystem may have the storage attributes suitable for storing the data. [0003]
    • SUMMARY OF THE INVENTION
  • Accordingly, it is an object of the present invention to provide an outboard data storage management system and method which present to host processors a virtual data storage image having a desired storage attribute for a particular data storage application by combining physical data storage devices in an arrangement suitable for providing the desired storage attribute. The virtual data storage image can be, for example, a device image (e.g., disk, tape, etc.) or a file system image (e.g., NFS, GFS, etc.), a database image, or an object based storage device image. The term “virtual data storage device” used herein refers to a device, file, database, and object. [0004]
  • It is another object of the present invention to provide an outboard data storage management system and method which present to host processors an image of a virtual disk component for storing data by combining physical data storage devices to emulate the virtual disk component as a function of attributes of the data. [0005]
  • It is a further object of the present invention to provide an outboard data storage management system and method which present to host processors an image of a virtual tape component for storing data by combining physical data storage devices to emulate the virtual tape component as a function of attributes of the data. [0006]
  • It is still another object of the present invention to provide an outboard storage management system and method which present to host processors an image of a virtual library component for storing data by combining physical data storage devices to emulate the virtual library component as a function of attributes of the data. [0007]
  • It is still a further object of the present invention to provide an outboard storage management system and method which present to host processors an image of a virtual server component by combining physical data storage devices to emulate the virtual server component as a function of attributes of the data. [0008]
  • It is still yet another object of the present invention to provide an outboard storage management system and method which present to host processors an image of a virtual database server component by combining physical data storage devices to emulate the virtual database server component as a function of attributes of the data. [0009]
  • It is still yet a further object of the present invention to provide an outboard storage management system and method which present to host processors an image of a virtual object server component as a function of attributes of the data. [0010]
  • In carrying out the above objects and other objects, the present invention provides a data storage system for storing data for a host processor. The data storage system includes a plurality of physical data storage devices each having data storage attributes. An outboard storage manager is operable with the plurality of physical data storage devices for presenting to the host processor a virtual data storage image having a desired data storage attribute for a particular data storage application by organizing the physical data storage devices in an arrangement suitable for providing the desired data storage attribute irrespective of the data storage attributes of the physical data storage devices such that the organized physical data storage device arrangement emulates the virtual data storage image. The outboard storage manager is operable to transfer data between the host processor and the organized physical data storage device arrangement via the virtual data storage image. The outboard storage manager organizes the physical data storage devices in the arrangement suitable for providing the desired data storage attributes as a function of attributes of the data for the particular data application. [0011]
  • The virtual data storage image presented by the outboard storage manager may be a virtual data storage device image, a virtual data storage file image, a virtual data storage database image, a virtual disk component, a virtual tape component, a virtual library component, a virtual server component, a virtual database component, or a virtual object component. [0012]
  • A storage manager client is resident on the host processor. The storage manager client is operable with the outboard storage manager for transferring information indicative of the desired data storage attribute and for transferring information indicative of the attributes of the data for the particular data application to the outboard storage manager. [0013]
  • The outboard storage manager may further includes interim storage for storing data transferred between the host processor and the combined physical data storage device arrangement via the virtual data storage device. The outboard storage manager includes a front end and a back end. The front end is operable for presenting to the host processor the virtual data storage image having the desired data storage attribute for the particular data application. The back end is operable for organizing the physical storage devices in the suitable arrangement. The front end is connected by a data channel function and a control path function to the host processor for receiving the data and information indicative of the desired data storage attribute. The back end is connected to each of the plurality of physical data storage devices by respective data channels for transferring the received data to the organized physical data storage device arrangement providing the desired data storage attribute. [0014]
  • The plurality of physical data storage devices may include a disk subsystem, a tape subsystem, an optical subsystem, a solid state subsystem, and a probe storage subsystem. [0015]
  • The outboard storage manager may arrange the combined physical data storage device arrangement emulating the virtual data storage image in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application. The outboard storage manager may promote and demote storage levels in the storage hierarchy without knowledge by the host processor for the particular data application. The outboard storage manager may remove and restore storage levels in the storage hierarchy without knowledge by the host processor for the particular data application. [0016]
  • The outboard storage manager may transfer the data from the host processor directly to intermediate storage levels via the virtual data storage image without knowledge by the host processor for the particular data application. The outboard storage manager may transfer respective portions of the data from the host processor to respective storage levels via the virtual data storage image without knowledge by the host processor for the particular data application. The outboard storage manager may transfer data simultaneously to different storage levels via the virtual data storage image without knowledge by the host processor for the particular data application. The outboard storage manager may transfer data simultaneously from different storage levels to the virtual data storage image without knowledge by the host processor for the particular data application. [0017]
  • The outboard storage manager may arrange a physical data storage device in the combined physical data storage device arrangement in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application. The outboard storage manager may arrange a portion of a physical data storage device in the combined physical data storage device arrangement in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application. [0018]
  • Further, in carrying out the above objects and other objects, the present invention provides a data storage method for storing data for a host processor. The data storage method includes providing a plurality of physical data storage devices each having data storage attributes. A virtual data storage image having a desired data storage attribute for a particular data storage application is then presented to the host processor by organizing the physical data storage devices in an arrangement suitable for providing the desired data storage attribute irrespective of the data storage attributes of the physical data storage devices such that the organized physical data storage device arrangement emulates the virtual data storage image. Data is then transferred between the host processor and the organized physical data storage device arrangement via the virtual data storage image. [0019]
  • The above objects and other objects, features, and advantages of the present invention are readily apparent from the following detailed description of the best mode for carrying out the present invention when taken in connection with the accompanying drawings.[0020]
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • The FIGURE illustrates a block diagram of an outboard storage manager in accordance with the outboard storage management system and method of the present invention.[0021]
    • BEST MODES FOR CARRYING OUT THE INVENTION
  • Data Storage Conventions [0022]
  • Data is user information which is to be stored or retrieved. The content or meaning of the user information is not known and the user information does not depend on physical storage device formatting attributes for content or meaning. A data path is an interface over which data is transferred. A data set or data file is an end user named and defined grouping of data. The names do not have to be unique across the host processors in the data storage subsystem. A volume is an identified collection of data sets. [0023]
  • A host or virtual volume is a uniquely identified collection of data sets. A host or virtual volume typically includes a single physical data storage device or a portion of a single physical data storage device. In this context, a physical volume includes a single physical data storage device which may contain a portion of a host volume, all of a host volume, or many host volumes stored thereon. A physical or real data storage device is the actual read/write data storage device which stores data on a physical volume. [0024]
  • Random access is a method of storing data on a data storage device that permits the user to access any of the data sets stored on the data storage device in any order that the user desires. The user is typically unaware of the sequences which provide access to the desired data set. Sequential access is a method of storing data on a data storage device in a predetermined sequential order such that the user can access a desired data set only if all the sequentially prior data sets on the sequentially written data storage device have been accessed. [0025]
  • Outboard Storage Manager High Level Architecture Referring now to the FIGURE, a block diagram of an [0026] outboard storage manager 10 in accordance with the outboard storage management system and method of the present invention is shown. Generally, outboard storage manager 10 is an outboard channel subsystem with front end data storage device virtualization, management of data per user specified data storage rules, back end data path management, and physical data storage.
  • [0027] Outboard storage manager 10 includes a storage manager component portion 12 having a front end 14 and a back end 16. Front end 14 generally refers to the virtual device side of storage manager component portion 12. Back end 16 generally refers to the physical device side of storage manager component portion 12. Host processors 18 and 20 of a host processor complex are individually connected to front end 14 of storage manager component portion 12. As an example, host processor 18 is a multiple virtual storage (MVS) host processor and host processor 20 is a non-MVS host processor.
  • Each of [0028] host processors 18 and 20 is connected by a respective data channel 19 and 21 and a respective control path 23 and 25 to front end 14 of storage manager component portion 12. Data channels 19 and 21 are interfaces over which data is communicated between host processors 18 and 20 and outboard storage manager 10. The data interface types include FIPS, ESCON, SCSI, etc. Control paths 23 and 25 are interfaces over which control information is communicated between host processors 18, 20 and outboard storage manager 10.
  • Storage [0029] manager component portion 12 is connected to host processors 18 and 20 to provide data storage capacity for host processor data on a plurality of physical data storage subsystems 22, 24, 26, 28, and 39. Data storage subsystems 22, 24, 26, 28, and 39 are individually connected to a data storage device controller 43 located in back end 16 of storage manager component portion 12 by respective back end data paths 27, 29, 31, 33, and 35. Data storage subsystems 22, 24, 26, 28, and 39 are generally comprised of physical data storage devices. As an example, the data storage subsystems include disk data storage subsystems 22 having a plurality of disk storage devices, tape data storage subsystems 24 having a plurality of tape storage devices, optical data storage subsystems 26 having a plurality of optical storage devices, new data storage subsystems 28 such as probe storage subsystems and solid state storage subsystems, and library subsystems 39 operable for managing removable media for each of the other data storage subsystems.
  • [0030] Outboard storage manager 10 appears to host processors 18 and 20 as either an attached physical data storage device or a data file repository. Outboard storage manager 10 is generally a system of cooperatively executing processes located in a processing system that interconnects host processor data channels 19 and 21 and the physical data storage devices 22, 24, 26, 28, and 39. From the view of host processors 18 and 20 outboard storage manager 10 represents a plurality of physical data storage devices. From the view of data storage devices 22, 24, 26, 28, and 39, outboard storage manager 10 represents an associated data storage device controller, i.e., device controller 43.
  • [0031] Outboard storage manager 10 accomplishes this by providing front end data storage device virtualization in which a virtual data storage device 30, 32, 34, 36, 50, and 52 representing one or more different physical data storage devices and/or a file server are presented at front end 14 to host processors 18 and 20. As an example, virtual data storage devices 30, 32, 34, 36, 50, and 52 include a virtual disk component (VDC) 30, a virtual tape component (VTC) 32, a virtual file server component 34, a virtual library component (VLC) 36, a virtual database server component 50, and a virtual object server component 52. Virtual data storage devices 30, 32, and 36 provide physical data storage device emulation and also provide for new representations of physical data storage devices that have yet to be designed or sold. For instance, virtual data storage devices 30, 32, and 36 each appear to host processors 18 and 20 as a separate entity, but each virtual data storage device is actually a shared portion of a physical data storage device(s) 22, 24, 26, 28, and 39.
  • In addition, [0032] outboard storage manager 10 manages the received user data based on user provided data storage rules, data attributes, and data policies. Outboard storage manager 10 further manages the physical data storage capacity of physical data storage devices 22, 24, 26, 28, and 39 and back end data paths 27, 29, 31, 33, and 35 that interconnect the physical data storage devices with storage manager component portion 12.
  • [0033] Outboard storage manager 10 further includes storage manager clients 38 and 40 resident on respective host processors 18 and 20. Storage manager clients 38 and 40 are software products which function to direct data sets to an appropriate one of the virtual data storage device components 30, 32, or 36, virtual file server component 34, virtual database server component 50, or virtual object server component 52. Storage manager clients 38 and 40 communicate data storage rules from respective host processors 18 and 20 to storage manager component portion 12 via respective control paths 23 and 25. The data storage rules specify in high level terms how the accompanying data sets are to be stored by storage manager 10. Management software 42 residing in storage manage component portion 12 uses the data storage rules to determine how the received data sets transferred via data channels 19 and 21 are to be treated. The data storage rules contain information such as what data transfer and data access characteristics are needed by the user and when these defined characteristics can be relaxed to reduce the impact on expensive effected data storage devices 22, 24, 26, 28, and 39 served by storage manager 10. If data storage rules do not exist, as in the case of most non-MVS host processors, then outboard storage manager 10 provides a single point of control for the user to specify the data storage rules.
  • In response to the data storage rules and data policies and attributes, [0034] outboard storage manager 10 controls the selection of data storage devices 22, 24, 26, 28, and 39 and data paths 27, 29, 31, 33, and 35 used for the storage of each data set received from host processors 18 and 20 to maximize data throughput and storage media utilization. The user and host processors 18 and 20 are unaware of the selected data storage device on which the data sets are stored.
  • Data Set Creation [0035]
  • When a [0036] host processor 18 or 20 needs to create a data set and the data storage rules indicate that this data set should reside on managed resources of outboard storage manager 10 storage manager clients 38 and 40 initiate the data set transfer by causing the host processor operating system to select a physical data storage device and transfer any control information (i.e., data storage rules) via control paths 23 and 25 to storage manager component portion 12. Host processor 18 or 20 then transfers the identified data set to the virtual data storage device 30, 32, or 36 that corresponds to the selected physical data storage device. The transfer appears to host processors 18 or 20 as if it were occurring to the selected data storage device. The data set in reality is transmitted by host processors 18 or 20 over a respective data channel 19 or 21 to storage manager component portion 12 which receives the data set via emulating the selected physical data storage device and stores the received data set in interim storage (cache) 44 of storage management component portion 12. Interim storage 44 is data storage space which is used as a temporary storage area when either the initial data management rules cannot be satisfied or when speed matching or masking of data transfers is needed. Interim memory 44 may include solid state memory, DASD, or other suitable memory technologies. Interim memory 44 may be dedicated memory located within storage manager component portion 12 or shared space on one of the back end physical data storage devices.
  • Storage [0037] manager management software 42 determines which physical data storage device(s) 22, 24, 26, 28, and 39 and physical volume(s) on the selected physical data storage device(s) the data set is written to. Storage management data space 46 of outboard storage manager 10 catalogs the correlation between the host volume and the physical volume(s).
  • If the interface command protocol specifies that the data write must be verified as successful before the data set transfer can complete, [0038] interim storage 44 must be of sufficient reliability to immediately verify the write when the data set is stored in the interim storage, or the verification must await the destaging of the received data set from the interim storage to a selected back end physical data storage device 22, 24, 26, 28, or 39. The writing of the received data set on to a back end physical storage device 22, 24, 26, 28, or 39 may be dependent on the mounting of the selected physical media on the selected physical storage device via library subsystem 39.
  • Data Set Retrieval [0039]
  • When a data set stored by [0040] outboard storage manager 10 must be retrieved for access by one of host processors 18 or 20, the host operating system in conjunction with storage manager clients 38 or 40 initiates a data set access based on unique volume or data set identification information. Storage manager management software 42 uses the host processor provided identification information to retrieve the corresponding physical volume data from storage manager management data space 46. Storage manager management software 42 also causes the identified physical volume to be mounted on a selected physical device to thereby enable the data stored on the physical volume to be accessed by host processors 18 and 20. Outboard storage manager 10 can initiate a data transfer from the mounted physical volume to interim storage 44 while concurrently transmitting control information to the requesting host processor 18 or 20 via the control path 23 or 25 that the requested volume is available. Host processor 18 or 20 begins the data set transfer from the virtual data storage device 30, 32, or 36 by transmitting control information to the virtual data storage device over control paths 23 or 25. Outboard storage manager 10 transfers the staged data set from interim storage 44 to the requesting host processor 18 or 20 via the selected virtual data storage device interface 30, 32, or 36 using the specified front end device format. If host processor 18 or 20 requests the data set before it is staged into interim storage 44, outboard storage manager 10 causes the host processor to wait until the data set is available from the physical data storage devices 22, 24, 26, 28, and 39 storing the requested data set.
  • Outboard Storage Manager Functions [0041]
  • As described above, [0042] outboard storage manager 10 generally presents images of a virtual data storage device 30, 32, and 36 to host processors 18 and 20, but in reality, the physical data storage devices 22, 24, 26, 28, and 39 implemented to effect the virtual data storage device may be completely different physical data storage devices than the effected virtual data storage device. The physical data storage devices 22, 24, 26, 28, and 39 may even be a different class of storage (tape, disk, optical, etc.) than the class of storage of the virtual data storage device 30, 32, and 36. Combinations of portions of the physical data storage devices 22, 24, 26, 28, and 39 may also be used to effect the virtual data storage devices 30, 32, and 36. Outboard storage manager 10 generally combines selected physical data storage devices in an arrangement suitable for emulating a virtual data storage device having certain data storage attributes. Outboard storage manager 10 combines the selected physical data storage devices as a function of data storage policies for a particular data storage application or as set by a user.
  • Data Management Rules [0043]
  • The capability of [0044] outboard storage manager 10 to store incoming data, migrate the data between different types of data storage devices 22, 24, 26, 28, and 39, and deliver the data back to a host processor 18 or 20 depends on information which normally does not come down the I/O data interface as the data is written. The attributes or storage policies of the individual data sets must be understood by outboard storage manager 10 in order to make intelligent decisions about placement and movement of the data sets. Some relevant data set attributes and policies are: data set size, the time interval between data set creation and next sequential access, level of performance expected by the applications which use the data set, acceptable data retrieval delay, change in data set performance over time, backup status of the data set, and number of active backup copies of the data set. Some of these data attributes and policies are categorized into data class, storage class, storage group, and management class. The host processor resident operating system permits the user to assign one of these attributes and policies to a data set when the data set is initially created.
  • [0045] Outboard storage manager 10 decides where the data set resides when it is initially created. The user can initially designate data set attributes and policies for a selected virtual data storage device 30, 32, and 36 to write data to and the virtual volume for storing the data, but outboard storage manager 10 automatically assigns a physical data storage device 22, 24, 26, 28, and 39 or combination thereof and physical volume(s) based on the user identified attributes and data storage rules.
  • The transmission of the data set attributes can be accomplished by the use of [0046] control paths 23 and 25 that interconnect storage manager clients 38 and 40 of host processors 18 and 20 with front end 14 of outboard storage manager component portion 12. This out of band control signaling is associated by outboard storage manager 10 with a data set stream transmitted via data paths 19 and 21 that interconnect host processors 18 and 20 with front end 14 of outboard storage manager component portion 12. The received data set is temporarily stored in interim storage 44 and the control information is used to select a physical device and physical volume for the destaging of the received data set from the interim storage to the selected storage location. Alternatively, storage manager clients 38 and 40 can create a preamble that contains this attribute information and prepend this preamble to the data set for in band transmission to outboard storage manager component portion 12 via data paths 19 and 21. Regardless of the choice of techniques to prime outboard storage manager 10 with data set attributes the host software in question is responsible for obtaining the definition of those attributes and sending them to the outboard storage manager at the right time.
  • [0047] Outboard storage manager 10 decides when and where data is to be migrated. Many data sets have initial performance requirements which are much higher than the performance required when the data sets are a few days old. Additionally, some data sets have rather sporadic time periods of reference and reside on lower performing less expensive data storage devices during periods of infrequent use. Outboard storage manager 10 automatically performs these functions based on the data set attributes.
  • [0048] Outboard storage manager 10 performs space reclamation when data sets are to be deleted. The data set attributes define when a data set is no longer needed, but the storage space used by that data set needs to be made available for new data. The action of reclaiming the storage space cannot occur until it is certain that the data set in question has been deleted by host processors 18 or 20. When that determination has been made outboard storage manager 10 will control the space reclamation process by itself.
  • Server Components [0049]
  • In addition to providing data storage and access capabilities via virtual [0050] data storage devices 30, 32, and 36, outboard storage manager 10 implements a native mode file system (i.e., virtual file server component 34) which can be concurrently shared by host processors 18 and 20. The data storage and retrieval access to this file system is accomplished through storage manager clients 38 and 40 resident on host processors 18 and 20, which translate logical data set requests received from application programs also resident on the host processors into the appropriate command sequences and dialogs with services contained in outboard storage manager 10. The application programs are unaware of the actual physical storage devices which are used to implement virtual file server component 34 and data set access can be either sequential or random. Similarly, outboard storage manager 10 also implements a virtual database server component 50 and a virtual object server component 52 which can be concurrently shared by host processors 18 and 20.
  • Device Virtualization [0051]
  • Virtual tape component (VTC) [0052] 32 of outboard storage manager 10 component portion 12 presents to host processors 18 and 20 the virtual image of a set of zero or more tape storage subsystems. With respect to the command set, statuses, and other programming interfaces from the point of view of host processors 18 and 20 each of the virtual tape storage subsystems has the full capabilities of a corresponding actual tape storage subsystem. For example, a host processor restricting itself to the documented actual tape storage subsystem would be unable to distinguish the virtual tape storage subsystem presented by VTC 32 from the actual tape storage subsystem. Actual tape storage devices emulated by VTC 32 include Storage Technology Corporation and IBM tape storage device models 3490 and 3490E. All of the features available on the actual tape storage devices that are being emulated by VTC 32 are available on the VTC. The emulated devices can be arbitrarily arranged to give the appearance of an actual tape storage subsystem.
  • Virtual disk component (VDC) [0053] 30 of outboard storage manager component portion 12 presents to host processors 18 and 20 the virtual image of a set of zero or more direct access storage device (DASD) subsystems. The extent of the virtualization is the same as that previously stated for virtual tape storage subsystems. Actual DASD subsystems emulated by VDC 30 include Storage Technology Corporation models 3380, 3390, and RAMAC and IBM DASD model 3990. All of the features available on the actual DASD subsystem will be available on the emulated device, i.e., VDC 30. The emulated devices can be arbitrarily grouped to give the appearance of an actual DASD subsystem.
  • Virtual library component (VLC) [0054] 36 of outboard storage manager component portion 12 presents to host processors 18 and 20 the virtual image of a set of zero or more tape storage libraries. Actual tape storage libraries emulated by VLC 36 include Storage Technology Corporation models 3494 and 3495. In general, the virtualized devices can be configured in any configuration that would be valid for the read devices that are being emulated.
  • Physical Data Storage Device Support [0055]
  • Physical data storage devices which can be supported by [0056] back end 16 of outboard storage manager component portion 12 include Storage Technology Corporation data storage device models Timberline, Iceberg, 4430 LMU, 9330/15 LMU, Nordique, 4480 and 4490, RedWood, SnoCap, and commodity SCSI tape and disk drives and IBM models 3490, 3390, and NTL. Data storage devices are attached to back end 16 by data channels 27, 29, 31, 33, and 35 which support ESCON, SCSI, FIPS, and fiberchannel data communications.
  • Management Software [0057]
  • [0058] Management software 42 performs data flow management for outboard storage manager 10. Data flow management refers to the set of processes which deal with: the management of interim storage 44 for virtual data storage devices 30, 32, and 36 and virtual file system objects 34; the scheduling and control of data transfers between interim storage 44 and physical data storage devices 22, 24, 26, 28, and 39 (i.e., stage and destage operations); the scheduling and control of data migration through the physical data storage device hierarchy; the application of techniques such as data striping to achieve the appropriate level of performance for a given data set; the management of data channels 27, 29, 31, 33, and 35 and control paths between storage manager component portion 12 and physical data storage devices 22, 24, 26, 28, and 39; the association of virtual data storage devices to the corresponding physical data storage devices; and overall workload management.
  • [0059] Management software 42 further controls physical volume management. When outboard storage manager 10 decides to move a data set from interim storage 44 to a back end physical storage device(s) 22, 24, 26, 28, and 39 then some decisions need to be made as to where to put them. If the data attributes as defined by storage management policy indicates that the data set is a candidate to reside on a tape cartridge, then a tape cartridge with expired data on it must be selected to write the data set to. The tape cartridge selected can be one which is completely void of data sets, or the tape cartridge could contain some data sets which have not yet expired and the space available on that tape cartridge can be used to write the current data.
  • [0060] Management software 42 further performs data expiration processing. It is typical for data sets to have an inherent expiration date which defines a point in time at which the data contained in the data set is no longer valid. When data sets reach their expiration data and have been deleted by the user the memory space that these data sets occupy should be reclaimed so that media usage is as high as possible. On sequential media, such as magnetic tape, partial reclamation of space for a given piece of media demands that all space from the data set to the end of the tape be reclaimed. If this segment of tape contains valid data sets a judgement must be made regarding the cost to relocate these valid data sets to another media element so that this segment of tape can be reclaimed. Thus, it is beneficial to initially write data sets having the same expiration date on the same media element so that the entirety of the media element can be reclaimed at once. If the expiration date of a data set changed during management of the data set it should be relocated to a media element that contains other data sets having the same or temporally near expiration date. In addition, users typically group media elements into subsets termed tape pools and the media management of outboard storage manager 10 should accommodate this organization, at least on a virtual level.
  • [0061] Management software 42 further performs virtual volume management. When a host system creates a new data set the serial number of the is remembered by the host system that created the data set. The combination of the data set name and the volume serial number is the identifier that is used in the future when the data set is read. In the environment of outboard storage manager 10, the volume represented by this serial number is an illusion to host processors 18 and 20, but the outboard storage manager must remember what that host known serial number is when the data set is created so that it can respond to subsequent requests to read that data set as if the data set resides on that volume. In addition to the serial number of the volume that the host processor believed the data set was created on, outboard storage manager 10 must keep the position of the data set relative to the beginning of that volume. When the host processor reads the data set, positioning commands are issued to the virtual device to move to the place on the volume where the host processor thinks the data set was created. The outboard storage manager virtual device front end 14 will accept and portray the illusion that these commands are executed.
  • Physical Data Storage Device Arrangements [0062]
  • As described above, [0063] outboard storage manager 10 generally presents images of a virtual data storage device 30, 32, and 36 to host processors 18 and 20, but in reality, the physical data storage devices 22, 24, 26, 28, and 39 implemented to effect the virtual data storage device may be completely different physical data storage devices than the effected virtual data storage device. Outboard storage manager 10 is further operable to perform a variety of functions with respect to physical data storage devices 22, 24, 26, 28, and 39 for emulating virtual data storage devices 30, 32, and 36.
  • First, [0064] outboard storage manager 10 arranges physical data storage devices 22, 24, 26, 28, and 39 in a hierarchical fashion with multiple storage levels for a particular data application. The existence and the management of these storage levels is performed solely by outboard storage manager 10 without the knowledge of host processors 18 and 20. The multiple storage levels includes several intermediate storage levels between a fast and expensive random access top storage level and a removable inexpensive sequential access bottom storage level.
  • Second, [0065] outboard storage manager 10 can logically demount (e.g., remove and restore) individual storage levels of the storage level organization for a particular data application without affecting host processors 18 and 20.
  • Third, [0066] outboard storage manager 10 can promote and demote a particular storage level in the storage level organization without affecting host processors 18 and 20.
  • Fourth, [0067] outboard storage manager 10 can transfer data sets directly between host processors 18 and 20 to the lowest or intermediate storage levels without requiring the data sets be staged through higher storage levels for a particular data application. That is, outboard storage manager 10 can establish a virtual storage hierarchy for each data set transfer.
  • Fifth, [0068] outboard storage manager 10 can split data set residency between storage levels with some data set portion (e.g., an index, the first n bytes, etc.) resident on faster more expensive higher storage level such as DASD and the remaining data set bulk on a removable media lower storage level such as tape for a particular data application. That is, outboard storage manager 10 can split the data comprising a data set between different storage levels without knowledge by host processors 18 and 20.
  • Sixth, [0069] outboard storage manager 10 can simultaneously transfer data sets during writes to more than one storage level in accordance with attributes of the data sets for a particular data application. The data sets can be forked so that it goes to several storage levels at once or split so that some of the data set is transferred to one storage level and the remaining data set is transferred to another storage level.
  • Seventh, similarly [0070] outboard storage manager 10 can simultaneously transfer data sets during reads to host processors 18 and 20 for a particular data application by joining the data sets from the different storage levels for transfer to the host processors.
  • Eighth, [0071] outboard storage manager 10 may use the storage on one data storage device as more than one storage level for a particular data application. Eighth, the outboard storage manager may use the media of a single level as more than one level for a particular data application.
  • Thus it is apparent that there has been provided, in accordance with the present invention, an outboard data storage management system and method which present to host processors a virtual data storage device having a desired storage attribute for a particular data storage application by combining data storage devices in an arrangement suitable for providing the desired storage attribute that fully satisfies the objects, aims, and advantages set forth above. While the present invention has been described in conjunction with specific embodiments thereof, it is evident that many alternatives, modifications, and variations will be apparent to those skilled in the art in light of the foregoing description. Accordingly, it is intended to embrace all such alternatives, modifications, and variations as fall within the spirit and broad scope of the appended claims. [0072]

Claims (43)

What is claimed is:
1. A data storage system for storing data for a host processor, the data storage system comprising:
a plurality of physical data storage devices each having data storage attributes; and
an outboard storage manager operable with the plurality of physical data storage devices for presenting to the host processor a virtual data storage image having a desired data storage attribute for a particular data storage application by organizing the physical data storage devices in an arrangement suitable for providing the desired data storage attribute irrespective of the data storage attributes of the physical data storage devices such that the organized physical data storage device arrangement emulates the virtual data storage image, wherein the outboard storage manager is operable to transfer data between the host processor and the organized physical data storage device arrangement via the virtual data storage image.
2. The data storage system of claim 1 wherein:
the virtual data storage image is a virtual data storage device image.
3. The data storage system of claim 1 wherein:
the virtual data storage image is a virtual data storage file image.
4. The data storage system of claim 1 wherein:
the virtual data storage image is a virtual data storage database image.
5. The data storage system of claim 1 wherein:
the virtual data storage image presented by the outboard storage manager is a virtual disk component.
6. The data storage system of claim 1 wherein:
the virtual data storage image presented by the outboard storage manager is a virtual tape component.
7. The data storage system of claim 1 wherein:
the virtual data storage image presented by the outboard storage manager is a virtual library component.
8. The data storage system of claim 1 wherein:
the virtual data storage image presented by the outboard storage manager is a virtual server component.
9. The data storage system of claim 1 wherein:
the virtual data storage image presented by the outboard storage manager is a virtual database component.
10. The data storage system of claim 1 wherein:
the virtual data storage image presented by the outboard storage manager is a virtual object component.
11. The data storage system of claim 1 wherein:
the outboard storage manager organizes the physical data storage devices in the arrangement suitable for providing the desired data storage attribute as a function of attributes of the data for the particular data application.
12. The data storage system of claim 1 further comprising:
a storage manager client resident on the host processor, wherein the storage manager client is operable with the outboard storage manager for transferring information indicative of the desired data storage attribute for the particular data application to the outboard storage manager.
13. The data storage system of claim 12 further comprising:
a storage manager client resident on the host processor, wherein the storage manager client is operable with the outboard storage manager for transferring information indicative of the attributes of the data for the particular data application to the outboard storage manager.
14. The data storage system of claim 1 wherein:
the outboard storage manager further includes interim storage for storing data transferred between the host processor and the combined physical data storage device arrangement via the virtual data storage device.
15. The data storage system of claim 1 wherein:
the outboard storage manager includes a front end and a back end, the front end operable for presenting to the host processor the virtual data storage image having the desired data storage attribute for the particular data application, the back end operable for organizing the physical storage devices in the suitable arrangement, wherein the front end is connected by a data channel function and a control path function to the host processor for receiving the data and information indicative of the desired data storage attribute, wherein the back end is connected to each of the plurality of physical data storage devices by respective data channels for transferring the received data to the organized physical data storage device arrangement providing the desired data storage attribute.
16. The data storage system of claim 15 wherein:
the data channel function and the control path function connect to the front end by using a single communication line.
17. The data storage system of claim 15 wherein:
the data channel function and the control path function connect to the front end using respective communication lines.
18. The data storage system of claim 1 wherein:
the plurality of physical data storage devices includes a disk subsystem.
19. The data storage system of claim 1 wherein:
the plurality of physical data storage devices includes a tape subsystem.
20. The data storage system of claim 1 wherein:
the plurality of physical data storage devices includes an optical subsystem.
21. The data storage system of claim 1 wherein:
the plurality of physical data storage devices includes a solid state subsystem.
22. The data storage system of claim 1 wherein:
the plurality of physical data storage devices includes a probe storage subsystem.
23. The data storage system of claim 1 wherein:
the outboard storage manager arranges the combined physical data storage device arrangement emulating the virtual data storage image in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application.
24. The data storage system of claim 23 wherein:
the outboard storage manager promotes and demotes storage levels in the storage hierarchy without knowledge by the host processor for the particular data application.
25. The data storage system of claim 23 wherein:
the outboard storage manager removes and restores storage levels in the storage hierarchy without knowledge by the host processor for the particular data application.
26. The data storage system of claim 23 wherein:
the outboard storage manager transfers the data from the host processor directly to intermediate storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
27. The data storage system of claim 23 wherein:
the outboard storage manager transfers respective portions of the data from the host processor to respective storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
28. The data storage system of claim 23 wherein:
the outboard storage manager transfers data simultaneously to different storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
29. The data storage system of claim 23 wherein:
the outboard storage manager transfers data simultaneously from different storage levels to the virtual data storage image without knowledge by the host processor for the particular data application.
30. The data storage system of claim 23 wherein:
the outboard storage manager arranges a physical data storage device in the combined physical data storage device arrangement in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application.
31. The data storage system of claim 23 wherein:
the outboard storage manager arranges a portion of a physical data storage device in the combined physical data storage device arrangement in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application.
32. A data storage system for storing data for a host processor, the data storage system comprising:
a plurality of physical data storage devices each having data storage attributes; and
an outboard storage manager operable with the plurality of physical data storage devices for presenting to the host processor a virtual data storage image having a desired data storage attribute for a particular data storage application by organizing the physical data storage devices in an arrangement suitable for providing the desired data storage attribute irrespective of the data storage attributes of the physical data storage devices such that the organized physical data storage device arrangement emulates the virtual data storage image.
33. A data storage method for storing data for a host processor, the data storage method comprising:
providing a plurality of physical data storage devices each having data storage attributes; and
presenting to the host processor a virtual data storage image having a desired data storage attribute for a particular data storage application by organizing the physical data storage devices in an arrangement suitable for providing the desired data storage attribute irrespective of the data storage attributes of the physical data storage devices such that the organized physical data storage device arrangement emulates the virtual data storage image; and
transferring data between the host processor and the organized physical data storage device arrangement via the virtual data storage image.
34. The data storage method of claim 33 wherein:
organizing the physical data storage devices includes organizing the physical data storage devices as a function of attributes of the data for the particular data application.
35. The data storage method of claim 33 wherein:
organizing the physical data storage devices includes organizing the physical data storage devices without knowledge by the host processor for the particular data application.
36. The data storage method of claim 33 wherein:
organizing the physical storage devices includes promoting and demoting storage levels in the storage hierarchy without knowledge by the host processor for the particular data application.
37. The data storage method of claim 33 wherein:
organizing the physical storage devices includes removing and restoring storage levels in the storage hierarchy without knowledge by the host processor for the particular data application.
38. The data storage method of claim 33 wherein:
transferring data includes transferring the data from the host processor directly to intermediate storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
39. The data storage method of claim 33 wherein:
transferring data includes transferring respective portions of the data from the host processor to respective storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
40. The data storage method of claim 33 wherein:
transferring data includes transferring the data simultaneously to different storage levels via the virtual data storage image without knowledge by the host processor for the particular data application.
41. The data storage method of claim 33 wherein:
transferring data includes transferring the data simultaneously from different storage levels to the virtual data storage image without knowledge by the host processor for the particular data application.
42. The data storage method of claim 33 wherein:
organizing the physical data storage devices includes arranging a physical data storage device in the combined physical data storage device arrangement in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application.
43. The data storage method of claim 33 wherein:
organizing the physical data storage devices includes arranging a portion of a physical data storage device in the combined physical data storage device arrangement in a storage hierarchy having several storage levels without knowledge by the host processor for the particular data application.
US09/878,696 2001-06-11 2001-06-11 Outboard data storage management system and method Abandoned US20020188592A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US09/878,696 US20020188592A1 (en) 2001-06-11 2001-06-11 Outboard data storage management system and method
PCT/US2002/018700 WO2002101535A2 (en) 2001-06-11 2002-06-10 Outboard data storage management system and method
AU2002303998A AU2002303998A1 (en) 2001-06-11 2002-06-10 Outboard data storage management system and method
JP2003504230A JP2005501317A (en) 2001-06-11 2002-06-10 External data storage management system and method
EP02732068A EP1438653A2 (en) 2001-06-11 2002-06-10 Outboard data storage management system and method
US10/803,137 US7136801B2 (en) 2001-06-11 2004-03-10 Outboard data storage management system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09/878,696 US20020188592A1 (en) 2001-06-11 2001-06-11 Outboard data storage management system and method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/803,137 Continuation US7136801B2 (en) 2001-06-11 2004-03-10 Outboard data storage management system and method

Publications (1)

Publication Number Publication Date
US20020188592A1 true US20020188592A1 (en) 2002-12-12

Family

ID=25372603

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/878,696 Abandoned US20020188592A1 (en) 2001-06-11 2001-06-11 Outboard data storage management system and method
US10/803,137 Expired - Lifetime US7136801B2 (en) 2001-06-11 2004-03-10 Outboard data storage management system and method

Family Applications After (1)

Application Number Title Priority Date Filing Date
US10/803,137 Expired - Lifetime US7136801B2 (en) 2001-06-11 2004-03-10 Outboard data storage management system and method

Country Status (5)

Country Link
US (2) US20020188592A1 (en)
EP (1) EP1438653A2 (en)
JP (1) JP2005501317A (en)
AU (1) AU2002303998A1 (en)
WO (1) WO2002101535A2 (en)

Cited By (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030225801A1 (en) * 2002-05-31 2003-12-04 Devarakonda Murthy V. Method, system, and program for a policy based storage manager
US20030229767A1 (en) * 2002-06-10 2003-12-11 Lee Whay Sing Data storage system using 3-party hand-off protocol to maintain a single coherent logical image
US20040044829A1 (en) * 2002-08-29 2004-03-04 Dawson Erika M. Apparatus and method to maintain information using a plurality of storage attributes
US20040133915A1 (en) * 2002-11-08 2004-07-08 Moody William H. System and method for controlling access to media libraries
US20040186881A1 (en) * 2002-12-18 2004-09-23 Emc Corp. Automated media library configuration
US20040193397A1 (en) * 2003-03-28 2004-09-30 Christopher Lumb Data storage system emulation
WO2005031523A2 (en) * 2003-09-23 2005-04-07 Lockheed Martin Corporation Systems and methods for sharing data between entities
US20050108565A1 (en) * 2003-11-14 2005-05-19 International Business Machines Corporation System, apparatus, and method for automatic copy function selection
US20050160150A1 (en) * 2004-01-20 2005-07-21 Su-Hwa Kao Apparatus and method for managing and transporting virtual disks over a network to networked stations
US20050235107A1 (en) * 2002-04-26 2005-10-20 Hitachi, Ltd. Method for controlling storage system, and storage control apparatus
US6976244B2 (en) * 2002-01-09 2005-12-13 International Business Machines Corporation Method, system, and product for storage of attribute data in an object oriented environment
US20060036405A1 (en) * 2004-08-10 2006-02-16 Byrd Stephen A Apparatus, system, and method for analyzing the association of a resource to a business process
US20060037022A1 (en) * 2004-08-10 2006-02-16 Byrd Stephen A Apparatus, system, and method for automatically discovering and grouping resources used by a business process
US20060036579A1 (en) * 2004-08-10 2006-02-16 Byrd Stephen A Apparatus, system, and method for associating resources using a time based algorithm
US20060047805A1 (en) * 2004-08-10 2006-03-02 Byrd Stephen A Apparatus, system, and method for gathering trace data indicative of resource activity
EP1632856A1 (en) * 2003-06-09 2006-03-08 Fujitsu Limited Storage management unit, storage unit, file processing system, file management system, and their methods and programs
US20060059118A1 (en) * 2004-08-10 2006-03-16 Byrd Stephen A Apparatus, system, and method for associating resources using a behavior based algorithm
US20060101084A1 (en) * 2004-10-25 2006-05-11 International Business Machines Corporation Policy based data migration in a hierarchical data storage system
US20060129654A1 (en) * 2003-09-09 2006-06-15 Hitachi, Ltd. File sharing device and inter-file sharing device data migration method
US7080202B2 (en) 2003-09-17 2006-07-18 Hitachi, Ltd. Remote storage disk control device with function to transfer commands to remote storage devices
US20060174071A1 (en) * 2005-01-28 2006-08-03 Justiss Steven A System and method for handling status commands directed to partitioned media library
US20060170238A1 (en) * 2005-01-28 2006-08-03 Justiss Steven A System and method for mode select handling for a partitioned media library
US20060174088A1 (en) * 2005-01-28 2006-08-03 Justiss Steven A Method and system for presenting contiguous element addresses for a partitioned media library
US20060200700A1 (en) * 2003-08-18 2006-09-07 Malcolm Peter B Data storage system
US20060215700A1 (en) * 2005-03-22 2006-09-28 Zayas Edward R Shared implementation for multiple system interfaces
US7130941B2 (en) 2003-06-24 2006-10-31 Hitachi, Ltd. Changing-over and connecting a first path, wherein hostscontinue accessing an old disk using a second path, and the second path of the old disk to a newly connected disk via a switch
US7155587B2 (en) 2004-02-26 2006-12-26 Hitachi, Ltd. Storage subsystem and performance tuning method
US7165163B2 (en) 2003-09-17 2007-01-16 Hitachi, Ltd. Remote storage disk control device and method for controlling the same
US20070033327A1 (en) * 2005-08-03 2007-02-08 Sinclair Alan W Enhanced host interface
US7177991B2 (en) 2003-01-16 2007-02-13 Hitachi, Ltd. Installation method of new storage system into a computer system
WO2007019258A2 (en) * 2005-08-03 2007-02-15 Sandisk Corporation Enhanced host interface
WO2007019075A2 (en) * 2005-08-03 2007-02-15 Sandisk Corporation Method and system for dual mode access for storage devices
US7200546B1 (en) * 2002-09-05 2007-04-03 Ultera Systems, Inc. Tape storage emulator
US7231465B2 (en) 2002-09-18 2007-06-12 Hitachi, Ltd. Storage system, and method for controlling the same
US7263593B2 (en) 2002-11-25 2007-08-28 Hitachi, Ltd. Virtualization controller and data transfer control method
US20070233449A1 (en) * 2006-03-31 2007-10-04 Microsoft Corporation Simulation of hierarchical storage systems
US20080177558A1 (en) * 2005-02-04 2008-07-24 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Resolution of virtual world revocable transfers
US20080208917A1 (en) * 2007-02-22 2008-08-28 Network Appliance, Inc. Apparatus and a method to make data sets conform to data management policies
WO2008103429A1 (en) * 2007-02-22 2008-08-28 Network Appliance, Inc. Data management in a data storage system using data sets
US20080208926A1 (en) * 2007-02-22 2008-08-28 Smoot Peter L Data management in a data storage system using data sets
US7428613B1 (en) 2004-06-29 2008-09-23 Crossroads Systems, Inc. System and method for centralized partitioned library mapping
US7441095B2 (en) 2003-09-29 2008-10-21 Hitachi, Ltd. Storage system and storage controller
US7454565B1 (en) 2004-06-29 2008-11-18 Crossroads Systems, Inc System and method for distributed partitioned library mapping
US7673107B2 (en) 2004-10-27 2010-03-02 Hitachi, Ltd. Storage system and storage control device
US7734869B1 (en) 2005-04-28 2010-06-08 Netapp, Inc. Interfaces for flexible storage management
US7747837B2 (en) 2005-12-21 2010-06-29 Sandisk Corporation Method and system for accessing non-volatile storage devices
US20100180074A1 (en) * 2009-01-09 2010-07-15 Alastair Slater Virtual tape library
US7769978B2 (en) 2005-12-21 2010-08-03 Sandisk Corporation Method and system for accessing non-volatile storage devices
US7788413B1 (en) 2005-04-29 2010-08-31 Crossroads Systems, Inc. Method and system for handling commands requesting movement of a data storage medium between physical media libraries
US7793068B2 (en) 2005-12-21 2010-09-07 Sandisk Corporation Dual mode access for non-volatile storage devices
US7840767B2 (en) 2004-08-30 2010-11-23 Hitachi, Ltd. System managing a plurality of virtual volumes and a virtual volume management method for the system
US20100318579A1 (en) * 2006-08-02 2010-12-16 Hitachi, Ltd. Control Device for Storage System Capable of Acting as a Constituent Element of Virtualization Storage System
US7949512B2 (en) * 2004-11-08 2011-05-24 Commvault Systems, Inc. Systems and methods for performing virtual storage operations
US7958307B2 (en) 2004-11-05 2011-06-07 Commvault Systems, Inc. Method and system for grouping storage system components
US20110184904A1 (en) * 2010-01-27 2011-07-28 Precise Software Solutions, Inc. Dynamic Storage Blocks Tiering
US8032718B2 (en) 2003-04-03 2011-10-04 Commvault Systems, Inc. Systems and methods for sharing media in a computer network
US8041905B2 (en) 2002-09-09 2011-10-18 Commvault Systems, Inc. Systems and methods for allocating control of storage media in a network environment
US20110258379A1 (en) * 2010-04-19 2011-10-20 Hitachi, Ltd. Method and apparatus to manage tier information
US8073671B2 (en) 2006-03-31 2011-12-06 Microsoft Corporation Dynamic software performance models
US8117165B1 (en) 2008-04-30 2012-02-14 Netapp, Inc. Disk-to-disk backup of database archive logs
US20120260051A1 (en) * 2011-03-01 2012-10-11 Hitachi, Ltd. Computer system, management system and data management method
US8429346B1 (en) * 2009-12-28 2013-04-23 Emc Corporation Automated data relocation among storage tiers based on storage load
US8438276B1 (en) 2004-08-31 2013-05-07 Precise Software Solutions, Inc. Method of monitoring network and application performance by analyzing web clients and web servers
US8566549B1 (en) * 2008-12-31 2013-10-22 Emc Corporation Synchronizing performance requirements across multiple storage platforms
US8788527B1 (en) 2003-12-31 2014-07-22 Precise Software Solutions, Inc. Object-level database performance management
US8965803B2 (en) 2005-02-04 2015-02-24 The Invention Science Fund I, Llc Virtual world reversion rights
US9104315B2 (en) 2005-02-04 2015-08-11 Sandisk Technologies Inc. Systems and methods for a mass data storage system having a file-based interface to a host and a non-file-based interface to secondary storage
US20170031603A1 (en) * 2015-07-30 2017-02-02 International Business Machines Corporation Reclamation of storage medium
US10019159B2 (en) 2012-03-14 2018-07-10 Open Invention Network Llc Systems, methods and devices for management of virtual memory systems
US10379988B2 (en) 2012-12-21 2019-08-13 Commvault Systems, Inc. Systems and methods for performance monitoring
US10956299B2 (en) 2015-02-27 2021-03-23 Commvault Systems, Inc. Diagnosing errors in data storage and archiving in a cloud or networking environment
US11032350B2 (en) 2017-03-15 2021-06-08 Commvault Systems, Inc. Remote commands framework to control clients
US11593223B1 (en) 2021-09-02 2023-02-28 Commvault Systems, Inc. Using resource pool administrative entities in a data storage management system to provide shared infrastructure to tenants

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7522965B2 (en) * 2000-12-01 2009-04-21 O2Micro International Limited Low power digital audio decoding/playing system for computing devices
US7522964B2 (en) * 2000-12-01 2009-04-21 O2Micro International Limited Low power digital audio decoding/playing system for computing devices
US7890741B2 (en) 2000-12-01 2011-02-15 O2Micro International Limited Low power digital audio decoding/playing system for computing devices
JP2004021557A (en) 2002-06-14 2004-01-22 Hitachi Ltd Program, information processing method, information processor, and storage device
JP4345313B2 (en) 2003-01-24 2009-10-14 株式会社日立製作所 Operation management method of storage system based on policy
US20040153614A1 (en) 2003-02-05 2004-08-05 Haim Bitner Tape storage emulation for open systems environments
US7496492B2 (en) * 2003-08-29 2009-02-24 Microsoft Corporation Software-aided storage device emulation in a physical storage device
JP4156499B2 (en) * 2003-11-28 2008-09-24 株式会社日立製作所 Disk array device
US8843725B2 (en) * 2005-09-19 2014-09-23 Spectra Logic Corporation Virtual interchangeable storage device
US20080183934A1 (en) * 2004-12-14 2008-07-31 Spectra Logic Corporation Optional mobile media storage system
US7680830B1 (en) * 2005-05-31 2010-03-16 Symantec Operating Corporation System and method for policy-based data lifecycle management
US7747577B2 (en) * 2005-08-17 2010-06-29 International Business Machines Corporation Management of redundant objects in storage systems
US7516291B2 (en) * 2005-11-21 2009-04-07 Red Hat, Inc. Cooperative mechanism for efficient application memory allocation
US7697554B1 (en) 2005-12-27 2010-04-13 Emc Corporation On-line data migration of a logical/virtual storage array by replacing virtual names
US7685395B1 (en) 2005-12-27 2010-03-23 Emc Corporation Spanning virtual arrays across multiple physical storage arrays
US7697515B2 (en) * 2005-12-27 2010-04-13 Emc Corporation On-line data migration of a logical/virtual storage array
US9348530B2 (en) * 2005-12-27 2016-05-24 Emc Corporation Presentation of virtual arrays using n-port ID virtualization
US8510429B1 (en) 2006-01-19 2013-08-13 Sprint Communications Company L.P. Inventory modeling in a data storage infrastructure for a communication network
US7895295B1 (en) 2006-01-19 2011-02-22 Sprint Communications Company L.P. Scoring data flow characteristics to assign data flows to storage systems in a data storage infrastructure for a communication network
US8996586B2 (en) 2006-02-16 2015-03-31 Callplex, Inc. Virtual storage of portable media files
US10303783B2 (en) * 2006-02-16 2019-05-28 Callplex, Inc. Distributed virtual storage of portable media files
US8583861B1 (en) * 2006-06-29 2013-11-12 Emc Corporation Presentation of management functionality of virtual arrays
US8533408B1 (en) * 2006-06-29 2013-09-10 Emc Corporation Consolidating N-storage arrays into one storage array using virtual array non-disruptive data migration
US8539177B1 (en) * 2006-06-29 2013-09-17 Emc Corporation Partitioning of a storage array into N-storage arrays using virtual array non-disruptive data migration
US7757059B1 (en) 2006-06-29 2010-07-13 Emc Corporation Virtual array non-disruptive management data migration
US8452928B1 (en) 2006-06-29 2013-05-28 Emc Corporation Virtual array non-disruptive migration of extended storage functionality
US20080059144A1 (en) * 2006-09-01 2008-03-06 Inphase Technologies Emulation of dissimilar removable medium storage device types assisted by information embedded in the logical format
US9098211B1 (en) 2007-06-29 2015-08-04 Emc Corporation System and method of non-disruptive data migration between a full storage array and one or more virtual arrays
US9063896B1 (en) 2007-06-29 2015-06-23 Emc Corporation System and method of non-disruptive data migration between virtual arrays of heterogeneous storage arrays
US8468310B2 (en) * 2007-07-31 2013-06-18 Vmware, Inc. Method and system for tracking data correspondences
US9342383B2 (en) * 2007-12-28 2016-05-17 Sap Se Streaming operations for workflow process models using multiple views on a same buffer
JP2009237826A (en) * 2008-03-26 2009-10-15 Hitachi Ltd Storage system and volume management method therefor
US9773033B2 (en) * 2009-05-22 2017-09-26 International Business Machines Corporation Storing and retrieving volumes in a database by volume attributes
US8341346B2 (en) * 2010-06-25 2012-12-25 International Business Machines Corporation Offloading volume space reclamation operations to virtual tape systems
US20130138915A1 (en) * 2010-08-11 2013-05-30 Nec Corporation Data processing system, data processing method, and program
US20130117272A1 (en) * 2011-11-03 2013-05-09 Microsoft Corporation Systems and methods for handling attributes and intervals of big data
US11016820B2 (en) 2013-08-26 2021-05-25 Vmware, Inc. Load balancing of resources
US10747475B2 (en) * 2013-08-26 2020-08-18 Vmware, Inc. Virtual disk blueprints for a virtualized storage area network, wherein virtual disk objects are created from local physical storage of host computers that are running multiple virtual machines
US9811531B2 (en) 2013-08-26 2017-11-07 Vmware, Inc. Scalable distributed storage architecture
US9887924B2 (en) 2013-08-26 2018-02-06 Vmware, Inc. Distributed policy-based provisioning and enforcement for quality of service
US9672115B2 (en) 2013-08-26 2017-06-06 Vmware, Inc. Partition tolerance in cluster membership management
US9582198B2 (en) 2013-08-26 2017-02-28 Vmware, Inc. Compressed block map of densely-populated data structures
US11507622B2 (en) 2020-03-25 2022-11-22 The Toronto-Dominion Bank System and method for automatically managing storage resources of a big data platform

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5018060A (en) * 1989-01-26 1991-05-21 Ibm Corporation Allocating data storage space of peripheral data storage devices using implied allocation based on user parameters
US5491810A (en) * 1994-03-01 1996-02-13 International Business Machines Corporation Method and system for automated data storage system space allocation utilizing prioritized data set parameters

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4467421A (en) * 1979-10-18 1984-08-21 Storage Technology Corporation Virtual storage system and method
USRE36989E (en) * 1979-10-18 2000-12-12 Storage Technology Corporation Virtual storage system and method
US5394532A (en) * 1992-04-15 1995-02-28 Storage Technology Corporation Disk drive array memory system having instant format capability
US5403639A (en) * 1992-09-02 1995-04-04 Storage Technology Corporation File server having snapshot application data groups
US6269464B1 (en) * 1997-06-18 2001-07-31 Sutmyn Storage Corporation Error checking technique for use in mass storage systems
US6052765A (en) * 1998-04-21 2000-04-18 Storage Technology Corporation Method for optimized placement of virtual volumes on a physical cartridge
US6151666A (en) * 1998-05-27 2000-11-21 Storage Technology Corporation Method for reclaiming fragmented space on a physical data storage cartridge
US6067587A (en) * 1998-06-17 2000-05-23 Sutmyn Storage Corporation Method for serializing and synchronizing data packets by utilizing a physical lock system and a control data structure for mutual exclusion lock
US6317814B1 (en) * 1998-07-01 2001-11-13 Storage Technology Corporation Method for selectively storing redundant copies of virtual volume data on physical data storage cartridges
US6289425B1 (en) * 1998-07-01 2001-09-11 Storage Technology Corporation Method for verifying availability of data space in virtual tape system
US6094605A (en) * 1998-07-06 2000-07-25 Storage Technology Corporation Virtual automated cartridge system
US6049848A (en) * 1998-07-15 2000-04-11 Sutmyn Storage Corporation System and method for performing high-speed tape positioning operations
US6324497B1 (en) * 1998-07-15 2001-11-27 Sutmyn Storage Corporation Tape drive emulation system including tape library interface
US6330621B1 (en) * 1999-01-15 2001-12-11 Storage Technology Corporation Intelligent data storage manager
US6816957B1 (en) * 1999-10-26 2004-11-09 Storage Technology Corporation Management of virtual tape volumes using data page atomic units

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5018060A (en) * 1989-01-26 1991-05-21 Ibm Corporation Allocating data storage space of peripheral data storage devices using implied allocation based on user parameters
US5491810A (en) * 1994-03-01 1996-02-13 International Business Machines Corporation Method and system for automated data storage system space allocation utilizing prioritized data set parameters

Cited By (171)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6976244B2 (en) * 2002-01-09 2005-12-13 International Business Machines Corporation Method, system, and product for storage of attribute data in an object oriented environment
US20050235107A1 (en) * 2002-04-26 2005-10-20 Hitachi, Ltd. Method for controlling storage system, and storage control apparatus
US7937513B2 (en) 2002-04-26 2011-05-03 Hitachi, Ltd. Method for controlling storage system, and storage control apparatus
US7412543B2 (en) 2002-04-26 2008-08-12 Hitachi, Ltd. Method for controlling storage system, and storage control apparatus
US7457899B2 (en) 2002-04-26 2008-11-25 Hitachi, Ltd. Method for controlling storage system, and storage control apparatus
US7051121B2 (en) 2002-04-26 2006-05-23 Hitachi, Ltd. Method for controlling storage system, and storage control apparatus
US7209986B2 (en) 2002-04-26 2007-04-24 Hitachi, Ltd. Method for controlling storage system, and storage control apparatus
US7269612B2 (en) 2002-05-31 2007-09-11 International Business Machines Corporation Method, system, and program for a policy based storage manager
US20030225801A1 (en) * 2002-05-31 2003-12-04 Devarakonda Murthy V. Method, system, and program for a policy based storage manager
US7730042B2 (en) 2002-05-31 2010-06-01 International Business Machines Corporation Method, system, and program for a policy based storage manager
US20070244940A1 (en) * 2002-05-31 2007-10-18 International Business Machines Corporation Method, system, and program for a policy based storage manager
US20070244939A1 (en) * 2002-05-31 2007-10-18 International Business Machines Corporation Method, system, and program for a policy based storage manager
US7725444B2 (en) 2002-05-31 2010-05-25 International Business Machines Corporation Method for a policy based storage manager
US6857050B2 (en) * 2002-06-10 2005-02-15 Sun Microsystemes, Inc. Data storage system using 3-party hand-off protocol to maintain a single coherent logical image
US20030229767A1 (en) * 2002-06-10 2003-12-11 Lee Whay Sing Data storage system using 3-party hand-off protocol to maintain a single coherent logical image
US20040044829A1 (en) * 2002-08-29 2004-03-04 Dawson Erika M. Apparatus and method to maintain information using a plurality of storage attributes
US6889285B2 (en) * 2002-08-29 2005-05-03 International Business Machines Corporation Apparatus and method to maintain information using a plurality of storage attributes
US7200546B1 (en) * 2002-09-05 2007-04-03 Ultera Systems, Inc. Tape storage emulator
US7359848B1 (en) * 2002-09-05 2008-04-15 Ultera Systems, Inc. Tape storage emulator
US8291177B2 (en) 2002-09-09 2012-10-16 Commvault Systems, Inc. Systems and methods for allocating control of storage media in a network environment
US8041905B2 (en) 2002-09-09 2011-10-18 Commvault Systems, Inc. Systems and methods for allocating control of storage media in a network environment
US20080091899A1 (en) * 2002-09-18 2008-04-17 Masataka Innan Storage system, and method for controlling the same
US7231465B2 (en) 2002-09-18 2007-06-12 Hitachi, Ltd. Storage system, and method for controlling the same
US20090157710A1 (en) * 2002-11-08 2009-06-18 Crossroads Systems, Inc. System and method for controlling access to multiple physical media libraries
US7752384B2 (en) 2002-11-08 2010-07-06 Crossroads Systems, Inc. System and method for controlling access to media libraries
US7971019B2 (en) 2002-11-08 2011-06-28 Crossroads Systems, Inc. System and method for controlling access to multiple physical media libraries
US20040133915A1 (en) * 2002-11-08 2004-07-08 Moody William H. System and method for controlling access to media libraries
US7505980B2 (en) * 2002-11-08 2009-03-17 Crossroads Systems, Inc. System and method for controlling access to multiple physical media libraries
US7941597B2 (en) 2002-11-08 2011-05-10 Crossroads Systems, Inc. System and method for controlling access to media libraries
US20040139094A1 (en) * 2002-11-08 2004-07-15 Tyndall John F. System and method for controlling access to multiple physical media libraries
US7694104B2 (en) 2002-11-25 2010-04-06 Hitachi, Ltd. Virtualization controller and data transfer control method
US8572352B2 (en) 2002-11-25 2013-10-29 Hitachi, Ltd. Virtualization controller and data transfer control method
US7263593B2 (en) 2002-11-25 2007-08-28 Hitachi, Ltd. Virtualization controller and data transfer control method
US8190852B2 (en) 2002-11-25 2012-05-29 Hitachi, Ltd. Virtualization controller and data transfer control method
US7877568B2 (en) 2002-11-25 2011-01-25 Hitachi, Ltd. Virtualization controller and data transfer control method
US20040186881A1 (en) * 2002-12-18 2004-09-23 Emc Corp. Automated media library configuration
US7177991B2 (en) 2003-01-16 2007-02-13 Hitachi, Ltd. Installation method of new storage system into a computer system
US7643983B2 (en) * 2003-03-28 2010-01-05 Hewlett-Packard Development Company, L.P. Data storage system emulation
US20040193397A1 (en) * 2003-03-28 2004-09-30 Christopher Lumb Data storage system emulation
US9940043B2 (en) 2003-04-03 2018-04-10 Commvault Systems, Inc. Systems and methods for performing storage operations in a computer network
US8892826B2 (en) 2003-04-03 2014-11-18 Commvault Systems, Inc. Systems and methods for performing storage operations in a computer network
US8341359B2 (en) 2003-04-03 2012-12-25 Commvault Systems, Inc. Systems and methods for sharing media and path management in a computer network
US8032718B2 (en) 2003-04-03 2011-10-04 Commvault Systems, Inc. Systems and methods for sharing media in a computer network
US8364914B2 (en) 2003-04-03 2013-01-29 Commvault Systems, Inc. Systems and methods for performing storage operations in a computer network
US9251190B2 (en) * 2003-04-03 2016-02-02 Commvault Systems, Inc. System and method for sharing media in a computer network
US9201917B2 (en) 2003-04-03 2015-12-01 Commvault Systems, Inc. Systems and methods for performing storage operations in a computer network
US8176268B2 (en) 2003-04-03 2012-05-08 Comm Vault Systems, Inc. Systems and methods for performing storage operations in a computer network
US8510516B2 (en) * 2003-04-03 2013-08-13 Commvault Systems, Inc. Systems and methods for sharing media in a computer network
US8688931B2 (en) 2003-04-03 2014-04-01 Commvault Systems, Inc. Systems and methods for performing storage operations in a computer network
US9021213B2 (en) 2003-04-03 2015-04-28 Commvault Systems, Inc. System and method for sharing media in a computer network
US20060090055A1 (en) * 2003-06-09 2006-04-27 Fujitsu Limited Storage management apparatus, storage apparatus, file processing system, file management system, and methods and programs thereof
EP1632856A4 (en) * 2003-06-09 2007-02-28 Fujitsu Ltd Storage management unit, storage unit, file processing system, file management system, and their methods and programs
EP1632856A1 (en) * 2003-06-09 2006-03-08 Fujitsu Limited Storage management unit, storage unit, file processing system, file management system, and their methods and programs
US7634588B2 (en) 2003-06-24 2009-12-15 Hitachi, Ltd. Data migration method for disk apparatus
US7231466B2 (en) 2003-06-24 2007-06-12 Hitachi, Ltd. Data migration method for disk apparatus
US7130941B2 (en) 2003-06-24 2006-10-31 Hitachi, Ltd. Changing-over and connecting a first path, wherein hostscontinue accessing an old disk using a second path, and the second path of the old disk to a newly connected disk via a switch
US8099394B2 (en) * 2003-08-18 2012-01-17 Computer Associates Think, Inc. Persistent data storage for data files of application data
US20060200700A1 (en) * 2003-08-18 2006-09-07 Malcolm Peter B Data storage system
US7424547B2 (en) * 2003-09-09 2008-09-09 Hitachi, Ltd. File sharing device and inter-file sharing device data migration method
US20060129654A1 (en) * 2003-09-09 2006-06-15 Hitachi, Ltd. File sharing device and inter-file sharing device data migration method
US7203806B2 (en) 2003-09-17 2007-04-10 Hitachi, Ltd. Remote storage disk control device with function to transfer commands to remote storage devices
US7080202B2 (en) 2003-09-17 2006-07-18 Hitachi, Ltd. Remote storage disk control device with function to transfer commands to remote storage devices
US7975116B2 (en) 2003-09-17 2011-07-05 Hitachi, Ltd. Remote storage disk control device and method for controlling the same
US7363461B2 (en) 2003-09-17 2008-04-22 Hitachi, Ltd. Remote storage disk control device and method for controlling the same
US8255652B2 (en) 2003-09-17 2012-08-28 Hitachi, Ltd. Remote storage disk control device and method for controlling the same
US7707377B2 (en) 2003-09-17 2010-04-27 Hitachi, Ltd. Remote storage disk control device and method for controlling the same
US7165163B2 (en) 2003-09-17 2007-01-16 Hitachi, Ltd. Remote storage disk control device and method for controlling the same
WO2005031523A3 (en) * 2003-09-23 2007-04-19 Lockheed Corp Systems and methods for sharing data between entities
WO2005031523A2 (en) * 2003-09-23 2005-04-07 Lockheed Martin Corporation Systems and methods for sharing data between entities
US7441095B2 (en) 2003-09-29 2008-10-21 Hitachi, Ltd. Storage system and storage controller
US7493466B2 (en) 2003-09-29 2009-02-17 Hitachi, Ltd. Virtualization system for virtualizing disks drives of a disk array system
US7917711B2 (en) * 2003-11-14 2011-03-29 International Business Machines Corporation System, apparatus, and method for automatic copy function selection
US20050108565A1 (en) * 2003-11-14 2005-05-19 International Business Machines Corporation System, apparatus, and method for automatic copy function selection
US8788527B1 (en) 2003-12-31 2014-07-22 Precise Software Solutions, Inc. Object-level database performance management
US20050160150A1 (en) * 2004-01-20 2005-07-21 Su-Hwa Kao Apparatus and method for managing and transporting virtual disks over a network to networked stations
US7809906B2 (en) 2004-02-26 2010-10-05 Hitachi, Ltd. Device for performance tuning in a system
US7624241B2 (en) 2004-02-26 2009-11-24 Hitachi, Ltd. Storage subsystem and performance tuning method
US8046554B2 (en) 2004-02-26 2011-10-25 Hitachi, Ltd. Storage subsystem and performance tuning method
US7155587B2 (en) 2004-02-26 2006-12-26 Hitachi, Ltd. Storage subsystem and performance tuning method
US8281098B2 (en) 2004-02-26 2012-10-02 Hitachi, Ltd. Storage subsystem and performance tuning method
US7752416B2 (en) 2004-06-29 2010-07-06 Crossroads Systems, Inc. System and method for distributed partitioned library mapping
US20100199061A1 (en) * 2004-06-29 2010-08-05 Justiss Steven A System and Method for Distributed Partitioned Library Mapping
US7975124B2 (en) 2004-06-29 2011-07-05 Crossroads Systems, Inc. System and method for distributed partitioned library mapping
US7428613B1 (en) 2004-06-29 2008-09-23 Crossroads Systems, Inc. System and method for centralized partitioned library mapping
US7454565B1 (en) 2004-06-29 2008-11-18 Crossroads Systems, Inc System and method for distributed partitioned library mapping
US7546601B2 (en) 2004-08-10 2009-06-09 International Business Machines Corporation Apparatus, system, and method for automatically discovering and grouping resources used by a business process
US7661135B2 (en) 2004-08-10 2010-02-09 International Business Machines Corporation Apparatus, system, and method for gathering trace data indicative of resource activity
US20060037022A1 (en) * 2004-08-10 2006-02-16 Byrd Stephen A Apparatus, system, and method for automatically discovering and grouping resources used by a business process
US20060036579A1 (en) * 2004-08-10 2006-02-16 Byrd Stephen A Apparatus, system, and method for associating resources using a time based algorithm
US7630955B2 (en) 2004-08-10 2009-12-08 International Business Machines Corporation Apparatus, system, and method for analyzing the association of a resource to a business process
US20060047805A1 (en) * 2004-08-10 2006-03-02 Byrd Stephen A Apparatus, system, and method for gathering trace data indicative of resource activity
US20060059118A1 (en) * 2004-08-10 2006-03-16 Byrd Stephen A Apparatus, system, and method for associating resources using a behavior based algorithm
US20060036405A1 (en) * 2004-08-10 2006-02-16 Byrd Stephen A Apparatus, system, and method for analyzing the association of a resource to a business process
US7840767B2 (en) 2004-08-30 2010-11-23 Hitachi, Ltd. System managing a plurality of virtual volumes and a virtual volume management method for the system
US8122214B2 (en) 2004-08-30 2012-02-21 Hitachi, Ltd. System managing a plurality of virtual volumes and a virtual volume management method for the system
US8843715B2 (en) 2004-08-30 2014-09-23 Hitachi, Ltd. System managing a plurality of virtual volumes and a virtual volume management method for the system
US8438276B1 (en) 2004-08-31 2013-05-07 Precise Software Solutions, Inc. Method of monitoring network and application performance by analyzing web clients and web servers
US20060101084A1 (en) * 2004-10-25 2006-05-11 International Business Machines Corporation Policy based data migration in a hierarchical data storage system
US7673107B2 (en) 2004-10-27 2010-03-02 Hitachi, Ltd. Storage system and storage control device
US7958307B2 (en) 2004-11-05 2011-06-07 Commvault Systems, Inc. Method and system for grouping storage system components
US8443142B2 (en) 2004-11-05 2013-05-14 Commvault Systems, Inc. Method and system for grouping storage system components
US9507525B2 (en) 2004-11-05 2016-11-29 Commvault Systems, Inc. Methods and system of pooling storage devices
US8074042B2 (en) 2004-11-05 2011-12-06 Commvault Systems, Inc. Methods and system of pooling storage devices
US10191675B2 (en) 2004-11-05 2019-01-29 Commvault Systems, Inc. Methods and system of pooling secondary storage devices
US8402244B2 (en) 2004-11-05 2013-03-19 Commvault Systems, Inc. Methods and system of pooling storage devices
US8799613B2 (en) 2004-11-05 2014-08-05 Commvault Systems, Inc. Methods and system of pooling storage devices
US7949512B2 (en) * 2004-11-08 2011-05-24 Commvault Systems, Inc. Systems and methods for performing virtual storage operations
US7962714B2 (en) 2004-11-08 2011-06-14 Commvault Systems, Inc. System and method for performing auxiliary storage operations
US8230195B2 (en) 2004-11-08 2012-07-24 Commvault Systems, Inc. System and method for performing auxiliary storage operations
US7971006B2 (en) 2005-01-28 2011-06-28 Crossroads Systems, Inc. System and method for handling status commands directed to partitioned media library
US20060174088A1 (en) * 2005-01-28 2006-08-03 Justiss Steven A Method and system for presenting contiguous element addresses for a partitioned media library
US7451291B2 (en) 2005-01-28 2008-11-11 Crossroads Systems, Inc. System and method for mode select handling for a partitioned media library
US20060174071A1 (en) * 2005-01-28 2006-08-03 Justiss Steven A System and method for handling status commands directed to partitioned media library
US7370173B2 (en) 2005-01-28 2008-05-06 Crossroads Systems, Inc. Method and system for presenting contiguous element addresses for a partitioned media library
US20060170238A1 (en) * 2005-01-28 2006-08-03 Justiss Steven A System and method for mode select handling for a partitioned media library
US9104315B2 (en) 2005-02-04 2015-08-11 Sandisk Technologies Inc. Systems and methods for a mass data storage system having a file-based interface to a host and a non-file-based interface to secondary storage
US10126959B2 (en) 2005-02-04 2018-11-13 Sandisk Technologies Llc Systems and methods for a mass data storage system having a file-based interface to a host and a non-file-based interface to secondary storage
US10055147B2 (en) 2005-02-04 2018-08-21 Sandisk Technologies Llc Systems and methods for a mass data storage system having a file-based interface to a host and a non-file-based interface to secondary storage
US8977566B2 (en) 2005-02-04 2015-03-10 The Invention Science Fund I, Llc Virtual world reversion rights
US20080177558A1 (en) * 2005-02-04 2008-07-24 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Resolution of virtual world revocable transfers
US8965803B2 (en) 2005-02-04 2015-02-24 The Invention Science Fund I, Llc Virtual world reversion rights
US7756154B2 (en) 2005-03-22 2010-07-13 Netapp, Inc. Shared implementation for multiple system interfaces
US20060215700A1 (en) * 2005-03-22 2006-09-28 Zayas Edward R Shared implementation for multiple system interfaces
US7734869B1 (en) 2005-04-28 2010-06-08 Netapp, Inc. Interfaces for flexible storage management
US7788413B1 (en) 2005-04-29 2010-08-31 Crossroads Systems, Inc. Method and system for handling commands requesting movement of a data storage medium between physical media libraries
WO2007019258A2 (en) * 2005-08-03 2007-02-15 Sandisk Corporation Enhanced host interface
US8291151B2 (en) 2005-08-03 2012-10-16 Sandisk Technologies Inc. Enhanced host interface
US20070033326A1 (en) * 2005-08-03 2007-02-08 Sinclair Alan W Enhanced host interfacing methods
US20070033327A1 (en) * 2005-08-03 2007-02-08 Sinclair Alan W Enhanced host interface
WO2007019075A2 (en) * 2005-08-03 2007-02-15 Sandisk Corporation Method and system for dual mode access for storage devices
KR101055324B1 (en) * 2005-08-03 2011-08-08 쌘디스크 코포레이션 Enhanced Host Interface
US7627733B2 (en) * 2005-08-03 2009-12-01 Sandisk Corporation Method and system for dual mode access for storage devices
WO2007019075A3 (en) * 2005-08-03 2007-05-03 Sandisk Corp Method and system for dual mode access for storage devices
WO2007019258A3 (en) * 2005-08-03 2007-07-19 Sandisk Corp Enhanced host interface
US7747837B2 (en) 2005-12-21 2010-06-29 Sandisk Corporation Method and system for accessing non-volatile storage devices
US7769978B2 (en) 2005-12-21 2010-08-03 Sandisk Corporation Method and system for accessing non-volatile storage devices
US7793068B2 (en) 2005-12-21 2010-09-07 Sandisk Corporation Dual mode access for non-volatile storage devices
US8209516B2 (en) 2005-12-21 2012-06-26 Sandisk Technologies Inc. Method and system for dual mode access for storage devices
US8073671B2 (en) 2006-03-31 2011-12-06 Microsoft Corporation Dynamic software performance models
US20070233449A1 (en) * 2006-03-31 2007-10-04 Microsoft Corporation Simulation of hierarchical storage systems
US20100318579A1 (en) * 2006-08-02 2010-12-16 Hitachi, Ltd. Control Device for Storage System Capable of Acting as a Constituent Element of Virtualization Storage System
US10140045B2 (en) * 2006-08-02 2018-11-27 Hitachi, Ltd. Control device for storage system capable of acting as a constituent element of virtualization storage system
US9898221B2 (en) * 2006-08-02 2018-02-20 Hitachi, Ltd. Control device for storage system capable of acting as a constituent element of virtualization storage system
US20160054950A1 (en) * 2006-08-02 2016-02-25 Hitachi, Ltd. Control device for storage system capable of acting as a constituent element of virtualization storage system
WO2008103429A1 (en) * 2007-02-22 2008-08-28 Network Appliance, Inc. Data management in a data storage system using data sets
US20080208917A1 (en) * 2007-02-22 2008-08-28 Network Appliance, Inc. Apparatus and a method to make data sets conform to data management policies
US7953928B2 (en) 2007-02-22 2011-05-31 Network Appliance, Inc. Apparatus and a method to make data sets conform to data management policies
US20080208926A1 (en) * 2007-02-22 2008-08-28 Smoot Peter L Data management in a data storage system using data sets
US8117165B1 (en) 2008-04-30 2012-02-14 Netapp, Inc. Disk-to-disk backup of database archive logs
US8566549B1 (en) * 2008-12-31 2013-10-22 Emc Corporation Synchronizing performance requirements across multiple storage platforms
US9690506B2 (en) 2009-01-09 2017-06-27 Hewlett Packard Enterprise Development Lp Virtual tape library
US9323473B2 (en) * 2009-01-09 2016-04-26 Hewlett Packard Enterprise Development Lp Virtual tape library
US20100180074A1 (en) * 2009-01-09 2010-07-15 Alastair Slater Virtual tape library
US8429346B1 (en) * 2009-12-28 2013-04-23 Emc Corporation Automated data relocation among storage tiers based on storage load
US8819057B2 (en) 2010-01-27 2014-08-26 Precise Software Solutions, Inc. Dynamic storage blocks tiering
US20110184904A1 (en) * 2010-01-27 2011-07-28 Precise Software Solutions, Inc. Dynamic Storage Blocks Tiering
US9244962B2 (en) 2010-01-27 2016-01-26 Precise Software Solutions, Inc. Dynamic storage blocks tiering
WO2011094336A1 (en) * 2010-01-27 2011-08-04 Precise Software Solutions, Inc Dynamic storage blocks tiering
US20110258379A1 (en) * 2010-04-19 2011-10-20 Hitachi, Ltd. Method and apparatus to manage tier information
US9753668B2 (en) 2010-04-19 2017-09-05 Hitachi, Ltd. Method and apparatus to manage tier information
US8677093B2 (en) * 2010-04-19 2014-03-18 Hitachi, Ltd. Method and apparatus to manage tier information
US20120260051A1 (en) * 2011-03-01 2012-10-11 Hitachi, Ltd. Computer system, management system and data management method
US10019159B2 (en) 2012-03-14 2018-07-10 Open Invention Network Llc Systems, methods and devices for management of virtual memory systems
US10379988B2 (en) 2012-12-21 2019-08-13 Commvault Systems, Inc. Systems and methods for performance monitoring
US10956299B2 (en) 2015-02-27 2021-03-23 Commvault Systems, Inc. Diagnosing errors in data storage and archiving in a cloud or networking environment
US10042556B2 (en) * 2015-07-30 2018-08-07 International Business Machines Corporation Reclamation of storage medium
US20170031603A1 (en) * 2015-07-30 2017-02-02 International Business Machines Corporation Reclamation of storage medium
US10620838B2 (en) 2015-07-30 2020-04-14 International Business Machines Corporation Reclamation of storage medium
US11032350B2 (en) 2017-03-15 2021-06-08 Commvault Systems, Inc. Remote commands framework to control clients
US11593223B1 (en) 2021-09-02 2023-02-28 Commvault Systems, Inc. Using resource pool administrative entities in a data storage management system to provide shared infrastructure to tenants
US11928031B2 (en) 2021-09-02 2024-03-12 Commvault Systems, Inc. Using resource pool administrative entities to provide shared infrastructure to tenants

Also Published As

Publication number Publication date
US7136801B2 (en) 2006-11-14
AU2002303998A1 (en) 2002-12-23
WO2002101535A2 (en) 2002-12-19
EP1438653A2 (en) 2004-07-21
US20040177228A1 (en) 2004-09-09
WO2002101535A3 (en) 2004-05-21
JP2005501317A (en) 2005-01-13

Similar Documents

Publication Publication Date Title
US7136801B2 (en) Outboard data storage management system and method
US6978325B2 (en) Transferring data in virtual tape server, involves determining availability of small chain of data, if large chain is not available while transferring data to physical volumes in peak mode
US5887151A (en) Method and apparatus for performing a modified prefetch which sends a list identifying a plurality of data blocks
US6598134B2 (en) System and method for on-line, real time, data migration
US5881311A (en) Data storage subsystem with block based data management
US6219693B1 (en) File array storage architecture having file system distributed across a data processing platform
US7249218B2 (en) Method, system, and program for managing an out of available space condition
US7308528B2 (en) Virtual tape library device
US7979402B1 (en) System and method for managing file data during consistency points
US8069331B2 (en) Storage system, storage extent release method and storage apparatus
US7115919B2 (en) Storage system for content distribution
US7209932B2 (en) Method, system, and program for allocating tasks to a plurality of processors
US20070038822A1 (en) Copying storage units and related metadata to storage
US6954839B2 (en) Computer system
US8595458B2 (en) Intelligent extent initialization in storage environment
JP2002082775A (en) Computer system
JP2008152807A (en) Computer system
KR20070015185A (en) Dynamic loading of virtual volume data in a virtual tape server
US6260109B1 (en) Method and apparatus for providing logical devices spanning several physical volumes
JPH07271521A (en) Computer system
US20050262296A1 (en) Selective dual copy control of data storage and copying in a peer-to-peer virtual tape server system
US7882086B1 (en) Method and system for portset data management
US7437511B1 (en) Secondary level cache for storage area networks
US7783611B1 (en) System and method for managing file metadata during consistency points
US7509329B1 (en) Technique for accelerating file deletion by preloading indirect blocks

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: EXPRESSLY ABANDONED -- DURING PUBLICATION PROCESS