WO2008121240A3 - Write ordering style asynchronous replication utilizing a loosely-accurate global clock - Google Patents

Write ordering style asynchronous replication utilizing a loosely-accurate global clock Download PDF

Info

Publication number
WO2008121240A3
WO2008121240A3 PCT/US2008/003612 US2008003612W WO2008121240A3 WO 2008121240 A3 WO2008121240 A3 WO 2008121240A3 US 2008003612 W US2008003612 W US 2008003612W WO 2008121240 A3 WO2008121240 A3 WO 2008121240A3
Authority
WO
WIPO (PCT)
Prior art keywords
loosely
global clock
accurate global
write ordering
replication
Prior art date
Application number
PCT/US2008/003612
Other languages
French (fr)
Other versions
WO2008121240A2 (en
Inventor
Erez Webman
Yoram Novick
Dvir Koren
Original Assignee
Network Appliance Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Network Appliance Inc filed Critical Network Appliance Inc
Priority to EP08726987.4A priority Critical patent/EP2140354B1/en
Publication of WO2008121240A2 publication Critical patent/WO2008121240A2/en
Publication of WO2008121240A3 publication Critical patent/WO2008121240A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2064—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring while ensuring consistency
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2071—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring using a plurality of controllers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2071—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring using a plurality of controllers
    • G06F11/2074—Asynchronous techniques

Abstract

A write ordering style asynchronous replication service utilizes a loosely-accurate global clock in a data backup and recovery storage environment. The storage environment includes a set of source storage systems illustratively embodied as source replication nodes that cooperate to maintain a consistency group that may span multiple geographical sites. The storage environment also includes one or more target storage systems illustratively embodied as target replication nodes configured to service the consistency group. The write ordering style service utilizes the loosely-accurate global clock to provide consistent replication of a storage space of the consistency group.
PCT/US2008/003612 2007-03-28 2008-03-19 Write ordering style asynchronous replication utilizing a loosely-accurate global clock WO2008121240A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP08726987.4A EP2140354B1 (en) 2007-03-28 2008-03-19 Write ordering style asynchronous replication utilizing a loosely-accurate global clock

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/692,668 US7925629B2 (en) 2007-03-28 2007-03-28 Write ordering style asynchronous replication utilizing a loosely-accurate global clock
US11/692,668 2007-03-28

Publications (2)

Publication Number Publication Date
WO2008121240A2 WO2008121240A2 (en) 2008-10-09
WO2008121240A3 true WO2008121240A3 (en) 2008-12-18

Family

ID=39537976

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2008/003612 WO2008121240A2 (en) 2007-03-28 2008-03-19 Write ordering style asynchronous replication utilizing a loosely-accurate global clock

Country Status (3)

Country Link
US (1) US7925629B2 (en)
EP (1) EP2140354B1 (en)
WO (1) WO2008121240A2 (en)

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8515912B2 (en) 2010-07-15 2013-08-20 Palantir Technologies, Inc. Sharing and deconflicting data changes in a multimaster database system
US8688749B1 (en) 2011-03-31 2014-04-01 Palantir Technologies, Inc. Cross-ontology multi-master replication
US8290899B2 (en) * 2007-03-28 2012-10-16 Netapp, Inc. Group stamping style asynchronous replication utilizing a loosely-accurate global clock
US8150800B2 (en) 2007-03-28 2012-04-03 Netapp, Inc. Advanced clock synchronization technique
US8015427B2 (en) * 2007-04-23 2011-09-06 Netapp, Inc. System and method for prioritization of clock rates in a multi-core processor
US10108460B2 (en) * 2008-02-28 2018-10-23 International Business Machines Corporation Method and system for integrated deployment planning for virtual appliances
US8099571B1 (en) 2008-08-06 2012-01-17 Netapp, Inc. Logical block replication with deduplication
US9158579B1 (en) 2008-11-10 2015-10-13 Netapp, Inc. System having operation queues corresponding to operation execution time
US8321380B1 (en) 2009-04-30 2012-11-27 Netapp, Inc. Unordered idempotent replication operations
US8655848B1 (en) 2009-04-30 2014-02-18 Netapp, Inc. Unordered idempotent logical replication operations
US8671072B1 (en) 2009-09-14 2014-03-11 Netapp, Inc. System and method for hijacking inodes based on replication operations received in an arbitrary order
US8799367B1 (en) 2009-10-30 2014-08-05 Netapp, Inc. Using logical block addresses with generation numbers as data fingerprints for network deduplication
US8473690B1 (en) 2009-10-30 2013-06-25 Netapp, Inc. Using logical block addresses with generation numbers as data fingerprints to provide cache coherency
US8478718B1 (en) 2010-11-16 2013-07-02 Symantec Corporation Systems and methods for replicating data in cluster environments
US8918362B2 (en) 2011-05-23 2014-12-23 Microsoft Corporation Replication processes in a distributed storage environment
US9251021B2 (en) 2011-05-23 2016-02-02 Bradley Gene Calder Asynchronous replication in a distributed storage environment
US9519555B2 (en) 2011-05-23 2016-12-13 Microsoft Technology Licensing, Llc Synchronous replication in a distributed storage environment
US8782004B2 (en) 2012-01-23 2014-07-15 Palantir Technologies, Inc. Cross-ACL multi-master replication
US8868874B2 (en) 2012-02-01 2014-10-21 International Business Machines Corporation Managing remote data replication
US9355036B2 (en) 2012-09-18 2016-05-31 Netapp, Inc. System and method for operating a system to cache a networked file system utilizing tiered storage and customizable eviction policies based on priority and tiers
US9081975B2 (en) 2012-10-22 2015-07-14 Palantir Technologies, Inc. Sharing information between nexuses that use different classification schemes for information access control
US9501761B2 (en) 2012-11-05 2016-11-22 Palantir Technologies, Inc. System and method for sharing investigation results
US8930897B2 (en) 2013-03-15 2015-01-06 Palantir Technologies Inc. Data integration tool
US8903717B2 (en) 2013-03-15 2014-12-02 Palantir Technologies Inc. Method and system for generating a parser and parsing complex data
US8855999B1 (en) 2013-03-15 2014-10-07 Palantir Technologies Inc. Method and system for generating a parser and parsing complex data
US8886601B1 (en) * 2013-06-20 2014-11-11 Palantir Technologies, Inc. System and method for incrementally replicating investigative analysis data
US9311314B2 (en) 2013-08-27 2016-04-12 Netapp, Inc. System and method for migrating data from a source file system to a destination file system with use of attribute manipulation
US9304997B2 (en) * 2013-08-27 2016-04-05 Netapp, Inc. Asynchronously migrating a file system
US9300692B2 (en) 2013-08-27 2016-03-29 Netapp, Inc. System and method for implementing data migration while preserving security policies of a source filer
US9311331B2 (en) 2013-08-27 2016-04-12 Netapp, Inc. Detecting out-of-band (OOB) changes when replicating a source file system using an in-line system
US20160041996A1 (en) 2014-08-11 2016-02-11 Netapp, Inc. System and method for developing and implementing a migration plan for migrating a file system
US10860529B2 (en) 2014-08-11 2020-12-08 Netapp Inc. System and method for planning and configuring a file system migration
US9569070B1 (en) 2013-11-11 2017-02-14 Palantir Technologies, Inc. Assisting in deconflicting concurrency conflicts
US9009827B1 (en) 2014-02-20 2015-04-14 Palantir Technologies Inc. Security sharing system
US9021260B1 (en) 2014-07-03 2015-04-28 Palantir Technologies Inc. Malware data item analysis
US10572496B1 (en) 2014-07-03 2020-02-25 Palantir Technologies Inc. Distributed workflow system and database with access controls for city resiliency
US9785773B2 (en) 2014-07-03 2017-10-10 Palantir Technologies Inc. Malware data item analysis
US9715433B2 (en) * 2014-08-29 2017-07-25 Netapp, Inc. Reconciliation in sync replication
US10621198B1 (en) 2015-12-30 2020-04-14 Palantir Technologies Inc. System and method for secure database replication
US10262053B2 (en) 2016-12-22 2019-04-16 Palantir Technologies Inc. Systems and methods for data replication synchronization
US10068002B1 (en) 2017-04-25 2018-09-04 Palantir Technologies Inc. Systems and methods for adaptive data replication
US10430062B2 (en) 2017-05-30 2019-10-01 Palantir Technologies Inc. Systems and methods for geo-fenced dynamic dissemination
US11030494B1 (en) 2017-06-15 2021-06-08 Palantir Technologies Inc. Systems and methods for managing data spills
US10817392B1 (en) * 2017-11-01 2020-10-27 Pure Storage, Inc. Ensuring resiliency to storage device failures in a storage system that includes a plurality of storage devices
US10380196B2 (en) 2017-12-08 2019-08-13 Palantir Technologies Inc. Systems and methods for using linked documents
US10915542B1 (en) 2017-12-19 2021-02-09 Palantir Technologies Inc. Contextual modification of data sharing constraints in a distributed database system that uses a multi-master replication scheme
US11442652B1 (en) 2020-07-23 2022-09-13 Pure Storage, Inc. Replication handling during storage system transportation
US11349917B2 (en) 2020-07-23 2022-05-31 Pure Storage, Inc. Replication handling among distinct networks

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5504861A (en) * 1994-02-22 1996-04-02 International Business Machines Corporation Remote data duplexing
US5657440A (en) * 1994-03-21 1997-08-12 International Business Machines Corporation Asynchronous remote data copying using subsystem to subsystem communication
US20030204692A1 (en) * 2002-04-29 2003-10-30 Tamer Philip E. Method and apparatus for enhancing operations in disk array storage devices
US20040139367A1 (en) * 2003-01-09 2004-07-15 International Business Machines Corporation Method, system, and article of manufacture for maintaining data integrity
US20040250029A1 (en) * 2003-06-06 2004-12-09 Minwen Ji Asynchronous data redundancy technique
US20050071708A1 (en) * 2003-09-29 2005-03-31 International Business Machines (Ibm) Corporation Method, system, and program for recovery from a failure in an asynchronous data copying system
US20050154786A1 (en) * 2004-01-09 2005-07-14 International Business Machines Corporation Ordering updates in remote copying of data
EP1617330A2 (en) * 2004-07-17 2006-01-18 International Business Machines Corporation Controlling data consistency guarantees in storage apparatus
US20070022264A1 (en) * 2005-07-14 2007-01-25 Yottayotta, Inc. Maintaining write order fidelity on a multi-writer system
US20070165549A1 (en) * 2006-01-19 2007-07-19 Ciena Corporation Transport systems and methods incorporating absolute time references and selective buildout delays

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5544347A (en) * 1990-09-24 1996-08-06 Emc Corporation Data storage system controlled remote data mirroring with respectively maintained data indices
US5592618A (en) 1994-10-03 1997-01-07 International Business Machines Corporation Remote copy secondary data copy validation-audit function
US5682513A (en) * 1995-03-31 1997-10-28 International Business Machines Corporation Cache queue entry linking for DASD record updates
US6144999A (en) * 1998-05-29 2000-11-07 Sun Microsystems, Incorporated Method and apparatus for file system disaster recovery
US7203732B2 (en) 1999-11-11 2007-04-10 Miralink Corporation Flexible remote data mirroring
US6985499B2 (en) * 2000-04-20 2006-01-10 Symmetricom, Inc. Precise network time transfer
US7334098B1 (en) * 2000-06-06 2008-02-19 Quantum Corporation Producing a mass storage backup using a log of write commands and time information
US7114091B2 (en) * 2002-03-18 2006-09-26 National Instruments Corporation Synchronization of distributed systems
US7152077B2 (en) * 2003-05-16 2006-12-19 Hewlett-Packard Development Company, L.P. System for redundant storage of data
US7467168B2 (en) * 2003-06-18 2008-12-16 International Business Machines Corporation Method for mirroring data at storage locations
US7065589B2 (en) * 2003-06-23 2006-06-20 Hitachi, Ltd. Three data center remote copy system with journaling
US7720801B2 (en) * 2003-12-19 2010-05-18 Netapp, Inc. System and method for supporting asynchronous data replication with very short update intervals
WO2005086001A1 (en) 2004-02-27 2005-09-15 Incipient, Inc. Distributed asynchronous ordered replication
US7467265B1 (en) 2005-06-30 2008-12-16 Symantec Operating Corporation System and method for block conflict resolution within consistency interval marker based replication
US7571268B2 (en) 2006-04-06 2009-08-04 International Business Machines Corporation Consistent updates across storage subsystems coupled to a plurality of primary and secondary units at selected times
US8290899B2 (en) 2007-03-28 2012-10-16 Netapp, Inc. Group stamping style asynchronous replication utilizing a loosely-accurate global clock

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5504861A (en) * 1994-02-22 1996-04-02 International Business Machines Corporation Remote data duplexing
US5657440A (en) * 1994-03-21 1997-08-12 International Business Machines Corporation Asynchronous remote data copying using subsystem to subsystem communication
US20030204692A1 (en) * 2002-04-29 2003-10-30 Tamer Philip E. Method and apparatus for enhancing operations in disk array storage devices
US20040139367A1 (en) * 2003-01-09 2004-07-15 International Business Machines Corporation Method, system, and article of manufacture for maintaining data integrity
US20040250029A1 (en) * 2003-06-06 2004-12-09 Minwen Ji Asynchronous data redundancy technique
US20050071708A1 (en) * 2003-09-29 2005-03-31 International Business Machines (Ibm) Corporation Method, system, and program for recovery from a failure in an asynchronous data copying system
US20050154786A1 (en) * 2004-01-09 2005-07-14 International Business Machines Corporation Ordering updates in remote copying of data
EP1617330A2 (en) * 2004-07-17 2006-01-18 International Business Machines Corporation Controlling data consistency guarantees in storage apparatus
US20070022264A1 (en) * 2005-07-14 2007-01-25 Yottayotta, Inc. Maintaining write order fidelity on a multi-writer system
US20070165549A1 (en) * 2006-01-19 2007-07-19 Ciena Corporation Transport systems and methods incorporating absolute time references and selective buildout delays

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MILLS D L: "NETWORK TIME PROTOCOL (VERSION 3) SPECIFICATION, IMPLEMENTATION ANDANALYSIS", NETWORK WORKING GROUP. NETWORK TIME PROTOCOL (VERSION 3)SPECIFICATION, IMPLEMENTATION AND ANALYSIS, XX, XX, 1 March 1992 (1992-03-01), pages I - VII,01, XP002935527 *

Also Published As

Publication number Publication date
WO2008121240A2 (en) 2008-10-09
EP2140354B1 (en) 2013-05-08
EP2140354A2 (en) 2010-01-06
US7925629B2 (en) 2011-04-12
US20080243951A1 (en) 2008-10-02

Similar Documents

Publication Publication Date Title
WO2008121240A3 (en) Write ordering style asynchronous replication utilizing a loosely-accurate global clock
WO2008121249A3 (en) Advanced clock synchronization technique
WO2012162173A3 (en) Asynchronous replication in a distributed storage environment
BRPI1014698A2 (en) differential file and system restores from points and cloud.
WO2010046393A3 (en) Distributed data storage
WO2006130667A3 (en) Modeling of a multiprocessor system
WO2009029792A3 (en) Method and system for global usage based file location manipulation
GB2491730A (en) Transmission of map-reduce data based on a storage network or a storage network file system
WO2012112903A3 (en) Location mapping
EP1872282A4 (en) Systems and methods for providing distributed, decentralized data storage and retrieval
WO2007088084A3 (en) Restoring a file to its proper storage tier in an information lifecycle management environment
DE602008001470D1 (en) Memory system with function to backup data in the cache memory
GB2490400A (en) Read-other protocol for maintaining parity coherency in a write-back distributed redundancy data storage system
WO2008100938A3 (en) A method and system for integrating a social network and data repository to enable map creation
WO2008113647A3 (en) Shared disk clones
DE602007006201D1 (en) REMOVABLE AND PORTABLE DATA BACKUP DEVICE FOR A NETWORK STORAGE SYSTEM
WO2011017161A3 (en) Systems and methods for a manager toolkit
AU2003259297A8 (en) Consistent message ordering for semi-active and passive replication
WO2008117295A3 (en) Distributed storage management
WO2008024594A3 (en) Methods for efficient data version verification
GB2513510A (en) Dynamic optimization of a multicast tree hierarchy for a distributed switch
WO2012143920A3 (en) Access permissions management system and method
SE0400663L (en) Management of uncertainty in management systems
GB0625698D0 (en) Rollback support in distributed data management systems
GB2484371B (en) Methods and systems for single instance storage of asset parts

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2008726987

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08726987

Country of ref document: EP

Kind code of ref document: A2