WO2003060748A3 - Parallel processing systems and method - Google Patents

Parallel processing systems and method Download PDF

Info

Publication number
WO2003060748A3
WO2003060748A3 PCT/US2003/000787 US0300787W WO03060748A3 WO 2003060748 A3 WO2003060748 A3 WO 2003060748A3 US 0300787 W US0300787 W US 0300787W WO 03060748 A3 WO03060748 A3 WO 03060748A3
Authority
WO
WIPO (PCT)
Prior art keywords
nodes
algorithm
request
howard cascade
parallel processing
Prior art date
Application number
PCT/US2003/000787
Other languages
French (fr)
Other versions
WO2003060748A2 (en
Inventor
Kevin David Howard
Glen Curtis Rea
Nick Wade Robertson
Silva Chang
Original Assignee
Massively Parallel Technologie
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Massively Parallel Technologie filed Critical Massively Parallel Technologie
Priority to CA002472442A priority Critical patent/CA2472442A1/en
Priority to EP03713226A priority patent/EP1502203A2/en
Priority to AU2003217190A priority patent/AU2003217190A1/en
Priority to JP2003560774A priority patent/JP4596781B2/en
Publication of WO2003060748A2 publication Critical patent/WO2003060748A2/en
Publication of WO2003060748A3 publication Critical patent/WO2003060748A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061Partitioning or combining of resources
    • G06F9/5066Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/40Transformation of program code
    • G06F8/41Compilation
    • G06F8/45Exploiting coarse grain parallelism in compilation, i.e. parallelism between groups of instructions

Abstract

Methods and systems for parallel computation of an algorithm using a plurality of nodes configured as a Howard Cascade. A home node of a Howard Cascade receives a request from ahost system to compute an algorithm identified in the request. The request is distributed to processing nodes of the Howard Cascade in a time sequence order in a manner to minimize the time to so expand the Howard Cascade. The participating nodes then perform the designated portion of the algorithm in parallel. Partial results from each node are agglomerated upstream to higher nodes of the structure and then returned to the host system. The nodes each include a library of stored algorithms accompanied by data template information defining partitioning of the data used in the algorithm among the number of participating nodes.
PCT/US2003/000787 2002-01-10 2003-01-10 Parallel processing systems and method WO2003060748A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CA002472442A CA2472442A1 (en) 2002-01-10 2003-01-10 Parallel processing systems and method
EP03713226A EP1502203A2 (en) 2002-01-10 2003-01-10 Parallel processing systems and method
AU2003217190A AU2003217190A1 (en) 2002-01-10 2003-01-10 Parallel processing systems and method
JP2003560774A JP4596781B2 (en) 2002-01-10 2003-01-10 Parallel processing system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US34732502P 2002-01-10 2002-01-10
US60/347,325 2002-01-10

Publications (2)

Publication Number Publication Date
WO2003060748A2 WO2003060748A2 (en) 2003-07-24
WO2003060748A3 true WO2003060748A3 (en) 2004-11-18

Family

ID=23363243

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/000787 WO2003060748A2 (en) 2002-01-10 2003-01-10 Parallel processing systems and method

Country Status (5)

Country Link
EP (1) EP1502203A2 (en)
JP (5) JP4596781B2 (en)
AU (1) AU2003217190A1 (en)
CA (1) CA2472442A1 (en)
WO (1) WO2003060748A2 (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7676807B2 (en) * 2006-02-28 2010-03-09 Sap Ag Method and system for cascaded processing a plurality of data objects
US8108512B2 (en) 2006-09-01 2012-01-31 Massively Parallel Technologies, Inc. System and method for accessing and using a supercomputer
US9880970B2 (en) * 2007-10-03 2018-01-30 William L. Bain Method for implementing highly available data parallel operations on a computational grid
US10216692B2 (en) 2009-06-17 2019-02-26 Massively Parallel Technologies, Inc. Multi-core parallel processing system
EP2606424A4 (en) * 2010-08-17 2014-10-29 Massively Parallel Tech Inc System and method for execution of high performance computing applications
US9953137B2 (en) * 2012-07-06 2018-04-24 Nant Holdings Ip, Llc Healthcare analysis stream management
WO2014208139A1 (en) 2013-06-28 2014-12-31 日本電気株式会社 Fault detection device, control method, and program
JP6303806B2 (en) 2014-05-22 2018-04-04 富士通株式会社 Parallel computer system, process control program, and parallel computer system control method
US9851949B2 (en) 2014-10-07 2017-12-26 Kevin D. Howard System and method for automatic software application creation
US10496514B2 (en) 2014-11-20 2019-12-03 Kevin D. Howard System and method for parallel processing prediction
DE102015102362B3 (en) * 2015-02-19 2016-04-28 Synopsys, Inc. METHOD FOR PROCESSING A COMPUTER SIMULATION PROGRAM AND COMPUTER PROGRAM PRODUCT FOR IMPLEMENTING SUCH A METHOD
JP6907700B2 (en) * 2017-05-23 2021-07-21 富士通株式会社 Information processing device, multi-thread matrix operation method, and multi-thread matrix operation program
CN107844827B (en) 2017-11-28 2020-05-26 南京地平线机器人技术有限公司 Method and apparatus for performing operations on convolutional layers in convolutional neural networks
CN107832842B (en) 2017-11-28 2020-05-22 南京地平线机器人技术有限公司 Method and device for performing convolution operation aiming at folding characteristic data
CN107729994B (en) * 2017-11-28 2020-05-26 南京地平线机器人技术有限公司 Method and apparatus for performing operations on convolutional layers in convolutional neural networks
CN110033078B (en) * 2018-01-12 2024-01-12 华为技术有限公司 Computing system and method based on tree topology
US11520560B2 (en) 2018-12-31 2022-12-06 Kevin D. Howard Computer processing and outcome prediction systems and methods
US11861336B2 (en) 2021-08-12 2024-01-02 C Squared Ip Holdings Llc Software systems and methods for multiple TALP family enhancement and management
US11687328B2 (en) 2021-08-12 2023-06-27 C Squared Ip Holdings Llc Method and system for software enhancement and management

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0107453A1 (en) * 1982-10-15 1984-05-02 THE GENERAL ELECTRIC COMPANY, p.l.c. Data processing systems
US5325526A (en) * 1992-05-12 1994-06-28 Intel Corporation Task scheduling in a multicomputer system
EP0640930A2 (en) * 1993-08-27 1995-03-01 International Business Machines Corporation A multiprocessor system and a method of controlling such a system
EP1031923A2 (en) * 1999-02-04 2000-08-30 Sun Microsystems Inc. Method and system for implementing a balanced distribution of processor resources
WO2001001219A2 (en) * 1999-06-25 2001-01-04 Massively Parallel Computing, Inc. Massive collective network processing system and methods
EP1096378A2 (en) * 1999-10-19 2001-05-02 Kabushiki Kaisha Toshiba Parallel computer having a hierarchy structure

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06168217A (en) * 1992-11-25 1994-06-14 Hitachi Ltd Method and device for constituting parallel arithmetic mechanism and parallel arithmetic mechanism
JPH07168790A (en) * 1993-12-15 1995-07-04 Oki Electric Ind Co Ltd Information processor
JPH07200505A (en) * 1993-12-30 1995-08-04 Hitachi Ltd Broadcast communication method/device
JPH0844678A (en) * 1994-07-29 1996-02-16 Canon Inc Device and system for processing image
JP3036489B2 (en) * 1997-10-24 2000-04-24 日本電気株式会社 Collective communication device in multiprocessor system
JP2000181890A (en) * 1998-12-15 2000-06-30 Fujitsu Ltd Multiprocessor exchange and switching method of its main processor
JP2001022601A (en) * 1999-07-12 2001-01-26 Hitachi Ltd Job execution control method and parallel computer system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0107453A1 (en) * 1982-10-15 1984-05-02 THE GENERAL ELECTRIC COMPANY, p.l.c. Data processing systems
US5325526A (en) * 1992-05-12 1994-06-28 Intel Corporation Task scheduling in a multicomputer system
EP0640930A2 (en) * 1993-08-27 1995-03-01 International Business Machines Corporation A multiprocessor system and a method of controlling such a system
EP1031923A2 (en) * 1999-02-04 2000-08-30 Sun Microsystems Inc. Method and system for implementing a balanced distribution of processor resources
WO2001001219A2 (en) * 1999-06-25 2001-01-04 Massively Parallel Computing, Inc. Massive collective network processing system and methods
EP1096378A2 (en) * 1999-10-19 2001-05-02 Kabushiki Kaisha Toshiba Parallel computer having a hierarchy structure

Non-Patent Citations (9)

* Cited by examiner, † Cited by third party
Title
FERNANDEZ E B ET AL: "Fault-tolerant parallel algorithms", PROCEEDINGS OF SOUTHEASTCON. WILLIAMSBURG, APRIL 7 - 10, 1991, PROCEEDINGS OF THE SOUTHEAST CONFERENCE, NEW YORK, IEEE, US, vol. VOL. 1, 7 April 1991 (1991-04-07), pages 466 - 469, XP010045144, ISBN: 0-7803-0033-5 *
GRUNDY J: "Software architecture modelling, analysis and implementation with softarch", PROC 34TH HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES, 3 January 2001 (2001-01-03), pages 3826 - 3834, XP010550048 *
KEAGLE C ET AL: "Categorization and performance analysis of advanced avionics algorithms on parallel processing architectures", IEEE, 22 May 1989 (1989-05-22), pages 1722 - 1724, XP010086744 *
KWAN A W ET AL: "Using Parallel Programming Paradigms for Structuring Programs on Distributed Memory Computers", IEEE, 28 April 1991 (1991-04-28), pages 210 - 213, XP010255023 *
MIN-BIN CHEN ET AL: "Parallel 2d delaunay triangulations in hpf and mpi", PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM., PROCEEDINGS 15TH INTERNATIONAL SAN FRANCISCO, CA, USA 23-27 APRIL 2001, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 23 April 2001 (2001-04-23), pages 301 - 308, XP010544397, ISBN: 0-7695-0990-8 *
PONTELLI, E. ET AL: "Automatic Compile-time Parallelization of Prolog Programs for Dependent And-Parallelism", PROC. OF THE FOURTEENTH INTERNATIONAL CONFERENCE ON LOGIC PROGRAMMING, July 1997 (1997-07-01), pages 108 - 122, XP002294656, Retrieved from the Internet <URL:http://citeseer.ist.psu.edu/cache/papers/cs/16510/http:zSzzSzwww.cs.nmsu.eduzSz~guptazSzacezSzstaticdap.pdf/pontelli97automatic.pdf> [retrieved on 20040901] *
TRYSTRAM D: "Scheduling parallel applications using malleable tasks on clusters", PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM., PROCEEDINGS 15TH INTERNATIONAL SAN FRANCISCO, CA, USA 23-27 APRIL 2001, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 23 April 2001 (2001-04-23), pages 2128 - 2135, XP010544637, ISBN: 0-7695-0990-8 *
WELCH L R ET AL: "Metrics and techniques for automatic partitioning and assignment of object-based concurrent programs", PARALLEL AND DISTRIBUTED PROCESSING, 1995. PROCEEDINGS. SEVENTH IEEE SYMPOSIUM ON SAN ANTONIO, TX, USA 25-28 OCT. 1995, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 25 October 1995 (1995-10-25), pages 440 - 447, XP010196232, ISBN: 0-8186-7195-5 *
XIAOXIONG ZHONG ET AL: "Optimal implementation of parallel divide-and-conquer algorithms on de Bruijn networks", FRONTIERS OF MASSIVELY PARALLEL COMPUTATION, 1992., FOURTH SYMPOSIUM ON THE MCLEAN, VA, USA 19-21 OCT. 1992, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 19 October 1992 (1992-10-19), pages 583 - 585, XP010028514, ISBN: 0-8186-2772-7 *

Also Published As

Publication number Publication date
JP2011100487A (en) 2011-05-19
JP4596781B2 (en) 2010-12-15
CA2472442A1 (en) 2003-07-24
JP2008243216A (en) 2008-10-09
JP5487128B2 (en) 2014-05-07
JP4698700B2 (en) 2011-06-08
AU2003217190A8 (en) 2003-07-30
JP2010277604A (en) 2010-12-09
WO2003060748A2 (en) 2003-07-24
AU2003217190A1 (en) 2003-07-30
EP1502203A2 (en) 2005-02-02
JP2013061958A (en) 2013-04-04
JP2005515551A (en) 2005-05-26

Similar Documents

Publication Publication Date Title
WO2003060748A3 (en) Parallel processing systems and method
US11087234B2 (en) Method and system for distributed deep machine learning
JP6370469B2 (en) Parallelizing training for convolutional neural networks
WO2020011283A3 (en) System and method for deleting node in blockchain network
CN1551555B (en) Architecture for partition computation and propagation of changes in data replication
Larsen et al. EasyGene–a prokaryotic gene finder that ranks ORFs by statistical significance
Vidal Applied simulated annealing
WO2002044835A3 (en) A method and system for software and hardware multiplicity
US20110184952A1 (en) Method And Apparatus For Fast Audio Search
JP2007149068A (en) Method, system, and product for rebalancing striped disc and data (rebalancing of striped disc and data)
CA3098770C (en) Performing map iterations in blockchain-based system
CN109657605A (en) A kind of method and device of face track and MAC track collision
Todorov et al. TinGa: fast and flexible trajectory inference with Growing Neural Gas
CN113094558A (en) Network node influence sequencing method based on local structure
Rocha et al. Distributed cycle detection in large-scale sparse graphs
Andonov et al. Protein threading: From mathematical models to parallel implementations
Yao et al. Design and performance analysis of divisible load scheduling strategies on arbitrary graphs
CN112799852A (en) Multi-dimensional SBP distributed signature decision system and method for logic node
Bonomo et al. Complexity of the cluster deletion problem on subclasses of chordal graphs
US20050027780A1 (en) Maximum clique in a graph
Dasari et al. Maximal clique enumeration for large graphs on hadoop framework
Goddard et al. Parallel GENESIS for large-scale modeling
CN109993338B (en) Link prediction method and device
CN106790620B (en) Distributed big data processing method
El-Amawy et al. Algorithmic mapping of feedforward neural networks onto multiple bus systems

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2472442

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2003560774

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2003713226

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003713226

Country of ref document: EP