WO2014031416A3 - Hardware implementation of the aggregation/group by operation: hash-table method - Google Patents
Hardware implementation of the aggregation/group by operation: hash-table method Download PDFInfo
- Publication number
- WO2014031416A3 WO2014031416A3 PCT/US2013/055020 US2013055020W WO2014031416A3 WO 2014031416 A3 WO2014031416 A3 WO 2014031416A3 US 2013055020 W US2013055020 W US 2013055020W WO 2014031416 A3 WO2014031416 A3 WO 2014031416A3
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- group
- aggregation
- hash
- column
- hardware implementation
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
- G06F16/244—Grouping and aggregation
Abstract
Techniques are described for performing grouping and aggregation operations. In one embodiment, a request is received to aggregate data grouped by a first column. In response to receiving the request, a group value in a row of a first column is mapped to an address. A pointer is stored for a first group at a first location identified by the address. The pointer identifies a second location of a set of aggregation data for the first group. An aggregate value included in the set of aggregation data is updated based on a value in the row of a second column.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015528526A JP6356675B2 (en) | 2012-08-20 | 2013-08-14 | Aggregation / grouping operation: Hardware implementation of hash table method |
EP13753948.2A EP2885728B1 (en) | 2012-08-20 | 2013-08-14 | Hardware implementation of the aggregation/group by operation: hash-table method |
CN201380050947.7A CN104685498B (en) | 2012-08-20 | 2013-08-14 | The hardware implementation mode of polymerization/division operation:Hash table method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/590,057 | 2012-08-20 | ||
US13/590,057 US9563658B2 (en) | 2012-08-20 | 2012-08-20 | Hardware implementation of the aggregation/group by operation: hash-table method |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2014031416A2 WO2014031416A2 (en) | 2014-02-27 |
WO2014031416A3 true WO2014031416A3 (en) | 2014-07-24 |
Family
ID=49083762
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2013/055020 WO2014031416A2 (en) | 2012-08-20 | 2013-08-14 | Hardware implementation of the aggregation/group by operation: hash-table method |
Country Status (5)
Country | Link |
---|---|
US (1) | US9563658B2 (en) |
EP (1) | EP2885728B1 (en) |
JP (1) | JP6356675B2 (en) |
CN (1) | CN104685498B (en) |
WO (1) | WO2014031416A2 (en) |
Families Citing this family (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10127281B2 (en) * | 2010-12-23 | 2018-11-13 | Sap Se | Dynamic hash table size estimation during database aggregation processing |
US9792117B2 (en) | 2011-12-08 | 2017-10-17 | Oracle International Corporation | Loading values from a value vector into subregisters of a single instruction multiple data register |
US9697174B2 (en) | 2011-12-08 | 2017-07-04 | Oracle International Corporation | Efficient hardware instructions for processing bit vectors for single instruction multiple data processors |
US10534606B2 (en) | 2011-12-08 | 2020-01-14 | Oracle International Corporation | Run-length encoding decompression |
US9727606B2 (en) | 2012-08-20 | 2017-08-08 | Oracle International Corporation | Hardware implementation of the filter/project operations |
US9600522B2 (en) | 2012-08-20 | 2017-03-21 | Oracle International Corporation | Hardware implementation of the aggregation/group by operation: filter method |
US9779137B2 (en) | 2013-07-09 | 2017-10-03 | Logicblox Inc. | Salient sampling for query size estimation |
US11113054B2 (en) | 2013-09-10 | 2021-09-07 | Oracle International Corporation | Efficient hardware instructions for single instruction multiple data processors: fast fixed-length value compression |
US9430390B2 (en) | 2013-09-21 | 2016-08-30 | Oracle International Corporation | Core in-memory space and object management architecture in a traditional RDBMS supporting DW and OLTP applications |
KR101642072B1 (en) * | 2014-05-08 | 2016-07-22 | 주식회사 알티베이스 | Method and Apparatus for Hybrid storage |
US11250001B2 (en) | 2014-08-01 | 2022-02-15 | International Business Machines Corporation | Accurate partition sizing for memory efficient reduction operations |
US10007615B1 (en) * | 2015-05-01 | 2018-06-26 | Marvell International Ltd. | Methods and apparatus for performing fast caching |
US10025823B2 (en) | 2015-05-29 | 2018-07-17 | Oracle International Corporation | Techniques for evaluating query predicates during in-memory table scans |
US9971808B2 (en) | 2015-06-24 | 2018-05-15 | International Business Machines Corporation | Fast query processing in columnar databases with GPUs |
US10067954B2 (en) | 2015-07-22 | 2018-09-04 | Oracle International Corporation | Use of dynamic dictionary encoding with an associated hash table to support many-to-many joins and aggregations |
CN106570022B (en) * | 2015-10-10 | 2020-06-23 | 菜鸟智能物流控股有限公司 | Cross-data-source query method, device and system |
US11023468B2 (en) * | 2015-11-20 | 2021-06-01 | Sap Se | First/last aggregation operator on multiple keyfigures with a single table scan |
US10402425B2 (en) | 2016-03-18 | 2019-09-03 | Oracle International Corporation | Tuple encoding aware direct memory access engine for scratchpad enabled multi-core processors |
US10055358B2 (en) | 2016-03-18 | 2018-08-21 | Oracle International Corporation | Run length encoding aware direct memory access filtering engine for scratchpad enabled multicore processors |
US10061832B2 (en) | 2016-11-28 | 2018-08-28 | Oracle International Corporation | Database tuple-encoding-aware data partitioning in a direct memory access engine |
US10061714B2 (en) | 2016-03-18 | 2018-08-28 | Oracle International Corporation | Tuple encoding aware direct memory access engine for scratchpad enabled multicore processors |
US10552413B2 (en) | 2016-05-09 | 2020-02-04 | Sap Se | Database workload capture and replay |
US10885009B1 (en) * | 2016-06-14 | 2021-01-05 | Amazon Technologies, Inc. | Generating aggregate views for data indices |
US10599488B2 (en) | 2016-06-29 | 2020-03-24 | Oracle International Corporation | Multi-purpose events for notification and sequence control in multi-core processor systems |
US10380058B2 (en) | 2016-09-06 | 2019-08-13 | Oracle International Corporation | Processor core to coprocessor interface with FIFO semantics |
US10783102B2 (en) * | 2016-10-11 | 2020-09-22 | Oracle International Corporation | Dynamically configurable high performance database-aware hash engine |
US11061876B2 (en) * | 2016-11-15 | 2021-07-13 | Sap Se | Fast aggregation on compressed data |
US10459859B2 (en) | 2016-11-28 | 2019-10-29 | Oracle International Corporation | Multicast copy ring for database direct memory access filtering engine |
US10176114B2 (en) | 2016-11-28 | 2019-01-08 | Oracle International Corporation | Row identification number generation in database direct memory access engine |
US10725947B2 (en) | 2016-11-29 | 2020-07-28 | Oracle International Corporation | Bit vector gather row count calculation and handling in direct memory access engine |
US10324634B2 (en) * | 2017-04-07 | 2019-06-18 | Micron Technology, Inc. | Methods of bit-flagged sketch-based memory management and memory devices utilizing the same |
US10558704B2 (en) * | 2017-07-20 | 2020-02-11 | Sap Se | Smart rollover |
US10698892B2 (en) * | 2018-04-10 | 2020-06-30 | Sap Se | Order-independent multi-record hash generation and data filtering |
CN110442574B (en) * | 2019-07-01 | 2022-05-03 | 上海赜睿信息科技有限公司 | Data processing method, electronic equipment and computer readable storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5511190A (en) * | 1995-01-20 | 1996-04-23 | Tandem Computers, Inc. | Hash-based database grouping system and method |
US5655080A (en) * | 1995-08-14 | 1997-08-05 | International Business Machines Corporation | Distributed hash group-by cooperative processing |
US5884299A (en) * | 1997-02-06 | 1999-03-16 | Ncr Corporation | Optimization of SQL queries involving aggregate expressions using a plurality of local and global aggregation operations |
US6381601B1 (en) * | 1998-12-22 | 2002-04-30 | Hitachi, Ltd. | Grouping and duplicate removal method in a database |
US20060116989A1 (en) * | 2004-11-30 | 2006-06-01 | Srikanth Bellamkonda | Efficient data aggregation operations using hash tables |
Family Cites Families (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS63143627A (en) * | 1986-12-05 | 1988-06-15 | Nippon Telegr & Teleph Corp <Ntt> | Associative summarizing arithmetic unit |
JP2568657B2 (en) * | 1988-11-28 | 1997-01-08 | シャープ株式会社 | Hash collision avoidance method for data driven microprocessor |
US5706495A (en) | 1996-05-07 | 1998-01-06 | International Business Machines Corporation | Encoded-vector indices for decision support and warehousing |
US5890147A (en) * | 1997-03-07 | 1999-03-30 | Microsoft Corporation | Scope testing of documents in a search engine using document to folder mapping |
US6934712B2 (en) * | 2000-03-21 | 2005-08-23 | International Business Machines Corporation | Tagging XML query results over relational DBMSs |
US6598041B1 (en) * | 2000-09-07 | 2003-07-22 | International Business Machines Corporation | Method, system, and program for processing modifications to data in tables in a database system |
US6581055B1 (en) | 2000-09-11 | 2003-06-17 | Oracle International Corporation | Query optimization with switch predicates |
CA2327167C (en) | 2000-11-30 | 2007-10-16 | Ibm Canada Limited-Ibm Canada Limitee | Method and system for composing a query for a database and traversing the database |
US6571233B2 (en) | 2000-12-06 | 2003-05-27 | International Business Machines Corporation | Optimization of SQL queries using filtering predicates |
US6996569B1 (en) | 2001-06-20 | 2006-02-07 | Microstrategy Incorporated | Systems and methods for custom grouping of data |
US6823329B2 (en) | 2002-04-02 | 2004-11-23 | Sybase, Inc. | Database system providing methodology for acceleration of queries involving functional expressions against columns having enumerated storage |
US6957225B1 (en) | 2002-05-07 | 2005-10-18 | Oracle International Corporation | Automatic discovery and use of column correlations in tables |
US7111025B2 (en) | 2003-04-30 | 2006-09-19 | International Business Machines Corporation | Information retrieval system and method using index ANDing for improving performance |
US7433886B2 (en) | 2003-10-24 | 2008-10-07 | Microsoft Corporation | SQL language extensions for modifying collection-valued and scalar valued columns in a single statement |
US8244718B2 (en) | 2006-08-25 | 2012-08-14 | Teradata Us, Inc. | Methods and systems for hardware acceleration of database operations and queries |
US7974976B2 (en) | 2006-11-09 | 2011-07-05 | Yahoo! Inc. | Deriving user intent from a user query |
US7870398B2 (en) | 2007-01-25 | 2011-01-11 | International Business Machines Corporation | Integrity assurance of query result from database service provider |
US9524317B2 (en) * | 2007-08-24 | 2016-12-20 | International Business Machines Corporation | Optimization of aggregate queries in database management systems using an early out join when processing min and max functions |
US8078595B2 (en) * | 2007-10-09 | 2011-12-13 | Oracle International Corporation | Secure normal forms |
US8150850B2 (en) | 2008-01-07 | 2012-04-03 | Akiban Technologies, Inc. | Multiple dimensioned database architecture |
US20090216757A1 (en) | 2008-02-27 | 2009-08-27 | Robi Sen | System and Method for Performing Frictionless Collaboration for Criteria Search |
US8275761B2 (en) * | 2008-05-15 | 2012-09-25 | International Business Machines Corporation | Determining a density of a key value referenced in a database query over a range of rows |
US8374986B2 (en) | 2008-05-15 | 2013-02-12 | Exegy Incorporated | Method and system for accelerated stream processing |
US8832112B2 (en) * | 2008-06-17 | 2014-09-09 | International Business Machines Corporation | Encoded matrix index |
SE0801708L (en) * | 2008-07-18 | 2009-11-24 | Qliktech Internat Ab | Method and apparatus for extracting information from a database |
US20100030728A1 (en) * | 2008-07-29 | 2010-02-04 | Oracle International Corporation | Computing selectivities for group of columns and expressions |
US9430526B2 (en) | 2008-09-29 | 2016-08-30 | Teradata Us, Inc. | Method and system for temporal aggregation |
US8478775B2 (en) | 2008-10-05 | 2013-07-02 | Microsoft Corporation | Efficient large-scale filtering and/or sorting for querying of column based data encoded structures |
US8312038B2 (en) | 2008-12-18 | 2012-11-13 | Oracle International Corporation | Criteria builder for query builder |
US8745031B2 (en) | 2009-05-28 | 2014-06-03 | Oracle International Corporation | Cache-based predicate handling for queries on XML data using uncorrelated path-based row sources |
EP2290562A1 (en) * | 2009-08-24 | 2011-03-02 | Amadeus S.A.S. | Segmented main-memory stored relational database table system with improved collaborative scan algorithm |
US8959070B2 (en) * | 2009-09-15 | 2015-02-17 | Factual Inc. | Processes and systems for collaborative manipulation of data |
US8832142B2 (en) | 2010-08-30 | 2014-09-09 | Oracle International Corporation | Query and exadata support for hybrid columnar compressed data |
US10311105B2 (en) | 2010-12-28 | 2019-06-04 | Microsoft Technology Licensing, Llc | Filtering queried data on data stores |
US8676834B2 (en) | 2011-02-16 | 2014-03-18 | International Business Machines Corporation | Set-level comparisons in dynamically formed groups |
US9600522B2 (en) | 2012-08-20 | 2017-03-21 | Oracle International Corporation | Hardware implementation of the aggregation/group by operation: filter method |
US9727606B2 (en) | 2012-08-20 | 2017-08-08 | Oracle International Corporation | Hardware implementation of the filter/project operations |
-
2012
- 2012-08-20 US US13/590,057 patent/US9563658B2/en active Active
-
2013
- 2013-08-14 JP JP2015528526A patent/JP6356675B2/en active Active
- 2013-08-14 CN CN201380050947.7A patent/CN104685498B/en active Active
- 2013-08-14 EP EP13753948.2A patent/EP2885728B1/en active Active
- 2013-08-14 WO PCT/US2013/055020 patent/WO2014031416A2/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5511190A (en) * | 1995-01-20 | 1996-04-23 | Tandem Computers, Inc. | Hash-based database grouping system and method |
US5655080A (en) * | 1995-08-14 | 1997-08-05 | International Business Machines Corporation | Distributed hash group-by cooperative processing |
US5884299A (en) * | 1997-02-06 | 1999-03-16 | Ncr Corporation | Optimization of SQL queries involving aggregate expressions using a plurality of local and global aggregation operations |
US6381601B1 (en) * | 1998-12-22 | 2002-04-30 | Hitachi, Ltd. | Grouping and duplicate removal method in a database |
US20060116989A1 (en) * | 2004-11-30 | 2006-06-01 | Srikanth Bellamkonda | Efficient data aggregation operations using hash tables |
Non-Patent Citations (1)
Title |
---|
ANONYMOUS: "Hash table - Wikipedia, the free encyclopedia", 20 June 2012 (2012-06-20), XP055116260, Retrieved from the Internet <URL:http://wayback.archive.org/web/20120620103940/https://en.wikipedia.org/wiki/Hash_table> [retrieved on 20140505] * |
Also Published As
Publication number | Publication date |
---|---|
EP2885728B1 (en) | 2019-07-31 |
JP2015528603A (en) | 2015-09-28 |
EP2885728A2 (en) | 2015-06-24 |
WO2014031416A2 (en) | 2014-02-27 |
US20140052726A1 (en) | 2014-02-20 |
JP6356675B2 (en) | 2018-07-11 |
CN104685498A (en) | 2015-06-03 |
US9563658B2 (en) | 2017-02-07 |
CN104685498B (en) | 2018-06-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2014031416A3 (en) | Hardware implementation of the aggregation/group by operation: hash-table method | |
PH12016500510B1 (en) | Determination of a display angle of a display | |
MX2016016598A (en) | Diagnosing and supplementing vehicle sensor data. | |
WO2016040862A3 (en) | Integration of auxiliary sensors with point cloud-based haptic rendering and virtual fixtures | |
IN2014MN02195A (en) | ||
WO2014150250A3 (en) | Method and apparatus for substitution scheme for anonymizing personally identifiable information | |
MX2015003556A (en) | Tracking from a vehicle. | |
IN2014DN10281A (en) | ||
GB2491101B (en) | Detection of spoofing of remote client system information | |
WO2014047182A3 (en) | High performance data streaming | |
IN2014CN04458A (en) | ||
WO2015056101A3 (en) | Processing concurrency in a network device | |
WO2012030793A3 (en) | Providing results to parameterless search queries | |
WO2014027243A3 (en) | Probability mapping system | |
MX351859B (en) | Methods and systems for processing payments globally over one of a plurality of processing paths. | |
WO2014150815A3 (en) | System and method to dynamically determine a timing parameter of a memory device | |
WO2014120646A3 (en) | Method, device and system for publishing merchandise information | |
GB2506783A (en) | Enabling a computing device to utilize another computing device | |
WO2015035056A3 (en) | Prognostics-based estimator | |
MX2015017319A (en) | Predicting multiples in survey data. | |
GB2531678A (en) | Moving objects in primary computer based on memory errors in secondary computer | |
EA201690256A1 (en) | SYSTEM AND METHOD FOR PLANNING AREA FOR VEHICLES | |
WO2014123982A3 (en) | Routine estimation | |
MX362169B (en) | Process system managmenet system, server device, management program, and management method. | |
GB2490591B (en) | Storage area network multi-pathing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13753948 Country of ref document: EP Kind code of ref document: A2 |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
ENP | Entry into the national phase |
Ref document number: 2015528526 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013753948 Country of ref document: EP |