US8269625B2 - Signal processing system and methods for reliably detecting audible alarms - Google Patents

Signal processing system and methods for reliably detecting audible alarms Download PDF

Info

Publication number
US8269625B2
US8269625B2 US12/756,698 US75669810A US8269625B2 US 8269625 B2 US8269625 B2 US 8269625B2 US 75669810 A US75669810 A US 75669810A US 8269625 B2 US8269625 B2 US 8269625B2
Authority
US
United States
Prior art keywords
templates
signal
audible alert
template
timing pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12/756,698
Other versions
US20110025499A1 (en
Inventor
Leslies D. Hoy
David E. Albert
Landgrave T. Smith
James J. Lewis
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InnovAlarm Corp
Original Assignee
InnovAlarm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by InnovAlarm Corp filed Critical InnovAlarm Corp
Priority to US12/756,698 priority Critical patent/US8269625B2/en
Assigned to INNOVALARM CORPORATION reassignment INNOVALARM CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HOY, LESLIE D., ALBERT, DAVID E., LEWIS, JAMES J., SMITH, LANDGRAVE T.
Assigned to FRANS, DOUG reassignment FRANS, DOUG SECURITY AGREEMENT Assignors: INNOVALARM CORPORATION
Priority to AU2010278884A priority patent/AU2010278884A1/en
Priority to PCT/US2010/043771 priority patent/WO2011014694A1/en
Priority to CA2769266A priority patent/CA2769266A1/en
Priority to NZ597928A priority patent/NZ597928A/en
Publication of US20110025499A1 publication Critical patent/US20110025499A1/en
Priority to US13/621,766 priority patent/US20130077797A1/en
Publication of US8269625B2 publication Critical patent/US8269625B2/en
Application granted granted Critical
Assigned to Knobbe, Martens, Olson & Bear, LLP reassignment Knobbe, Martens, Olson & Bear, LLP SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INNOVALARM CORPORATION
Assigned to INNOVALARM CORPORATION reassignment INNOVALARM CORPORATION RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: Knobbe, Martens, Olson & Bear, LLP
Assigned to INNOVALARM CORPORATION reassignment INNOVALARM CORPORATION RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: FRANS, DOUG
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00Monitoring arrangements; Testing arrangements
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B3/00Audible signalling systems; Audible personal calling systems
    • G08B3/10Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B1/00Systems for signalling characterised solely by the form of transmission of the signal
    • G08B1/08Systems for signalling characterised solely by the form of transmission of the signal using electric transmission ; transformation of alarm signals to electrical signals from a different medium, e.g. transmission of an electric alarm signal upon detection of an audible alarm signal
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/16Actuation by interference with mechanical vibrations in air or other fluid
    • G08B13/1654Actuation by interference with mechanical vibrations in air or other fluid using passive vibration detection systems
    • G08B13/1672Actuation by interference with mechanical vibrations in air or other fluid using passive vibration detection systems using sonic detecting means, e.g. a microphone operating in the audio frequency range
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B29/00Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
    • G08B29/18Prevention or correction of operating errors
    • G08B29/185Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B7/00Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
    • G08B7/06Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources

Definitions

  • the present invention relates to signal processing circuits and methods for reliably detecting audible alarm signals generated by smoke detectors, carbon monoxide detectors, and/or other types of detectors.
  • Underwriters Laboratories code 217 (UL 217, “The Standard of Safety for Single and Multiple Station Smoke Alarms”)
  • Underwriters Laboratories code 464 (UL 464, “The Standard of Safety for Audible Signal Appliances”)
  • Underwriters Laboratories code 1971 (UL 1971, “The Standard for Signaling Devices for the Hearing Impaired”)
  • Underwriters Laboratories code 2034 (UL 2034, “The Standard of Safety for Single and Multiple Station Carbon Monoxide Alarms”).
  • typical smoke, fire, and carbon monoxide detectors produce a 3100-3200 Hz pure tone alert signal with the intensity (or power) of 45 to 120 dB (A-weighted for human hearing).
  • using the pure tone signal can result in a less than effective means of alerting people with hearing loss, older adults, children, heavy sleepers, and intoxicated persons.
  • Traditional means of alerting can be inadequate especially at night time when the audible alarm is not located near the individual. If individuals are not alerted, the results can range from inconvenient to deadly.
  • a detection device that “listens” for audible signals generated by smoke, fire, and carbon monoxide detectors.
  • the detection device can trigger supplemental alert devices that are configured to reliably alert the individual to the presence of fire, smoke, carbon monoxide, and the like.
  • supplemental alerting is to generate a loud low frequency (e.g., 520 Hz) square wave sound pattern that can reliably alert people with hearing loss, older adults, children, heavy sleepers, and intoxicated persons as is described in U.S. Pat. No. 6,658,123 to Crutcher, the disclosure of which is hereby incorporated by reference.
  • One difficulty with designing such detection devices is to reliably detect audible alert signals generated by smoke, fire, and carbon monoxide detectors.
  • reliable detection cannot tolerate any false negative conditions (i.e., non-detection of actual audible alert signals) and can tolerate only a few false positive conditions (i.e., false detection of audible alert signals when, in fact, none actually occurred). These can be restated as requirements of high sensitivity and high specificity, respectively. False negative conditions cannot be tolerated because if individuals are not alerted, the results can range from inconvenient to deadly. False positive conditions ought to occur infrequently because they can cause individuals to disconnect smoke, fire, and carbon monoxide detectors and/or the detection devices.
  • Various embodiments of a system and machine-implemented process are disclosed for reliably detecting audible alert signals, such as beeps, Temporal-3 (or Code-3) smoke alert signals, and Temporal-4 (or Code-4) carbon monoxide alert signals.
  • Some embodiments of the system and process can reliably detect audible alert signals generated by commercially available smoke, fire, and carbon monoxide detectors, including audible alert signals of different intensities.
  • the disclosed system and process can also reliably detect audible alert signals in the presence of background noise of varying intensity.
  • the system and process may, in some embodiments, generate (or initiate the generation of) a supplemental alert signal capable of alerting individuals who might not otherwise respond to the alarm condition, such as children, persons who are asleep, hearing impaired persons, or intoxicated persons.
  • a method for detecting audible alert signals implemented in signal processing circuitry can comprise generating a digital representation of a received audio signal and, for each of a plurality of templates, comparing the digital representation of the received audio signal to the respective template, and generating a matching score representing a degree of match between the digital representation of the received audio signal and the respective template.
  • Each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal.
  • the method also can comprise determining, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present.
  • the plurality of templates can comprise templates that correspond to variations, for example, in the Temporal-3 or Temporal-4 timing patterns.
  • a computer-readable medium which stores executable instructions capable of causing a computing device to perform a signal processing method.
  • the method can comprise generating a digital representation of a received audio signal and, for each of a plurality of templates, comparing the digital representation of the received audio signal to the respective template, and generating a matching score representing a degree of match between the digital representation of the received audio signal and the respective template.
  • Each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal.
  • the method can also comprise determining, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present.
  • the plurality of templates can comprise templates that correspond to variations, for example, in the Temporal-3 or Temporal-4 timing patterns.
  • the method can comprise estimating a noise content of the received audio signal and determining, based at least partly on the noise content, whether an audible alert signal is present.
  • a signal processing system for detecting audible alert signals can comprise a circuit configured to receive an audio signal and to generate a digital representation of the received audio signal.
  • the system can also comprise a memory buffer configured to store a plurality of templates, wherein each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal.
  • the system can also comprise a circuit configured to compare the digital representation of the received audio signal to the respective template, to generate a matching score representing a degree of match between the digital representation of the received audio signal and the respective template, and to determine, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present.
  • the plurality of templates can comprise templates that correspond to variations, for example, in the Temporal-3 or Temporal-4 timing patterns.
  • the system can comprise a supplemental alert generator configured to generate a supplemental alert signal in response to the determination that an audible alert signal is present.
  • the system and methods can be implemented in a bedside unit, a portable device, a general purpose computer, or the like.
  • FIGS. 1 and 2 illustrate several different embodiments of a system for detecting and alerting persons to various types of audible alert signals.
  • FIG. 3 illustrates an arrangement of hardware and data processing components that may be used in the system for detecting and alerting persons to various types of audible alert signals.
  • FIG. 4 illustrates an arrangement of hardware and data processing components in a signal analyzer that may be used in the system for detecting and alerting persons to various types of audible alert signals.
  • FIG. 5 illustrates a frequency response of an input filter bank of the signal analyzer of FIG. 4 .
  • FIG. 6 illustrates an impulse response of a pulse matching filter bank of the signal analyzer of FIG. 4 .
  • FIG. 7 illustrates a Temporal-3 template pattern of the signal analyzer of FIG. 4 .
  • FIG. 8 illustrates a Temporal-4 template pattern of the signal analyzer of FIG. 4 .
  • FIG. 9 illustrates an adjustment of a detection threshold of the signal analyzer of FIG. 4 .
  • the present invention comprises signal processing methods and associated circuitry for reliably detecting audible alert/alarm signals such as those generated by commercially available smoke, fire, and carbon monoxide detectors.
  • audible alert/alarm signals such as those generated by commercially available smoke, fire, and carbon monoxide detectors.
  • the circuitry and signal processing methods are described in the context of a system that, upon detecting an audible alert signal, generates a supplemental alert signal capable of alerting individuals who might not otherwise respond to the alarm condition, such as children, persons who are asleep, hearing impaired persons, or intoxicated persons.
  • the disclosed signal processing circuitry and methods can also be used for other applications, such as the monitoring of alarm conditions by police, fire, emergency and security personnel.
  • the system can be adapted to be positioned at the bedside (and can also serve as an alarm clock) or to be mounted to a fixed structure, such as a wall or ceiling, as is described in U.S. Pat. No. 7,501,958 to Saltzstein et al., the disclosure of which is hereby incorporated by reference.
  • the system can be a wearable, battery-operated device.
  • the device can be configured to be worn on an individual's wrist (and can also serve as a wrist watch), can be incorporated into a hearing aid that is configured for insertion into the patient's ear, or can be incorporated into a general purpose computer.
  • FIG. 1 illustrates a system for detecting and alerting individuals to various types of alert signals according to some embodiments.
  • the system can comprise a detection device 120 that is configured to detect audible alert signals, such as audible signals generated by: a smoke detector 100 and output through a speaker 101 , a fire detector 105 and output through a speaker 106 , and a carbon monoxide detector 110 and output through a speaker 111 .
  • the detection device 120 can comprise a microphone or a microphone array 121 configured to detect audio signals.
  • the detection device 120 can, for example, comprise signal processing circuitry configured to determine whether detected audio signals comprise audible alert signals.
  • the signal processing circuitry can, for example, be implemented using a microcontroller, a digital signal processor, a microprocessor, an ASIC, a FPGA, and some combination thereof.
  • the detection device 120 may be designed to detect only some of the types of audible alarms described herein (e.g., those generated by smoke detectors), and not others.
  • alert devices can comprise alternate audible alert devices 130 (such as a generator of a low frequency, e.g., 520 Hz, square wave sound pattern), tactile alert devices 131 (such as a bed shaker), strobe light alert devices 132 , and other alert devices 133 (such as a bedside liquid sprayer).
  • the system can additionally or alternatively be configured to take other types of actions to alert the individual to the detected alarm condition. For example, in the case of a wrist-worn device, the system could generate a mild shock.
  • the system could output an audible voice message that notifies the individual of the type of alarm condition detected.
  • the presence of an alarm condition can be communicated to a monitoring service such a 911 emergency service.
  • the alert signal or signals generated by the system are referred to herein as a supplemental alert signals, as they supplement audible alert signals generated by smoke, fire, and carbon monoxide detectors.
  • supplemental alert signals are depicted, in some embodiments the system can be configured to generate a single type of supplemental alert signal.
  • the detection device 120 can be connected by connections 123 , 124 , 125 , and 126 to the devices configured to generate supplemental alert signals. In some embodiments, these connections can be wired, wireless, network, or a combination of thereof. In some embodiments, each of the connections 123 - 126 can be of the same type, of a different type, or of several different types.
  • FIG. 2 illustrates a system for detecting and alerting individuals to various types of audible alert signals according to some embodiments.
  • the system can comprise a detection device 220 configured to detect audible alert signals 210 , 211 , and 212 (e.g., audible alert signals generated by smoke, fire, and carbon monoxide detectors).
  • the detection device 220 can comprise a microphone or a microphone array 221 configured to detect audio signals.
  • the detection device 220 can comprise signal processing circuitry (e.g., a signal analyzer) configured to determine whether the detected audio signals comprise audible alert signals.
  • the detection device 220 can be configured to notify or activate one or more alert devices by generating a “new alert” notification 240 , as is illustrated in FIG. 2 .
  • Alert devices can comprise alternate audible alert devices 230 (such as a generator of a low frequency, e.g., 520 Hz, square wave sound pattern), tactile alert devices 231 (such as a bed shaker), strobe light alert devices 232 , and other alert devices 233 (such as a bedside liquid sprayer).
  • the system can additionally or alternatively be configured to take other types of actions to alert the individual to the detected alarm condition.
  • the detection device 220 can be connected by connections 223 , 224 , 225 , and 226 to devices configured to generate supplemental alert signals.
  • these connections can be wired, wireless, network, or a combination of thereof.
  • each of the connections 223 - 226 can be of the same type, of a different type, or of several different types.
  • FIG. 3 illustrates a hardware block diagram of the detection device 220 according to some embodiments.
  • a microphone or microphone array 301 converts sound pressure energy from the detected sound or sounds into electromagnetic energy.
  • the resulting electrical signal is passed through an analog front-end 302 , which can comprise amplifiers for amplification of the signal, buffers for stabilizing the signal, and filters for limiting the signal's bandwidth.
  • the processed signal is then digitized by an analog to digital converter 303 , and the resulting digital samples are stored in a memory buffer 304 .
  • the buffer 304 is arranged as a circular buffer to facilitate processing of the digital samples.
  • Signal analyzer 305 is configured to repeatedly determine whether the set or subset of digital samples (stored in the buffer 304 ) of the detected sound comprises audible alert signals.
  • the signal analyzer 305 can further apply a timing window to capture a time slice of the detected sound (i.e., the current time slice) for analyzing and for determining presence of audible alert signals.
  • the signal analyzer 305 can include a microcontroller, a digital signal processor, a microprocessor, an ASIC, a FPGA, or some combination thereof, and can include random access memory (e.g., an array of RAM devices) for storing data.
  • the underlying signal analysis algorithms implemented by the signal analyzer 305 may be embodied in executable instructions (firmware or software) executed by a processing device, and/or may be embodied in application-specific circuitry.
  • the executable instructions may be stored on any type computer-readable medium (e.g., solid state ROM or RAM, magnetic disk storage, etc.)
  • the detection device 220 may include a read-only memory (ROM) device (not shown) that stores the firmware code.
  • the signal analyzer 305 can comprise hardware, firmware, and/or software components other than those described herein.
  • the detection device 220 can be implemented using small, low cost, and low power components.
  • the detection device when the detection device is embodied in a bedside unit, such unit can be capable of providing alert signals for at least 7 days in case of power loss, unplugging, or the like, while operating of battery backup.
  • FIG. 4 is a functional block diagram of the signal analyzer of FIG. 3 according to some embodiments.
  • Each functional block shown in FIG. 4 is preferably implemented in executable code executed by hardware or firmware, but may alternatively be implemented partly or wholly in application-specific circuitry.
  • many of the blocks depicted in FIG. 4 represent implementation details that can be omitted or varied without departing from the scope of the invention. Thus, nothing FIG. 4 or the following description implies that any particular component, characteristic, step, or other feature is essential to the invention.
  • the system can be configured to detect audible alert signals such as Temporal-3 (“T3”) and Temporal-4 (“T4”) alert signals generated by home smoke, fire, and carbon monoxide detectors according to existing regulations (e.g., UL 217, UL 464, UL 1971, and UL 2034).
  • T3 audible alert signals generated by UL compliant smoke and fire detectors, are specified as beeping tones of a 0.5 seconds ( ⁇ 10%) duration (typically, in the 2900-3500 Hz frequency range) followed by 0.5 seconds ( ⁇ 10%) silence. Three alternating beeping tones and silence intervals are followed by 1.5 seconds ( ⁇ 10%) pause. Accordingly, the period of T3 audible alert signal is four seconds ( ⁇ 10%).
  • T4 audible alert signals generated by UL complaint carbon monoxide detectors, are specified as a single tone pattern consisting of four cycles of 100 msec ( ⁇ 10%) beeping tones (typically, in the 2900-3500 Hz frequency range), interspersed with silence intervals of 100 msec ( ⁇ 10%), and followed by 5 seconds ( ⁇ 10%) of silence. Accordingly, the period of T4 audible alert signal is 5.8 seconds ( ⁇ 10%).
  • the signal analyzer 305 is capable of reliably detecting (with high sensitivity and high specificity) T3 and T4 audible alert signals generated by commercially available home smoke, fire, and carbon monoxide detectors.
  • the signal analyzer 305 can be configured to detect T3 and T4 audible alert signals with intensity as low as 3 dB SNR (where SNR stands for the signal-to-noise ratio).
  • the signal analyzer 305 can be configured to detect T3 and T4 audible alert signals in the presence of background environments of varying intensity.
  • the signal analyzer 305 can be implemented in an ARM7 family microprocessor (low power 32-bit RISC architecture). In such embodiments, the signal analyzer 305 can be implemented in approximately 16 KB of program code and approximately 26 KB of data space.
  • digital audio input data 406 (i.e., digitized samples of audio input signal), stored in the buffer 304 , serves as an input to the signal analyzer 305 .
  • the audio input data 406 can comprise a block of 1024 audio samples, sampled at 11.025 KHz. Accordingly, the block update rate is 10.77 Hz (11.025 KHz/1024).
  • an interrupt service routine provided by an operating system of a processor (e.g., ARM7 family microprocessor) can collect samples represented as 16-bit signed integer values from the analog-to-digital converter 303 (shown in FIG. 3 ) and store the samples in the buffer 304 .
  • a flag can be set indicating that a new block of audio data samples is ready for processing, and a detector processing routine can be executed.
  • Other block sizes and sampling rates can be used in accordance with the desired reliability, speed, and power consumption of the signal analyzer 305 .
  • the audio input data 406 is filtered by an N-channel input filter bank 411 .
  • the filter bank 411 can be configured to comprise N bandpass narrow band filters covering the range of interest (e.g., 2900-3500 Hz frequency range of T3 and T4 alert signals).
  • the higher the number N of filters in the filter bank 411 the more reliable, but more memory and processing intensive, the signal analyzer 305 can be.
  • the filter bank 411 is implemented using N two-pole resonators, each having a center frequency placed approximately in the middle of the respective frequency channel (i.e., center frequencies are spaced out evenly over the entire range of interest) and a Q-factor set for an effective filter bandwidth of 28.6 Hz.
  • testing has demonstrated that commercially available smoke, fire, and carbon monoxide detectors generate T3 and T4 audible alert tones that drift from the overall specification governed by the existing regulations and, additionally, drift between consecutive beeping tones. Accordingly, configuring the input filter bank 411 to an approximately 30 Hz bandwidth of each channel can facilitate reliable detection of T3 and T4 audible alert signals.
  • a different number of channels in the filter bank and different types of filters can be used by the signal analyzer 305 in order to trade off reliability for processing speed, memory usage, and power consumption.
  • the number of channels (N) for the reliable detection of T3 and T4 audible alert signals can be in the range of 10-30, and more preferably at least 20.
  • the channel bandwidth is preferably 20-60 Hz, and more preferably at most 30 Hz Input filter bank 411 configuration with less than ten channels can cause a loss of sensitivity of the signal analyzer 305 due to the drift of T3 and/or T4 tones.
  • selecting more than thirty channels can provide negligible incremental improvements in the reliability of detection, while causing the signal analyzer 305 to use more processing resources, memory, and power.
  • the number of channels may increase over time as advances in technology lead to increased processing speeds, more dense, capacious memory modules, and lower power consumption.
  • Audio data processed by the input filter bank 411 is passed through an envelope detector 412 , which estimates the amplitude (or energy) of the audio signal on each channel.
  • the envelope detector 412 can be configured to estimate the amplitude on each of N channels.
  • amplitude detection is performed by summing absolute values of the filtered audio samples. This has the effect of downsampling the audio input data from the sampling rate to the block update rate (i.e., N envelope estimates are computed).
  • the envelope detector 412 may output 21 amplitude estimates at a block update rate of 10.77 Hz (11.025 KHz/1024).
  • the estimated amplitude values can be placed into a buffer (such as a circular buffer) in order to collect a frame of amplitude values on which the remaining detection steps will be performed.
  • a 33-second frame can be buffered, which corresponds to approximately 356 (33 ⁇ 10.77) amplitude estimates on each channel (e.g., a 21 ⁇ 356 matrix of amplitude estimates).
  • the audio input data may not be downsampled.
  • the amplitude of each sample can be computed without performing a summation operation and the resulting output can be 1024 amplitude estimates on each of N channels (e.g., a 21 ⁇ 1024 matrix of amplitude estimates).
  • other mathematical operations such as squaring the sample values, summing the squared sample values, weighing the squared samples, etc., can be performed for estimating the amplitude of the audio signal.
  • the output of the envelope detector 412 is passed through an N-channel pulse matching filter bank 415 .
  • the pulse matching filter bank 415 can be configured to enhance pulses that have the expected duration of T3 and T4 audible alarm tones, and to remove constant (i.e., DC) background.
  • T3 beeping tones have the expected duration of 0.5 seconds with a variance of approximately ⁇ 20%, as has been determined by testing.
  • T4 beeping tones have the expected duration of 100 msec with a smaller variance, since T4 audible alert signals are typically generated by more accurate microprocessor-based carbon monoxide detectors.
  • the pulse matching filter bank 415 can be configured to have a response function that matches the length of the shortest expected tone, the length of the average expected tone, the length of the longest expected tone, and the like.
  • the response function of the filters in the pulse matching filter bank 415 can be configured as a square wave with a negative offset, as to remove the DC components.
  • the filter function of each channel of the matching filter bank 415 is configured as a 69-tap FIR bandpass filter, having as it impulse response a single 280 msec long positive square pulse.
  • the impulse response also includes a negative offset to remove any DC components.
  • FIG. 6 illustrates an impulse response of the matching filter bank 415 according to some embodiments.
  • the audio input data 406 comprises a block of 1024 samples sampled at 11.025 KHz
  • such impulse response function covers about 6.5 seconds of the envelope detector 412 output (69 ⁇ 1024/11025), which corresponds to approximately 1.5 periods of the T3 audible alarm signal and approximately 1 period of the T4 audible alarm signal. Accordingly, configuring the impulse response function to have 69 taps facilitates reliable detection.
  • a different impulse response function can be selected for each channel in the pulse matching filter bank 415 or groups of channels can share the same impulse response function.
  • the output of the envelope detector 412 and of the pulse matching filter bank 415 can be provided to a spectral activity index detector 413 , which is configured to calculate a spectral activity index (“SAT”) value 414 .
  • the SAI value is a ratio of the energy of the dynamic (AC) portion of the audio data to the energy of the total audio data signal (DC portion).
  • the spectral activity index value 414 can be calculated as a scaled ratio of the cumulative AC output of the pulse matching filter bank 415 to the cumulative DC output of the signal filtered by the input filter bank 411 and amplitude estimated by the envelope detector 412 .
  • the cumulative DC and AC output can be computed as an average of the samples, a weighted average of the samples, a scaled average of the samples, or the like.
  • x k (n) is the value of the nth filtered sample on channel k.
  • the cumulative DC output can be computed as an average across all N channels:
  • the output of the pulse matching filter bank 415 can be used to compute the cumulative AC output because, as explained above, the pulse matching filter bank 415 can be configured to remove DC components (and thus retain AC components).
  • the pulse matching filter bank 415 can be configured to remove DC components (and thus retain AC components).
  • the cumulative AC output can be computed as:
  • y k (n) is the value of the nth pulse matching filtered sample on channel k.
  • the cumulative AC output can be computed as an average across all N channels:
  • the SAI value 414 (unscaled or scaled) can be computed as follows:
  • the cumulative DC and AC output and SAI value can be computed using other techniques (e.g., weighting of samples), as will be understood by a person of ordinary skill in the art from the disclosure herein.
  • the SAI value 414 can be used to reject background music, television signals, and other audible signals having frequency characteristics and periodicity similar to T3 and T4 audible alert signals.
  • the SAI value 414 can be used to readjust the signal analyzer 305 to reduce the occurrence of false alarm conditions or to detect faint T3 and/or T4 audible alarm signals.
  • the output of the pulse matching filter bank 415 can be clipped (i.e., limited to a range of values) by a clipper 416 .
  • the envelope data from the pulse matching filter bank 415 can be hard clipped to +1 for all zero or positive values and to ⁇ 1 for all negative values.
  • the clipper 416 can be configured to restrict values to a wider range of values.
  • the clipper 416 can be configured to perform soft clipping.
  • the output of the pulse matching filter bank 415 can be stored in a pulse pattern buffer 417 , in order to collect a frame of the processed audio signal.
  • the last 33 seconds of each channel of processed audio input data e.g., the last 356 amplitude estimates downsampled to 10.77 Hz
  • the pulse pattern buffer 417 can be stored in the pulse pattern buffer 417 and serve as the frame. Thirty-three seconds capture about eight periods of T3 audible alert signal and about 6.5 periods of T4 alert signal.
  • the pulse pattern buffer 417 can be configured to store twenty-one channels of 33 seconds of audio input data (e.g., the pulse pattern buffer 417 can be configured as a 21 ⁇ 356 matrix of samples, comprised by the frame). Furthermore, the pulse pattern buffer 417 can be configured as an N-channel circular buffer where the oldest stored processed audio signal samples are replaced by new samples. In some embodiments, the pulse pattern buffer 417 can be configured to store a configurable frame length. For example, the frame can be 10 seconds long or about 2.5 periods of the T3 alert signal and two periods of the T4 alert signal. As another example, the frame length can be 20 seconds, or about five periods of the T3 alert signal and four periods of the T4 alert signal. By configuring the pulse pattern buffer 417 to store a longer frame, the signal analyzer 305 can trade off a longer time of detection of audible alert signals for a more reliable (i.e., high sensitivity and high specificity) detection.
  • blocks 411 - 417 in FIG. 4 represent just one many possible ways in which the digitized audio signal can be processed to generate a buffered pulse pattern to be analyzed. Numerous variations to this pre-analysis signal path are possible.
  • the signal analyzer 305 detects T3 audible alert signals by matching the detected pulse patterns stored in pulse pattern buffer 417 with a set of expected T3 audible alert signal templates stored in a T3 template store 441 .
  • the template store 441 stores templates of T3 audible alert signals covering variations in the temporal pattern of the T3 signal, such as in the period of the T3 signal (i.e., overall signal drift), in the duration of the beeping tone of the T3 signal, in the duration of the silence interval of the T3 signal, in the duration between the adjacent samples (i.e., tone to tone signal drift), in the signal intensity (e.g., due to the background environment, the proximity of the smoke or fire detector to the detection device, etc.), and on the like.
  • the number of template patterns in the template store 441 can be configured to provide reliable detection of T3 audible alert signals.
  • a higher number of template patterns typically directly correlates with the reliability of detection and inversely correlates with the speed of detection, memory usage, and power consumption.
  • the number of template patterns is at least 10, and more preferably at least 20.
  • the template store 441 comprises 25 pre-calculated template patterns covering the range of [ ⁇ 18%, 30%] variation in the four second period of the T3 audible alert signal (i.e., covering the period range of [3.28, 5.2] seconds). Consequently, each template covers approximately a 2% deviation (i.e., 80 msec) in the four second period of the T3 audible alert signal, as specified by the existing regulations.
  • FIG. 7 illustrates a template pattern corresponding to the nominal 4 seconds T3 beeping tone pattern.
  • the template store 441 can have a smaller or greater number of template patterns corresponding respectively to a broader or narrower range of temporal pattern variations of the T3 audible alert signal.
  • a T3 pattern correlator 420 matches the detected pulse patterns with a template or templates stored in the T3 template store 441 .
  • each channel of processed audio input data frame stored in the pulse pattern buffer 417 can be compared with each template stored in the T3 template store 441 , and a matching score can be computed.
  • a match can be assigned a score of 1 and no match can be assigned a score of ⁇ 1. Then, the matching score, for example, can be computed as a sum of matches. As another example, the matching score can be computed as a sum of matches and non-matches, with the latter being subtracted from the score and thus functioning as a penalty. In some embodiments, a matching score can be expressed as a percentage of matches. For example, a matching score of 100% can indicate a perfect match of the pulse pattern with a template. As another example, a matching score of 50% can indicate that one half of pulse pattern values matched the template values. Testing has demonstrated that processing of random noise audio input data typically produces a 50% matching score. Processing of T3 audible alert signals generated in typical background environments usually produces a matching score of 70-90%.
  • pulse patterns stored in the pulse pattern buffer 417 are hard clipped to +1 for all zero or positive values and to ⁇ 1 for all negative values.
  • the templates stored in the T3 template store 441 can then have a +1 value corresponding to the time when a beeping tone is expected to be present and a ⁇ 1 value when a beeping tone is not expected to be present in the T3 audible alert signal (e.g., FIG. 7 ).
  • the templates stored in the T3 template store 441 comprise “don't care values” to provide an additional tolerance to the variation of the processed audio input data from the expected characteristics of the T3 audible alert signal governed by the existing regulations. For example, don't care values can be set to zero so that the matching score is not affected.
  • matching scores are separately computed for multiple time segments of the processed audio input data stored in the pulse pattern buffer 417 .
  • matching scores can be computed for the first and second full T3 audible alert signal periods (i.e. the first 4 seconds and the first 8 seconds) to improve the reliability of detection, as explained below.
  • the T3 pattern correlator 420 can be configured to calculate scores for the first three T3 alert signal periods (i.e. the first 12 seconds), the first four T3 alert signal periods (i.e. the first 16 seconds), and the first six T3 alert signal periods (i.e. the first 24 seconds).
  • the T3 pattern correlator 420 calculates, for each template, matching scores for three time segments.
  • the T3 pattern correlator 420 can be configured to calculate matching scores for other combinations of consecutive and nonconsecutive time segments.
  • the T3 pattern correlator 420 can be configured to calculate a matching score on the entire segment of the processed audio input data frame.
  • the T3 pattern correlator 420 selects a number of highest matching scores from the set of computed scores and discards the remaining matching scores. For example, the T3 pattern correlator 420 can select the best score from the matching scores computed by comparing a given template to each channel of the processed audio data. As another example, the T3 pattern correlator 420 can select the best matching score from the set of scores computed by comparing a given template to each channel, and further for multiple time segments. As described above, in some embodiments matching scores are computed for the first three, the first four, and the first six T3 alert signal periods for each of N channels (e.g. 21 channels) of the processed audio input data and for each templates (e.g. each of the 25 templates).
  • N channels e.g. 21 channels
  • the total number of matching scores would then be 1575 (25 ⁇ 21 ⁇ 3).
  • a maximum matching score can be selected from the set of 25 scores computed by comparing each template to the processed input data for each channel and further for each time segment.
  • the output of the T3 pattern correlator would then be 63 (21 ⁇ 3) best matching scores for each time segment on each channel.
  • the T3 pattern correlator 420 selects the second best score, the third best score, and the like, or selects a set of best matching scores, whether consecutive or not.
  • the matching scores computed by the T3 pattern correlator 420 are further processed by a T3 score filter 422 in order to remove matches for common sounds that closely mimic the T3 audible alert signals.
  • some background music or television signals have frequency characteristics and periodicity that closely match T3 alert signals. Such signals are referred to herein as “mimic signals.”
  • Mimic signals can cause the T3 pattern correlator 420 to mistakenly output large matching scores even though a T3 alert signal is not present in the audio input data.
  • Valid T3 audible alert signals typically create distinct patterns of matching scores, such as a single high matching score occurring every T3 alert signal period (i.e. every four seconds). Most mimic signals do not exhibit such regularity of the matching scores because mimic signals do not possess the exact periodic characteristics of the T3 alert signal.
  • the T3 score filter 422 analyzes the temporal pattern of matching scores and rejects mimic signals.
  • the T3 score filter verifies that only one primary score peak occurs every T3 alert signal cycle by examining the time sequence of the matching scores across the channels of the processed audio data. Within a T3 alert signal cycle, mimic signals typically comprise multiple high matching scores present on different channels; thus the T3 score filter 422 can detect and reject such mimic signals.
  • the T3 score filter 422 can reject mimic signals by subtracting a penalty factor from the matching score of the processed audio input data that exhibits characteristics of mimic signals.
  • the T3 score filter 422 can reject mimic signals by analyzing the temporal pattern of matching scores computed on multiple time segments of the processed audio input data. For example, the T3 score filter 422 can verify that only one primary score peak occurs during each period of the first three, the first four, and the first six T3 alert signal periods. In some embodiments, the T3 score filter 422 is not used.
  • a T3 threshold detector 423 determines whether the processed audio input data comprises the T3 audible alert signal. This determination can be made by comparing the matching score or scores computed by the T3 pattern correlator 420 , and processed by the T3 score filter 422 , to one or more threshold matching scores. In some embodiments, the highest matching score is compared to a threshold. In some embodiments, a set of best matching scores is compared to a set of threshold matching scores. In some embodiments, the highest matching scores or a set of highest matching scores, computed for multiple time segments of the processed audio input data, are compared to a set of threshold matching scores.
  • the T3 threshold detector 423 can compare the best matching scores computed for the first three, the first four, and the first six T3 audible alert signal periods to a set of thresholds.
  • the use of multiple time segments can provide a rapid detection of strong alert signals, while also allowing for detection of faint alert signals.
  • the T3 threshold detector 423 generates a smoke alarm alert notification 424 when at least one comparison to the threshold produces a match.
  • alert device or devices configured to generate supplemental alert signals can then be notified or activated.
  • the T3 threshold detector 423 automatically adjusts in order to reduce the occurrence of false alarm conditions or to detect faint T3 audible alarm signals.
  • the computed SAI value 414 can be used to reject strong background music, television signals, and other audible signals having frequency characteristics and periodicity similar to T3 audible alert signals. For example, when the background environment is quiet, the SAI value 414 tends to be low (e.g., 0.1 for random white noise background). When the background environment contains strong musical content, the SAI value 414 tends to be high (e.g., 0.3-0.6). Accordingly, the SAI value 414 can be used to automatically readjust the threshold of the T3 threshold detector 423 .
  • the SAI value can be scaled by a factor of 100 in some embodiments.
  • FIG. 9 illustrates the adjustment of the detection threshold based on the scaled SAI value 414 according to some embodiments. The illustrated detection threshold is linearly increased when SAI value increases from 40 to 60.
  • the signal analyzer 305 is additionally or alternatively configured to detect T4 audible alert signals. Such detection is similar to the detection of T3 audible alert signals explained above. However, as explained above, T4 audible alert signals are typically generated by more accurate microprocessor-based detectors, and, thus, have a smaller variance from the specifications of the T4 audible alert signal governed by the existing regulations.
  • the signal analyzer 305 can match the detected pulse patterns stored in the pulse pattern buffer 417 with a set of expected T4 audible alert signal templates stored in the T4 template store 445 .
  • the template store 445 can store templates of T4 audible alert signals covering variations the temporal pattern of the T4 signal, such as in the period of the T4 signal (i.e. overall signal drift), in the duration of the beeping tone of the T4 signal, in the duration of the silence intervals of the T4 signal, in duration between the adjacent samples (i.e. tone to tone signal drift), in the signal intensity (e.g., due to the background environment, the proximity of the carbon monoxide detector to the detection device, etc.), and so on.
  • the number of template patterns is at least 5, and more preferably at least 10.
  • the template store 445 comprises 11 pre-calculated template patterns covering the range of [ ⁇ 15%, 15%] variation in the 5.8 second period of the T4 audible alert signal governed by the existing standards (i.e. covering the period range of [4.25, 5.75] seconds). Consequently, each template covers approximately a 2.7% deviation (135 msec) from the 5.8 second period of the T4 audible alert signal, as specified by the existing regulations.
  • the template store 445 may alternatively have a smaller or greater number of template patterns corresponding respectively to a broader or narrower range of variation of the T4 audible alert signal period.
  • T4 template patterns are simplified to treat the four short beeping tones of the T4 audible alert signal interspersed by short silence intervals as one beeping tone. This approximation can better fit the detected audio signal resulting from the temporal spreading of the audible alert signal as it travels down hallways and through doorways when the microphone or microphone array is placed at a substantial distance away from the carbon monoxide detector.
  • FIG. 8 illustrates such a template pattern, which corresponds to the combined beeping tone interval of approximately 0.8 sec long (delayed by about 0.2 seconds from the signal specified by the existing regulations).
  • a T4 pattern correlator 430 matches the detected pulse patterns with a template or set of templates stored in the T4 template store 445 .
  • each channel of processed audio input data frame stored in the pulse pattern buffer 417 can be compared with each template stored in the T4 template store 445 , and a matching score can be computed.
  • the matching score can be computed as a number of samples in the pulse pattern buffer 417 that correspond to the respective in time samples in the template.
  • a match can be assigned a score of 1 and no match can be assigned a score of ⁇ 1.
  • the matching score for example, can be computed as a sum of matches.
  • the matching score can be computed as a sum of matches and non-matches, with the latter being subtracted from the score and thus functioning as a penalty.
  • a matching score can be expressed as a percentage of matches.
  • pulse patterns stored in the pulse pattern buffer 417 are hard clipped to +1 for all zero or positive values and to ⁇ 1 for all negative values.
  • the templates stored in the T4 template store 445 can then have a +1 value corresponding to the time when a beeping tone is expected to be present and a ⁇ 1 value when a beeping tone is not expected to be present in the T4 audible alert signal (e.g., FIG. 8 ).
  • the templates stored in the T4 template store 441 comprises “don't care values” (e.g. zero values) to provide an additional tolerance to the variation of the processed audio input data from the expected characteristics of the T4 audible alert signal governed by the existing regulations.
  • the T4 pattern correlator 430 calculates a matching score on the entire segment of the processed audio input data. For example, if a set of eleven T4 templates is used, a matching score can be computed by comparing each of the eleven templates stored in the T4 template store 445 with each channel of the processed audio input data frame stored in the pulse pattern buffer 417 . In some embodiments, matching scores are separately computed for multiple time segments of the processed audio input data frame stored in the pulse pattern buffer 417 . The T4 pattern correlator 430 may calculate matching scores for other combinations of consecutive and nonconsecutive time segments.
  • the T4 pattern correlator 430 selects a number of highest matching scores from the set of computed scores and to discard the remaining matching scores. For example, the T4 pattern correlator 430 can select the best score from the matching scores computed by comparing a given template to each channel of the processed audio data. As another example, the T4 pattern correlator 430 can select the best matching score from the set of scores computed by comparing a given template to each channel, and further for multiple time segments.
  • matching scores are computed by comparing each of the templates (e.g., 11 templates) stored in the T4 template store 445 with each of N (e.g., 21) channels of the processed audio input data frame (e.g., 33 seconds) stored in the pulse pattern buffer 417 .
  • the total number of matching scores would then be 231 (11 ⁇ 21).
  • a maximum matching score can be selected from this set.
  • the output of the T4 pattern correlator 430 would then be a single best score across all channels of the processed audio input data and across all templates.
  • the T4 pattern correlator 430 selects the second best score, the third best score, and the like, or selects a set of best matching scores whether consecutive or not.
  • the matching scores computed by the T4 pattern correlator 430 are further processed by a T4 score filter 432 in order to minimize the detection of false alarms for common sounds that closely mimic the T4 audible alert signal.
  • the T4 score filter 432 analyzes the temporal pattern of matching scores and rejects mimic signals. For example, the T4 score filter can verify that only one primary score peak occurs every T4 alert signal cycle by examining the time sequence of the matching scores across multiple channels of the processed audio data. In some embodiments, such as when the output of the T4 pattern correlator is a single best matching score across all channels of the processed audio input data, the T4 score filter 430 is not used.
  • a T4 threshold detector 433 determines whether the processed audio input data comprises the T4 audible alert signal. This determination can be made by comparing the matching scores computed by the T4 pattern correlator 430 , and processed by the T4 score filter 432 , to one or more threshold matching scores. In some embodiments, the highest matching score can be compared to a threshold. In some embodiments, the T4 threshold detector 433 can automatically readjust the threshold by using the SAI value 414 , as is explained above. Increasing the threshold as the SAI value increases can facilitate the reduction of false alarm conditions at the expense of making the signal analyzer 305 less sensitive. Conversely, decreasing the threshold when the SAI value decreases can facilitate the detection of faint T4 audible alarm signals and make the signal analyzer 305 more sensitive.
  • the occurrence of false alarm conditions can be further reduced by checking for the presence of consecutive detection events, such as detections of T4 audible alert signals for consecutively processed audio input signal segments.
  • the T4 threshold detector 433 can check for presence of at least six consecutive detection events.
  • the occurrence of false alarm conditions can be reduced by checking for the presence of a minimum number of detection events within a set of consecutively processed audio input signal segments.
  • the T4 threshold detector 433 can check for presence of six detection events in a set of nine consecutively processed audio input signal segments. Further, the variation of consecutive detection events or the variation of all detection events across the set can be examined to cause the reduction of false alarm conditions.
  • the T4 threshold detector 433 generates a carbon monoxide alarm alert notification 434 when the matching score computed by the T4 pattern correlator 430 crosses a detection threshold or when the presence of consecutive detection events is detected. As is illustrated in FIG. 2 , one or more alert devices configured to generate supplemental alert signals can then be notified or activated.
  • the audible alert detection systems and methods described herein are not limited to the detection of T3 and T4 alarm signals.
  • the disclosed systems and methods can also be applied to the detection of other types of audible alert signals.
  • the disclosed system and methods can be applied to the detection of audible alert signals in the frequency range above 3.5 kHz or below 2.9 kHz.
  • the disclosed system and methods can be applied to the detection of audible alert signals whose “on” periods are in the form of an approximately 520 Hz square wave.
  • the analysis may be limited to frequencies falling close to 520 Hz (the fundamental frequency of the square wave), or may be extended to one or more of the higher-frequency harmonics.
  • a first plurality of frequency bands corresponding to the fundamental frequency may be analyzed to generate respective sets of matching scores
  • a second plurality of frequency bands corresponding to the first (or higher) harmonic may also be analyzed to generate additional (respective) sets of matching scores.
  • Conditional language such as, among others, “can,” “could,” “might,” or “may,” unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without user input or prompting, whether these features, elements and/or steps are included or are to be performed in any particular embodiment.

Abstract

A signal processing system and associated methods are disclosed for reliably detecting audible alert signals, such as Temporal-3 (or Code-3) and Temporal-4 (or Code-4) alert signals generated by commercially available smoke, fire, and carbon monoxide detectors. The system and methods are capable of detecting audible alert signals of different intensities in the presence of dynamic background environment (e.g., television programming, music, noise, and the like). The system and methods are capable of detecting audible alert signals generated by far away smoke, fire, and carbon monoxide detectors. The signal processing system and methods may, in some embodiments, be incorporated into a bedside or other unit that generates a supplemental alert signal capable of alerting individuals who might not otherwise respond to the alarm condition, such as individuals who are asleep, children, hearing impaired, or intoxicated.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
This application is related to, and claims the benefit of, U.S. Provisional Patent Application No. 61/229,684, filed Jul. 29, 2009, the disclosure of which is hereby incorporated by reference herein.
BACKGROUND
1. Technical Field
The present invention relates to signal processing circuits and methods for reliably detecting audible alarm signals generated by smoke detectors, carbon monoxide detectors, and/or other types of detectors.
2. Description of the Related Art
The presence of smoke, fire, hazardous carbon monoxide concentrations are commonly sensed in commercially available products using several types of technologies. These products traditionally alert the occupants using loud audible alarms of loud tones. Regulations exist that require audible alarms to produce signals that alert individuals in case of a fire and other emergencies. Examples of such regulations are: Underwriters Laboratories code 217 (UL 217, “The Standard of Safety for Single and Multiple Station Smoke Alarms”), Underwriters Laboratories code 464 (UL 464, “The Standard of Safety for Audible Signal Appliances”), Underwriters Laboratories code 1971 (UL 1971, “The Standard for Signaling Devices for the Hearing Impaired”), and Underwriters Laboratories code 2034 (UL 2034, “The Standard of Safety for Single and Multiple Station Carbon Monoxide Alarms”).
According to these and other standards, typical smoke, fire, and carbon monoxide detectors produce a 3100-3200 Hz pure tone alert signal with the intensity (or power) of 45 to 120 dB (A-weighted for human hearing). However, using the pure tone signal can result in a less than effective means of alerting people with hearing loss, older adults, children, heavy sleepers, and intoxicated persons. Traditional means of alerting can be inadequate especially at night time when the audible alarm is not located near the individual. If individuals are not alerted, the results can range from inconvenient to deadly.
Current state of the art attempts to address these deficiencies by interconnecting alarms using wires or wirelessly. Alarms thusly networked together can communicate detection conditions and “trigger” each other. One example of such technology is Kidde Wireless Smoke Alarm Model RF-SM-DC or RF-SM-AC Smoke Alarm. However, such solutions can be expensive and unreliable for alerting people with hearing loss, older adults, children, heavy sleepers, and intoxicated persons.
Another solution for these deficiencies is the introduction of a detection device that “listens” for audible signals generated by smoke, fire, and carbon monoxide detectors. Upon detecting an audible alert signal, the detection device can trigger supplemental alert devices that are configured to reliably alert the individual to the presence of fire, smoke, carbon monoxide, and the like. One type of supplemental alerting is to generate a loud low frequency (e.g., 520 Hz) square wave sound pattern that can reliably alert people with hearing loss, older adults, children, heavy sleepers, and intoxicated persons as is described in U.S. Pat. No. 6,658,123 to Crutcher, the disclosure of which is hereby incorporated by reference.
One difficulty with designing such detection devices is to reliably detect audible alert signals generated by smoke, fire, and carbon monoxide detectors. Ideally, reliable detection cannot tolerate any false negative conditions (i.e., non-detection of actual audible alert signals) and can tolerate only a few false positive conditions (i.e., false detection of audible alert signals when, in fact, none actually occurred). These can be restated as requirements of high sensitivity and high specificity, respectively. False negative conditions cannot be tolerated because if individuals are not alerted, the results can range from inconvenient to deadly. False positive conditions ought to occur infrequently because they can cause individuals to disconnect smoke, fire, and carbon monoxide detectors and/or the detection devices.
Even though existing regulations (such as UL 217, UL 464, UL 1971, UL 2034, NFPA 72, ANSI 53.41, and ISO-8201) govern the characteristics of audible alert signals generated by commercially available smoke, fire, and carbon monoxide detectors, there still exist many problems with the reliable detection of these signals. Testing performed by LifeTone Technology™ demonstrates that commercially available detectors often produce audible alert signals that “drift” from the specifications of the existing regulations. In fact, approximately 11% of commercially available detectors do not meet the specifications of some or all of the above mentioned UL regulations. In addition, sources of audible alert signals can be located far away causing audible alert signals to have weak intensity by the time the detection device is reached. Moreover, other signals such as music, television programming, and noise can distort, weaken, or drown out audible alert signals before the detection device is reached. These problems can be further compounded when background signals have components, which potentially have higher signal intensity than the audible alert signals, and when such components also overlap in frequency and periodicity with the audible alert signals. Accordingly, there is a need for a detection device that can provide reliable detection (i.e., high sensitivity) while producing few false negative conditions (i.e., high specificity).
SUMMARY OF THE DISCLOSURE
Various embodiments of a system and machine-implemented process are disclosed for reliably detecting audible alert signals, such as beeps, Temporal-3 (or Code-3) smoke alert signals, and Temporal-4 (or Code-4) carbon monoxide alert signals. Some embodiments of the system and process can reliably detect audible alert signals generated by commercially available smoke, fire, and carbon monoxide detectors, including audible alert signals of different intensities. The disclosed system and process can also reliably detect audible alert signals in the presence of background noise of varying intensity. Upon detecting an audible alert signal, the system and process may, in some embodiments, generate (or initiate the generation of) a supplemental alert signal capable of alerting individuals who might not otherwise respond to the alarm condition, such as children, persons who are asleep, hearing impaired persons, or intoxicated persons.
A method for detecting audible alert signals implemented in signal processing circuitry is disclosed. The method can comprise generating a digital representation of a received audio signal and, for each of a plurality of templates, comparing the digital representation of the received audio signal to the respective template, and generating a matching score representing a degree of match between the digital representation of the received audio signal and the respective template. Each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal. The method also can comprise determining, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present. The plurality of templates can comprise templates that correspond to variations, for example, in the Temporal-3 or Temporal-4 timing patterns.
A computer-readable medium which stores executable instructions capable of causing a computing device to perform a signal processing method is disclosed. The method can comprise generating a digital representation of a received audio signal and, for each of a plurality of templates, comparing the digital representation of the received audio signal to the respective template, and generating a matching score representing a degree of match between the digital representation of the received audio signal and the respective template. Each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal. The method can also comprise determining, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present. The plurality of templates can comprise templates that correspond to variations, for example, in the Temporal-3 or Temporal-4 timing patterns. In addition, the method can comprise estimating a noise content of the received audio signal and determining, based at least partly on the noise content, whether an audible alert signal is present.
A signal processing system for detecting audible alert signals is disclosed. The system can comprise a circuit configured to receive an audio signal and to generate a digital representation of the received audio signal. The system can also comprise a memory buffer configured to store a plurality of templates, wherein each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal. The system can also comprise a circuit configured to compare the digital representation of the received audio signal to the respective template, to generate a matching score representing a degree of match between the digital representation of the received audio signal and the respective template, and to determine, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present. The plurality of templates can comprise templates that correspond to variations, for example, in the Temporal-3 or Temporal-4 timing patterns. In addition, the system can comprise a supplemental alert generator configured to generate a supplemental alert signal in response to the determination that an audible alert signal is present.
The system and methods can be implemented in a bedside unit, a portable device, a general purpose computer, or the like.
Neither this summary nor the following detailed description purports to define the invention. The invention is defined only by the claims.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other features will now be described with reference to the drawing summarized below. These drawings and the associated description are provided to illustrate specific embodiments of the invention, and not to limit the scope of the invention.
FIGS. 1 and 2 illustrate several different embodiments of a system for detecting and alerting persons to various types of audible alert signals.
FIG. 3 illustrates an arrangement of hardware and data processing components that may be used in the system for detecting and alerting persons to various types of audible alert signals.
FIG. 4 illustrates an arrangement of hardware and data processing components in a signal analyzer that may be used in the system for detecting and alerting persons to various types of audible alert signals.
FIG. 5 illustrates a frequency response of an input filter bank of the signal analyzer of FIG. 4.
FIG. 6 illustrates an impulse response of a pulse matching filter bank of the signal analyzer of FIG. 4.
FIG. 7 illustrates a Temporal-3 template pattern of the signal analyzer of FIG. 4.
FIG. 8 illustrates a Temporal-4 template pattern of the signal analyzer of FIG. 4.
FIG. 9 illustrates an adjustment of a detection threshold of the signal analyzer of FIG. 4.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present invention comprises signal processing methods and associated circuitry for reliably detecting audible alert/alarm signals such as those generated by commercially available smoke, fire, and carbon monoxide detectors. For purposes of illustrating a preferred embodiment of the invention, the circuitry and signal processing methods are described in the context of a system that, upon detecting an audible alert signal, generates a supplemental alert signal capable of alerting individuals who might not otherwise respond to the alarm condition, such as children, persons who are asleep, hearing impaired persons, or intoxicated persons. As will be apparent, the disclosed signal processing circuitry and methods can also be used for other applications, such as the monitoring of alarm conditions by police, fire, emergency and security personnel.
In some embodiments, the system can be adapted to be positioned at the bedside (and can also serve as an alarm clock) or to be mounted to a fixed structure, such as a wall or ceiling, as is described in U.S. Pat. No. 7,501,958 to Saltzstein et al., the disclosure of which is hereby incorporated by reference. In some embodiments and as is described in Saltzstein et al., the system can be a wearable, battery-operated device. For instance, the device can be configured to be worn on an individual's wrist (and can also serve as a wrist watch), can be incorporated into a hearing aid that is configured for insertion into the patient's ear, or can be incorporated into a general purpose computer.
FIG. 1 illustrates a system for detecting and alerting individuals to various types of alert signals according to some embodiments. The system can comprise a detection device 120 that is configured to detect audible alert signals, such as audible signals generated by: a smoke detector 100 and output through a speaker 101, a fire detector 105 and output through a speaker 106, and a carbon monoxide detector 110 and output through a speaker 111. The detection device 120 can comprise a microphone or a microphone array 121 configured to detect audio signals. The detection device 120 can, for example, comprise signal processing circuitry configured to determine whether detected audio signals comprise audible alert signals. The signal processing circuitry can, for example, be implemented using a microcontroller, a digital signal processor, a microprocessor, an ASIC, a FPGA, and some combination thereof. In some embodiments, the detection device 120 may be designed to detect only some of the types of audible alarms described herein (e.g., those generated by smoke detectors), and not others.
Upon detecting an audible alert signal, the detection device 120 can be configured to notify or activate alert device or devices. As is illustrated in FIG. 1, alert devices can comprise alternate audible alert devices 130 (such as a generator of a low frequency, e.g., 520 Hz, square wave sound pattern), tactile alert devices 131 (such as a bed shaker), strobe light alert devices 132, and other alert devices 133 (such as a bedside liquid sprayer). The system can additionally or alternatively be configured to take other types of actions to alert the individual to the detected alarm condition. For example, in the case of a wrist-worn device, the system could generate a mild shock. As another example, in the case of a hearing aid, the system could output an audible voice message that notifies the individual of the type of alarm condition detected. As another example, the presence of an alarm condition can be communicated to a monitoring service such a 911 emergency service. The alert signal or signals generated by the system are referred to herein as a supplemental alert signals, as they supplement audible alert signals generated by smoke, fire, and carbon monoxide detectors. Although multiple forms of supplemental alert signals are depicted, in some embodiments the system can be configured to generate a single type of supplemental alert signal.
The detection device 120 can be connected by connections 123, 124, 125, and 126 to the devices configured to generate supplemental alert signals. In some embodiments, these connections can be wired, wireless, network, or a combination of thereof. In some embodiments, each of the connections 123-126 can be of the same type, of a different type, or of several different types.
FIG. 2 illustrates a system for detecting and alerting individuals to various types of audible alert signals according to some embodiments. The system can comprise a detection device 220 configured to detect audible alert signals 210, 211, and 212 (e.g., audible alert signals generated by smoke, fire, and carbon monoxide detectors). The detection device 220 can comprise a microphone or a microphone array 221 configured to detect audio signals. As explained above, the detection device 220 can comprise signal processing circuitry (e.g., a signal analyzer) configured to determine whether the detected audio signals comprise audible alert signals.
Upon detecting an audible alert, the detection device 220 can be configured to notify or activate one or more alert devices by generating a “new alert” notification 240, as is illustrated in FIG. 2. Alert devices can comprise alternate audible alert devices 230 (such as a generator of a low frequency, e.g., 520 Hz, square wave sound pattern), tactile alert devices 231 (such as a bed shaker), strobe light alert devices 232, and other alert devices 233 (such as a bedside liquid sprayer). As is described above, the system can additionally or alternatively be configured to take other types of actions to alert the individual to the detected alarm condition. As described above, the detection device 220 can be connected by connections 223, 224, 225, and 226 to devices configured to generate supplemental alert signals. In some embodiments, these connections can be wired, wireless, network, or a combination of thereof. In some embodiments, each of the connections 223-226 can be of the same type, of a different type, or of several different types.
Detection System
FIG. 3 illustrates a hardware block diagram of the detection device 220 according to some embodiments. A microphone or microphone array 301 converts sound pressure energy from the detected sound or sounds into electromagnetic energy. The resulting electrical signal is passed through an analog front-end 302, which can comprise amplifiers for amplification of the signal, buffers for stabilizing the signal, and filters for limiting the signal's bandwidth. The processed signal is then digitized by an analog to digital converter 303, and the resulting digital samples are stored in a memory buffer 304. In some embodiments, the buffer 304 is arranged as a circular buffer to facilitate processing of the digital samples.
Signal analyzer 305 is configured to repeatedly determine whether the set or subset of digital samples (stored in the buffer 304) of the detected sound comprises audible alert signals. The signal analyzer 305 can further apply a timing window to capture a time slice of the detected sound (i.e., the current time slice) for analyzing and for determining presence of audible alert signals.
As described above, the signal analyzer 305 can include a microcontroller, a digital signal processor, a microprocessor, an ASIC, a FPGA, or some combination thereof, and can include random access memory (e.g., an array of RAM devices) for storing data. The underlying signal analysis algorithms implemented by the signal analyzer 305 may be embodied in executable instructions (firmware or software) executed by a processing device, and/or may be embodied in application-specific circuitry. The executable instructions, if any, may be stored on any type computer-readable medium (e.g., solid state ROM or RAM, magnetic disk storage, etc.) For example, where the algorithms are embodied in-whole or in-part in firmware, the detection device 220 may include a read-only memory (ROM) device (not shown) that stores the firmware code. In some embodiments, the signal analyzer 305 can comprise hardware, firmware, and/or software components other than those described herein.
The detection device 220 can be implemented using small, low cost, and low power components. For example, when the detection device is embodied in a bedside unit, such unit can be capable of providing alert signals for at least 7 days in case of power loss, unplugging, or the like, while operating of battery backup.
FIG. 4 is a functional block diagram of the signal analyzer of FIG. 3 according to some embodiments. Each functional block shown in FIG. 4 is preferably implemented in executable code executed by hardware or firmware, but may alternatively be implemented partly or wholly in application-specific circuitry. As will be apparent, many of the blocks depicted in FIG. 4, and their associated descriptions below, represent implementation details that can be omitted or varied without departing from the scope of the invention. Thus, nothing FIG. 4 or the following description implies that any particular component, characteristic, step, or other feature is essential to the invention.
The system can be configured to detect audible alert signals such as Temporal-3 (“T3”) and Temporal-4 (“T4”) alert signals generated by home smoke, fire, and carbon monoxide detectors according to existing regulations (e.g., UL 217, UL 464, UL 1971, and UL 2034). T3 audible alert signals, generated by UL compliant smoke and fire detectors, are specified as beeping tones of a 0.5 seconds (±10%) duration (typically, in the 2900-3500 Hz frequency range) followed by 0.5 seconds (±10%) silence. Three alternating beeping tones and silence intervals are followed by 1.5 seconds (±10%) pause. Accordingly, the period of T3 audible alert signal is four seconds (±10%). T4 audible alert signals, generated by UL complaint carbon monoxide detectors, are specified as a single tone pattern consisting of four cycles of 100 msec (±10%) beeping tones (typically, in the 2900-3500 Hz frequency range), interspersed with silence intervals of 100 msec (±10%), and followed by 5 seconds (±10%) of silence. Accordingly, the period of T4 audible alert signal is 5.8 seconds (±10%).
The signal analyzer 305 is capable of reliably detecting (with high sensitivity and high specificity) T3 and T4 audible alert signals generated by commercially available home smoke, fire, and carbon monoxide detectors. In some embodiments, the signal analyzer 305 can be configured to detect T3 and T4 audible alert signals with intensity as low as 3 dB SNR (where SNR stands for the signal-to-noise ratio). Moreover, in some embodiments the signal analyzer 305 can be configured to detect T3 and T4 audible alert signals in the presence of background environments of varying intensity.
In some embodiments, the signal analyzer 305 can be implemented in an ARM7 family microprocessor (low power 32-bit RISC architecture). In such embodiments, the signal analyzer 305 can be implemented in approximately 16 KB of program code and approximately 26 KB of data space.
As is illustrated in FIG. 4, digital audio input data 406 (i.e., digitized samples of audio input signal), stored in the buffer 304, serves as an input to the signal analyzer 305. In some embodiments, the audio input data 406 can comprise a block of 1024 audio samples, sampled at 11.025 KHz. Accordingly, the block update rate is 10.77 Hz (11.025 KHz/1024). In some embodiments, an interrupt service routine provided by an operating system of a processor (e.g., ARM7 family microprocessor) can collect samples represented as 16-bit signed integer values from the analog-to-digital converter 303 (shown in FIG. 3) and store the samples in the buffer 304. A flag can be set indicating that a new block of audio data samples is ready for processing, and a detector processing routine can be executed. Other block sizes and sampling rates can be used in accordance with the desired reliability, speed, and power consumption of the signal analyzer 305.
The audio input data 406 is filtered by an N-channel input filter bank 411. The filter bank 411 can be configured to comprise N bandpass narrow band filters covering the range of interest (e.g., 2900-3500 Hz frequency range of T3 and T4 alert signals). The higher the number N of filters in the filter bank 411, the more reliable, but more memory and processing intensive, the signal analyzer 305 can be. In some embodiments, twenty-one filters (N=21) can be used, each covering a bandwidth of 28.6 Hz ((3500-2900) Hz/21). In some embodiments, the filter bank 411 is implemented using N two-pole resonators, each having a center frequency placed approximately in the middle of the respective frequency channel (i.e., center frequencies are spaced out evenly over the entire range of interest) and a Q-factor set for an effective filter bandwidth of 28.6 Hz. For example, FIG. 5A illustrates the frequency response of a filter (center frequency=3200 Hz) comprised by the filter bank 411, and FIG. 5B illustrates the cumulative frequency response of the filter bank 411 (N=21).
Testing has demonstrated that commercially available smoke, fire, and carbon monoxide detectors generate T3 and T4 audible alert tones that drift from the overall specification governed by the existing regulations and, additionally, drift between consecutive beeping tones. Accordingly, configuring the input filter bank 411 to an approximately 30 Hz bandwidth of each channel can facilitate reliable detection of T3 and T4 audible alert signals. However, a different number of channels in the filter bank and different types of filters can be used by the signal analyzer 305 in order to trade off reliability for processing speed, memory usage, and power consumption. For example, testing has demonstrated that the number of channels (N) for the reliable detection of T3 and T4 audible alert signals can be in the range of 10-30, and more preferably at least 20. Accordingly, the channel bandwidth is preferably 20-60 Hz, and more preferably at most 30 Hz Input filter bank 411 configuration with less than ten channels can cause a loss of sensitivity of the signal analyzer 305 due to the drift of T3 and/or T4 tones. Conversely, selecting more than thirty channels can provide negligible incremental improvements in the reliability of detection, while causing the signal analyzer 305 to use more processing resources, memory, and power. However, the number of channels may increase over time as advances in technology lead to increased processing speeds, more dense, capacious memory modules, and lower power consumption.
Audio data processed by the input filter bank 411 is passed through an envelope detector 412, which estimates the amplitude (or energy) of the audio signal on each channel. The envelope detector 412 can be configured to estimate the amplitude on each of N channels. In some embodiments, amplitude detection is performed by summing absolute values of the filtered audio samples. This has the effect of downsampling the audio input data from the sampling rate to the block update rate (i.e., N envelope estimates are computed). For example, if there are twenty-one filters (N=21) in the filter bank 411 and audio input data 406 comprises a block of 1024 samples sampled at 11.025 KHz, the envelope detector 412 may output 21 amplitude estimates at a block update rate of 10.77 Hz (11.025 KHz/1024). In some embodiments, the estimated amplitude values can be placed into a buffer (such as a circular buffer) in order to collect a frame of amplitude values on which the remaining detection steps will be performed. For example, a 33-second frame can be buffered, which corresponds to approximately 356 (33×10.77) amplitude estimates on each channel (e.g., a 21×356 matrix of amplitude estimates). In some embodiments, the audio input data may not be downsampled. For example, the amplitude of each sample can be computed without performing a summation operation and the resulting output can be 1024 amplitude estimates on each of N channels (e.g., a 21×1024 matrix of amplitude estimates). In some embodiments, other mathematical operations such as squaring the sample values, summing the squared sample values, weighing the squared samples, etc., can be performed for estimating the amplitude of the audio signal.
The output of the envelope detector 412 is passed through an N-channel pulse matching filter bank 415. The pulse matching filter bank 415 can be configured to enhance pulses that have the expected duration of T3 and T4 audible alarm tones, and to remove constant (i.e., DC) background. For example, T3 beeping tones have the expected duration of 0.5 seconds with a variance of approximately ±20%, as has been determined by testing. T4 beeping tones have the expected duration of 100 msec with a smaller variance, since T4 audible alert signals are typically generated by more accurate microprocessor-based carbon monoxide detectors. The pulse matching filter bank 415 can be configured to have a response function that matches the length of the shortest expected tone, the length of the average expected tone, the length of the longest expected tone, and the like. The response function of the filters in the pulse matching filter bank 415 can be configured as a square wave with a negative offset, as to remove the DC components. In some embodiments, the filter function of each channel of the matching filter bank 415 is configured as a 69-tap FIR bandpass filter, having as it impulse response a single 280 msec long positive square pulse. The impulse response also includes a negative offset to remove any DC components. FIG. 6 illustrates an impulse response of the matching filter bank 415 according to some embodiments. When the audio input data 406 comprises a block of 1024 samples sampled at 11.025 KHz, such impulse response function covers about 6.5 seconds of the envelope detector 412 output (69×1024/11025), which corresponds to approximately 1.5 periods of the T3 audible alarm signal and approximately 1 period of the T4 audible alarm signal. Accordingly, configuring the impulse response function to have 69 taps facilitates reliable detection. In some embodiments, a different impulse response function can be selected for each channel in the pulse matching filter bank 415 or groups of channels can share the same impulse response function.
The output of the envelope detector 412 and of the pulse matching filter bank 415 can be provided to a spectral activity index detector 413, which is configured to calculate a spectral activity index (“SAT”) value 414. The SAI value is a ratio of the energy of the dynamic (AC) portion of the audio data to the energy of the total audio data signal (DC portion). In some embodiments, the spectral activity index value 414 can be calculated as a scaled ratio of the cumulative AC output of the pulse matching filter bank 415 to the cumulative DC output of the signal filtered by the input filter bank 411 and amplitude estimated by the envelope detector 412. In some embodiments, the cumulative DC and AC output can be computed as an average of the samples, a weighted average of the samples, a scaled average of the samples, or the like.
In some embodiments, the cumulative DC output can be computed as averaged amplitude estimates for a channel. For example, when the input filter bank is configured to output N=21 channels of 1024 filtered input audio data samples, and when this data is passed through the envelope detector 412 and is, optionally, further buffered (into a frame of M amplitude estimate samples) as explained above, the cumulative DC output can be computed as:
DC k _ = 1 M n = 1 M x k ( n ) , k [ 1 , N ]
where xk(n) is the value of the nth filtered sample on channel k. In some embodiments, the cumulative DC output can be computed as an average across all N channels:
DC _ = 1 N k = 1 N DC k _
Furthermore, the output of the pulse matching filter bank 415 can be used to compute the cumulative AC output because, as explained above, the pulse matching filter bank 415 can be configured to remove DC components (and thus retain AC components). For example, when the envelope detector 412 is configured to downsample the estimated amplitude values to a block update rate of 10.77 Hz and the amplitude estimates are further buffered (into a frame of M amplitude estimate samples) as explained above, the cumulative AC output can be computed as:
AC k _ = 1 M n = 1 M y k ( n ) , k [ 1 , N ]
where yk(n) is the value of the nth pulse matching filtered sample on channel k. In some embodiments, the cumulative AC output can be computed as an average across all N channels:
AC _ = 1 N k = 1 N AC k _
In some embodiments, the SAI value 414 (unscaled or scaled) can be computed as follows:
k = 1 N AC k _ DC k _ , 1 N k = 1 N AC k _ DC k _ , 100 k = 1 N AC k _ DC k _ , 100 N k = 1 N AC k _ DC k _ , 100 N k = 1 N AC k _ DC k _ , AC _ DC _ etc .
The cumulative DC and AC output and SAI value can be computed using other techniques (e.g., weighting of samples), as will be understood by a person of ordinary skill in the art from the disclosure herein.
As explained below, the SAI value 414 can be used to reject background music, television signals, and other audible signals having frequency characteristics and periodicity similar to T3 and T4 audible alert signals. The SAI value 414 can be used to readjust the signal analyzer 305 to reduce the occurrence of false alarm conditions or to detect faint T3 and/or T4 audible alarm signals.
The output of the pulse matching filter bank 415 can be clipped (i.e., limited to a range of values) by a clipper 416. In some embodiments, the envelope data from the pulse matching filter bank 415 can be hard clipped to +1 for all zero or positive values and to −1 for all negative values. In some embodiments, the clipper 416 can be configured to restrict values to a wider range of values. In some embodiments, the clipper 416 can be configured to perform soft clipping.
The output of the pulse matching filter bank 415 can be stored in a pulse pattern buffer 417, in order to collect a frame of the processed audio signal. In some embodiments, the last 33 seconds of each channel of processed audio input data (e.g., the last 356 amplitude estimates downsampled to 10.77 Hz) can be stored in the pulse pattern buffer 417 and serve as the frame. Thirty-three seconds capture about eight periods of T3 audible alert signal and about 6.5 periods of T4 alert signal. In some embodiments where the input filter bank is configured to with N=21 channels, the pulse pattern buffer 417 can be configured to store twenty-one channels of 33 seconds of audio input data (e.g., the pulse pattern buffer 417 can be configured as a 21×356 matrix of samples, comprised by the frame). Furthermore, the pulse pattern buffer 417 can be configured as an N-channel circular buffer where the oldest stored processed audio signal samples are replaced by new samples. In some embodiments, the pulse pattern buffer 417 can be configured to store a configurable frame length. For example, the frame can be 10 seconds long or about 2.5 periods of the T3 alert signal and two periods of the T4 alert signal. As another example, the frame length can be 20 seconds, or about five periods of the T3 alert signal and four periods of the T4 alert signal. By configuring the pulse pattern buffer 417 to store a longer frame, the signal analyzer 305 can trade off a longer time of detection of audible alert signals for a more reliable (i.e., high sensitivity and high specificity) detection.
As will be appreciated, blocks 411-417 in FIG. 4 represent just one many possible ways in which the digitized audio signal can be processed to generate a buffered pulse pattern to be analyzed. Numerous variations to this pre-analysis signal path are possible.
Detection of Audible Smoke and Fire Alarm Signals
In the illustrated embodiment, the signal analyzer 305 detects T3 audible alert signals by matching the detected pulse patterns stored in pulse pattern buffer 417 with a set of expected T3 audible alert signal templates stored in a T3 template store 441. The template store 441 stores templates of T3 audible alert signals covering variations in the temporal pattern of the T3 signal, such as in the period of the T3 signal (i.e., overall signal drift), in the duration of the beeping tone of the T3 signal, in the duration of the silence interval of the T3 signal, in the duration between the adjacent samples (i.e., tone to tone signal drift), in the signal intensity (e.g., due to the background environment, the proximity of the smoke or fire detector to the detection device, etc.), and on the like. The number of template patterns in the template store 441 can be configured to provide reliable detection of T3 audible alert signals. A higher number of template patterns typically directly correlates with the reliability of detection and inversely correlates with the speed of detection, memory usage, and power consumption. Preferably, the number of template patterns is at least 10, and more preferably at least 20.
In some embodiments, the template store 441 comprises 25 pre-calculated template patterns covering the range of [−18%, 30%] variation in the four second period of the T3 audible alert signal (i.e., covering the period range of [3.28, 5.2] seconds). Consequently, each template covers approximately a 2% deviation (i.e., 80 msec) in the four second period of the T3 audible alert signal, as specified by the existing regulations. For example, FIG. 7 illustrates a template pattern corresponding to the nominal 4 seconds T3 beeping tone pattern. In some embodiments, the template store 441 can have a smaller or greater number of template patterns corresponding respectively to a broader or narrower range of temporal pattern variations of the T3 audible alert signal.
In some embodiments, a T3 pattern correlator 420 matches the detected pulse patterns with a template or templates stored in the T3 template store 441. For example, each channel of processed audio input data frame stored in the pulse pattern buffer 417 can be compared with each template stored in the T3 template store 441, and a matching score can be computed. In some embodiments, the matching score is computed as a number of samples in the pulse pattern buffer 417 that correspond to or match the respective samples in the template. For example, a match occurs when:
pulse_pattern_buffer[n]=templatei[m]
where templatei is the ith template in the store 441, pulse_pattern_buffer is a frame of the processed audio signal, and n, m are samples. In some embodiments (as is shown in FIG. 7), a match can be assigned a score of 1 and no match can be assigned a score of −1. Then, the matching score, for example, can be computed as a sum of matches. As another example, the matching score can be computed as a sum of matches and non-matches, with the latter being subtracted from the score and thus functioning as a penalty. In some embodiments, a matching score can be expressed as a percentage of matches. For example, a matching score of 100% can indicate a perfect match of the pulse pattern with a template. As another example, a matching score of 50% can indicate that one half of pulse pattern values matched the template values. Testing has demonstrated that processing of random noise audio input data typically produces a 50% matching score. Processing of T3 audible alert signals generated in typical background environments usually produces a matching score of 70-90%.
As described above, in some embodiments as described above, pulse patterns stored in the pulse pattern buffer 417 are hard clipped to +1 for all zero or positive values and to −1 for all negative values. The templates stored in the T3 template store 441 can then have a +1 value corresponding to the time when a beeping tone is expected to be present and a −1 value when a beeping tone is not expected to be present in the T3 audible alert signal (e.g., FIG. 7). In some embodiments (e.g., FIG. 7), the templates stored in the T3 template store 441 comprise “don't care values” to provide an additional tolerance to the variation of the processed audio input data from the expected characteristics of the T3 audible alert signal governed by the existing regulations. For example, don't care values can be set to zero so that the matching score is not affected.
In some embodiments, matching scores are separately computed for multiple time segments of the processed audio input data stored in the pulse pattern buffer 417. For example, matching scores can be computed for the first and second full T3 audible alert signal periods (i.e. the first 4 seconds and the first 8 seconds) to improve the reliability of detection, as explained below. As another example when the pulse pattern buffer 417 is configured to store 33 seconds of the processed audio input data (or about eight periods of T3 audible alert signal), the T3 pattern correlator 420 can be configured to calculate scores for the first three T3 alert signal periods (i.e. the first 12 seconds), the first four T3 alert signal periods (i.e. the first 16 seconds), and the first six T3 alert signal periods (i.e. the first 24 seconds). In this example, the T3 pattern correlator 420 calculates, for each template, matching scores for three time segments. The T3 pattern correlator 420 can be configured to calculate matching scores for other combinations of consecutive and nonconsecutive time segments. In some embodiments, the T3 pattern correlator 420 can be configured to calculate a matching score on the entire segment of the processed audio input data frame.
In some embodiments, the T3 pattern correlator 420 selects a number of highest matching scores from the set of computed scores and discards the remaining matching scores. For example, the T3 pattern correlator 420 can select the best score from the matching scores computed by comparing a given template to each channel of the processed audio data. As another example, the T3 pattern correlator 420 can select the best matching score from the set of scores computed by comparing a given template to each channel, and further for multiple time segments. As described above, in some embodiments matching scores are computed for the first three, the first four, and the first six T3 alert signal periods for each of N channels (e.g. 21 channels) of the processed audio input data and for each templates (e.g. each of the 25 templates). The total number of matching scores would then be 1575 (25×21×3). As described above, a maximum matching score can be selected from the set of 25 scores computed by comparing each template to the processed input data for each channel and further for each time segment. The output of the T3 pattern correlator would then be 63 (21×3) best matching scores for each time segment on each channel. In some embodiments, the T3 pattern correlator 420 selects the second best score, the third best score, and the like, or selects a set of best matching scores, whether consecutive or not.
In some embodiments, the matching scores computed by the T3 pattern correlator 420 are further processed by a T3 score filter 422 in order to remove matches for common sounds that closely mimic the T3 audible alert signals. For example, some background music or television signals have frequency characteristics and periodicity that closely match T3 alert signals. Such signals are referred to herein as “mimic signals.” Mimic signals can cause the T3 pattern correlator 420 to mistakenly output large matching scores even though a T3 alert signal is not present in the audio input data. Valid T3 audible alert signals typically create distinct patterns of matching scores, such as a single high matching score occurring every T3 alert signal period (i.e. every four seconds). Most mimic signals do not exhibit such regularity of the matching scores because mimic signals do not possess the exact periodic characteristics of the T3 alert signal.
The T3 score filter 422 analyzes the temporal pattern of matching scores and rejects mimic signals. In some embodiments, for example, the T3 score filter verifies that only one primary score peak occurs every T3 alert signal cycle by examining the time sequence of the matching scores across the channels of the processed audio data. Within a T3 alert signal cycle, mimic signals typically comprise multiple high matching scores present on different channels; thus the T3 score filter 422 can detect and reject such mimic signals. In some embodiments, the T3 score filter 422 can reject mimic signals by subtracting a penalty factor from the matching score of the processed audio input data that exhibits characteristics of mimic signals. In some embodiments, the T3 score filter 422 can reject mimic signals by analyzing the temporal pattern of matching scores computed on multiple time segments of the processed audio input data. For example, the T3 score filter 422 can verify that only one primary score peak occurs during each period of the first three, the first four, and the first six T3 alert signal periods. In some embodiments, the T3 score filter 422 is not used.
A T3 threshold detector 423 determines whether the processed audio input data comprises the T3 audible alert signal. This determination can be made by comparing the matching score or scores computed by the T3 pattern correlator 420, and processed by the T3 score filter 422, to one or more threshold matching scores. In some embodiments, the highest matching score is compared to a threshold. In some embodiments, a set of best matching scores is compared to a set of threshold matching scores. In some embodiments, the highest matching scores or a set of highest matching scores, computed for multiple time segments of the processed audio input data, are compared to a set of threshold matching scores. For example, and as explained above, the T3 threshold detector 423 can compare the best matching scores computed for the first three, the first four, and the first six T3 audible alert signal periods to a set of thresholds. The use of multiple time segments can provide a rapid detection of strong alert signals, while also allowing for detection of faint alert signals. In some embodiments, the T3 threshold detector 423 generates a smoke alarm alert notification 424 when at least one comparison to the threshold produces a match. As is illustrated in FIG. 2, alert device or devices configured to generate supplemental alert signals can then be notified or activated.
In some embodiments, the T3 threshold detector 423 automatically adjusts in order to reduce the occurrence of false alarm conditions or to detect faint T3 audible alarm signals. The computed SAI value 414 can be used to reject strong background music, television signals, and other audible signals having frequency characteristics and periodicity similar to T3 audible alert signals. For example, when the background environment is quiet, the SAI value 414 tends to be low (e.g., 0.1 for random white noise background). When the background environment contains strong musical content, the SAI value 414 tends to be high (e.g., 0.3-0.6). Accordingly, the SAI value 414 can be used to automatically readjust the threshold of the T3 threshold detector 423. For example, increasing the threshold for high SAI values can facilitate the reduction of false alarm conditions at the expense of making the signal analyzer 305 less sensitive. Conversely, decreasing the threshold for low SAI values can facilitate the detection of faint T3 audible alarm signals and make the signal analyzer 305 more sensitive. For ease of computation, the SAI value can be scaled by a factor of 100 in some embodiments. FIG. 9 illustrates the adjustment of the detection threshold based on the scaled SAI value 414 according to some embodiments. The illustrated detection threshold is linearly increased when SAI value increases from 40 to 60.
Detection of Audible Carbon Monoxide Alarm Signals
With further reference to FIG. 4, in some embodiments, the signal analyzer 305 is additionally or alternatively configured to detect T4 audible alert signals. Such detection is similar to the detection of T3 audible alert signals explained above. However, as explained above, T4 audible alert signals are typically generated by more accurate microprocessor-based detectors, and, thus, have a smaller variance from the specifications of the T4 audible alert signal governed by the existing regulations.
The signal analyzer 305 can match the detected pulse patterns stored in the pulse pattern buffer 417 with a set of expected T4 audible alert signal templates stored in the T4 template store 445. The template store 445 can store templates of T4 audible alert signals covering variations the temporal pattern of the T4 signal, such as in the period of the T4 signal (i.e. overall signal drift), in the duration of the beeping tone of the T4 signal, in the duration of the silence intervals of the T4 signal, in duration between the adjacent samples (i.e. tone to tone signal drift), in the signal intensity (e.g., due to the background environment, the proximity of the carbon monoxide detector to the detection device, etc.), and so on. Preferably, the number of template patterns is at least 5, and more preferably at least 10. In some embodiments, the template store 445 comprises 11 pre-calculated template patterns covering the range of [−15%, 15%] variation in the 5.8 second period of the T4 audible alert signal governed by the existing standards (i.e. covering the period range of [4.25, 5.75] seconds). Consequently, each template covers approximately a 2.7% deviation (135 msec) from the 5.8 second period of the T4 audible alert signal, as specified by the existing regulations. The template store 445 may alternatively have a smaller or greater number of template patterns corresponding respectively to a broader or narrower range of variation of the T4 audible alert signal period.
In some embodiments, T4 template patterns are simplified to treat the four short beeping tones of the T4 audible alert signal interspersed by short silence intervals as one beeping tone. This approximation can better fit the detected audio signal resulting from the temporal spreading of the audible alert signal as it travels down hallways and through doorways when the microphone or microphone array is placed at a substantial distance away from the carbon monoxide detector. For example, FIG. 8 illustrates such a template pattern, which corresponds to the combined beeping tone interval of approximately 0.8 sec long (delayed by about 0.2 seconds from the signal specified by the existing regulations).
In some embodiments, a T4 pattern correlator 430 matches the detected pulse patterns with a template or set of templates stored in the T4 template store 445. For example, each channel of processed audio input data frame stored in the pulse pattern buffer 417 can be compared with each template stored in the T4 template store 445, and a matching score can be computed. In some embodiments, the matching score can be computed as a number of samples in the pulse pattern buffer 417 that correspond to the respective in time samples in the template. For example, a match occurs when:
pulse_pattern_buffer[n]=templatej[m]
where templatej is the jth template in the store 445 and n, pulse_pattern_buffer is a frame of the processed audio signal, and n and m are samples. In some embodiments (as is shown in FIG. 8), a match can be assigned a score of 1 and no match can be assigned a score of −1. Then, the matching score, for example, can be computed as a sum of matches. As another example, the matching score can be computed as a sum of matches and non-matches, with the latter being subtracted from the score and thus functioning as a penalty. In some embodiments, as described above, a matching score can be expressed as a percentage of matches.
As described abovein some embodiments as described above, pulse patterns stored in the pulse pattern buffer 417 are hard clipped to +1 for all zero or positive values and to −1 for all negative values. The templates stored in the T4 template store 445 can then have a +1 value corresponding to the time when a beeping tone is expected to be present and a −1 value when a beeping tone is not expected to be present in the T4 audible alert signal (e.g., FIG. 8). In some embodiments (e.g., FIG. 8), the templates stored in the T4 template store 441 comprises “don't care values” (e.g. zero values) to provide an additional tolerance to the variation of the processed audio input data from the expected characteristics of the T4 audible alert signal governed by the existing regulations.
In some embodiments, the T4 pattern correlator 430 calculates a matching score on the entire segment of the processed audio input data. For example, if a set of eleven T4 templates is used, a matching score can be computed by comparing each of the eleven templates stored in the T4 template store 445 with each channel of the processed audio input data frame stored in the pulse pattern buffer 417. In some embodiments, matching scores are separately computed for multiple time segments of the processed audio input data frame stored in the pulse pattern buffer 417. The T4 pattern correlator 430 may calculate matching scores for other combinations of consecutive and nonconsecutive time segments.
In some embodiments, the T4 pattern correlator 430 selects a number of highest matching scores from the set of computed scores and to discard the remaining matching scores. For example, the T4 pattern correlator 430 can select the best score from the matching scores computed by comparing a given template to each channel of the processed audio data. As another example, the T4 pattern correlator 430 can select the best matching score from the set of scores computed by comparing a given template to each channel, and further for multiple time segments. As described above, in some embodiments matching scores are computed by comparing each of the templates (e.g., 11 templates) stored in the T4 template store 445 with each of N (e.g., 21) channels of the processed audio input data frame (e.g., 33 seconds) stored in the pulse pattern buffer 417. The total number of matching scores would then be 231 (11×21). As described above, a maximum matching score can be selected from this set. The output of the T4 pattern correlator 430 would then be a single best score across all channels of the processed audio input data and across all templates. In some embodiments, the T4 pattern correlator 430 selects the second best score, the third best score, and the like, or selects a set of best matching scores whether consecutive or not.
In some embodiments, the matching scores computed by the T4 pattern correlator 430 are further processed by a T4 score filter 432 in order to minimize the detection of false alarms for common sounds that closely mimic the T4 audible alert signal. The T4 score filter 432 analyzes the temporal pattern of matching scores and rejects mimic signals. For example, the T4 score filter can verify that only one primary score peak occurs every T4 alert signal cycle by examining the time sequence of the matching scores across multiple channels of the processed audio data. In some embodiments, such as when the output of the T4 pattern correlator is a single best matching score across all channels of the processed audio input data, the T4 score filter 430 is not used.
A T4 threshold detector 433 determines whether the processed audio input data comprises the T4 audible alert signal. This determination can be made by comparing the matching scores computed by the T4 pattern correlator 430, and processed by the T4 score filter 432, to one or more threshold matching scores. In some embodiments, the highest matching score can be compared to a threshold. In some embodiments, the T4 threshold detector 433 can automatically readjust the threshold by using the SAI value 414, as is explained above. Increasing the threshold as the SAI value increases can facilitate the reduction of false alarm conditions at the expense of making the signal analyzer 305 less sensitive. Conversely, decreasing the threshold when the SAI value decreases can facilitate the detection of faint T4 audible alarm signals and make the signal analyzer 305 more sensitive.
In some embodiments, the occurrence of false alarm conditions can be further reduced by checking for the presence of consecutive detection events, such as detections of T4 audible alert signals for consecutively processed audio input signal segments. For example, the T4 threshold detector 433 can check for presence of at least six consecutive detection events. In some embodiments, the occurrence of false alarm conditions can be reduced by checking for the presence of a minimum number of detection events within a set of consecutively processed audio input signal segments. For example, the T4 threshold detector 433 can check for presence of six detection events in a set of nine consecutively processed audio input signal segments. Further, the variation of consecutive detection events or the variation of all detection events across the set can be examined to cause the reduction of false alarm conditions.
In some embodiments, the T4 threshold detector 433 generates a carbon monoxide alarm alert notification 434 when the matching score computed by the T4 pattern correlator 430 crosses a detection threshold or when the presence of consecutive detection events is detected. As is illustrated in FIG. 2, one or more alert devices configured to generate supplemental alert signals can then be notified or activated.
The audible alert detection systems and methods described herein are not limited to the detection of T3 and T4 alarm signals. The disclosed systems and methods can also be applied to the detection of other types of audible alert signals. The disclosed system and methods can be applied to the detection of audible alert signals in the frequency range above 3.5 kHz or below 2.9 kHz. For example, the disclosed system and methods can be applied to the detection of audible alert signals whose “on” periods are in the form of an approximately 520 Hz square wave. For purposes of detecting such a signal, the analysis may be limited to frequencies falling close to 520 Hz (the fundamental frequency of the square wave), or may be extended to one or more of the higher-frequency harmonics. For example, a first plurality of frequency bands corresponding to the fundamental frequency may be analyzed to generate respective sets of matching scores, and a second plurality of frequency bands corresponding to the first (or higher) harmonic may also be analyzed to generate additional (respective) sets of matching scores. These various sets of matching scores can be used in combination to determine whether an audible alert is present.
Conditional language, such as, among others, “can,” “could,” “might,” or “may,” unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without user input or prompting, whether these features, elements and/or steps are included or are to be performed in any particular embodiment.
Although this invention has been described in terms of certain preferred embodiments and applications, other embodiments and applications that are apparent to those of ordinary skill in the art, including embodiments which do not provide all of the features and advantages set forth herein, are also within the scope of this invention. Accordingly, the scope of the present invention is defined only by reference to the appended claims.

Claims (20)

1. A method for detecting audible alert signals implemented in signal processing circuitry, the method comprising:
generating a digital representation of a received audio signal;
for each of a plurality of templates, comparing the digital representation of the received audio signal to the respective template, and generating a matching score representing a degree of match between the digital representation of the received audio signal and the respective template, wherein each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal; and
determining, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present.
2. The method of claim 1, wherein the plurality of templates comprises templates that correspond to variations in a Temporal-3 timing pattern.
3. The method of claim 1, wherein the plurality of templates comprises templates that correspond to variations in a Temporal-4 timing pattern.
4. The method of claim 1, wherein the plurality of templates includes at least ten templates.
5. The method of claim 1, wherein generating the digital representations comprises applying band pass filtering such that the digital representation corresponds to a frequency band falling within a range of acceptable frequencies of an audible alert signal.
6. The method of claim 5, further comprising repeating the generating and comparing steps for each of multiple additional frequency bands falling within the range, to thereby generate a separate set of matching scores for each of a plurality of frequency ranges, and wherein said determining step comprises analyzing each of the sets of matching scores.
7. The method of claim 6, wherein the number of the frequency bands is at least ten.
8. The method of claim 6, wherein the number of the frequency bands is at least twenty.
9. The method of claim 6, wherein each of the plurality of frequency ranges falls within the range of 2.9 kHz to 3.5 kHz.
10. The method of claim 1, further comprising:
estimating a noise content of the received audio signal; and
determining, based at least partly on the noise content, whether an audible alert signal is present.
11. A computer-readable medium storage which stores executable instructions capable of causing a computing device to perform a signal processing method that comprises:
generating a digital representation of a received audio signal;
for each of a plurality of templates, comparing the digital representation of the received audio signal to the respective template, and generating a matching score representing a degree of match between the digital representation of the received audio signal and the respective template, wherein each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal; and
determining, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present.
12. The computer-readable medium of claim 11, wherein the plurality of templates comprises templates that correspond to variations in a Temporal-3 timing pattern.
13. The computer-readable medium of claim 11, wherein the plurality of templates comprises templates that correspond to variations in a Temporal-4 timing pattern.
14. The method of claim 11, wherein the plurality of templates includes at least ten templates.
15. A signal processing system for detecting audible alert signals comprising:
a circuit configured to receive an audio signal and to generate a digital representation of the received audio signal;
a memory buffer configured to store a plurality of templates, wherein each template corresponds to an acceptable audible alert signal timing pattern, and the plurality of templates encompass an acceptable range of variation in a timing pattern of a standard audible alert signal; and
a circuit configured to:
compare, for each template, the digital representation of the received audio signal to the respective template;
generate, for each template, a matching score representing a degree of match between the digital representation of the received audio signal and the respective template; and
determine, based at least partly on the matching scores corresponding to the plurality of templates, whether an audible alert signal is present.
16. The signal processing system of claim 15, wherein the plurality of templates comprises templates that correspond to variations in a Temporal-3 timing pattern.
17. The signal processing system of claim 15, wherein the plurality of templates comprises templates that correspond to variations in a Temporal-4 timing pattern.
18. The method of claim 15, wherein the number of the frequency bands is twenty-one.
19. The signal processing system of claim 15, further comprising a supplemental alert generator configured to generate a supplemental alert signal in response to the determination that an audible alert signal is present.
20. The signal processing system of claim 19, wherein the supplemental alert signal is a low-frequency square wave sound pattern.
US12/756,698 2009-07-29 2010-04-08 Signal processing system and methods for reliably detecting audible alarms Active 2031-05-21 US8269625B2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US12/756,698 US8269625B2 (en) 2009-07-29 2010-04-08 Signal processing system and methods for reliably detecting audible alarms
AU2010278884A AU2010278884A1 (en) 2009-07-29 2010-07-29 Signal processing system and methods for reliably detecting audible alarms
PCT/US2010/043771 WO2011014694A1 (en) 2009-07-29 2010-07-29 Signal processing system and methods for reliably detecting audible alarms
CA2769266A CA2769266A1 (en) 2009-07-29 2010-07-29 Signal processing system and methods for reliably detecting audible alarms
NZ597928A NZ597928A (en) 2009-07-29 2010-07-29 Signal processing system and methods for reliably detecting audible alarms
US13/621,766 US20130077797A1 (en) 2009-07-29 2012-09-17 Signal processing system and methods for reliably detecting audible alarms

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US22968409P 2009-07-29 2009-07-29
US12/756,698 US8269625B2 (en) 2009-07-29 2010-04-08 Signal processing system and methods for reliably detecting audible alarms

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/621,766 Continuation US20130077797A1 (en) 2009-07-29 2012-09-17 Signal processing system and methods for reliably detecting audible alarms

Publications (2)

Publication Number Publication Date
US20110025499A1 US20110025499A1 (en) 2011-02-03
US8269625B2 true US8269625B2 (en) 2012-09-18

Family

ID=43526463

Family Applications (2)

Application Number Title Priority Date Filing Date
US12/756,698 Active 2031-05-21 US8269625B2 (en) 2009-07-29 2010-04-08 Signal processing system and methods for reliably detecting audible alarms
US13/621,766 Abandoned US20130077797A1 (en) 2009-07-29 2012-09-17 Signal processing system and methods for reliably detecting audible alarms

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/621,766 Abandoned US20130077797A1 (en) 2009-07-29 2012-09-17 Signal processing system and methods for reliably detecting audible alarms

Country Status (5)

Country Link
US (2) US8269625B2 (en)
AU (1) AU2010278884A1 (en)
CA (1) CA2769266A1 (en)
NZ (1) NZ597928A (en)
WO (1) WO2011014694A1 (en)

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100014717A1 (en) * 2008-07-21 2010-01-21 Airborne Biometrics Group, Inc. Managed Biometric-Based Notification System and Method
US8719032B1 (en) 2013-12-11 2014-05-06 Jefferson Audio Video Systems, Inc. Methods for presenting speech blocks from a plurality of audio input data streams to a user in an interface
US20140267710A1 (en) * 2013-03-14 2014-09-18 I & T Tech Co., Ltd. Abnormality detection device and security system
US20140313040A1 (en) * 2013-04-23 2014-10-23 John Richard Wright, SR. Tactile and Visual Smoke Detector System
US20160335513A1 (en) * 2008-07-21 2016-11-17 Facefirst, Inc Managed notification system
US9500515B2 (en) 2013-10-21 2016-11-22 Mass Moment LLC Multifunctional wearable audio-sensing electronic device
US9734691B2 (en) 2015-12-15 2017-08-15 Intel Corporation Personalized wearable gas sensor using both the average and the rate of change of the gas level
US9830807B2 (en) 2015-07-09 2017-11-28 Microsemi Semiconductor (U.S.) Inc. Acoustic alarm detector
US9852620B1 (en) * 2014-09-19 2017-12-26 Thomas John Hoeft System and method for detecting sound and performing an action on the detected sound
USD848175S1 (en) 2015-03-27 2019-05-14 Happiest Baby, Inc. Bassinet
US10463168B2 (en) 2013-07-31 2019-11-05 Hb Innovations Inc. Infant calming/sleep-aid and SIDS prevention device with drive system
USD866122S1 (en) 2017-04-04 2019-11-12 Hb Innovations Inc. Wingless sleep sack
US10532180B2 (en) 2011-10-20 2020-01-14 Hb Innovations, Inc. Infant calming/sleep-aid, SIDS prevention device, and method of use
US10827851B2 (en) 2011-10-20 2020-11-10 Hb Innovations, Inc. Infant calming/sleep-aid device and method of use
US11052221B2 (en) 2016-10-17 2021-07-06 Hb Innovations, Inc. Infant calming/sleep-aid device
US11490663B2 (en) 2018-02-21 2022-11-08 Hb Innovations, Inc. Infant sleep garment
US11497884B2 (en) 2019-06-04 2022-11-15 Hb Innovations, Inc. Sleep aid system including smart power hub
US11528454B2 (en) 2018-03-12 2022-12-13 Innovation Lock, Llc Lock system including automation notification and surveillance integration
US11545025B2 (en) * 2018-03-12 2023-01-03 Innovation Lock, Llc Security system including automation notification and surveillance integration
US11636870B2 (en) 2020-08-20 2023-04-25 Denso International America, Inc. Smoking cessation systems and methods
US11760169B2 (en) 2020-08-20 2023-09-19 Denso International America, Inc. Particulate control systems and methods for olfaction sensors
US11760170B2 (en) 2020-08-20 2023-09-19 Denso International America, Inc. Olfaction sensor preservation systems and methods
US11813926B2 (en) 2020-08-20 2023-11-14 Denso International America, Inc. Binding agent and olfaction sensor
US11828210B2 (en) 2020-08-20 2023-11-28 Denso International America, Inc. Diagnostic systems and methods of vehicles using olfaction
US11881093B2 (en) 2020-08-20 2024-01-23 Denso International America, Inc. Systems and methods for identifying smoking in vehicles

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130127620A1 (en) 2011-06-20 2013-05-23 Cerner Innovation, Inc. Management of patient fall risk
US9741227B1 (en) 2011-07-12 2017-08-22 Cerner Innovation, Inc. Method and process for determining whether an individual suffers a fall requiring assistance
US10546481B2 (en) 2011-07-12 2020-01-28 Cerner Innovation, Inc. Method for determining whether an individual leaves a prescribed virtual perimeter
US9489820B1 (en) 2011-07-12 2016-11-08 Cerner Innovation, Inc. Method for determining whether an individual leaves a prescribed virtual perimeter
US20150360395A1 (en) * 2013-01-31 2015-12-17 Michelin Recherche Et Technique S.A. Tread cracking prevention and de-molding force reduction dolly
US20140266682A1 (en) 2013-03-15 2014-09-18 Leeo, Inc. Environmental monitoring device
US20140279574A1 (en) 2013-03-15 2014-09-18 Leeo, Inc. Environmental measurement display system and method
US9374629B2 (en) * 2013-03-15 2016-06-21 The Nielsen Company (Us), Llc Methods and apparatus to classify audio
FR3006798B1 (en) * 2013-06-06 2016-12-09 Finsecur DEVICE AND METHOD FOR REPORTING SOUND, LIGHT OR VIBRATION SIGNAL
US20150021465A1 (en) * 2013-07-16 2015-01-22 Leeo, Inc. Electronic device with environmental monitoring
US9116137B1 (en) 2014-07-15 2015-08-25 Leeo, Inc. Selective electrical coupling based on environmental conditions
US10047970B2 (en) 2013-08-21 2018-08-14 Honeywell International Inc. Devices and methods for interacting with an HVAC controller
JP6367937B2 (en) * 2013-11-01 2018-08-01 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Apparatus and method for acoustic alarm detection and validation
US10096223B1 (en) 2013-12-18 2018-10-09 Cerner Innovication, Inc. Method and process for determining whether an individual suffers a fall requiring assistance
US10078956B1 (en) 2014-01-17 2018-09-18 Cerner Innovation, Inc. Method and system for determining whether an individual takes appropriate measures to prevent the spread of healthcare-associated infections
US10225522B1 (en) 2014-01-17 2019-03-05 Cerner Innovation, Inc. Method and system for determining whether an individual takes appropriate measures to prevent the spread of healthcare-associated infections
US9729833B1 (en) 2014-01-17 2017-08-08 Cerner Innovation, Inc. Method and system for determining whether an individual takes appropriate measures to prevent the spread of healthcare-associated infections along with centralized monitoring
US9372477B2 (en) 2014-07-15 2016-06-21 Leeo, Inc. Selective electrical coupling based on environmental conditions
US9213327B1 (en) 2014-07-15 2015-12-15 Leeo, Inc. Selective electrical coupling based on environmental conditions
US9170625B1 (en) 2014-07-15 2015-10-27 Leeo, Inc. Selective electrical coupling based on environmental conditions
US9092060B1 (en) 2014-08-27 2015-07-28 Leeo, Inc. Intuitive thermal user interface
US20160070276A1 (en) 2014-09-08 2016-03-10 Leeo, Inc. Ecosystem with dynamically aggregated combinations of components
US9445451B2 (en) 2014-10-20 2016-09-13 Leeo, Inc. Communicating arbitrary attributes using a predefined characteristic
US10026304B2 (en) 2014-10-20 2018-07-17 Leeo, Inc. Calibrating an environmental monitoring device
GB201419396D0 (en) * 2014-10-31 2014-12-17 Univ Salford Entpr Ltd Assistive Mixing System And Method Of Assembling A Synchronised Spattial Sound Stage
US10090068B2 (en) 2014-12-23 2018-10-02 Cerner Innovation, Inc. Method and system for determining whether a monitored individual's hand(s) have entered a virtual safety zone
US10524722B2 (en) 2014-12-26 2020-01-07 Cerner Innovation, Inc. Method and system for determining whether a caregiver takes appropriate measures to prevent patient bedsores
US10091463B1 (en) 2015-02-16 2018-10-02 Cerner Innovation, Inc. Method for determining whether an individual enters a prescribed virtual zone using 3D blob detection
US10342478B2 (en) 2015-05-07 2019-07-09 Cerner Innovation, Inc. Method and system for determining whether a caretaker takes appropriate measures to prevent patient bedsores
EP3262621B1 (en) * 2015-05-08 2020-11-11 Hewlett-Packard Development Company, L.P. Alarm event determinations via microphone arrays
US9892611B1 (en) 2015-06-01 2018-02-13 Cerner Innovation, Inc. Method for determining whether an individual enters a prescribed virtual zone using skeletal tracking and 3D blob detection
FR3039916B1 (en) * 2015-08-07 2019-04-05 Azur Tech Concept ALERT SYSTEM FOR MISSING PEOPLE
US9801013B2 (en) 2015-11-06 2017-10-24 Leeo, Inc. Electronic-device association based on location duration
US10805775B2 (en) 2015-11-06 2020-10-13 Jon Castor Electronic-device detection and activity association
US9892310B2 (en) 2015-12-31 2018-02-13 Cerner Innovation, Inc. Methods and systems for detecting prohibited objects in a patient room
US10642233B2 (en) * 2016-01-04 2020-05-05 Ademco Inc. Device enrollment in a building automation system aided by audio input
US10152877B2 (en) * 2016-01-15 2018-12-11 Schneider Electric It Corporation Systems and methods for adaptive detection of audio alarms
EP4324393A2 (en) * 2016-03-31 2024-02-21 DexCom, Inc. Systems and methods for inter-app communications
US9836947B1 (en) 2016-08-02 2017-12-05 Ecolink Intelligent Technology, Inc. Method and apparatus for detecting a hazard detector signal in the presence of interference
US10147184B2 (en) 2016-12-30 2018-12-04 Cerner Innovation, Inc. Seizure detection
FR3063826B1 (en) * 2017-03-09 2019-05-03 Simon Aigouy PORTABLE ALERT DEVICE FOR SENIORS OR MISSING PEOPLE
SE542151C2 (en) * 2017-06-13 2020-03-03 Minut Ab Methods and devices for obtaining an event designation based on audio data and non-audio data
US10524046B2 (en) 2017-12-06 2019-12-31 Ademco Inc. Systems and methods for automatic speech recognition
WO2019126284A1 (en) * 2017-12-20 2019-06-27 Hubbell Incorporated Voice responsive in-wall device
US10643446B2 (en) 2017-12-28 2020-05-05 Cerner Innovation, Inc. Utilizing artificial intelligence to detect objects or patient safety events in a patient room
US10482321B2 (en) 2017-12-29 2019-11-19 Cerner Innovation, Inc. Methods and systems for identifying the crossing of a virtual barrier
US10922936B2 (en) 2018-11-06 2021-02-16 Cerner Innovation, Inc. Methods and systems for detecting prohibited objects
GB2579570A (en) * 2018-12-03 2020-07-01 Fireangel Safety Tech Limited Control system
AU2019402884A1 (en) 2018-12-19 2021-07-01 Dexcom, Inc. Intermittent monitoring
US11432746B2 (en) 2019-07-15 2022-09-06 International Business Machines Corporation Method and system for detecting hearing impairment

Citations (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4091366A (en) 1976-07-19 1978-05-23 J.H. Mcdaniel Tele-Communications, Inc. Sonic monitoring method and apparatus
US4180810A (en) 1978-01-16 1979-12-25 Muncheryan Hrand M Silent awakening system
US4186389A (en) 1978-02-09 1980-01-29 Flittie Clifford G Sleeper's smoke-alarm clock
US4237449A (en) 1978-06-16 1980-12-02 Zibell J Scott Signalling device for hard of hearing persons
US4365238A (en) * 1979-06-08 1982-12-21 Adam Kollin Visual signalling apparatus
US4417235A (en) 1981-03-24 1983-11-22 Del Grande Donald J Audible alarm network
US4450436A (en) 1979-09-07 1984-05-22 The Stoneleigh Trust Acoustic alarm repeater system
US4461927A (en) 1983-03-03 1984-07-24 Olson Ronald E Automatic dialing and alarm system
US4617555A (en) 1985-04-17 1986-10-14 Data Distribution Devices, Inc. Receiver for audible alarm
US4897862A (en) 1988-05-27 1990-01-30 Nec Corporation Acoustic alarm detection system for telephone activation
US4935952A (en) 1988-07-13 1990-06-19 B-Warned, Inc. Alarm-responsive apparatus and method
US4956866A (en) 1989-06-30 1990-09-11 Sy/Lert System Ltd. Emergency signal warning system
US4996517A (en) * 1989-04-06 1991-02-26 Assist, Inc. Household alarm system
US5012223A (en) 1990-02-23 1991-04-30 Black & Decker, Inc. Sound activated device and method
US5177461A (en) 1988-11-28 1993-01-05 Universal Electronics Inc. Warning light system for use with a smoke detector
US5287411A (en) 1990-07-27 1994-02-15 Hill James L System for detecting the siren of an approaching emergency vehicle
US5651070A (en) 1995-04-12 1997-07-22 Blunt; Thomas O. Warning device programmable to be sensitive to preselected sound frequencies
US5666331A (en) 1994-09-20 1997-09-09 Rhk Technology, Inc. Alarm clock
US5797852A (en) 1993-02-04 1998-08-25 Local Silence, Inc. Sleep apnea screening and/or detecting apparatus and method
US5867105A (en) 1996-10-21 1999-02-02 Hajel; William F. Wireless alarm system
US5889468A (en) 1997-11-10 1999-03-30 Banga; William Robert Extra security smoke alarm system
US5898369A (en) 1996-01-18 1999-04-27 Godwin; Paul K. Communicating hazardous condition detector
US5999089A (en) 1997-05-13 1999-12-07 Carlson; Lance K. Alarm system
US6087960A (en) 1998-06-24 2000-07-11 Mitsubishi Electric Engineering Company, Limited Accident sound detection circuit
US6215404B1 (en) 1999-03-24 2001-04-10 Fernando Morales Network audio-link fire alarm monitoring system and method
US6384724B1 (en) 1999-12-22 2002-05-07 Andre M Landais Smoke alarm
US6420973B2 (en) 1999-01-23 2002-07-16 James Acevedo Wireless smoke detection system
US6553100B1 (en) 2000-11-07 2003-04-22 At&T Corp. Intelligent alerting systems
JP2003210515A (en) 2002-01-17 2003-07-29 Shinji Miyazaki Method for automatically detecting fire alarm electronic sound and chime sound for visually handicapped person by utilizing pll
US6658123B1 (en) 1996-11-15 2003-12-02 William C. Crutcher Sonic relay for the high frequency hearing impaired
US20040145467A1 (en) 2002-10-02 2004-07-29 Roby Richard J. Method and apparatus for indicating activation of a smoke detector alarm
US20060250260A1 (en) * 2004-07-23 2006-11-09 Innovalarm Corporation Alert system with enhanced waking capabilities
US7501958B2 (en) 2006-07-12 2009-03-10 Innovalarm Corporation Strobe light alarm detection and alert system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US658123A (en) * 1900-03-29 1900-09-18 Jacob Rosenthal Folding go-cart.
US7629880B2 (en) * 2004-03-09 2009-12-08 Ingrid, Inc. System, method and device for detecting a siren

Patent Citations (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4091366A (en) 1976-07-19 1978-05-23 J.H. Mcdaniel Tele-Communications, Inc. Sonic monitoring method and apparatus
US4180810A (en) 1978-01-16 1979-12-25 Muncheryan Hrand M Silent awakening system
US4186389A (en) 1978-02-09 1980-01-29 Flittie Clifford G Sleeper's smoke-alarm clock
US4237449A (en) 1978-06-16 1980-12-02 Zibell J Scott Signalling device for hard of hearing persons
US4365238A (en) * 1979-06-08 1982-12-21 Adam Kollin Visual signalling apparatus
US4450436A (en) 1979-09-07 1984-05-22 The Stoneleigh Trust Acoustic alarm repeater system
US4417235A (en) 1981-03-24 1983-11-22 Del Grande Donald J Audible alarm network
US4461927A (en) 1983-03-03 1984-07-24 Olson Ronald E Automatic dialing and alarm system
US4617555A (en) 1985-04-17 1986-10-14 Data Distribution Devices, Inc. Receiver for audible alarm
US4897862A (en) 1988-05-27 1990-01-30 Nec Corporation Acoustic alarm detection system for telephone activation
US4935952A (en) 1988-07-13 1990-06-19 B-Warned, Inc. Alarm-responsive apparatus and method
US5177461A (en) 1988-11-28 1993-01-05 Universal Electronics Inc. Warning light system for use with a smoke detector
US4996517A (en) * 1989-04-06 1991-02-26 Assist, Inc. Household alarm system
US4956866A (en) 1989-06-30 1990-09-11 Sy/Lert System Ltd. Emergency signal warning system
US5012223A (en) 1990-02-23 1991-04-30 Black & Decker, Inc. Sound activated device and method
US5287411A (en) 1990-07-27 1994-02-15 Hill James L System for detecting the siren of an approaching emergency vehicle
US5797852A (en) 1993-02-04 1998-08-25 Local Silence, Inc. Sleep apnea screening and/or detecting apparatus and method
US5666331A (en) 1994-09-20 1997-09-09 Rhk Technology, Inc. Alarm clock
US5651070A (en) 1995-04-12 1997-07-22 Blunt; Thomas O. Warning device programmable to be sensitive to preselected sound frequencies
US5898369A (en) 1996-01-18 1999-04-27 Godwin; Paul K. Communicating hazardous condition detector
US5867105A (en) 1996-10-21 1999-02-02 Hajel; William F. Wireless alarm system
US6658123B1 (en) 1996-11-15 2003-12-02 William C. Crutcher Sonic relay for the high frequency hearing impaired
US5999089A (en) 1997-05-13 1999-12-07 Carlson; Lance K. Alarm system
US5889468A (en) 1997-11-10 1999-03-30 Banga; William Robert Extra security smoke alarm system
US6087960A (en) 1998-06-24 2000-07-11 Mitsubishi Electric Engineering Company, Limited Accident sound detection circuit
US6420973B2 (en) 1999-01-23 2002-07-16 James Acevedo Wireless smoke detection system
US6215404B1 (en) 1999-03-24 2001-04-10 Fernando Morales Network audio-link fire alarm monitoring system and method
US6384724B1 (en) 1999-12-22 2002-05-07 Andre M Landais Smoke alarm
US6553100B1 (en) 2000-11-07 2003-04-22 At&T Corp. Intelligent alerting systems
JP2003210515A (en) 2002-01-17 2003-07-29 Shinji Miyazaki Method for automatically detecting fire alarm electronic sound and chime sound for visually handicapped person by utilizing pll
US20040145467A1 (en) 2002-10-02 2004-07-29 Roby Richard J. Method and apparatus for indicating activation of a smoke detector alarm
US20060250260A1 (en) * 2004-07-23 2006-11-09 Innovalarm Corporation Alert system with enhanced waking capabilities
US7501958B2 (en) 2006-07-12 2009-03-10 Innovalarm Corporation Strobe light alarm detection and alert system

Non-Patent Citations (17)

* Cited by examiner, † Cited by third party
Title
Ellis, D.P.W., "The Listening Machine: 1st Annual Report," dated Mar. 15, 2004.
Ellis, Dan "Detecting Alarm Sounds" Department of Electrical Engineering, Columbia University. CRAC Poster. 2001.
Griebell, C.A. 1991 "Detecting the audible alarm of residual smoke detectors and its applications" Consumer Electronics, IEEE Transactions on Consumer Electronics 37(3):401-405. Abstract.
International Preliminary Report on Patentability mailed Feb. 9, 2012 in International Application No. PCT/US2010/043771 in 7 pages.
International Search Report and Written Opinion mailed Oct. 11, 2010 for related International Application No. PCT/US2010/043771.
Moncrieff, S. et al., "Incorporating Contextual Audio for an Actively Anxious Smart Home" Intelligent Sensors, Sensor Networks and Information Processing Conference, 2005, Proceedings of the 2005 International Conference 5(8):373-78.
Obata, K. et al., "A New Sound Source Location Algorithm Based on Formant Frequency for Sound Image Localization" Multimedia and Expo, 2003. ICME '03. Proceedings. 2003 International Conference 6-9(1):729-32, 2003.
Web page describing BEBE Sound Baby Movement Sensor and Sound product, printed from ShoppersChoice website, http://www.shopperschoice.com/item-item-1536072-source-froogle.html, on Jun. 20, 2007 (1 printed page).
Web page describing RoboNanny v1.00-Home security monitoring tool, printed from Spy Arsenal website, http://www.spyarsenal.com/spy-microphone/, on Nov. 14, 2003 (3 printed pages).
Web page labeled "Alarm Sound Detection" by Ellis, D.P.W., printed from Columbia University website, http://www.ee.columibia.edu/~dpwe/projects/alarmdetect.html, on Nov. 1, 2010 (2 printed pages).
Web page labeled "Alarm Sound Detection" by Ellis, D.P.W., printed from Columbia University website, http://www.ee.columibia.edu/˜dpwe/projects/alarmdetect.html, on Nov. 1, 2010 (2 printed pages).
Web page labeled "Audio Detector Circuit" by Barello, L., printed from Seattle Robotics website, http://www.seattlerobotics.org/encoder/200003/larryb.html, on Oct. 25, 2007 (2 printed pages).
Web page labeled "Audio Detector for Starting Robots" by Barello, L., printed from Seattle Robotics website, http://www.seattlerobotics.org/encoder/200005/audio-detector-circuit.html, on Oct. 25, 2007 (4 printed pages).
Web page labeled "Computer Security System," printed from http://www.sarbash.com/pro-csss.shtml on Sep. 7, 2002 (4 printed pages).
Web page labeled "CSSS-Computer Sound Security System," printed from PRWeb website, http://www.prweb.com/releases/2001/prweb25104.htm, on Nov. 14, 2003 (2 printed pages).
Web page labeled "Simple Sound Detection Circuit." Revolution Education Ltd 2003.
Web page labeled "Sound Detector Latch," printed from http://www.reconnsworld.com/audio-sounddetectlatch.html on Oct. 25, 2007 (1 printed page).

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10049288B2 (en) * 2008-07-21 2018-08-14 Facefirst, Inc. Managed notification system
US9141863B2 (en) * 2008-07-21 2015-09-22 Facefirst, Llc Managed biometric-based notification system and method
US20160335513A1 (en) * 2008-07-21 2016-11-17 Facefirst, Inc Managed notification system
US20100014717A1 (en) * 2008-07-21 2010-01-21 Airborne Biometrics Group, Inc. Managed Biometric-Based Notification System and Method
US11123515B2 (en) 2011-10-20 2021-09-21 Hb Innovations, Inc. Infant calming/sleep-aid, SIDS prevention device, and method of use
US10827851B2 (en) 2011-10-20 2020-11-10 Hb Innovations, Inc. Infant calming/sleep-aid device and method of use
US10532182B2 (en) 2011-10-20 2020-01-14 Hb Innovations, Inc. Infant calming/sleep-aid, SIDS prevention device, and method of use
US10532180B2 (en) 2011-10-20 2020-01-14 Hb Innovations, Inc. Infant calming/sleep-aid, SIDS prevention device, and method of use
US20140267710A1 (en) * 2013-03-14 2014-09-18 I & T Tech Co., Ltd. Abnormality detection device and security system
US9536400B2 (en) * 2013-03-14 2017-01-03 I & T Tech Co., Ltd. Alarm sound detection device
US20140313040A1 (en) * 2013-04-23 2014-10-23 John Richard Wright, SR. Tactile and Visual Smoke Detector System
US10463168B2 (en) 2013-07-31 2019-11-05 Hb Innovations Inc. Infant calming/sleep-aid and SIDS prevention device with drive system
US9500515B2 (en) 2013-10-21 2016-11-22 Mass Moment LLC Multifunctional wearable audio-sensing electronic device
US8942987B1 (en) 2013-12-11 2015-01-27 Jefferson Audio Video Systems, Inc. Identifying qualified audio of a plurality of audio streams for display in a user interface
US8719032B1 (en) 2013-12-11 2014-05-06 Jefferson Audio Video Systems, Inc. Methods for presenting speech blocks from a plurality of audio input data streams to a user in an interface
US9852620B1 (en) * 2014-09-19 2017-12-26 Thomas John Hoeft System and method for detecting sound and performing an action on the detected sound
USD848175S1 (en) 2015-03-27 2019-05-14 Happiest Baby, Inc. Bassinet
USD933993S1 (en) 2015-03-27 2021-10-26 Hb Innovations, Inc. Bassinet
USD889878S1 (en) 2015-03-27 2020-07-14 Hb Innovations, Inc. Bassinet
US9830807B2 (en) 2015-07-09 2017-11-28 Microsemi Semiconductor (U.S.) Inc. Acoustic alarm detector
US10157530B2 (en) 2015-12-15 2018-12-18 Intel Corporation Personalized wearable gas sensor using both the average and the rate of change of the gas level
US9734691B2 (en) 2015-12-15 2017-08-15 Intel Corporation Personalized wearable gas sensor using both the average and the rate of change of the gas level
US11052221B2 (en) 2016-10-17 2021-07-06 Hb Innovations, Inc. Infant calming/sleep-aid device
USD866122S1 (en) 2017-04-04 2019-11-12 Hb Innovations Inc. Wingless sleep sack
US11490663B2 (en) 2018-02-21 2022-11-08 Hb Innovations, Inc. Infant sleep garment
US11528454B2 (en) 2018-03-12 2022-12-13 Innovation Lock, Llc Lock system including automation notification and surveillance integration
US11545025B2 (en) * 2018-03-12 2023-01-03 Innovation Lock, Llc Security system including automation notification and surveillance integration
US11893877B2 (en) 2018-03-12 2024-02-06 Innovation Lock, Llc Security system including automation notification and surveillance integration
US11497884B2 (en) 2019-06-04 2022-11-15 Hb Innovations, Inc. Sleep aid system including smart power hub
US11636870B2 (en) 2020-08-20 2023-04-25 Denso International America, Inc. Smoking cessation systems and methods
US11760169B2 (en) 2020-08-20 2023-09-19 Denso International America, Inc. Particulate control systems and methods for olfaction sensors
US11760170B2 (en) 2020-08-20 2023-09-19 Denso International America, Inc. Olfaction sensor preservation systems and methods
US11813926B2 (en) 2020-08-20 2023-11-14 Denso International America, Inc. Binding agent and olfaction sensor
US11828210B2 (en) 2020-08-20 2023-11-28 Denso International America, Inc. Diagnostic systems and methods of vehicles using olfaction
US11881093B2 (en) 2020-08-20 2024-01-23 Denso International America, Inc. Systems and methods for identifying smoking in vehicles

Also Published As

Publication number Publication date
US20110025499A1 (en) 2011-02-03
NZ597928A (en) 2013-03-28
US20130077797A1 (en) 2013-03-28
WO2011014694A1 (en) 2011-02-03
AU2010278884A1 (en) 2012-03-01
CA2769266A1 (en) 2011-02-03

Similar Documents

Publication Publication Date Title
US8269625B2 (en) Signal processing system and methods for reliably detecting audible alarms
US9905116B2 (en) Method and apparatus for detecting a hazard alert signal
US8068025B2 (en) Personal alerting device and method
US7501958B2 (en) Strobe light alarm detection and alert system
US7015807B2 (en) Method and apparatus for indicating activation of a smoke detector alarm
JP2011237865A (en) Living space monitoring system
Carbonneau et al. Detection of alarms and warning signals on an digital in-ear device
US20140187142A1 (en) Seismic Alarm and Warning System
US5355350A (en) Passive acoustic tornado detector and detection method
US7315244B2 (en) Excessive noise level alerting device
CN110300997A (en) Abnormal conditions notify system and abnormal conditions notification method
US10733875B2 (en) Detection device, information input device, and watching system
GB2507582A (en) Self-calibrating audible alarm trigger
WO2010136808A1 (en) An alarm signal responder
KR101705572B1 (en) A fire alarm method and a fire alarm apparatus
JP7250329B2 (en) Notification sound detection device and notification sound detection method
WO2020257855A1 (en) Device and method for indicating an emergency exit
Yonezawa et al. Privacy protected life-context-aware alert by simplified sound spectrogram from microphone sensor
JP3056048B2 (en) Snoring detection device
US20130101124A1 (en) Method and device for detecting acoustic shocks
JP4344262B2 (en) Acoustic information presentation apparatus and method
Pohlhausen et al. Near-ear sound pressure level distribution in everyday life considering the user’s own voice and privacy
JP2004144890A (en) Notification sound generating device
JPH05205184A (en) Method for gathering facility data
JP2014078147A (en) Arsonist threatening device and arsonist threatening method

Legal Events

Date Code Title Description
AS Assignment

Owner name: INNOVALARM CORPORATION, OKLAHOMA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HOY, LESLIE D.;ALBERT, DAVID E.;SMITH, LANDGRAVE T.;AND OTHERS;SIGNING DATES FROM 20100617 TO 20100623;REEL/FRAME:024604/0893

AS Assignment

Owner name: FRANS, DOUG, OKLAHOMA

Free format text: SECURITY AGREEMENT;ASSIGNOR:INNOVALARM CORPORATION;REEL/FRAME:024706/0681

Effective date: 20100714

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
AS Assignment

Owner name: KNOBBE, MARTENS, OLSON & BEAR, LLP, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:INNOVALARM CORPORATION;REEL/FRAME:033976/0015

Effective date: 20131106

AS Assignment

Owner name: INNOVALARM CORPORATION, OKLAHOMA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:KNOBBE, MARTENS, OLSON & BEAR, LLP;REEL/FRAME:038057/0549

Effective date: 20160307

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2552); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 8

AS Assignment

Owner name: INNOVALARM CORPORATION, OKLAHOMA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:FRANS, DOUG;REEL/FRAME:064403/0076

Effective date: 20170426

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2553); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 12