US9480402B2 - System and method for task-less mapping of brain activity - Google Patents

System and method for task-less mapping of brain activity Download PDF

Info

Publication number
US9480402B2
US9480402B2 US13/673,816 US201213673816A US9480402B2 US 9480402 B2 US9480402 B2 US 9480402B2 US 201213673816 A US201213673816 A US 201213673816A US 9480402 B2 US9480402 B2 US 9480402B2
Authority
US
United States
Prior art keywords
time
brain
resting state
processor
map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US13/673,816
Other versions
US20130123607A1 (en
Inventor
Eric Leuthardt
Nicholas Szrama
Carl Hacker
Tim Laumann
Maurizio Corbetta
Abraham Z. Snyder
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Washington University in St Louis WUSTL
Original Assignee
Washington University in St Louis WUSTL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Washington University in St Louis WUSTL filed Critical Washington University in St Louis WUSTL
Priority to US13/673,816 priority Critical patent/US9480402B2/en
Assigned to WASHINGTON UNIVERSITY reassignment WASHINGTON UNIVERSITY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LAUMANN, TIMOTHY, HACKER, CARL, LEUTHARDT, ERIC, SZRAMA, NICHOLAS, SNYDER, ABRAHAM, CORBETTA, MAURIZIO
Publication of US20130123607A1 publication Critical patent/US20130123607A1/en
Priority to US15/237,202 priority patent/US10092246B2/en
Application granted granted Critical
Publication of US9480402B2 publication Critical patent/US9480402B2/en
Priority to US16/136,996 priority patent/US10258289B2/en
Priority to US16/383,926 priority patent/US11589826B2/en
Priority to US18/168,074 priority patent/US20230181119A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0033Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
    • A61B5/004Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part
    • A61B5/0042Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part for the brain
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0015Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
    • A61B5/0022Monitoring a patient using a global network, e.g. telephone networks, internet
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/053Measuring electrical impedance or conductance of a portion of the body
    • A61B5/0536Impedance imaging, e.g. by tomography
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/055Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves  involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/37Intracranial electroencephalography [IC-EEG], e.g. electrocorticography [ECoG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/40Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4058Detecting, measuring or recording for evaluating the nervous system for evaluating the central nervous system
    • A61B5/4064Evaluating the brain
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7246Details of waveform analysis using correlation, e.g. template matching or determination of similarity
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/4806Functional imaging of brain activation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/54Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
    • G01R33/56Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
    • G01R33/5608Data processing and visualization specially adapted for MR, e.g. for feature analysis and pattern recognition on the basis of measured MR data, segmentation of measured MR data, edge contour detection on the basis of measured MR data, for enhancing measured MR data in terms of signal-to-noise ratio by means of noise filtering or apodization, for enhancing measured MR data in terms of resolution by means for deblurring, windowing, zero filling, or generation of gray-scaled images, colour-coded images or images displaying vectors instead of pixels
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00Medical imaging apparatus involving image processing or analysis
    • A61B2576/02Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
    • A61B2576/026Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part for the brain

Definitions

  • the field of the invention relates generally to brain mapping systems and, more particularly, to systems and methods for task-less mapping of brain activity using resting state data collected from a brain of a subject.
  • Brain mapping includes a set of neuroscience techniques that are predicated on the mapping of biological quantities or properties onto spatial representations of a subject's brain resulting in at least one map.
  • At least some known neuroimaging systems or techniques are used frequently in clinical and research settings for brain mapping such that brain function can be monitored.
  • functional magnetic resonance imaging fMRI
  • One approach includes a task based technique wherein the fMRI may be used to detect correlations between brain activation and various tasks that a subject performs during a scan.
  • Such task-based techniques can be useful in clinical applications.
  • the images obtained through fMRI may enable a surgeon to identify portions of the brain that are responsible for various functions and the surgeon may attempt to avoid contact with such portions while performing surgery on the brain.
  • task-based neuroimaging may not be suitable for all segments of a clinical population. For example, a toddler or a nervous patient may be unable to comprehend and/or perform various tasks. It was recently discovered, via fMRI, that even during the absence of overt tasks, fluctuations in brain activity are correlated across functionally-related cortical regions. Thus, the spatial and temporal evaluations of spontaneous neuronal activity has allowed mapping of these resting-state networks (RSNs) with a task-less technique. For this technique, at least one voxel within the image obtained by the fMRI is selected and a correlation analysis is performed to identify other voxels that correspond with the selected voxel. However, it may be challenging to identify which voxel to select. For example, an individual would require a great deal of expertise and resources to select a relevant voxel. In fact, selecting a voxel and/or processing information to select a voxel can be time consuming.
  • RSNs resting-state networks
  • a computing device for use in a system for mapping brain activity of a subject generally comprises a processor.
  • the processor is programmed to select a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state.
  • the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject.
  • the processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point.
  • the processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map.
  • a system for mapping brain activity of a subject generally comprises a sensing system and a computing device that is coupled to the sensing system.
  • the sensing system is configured to detect a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state.
  • the computing device includes a communication interface that is configured to receive at least one signal representative of the measurements, and a processor that is coupled to the communication interface.
  • the processor is programmed to select the measurements of brain activity.
  • the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject.
  • the processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point.
  • the processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map.
  • a method for mapping brain activity of a patient generally comprises selecting, via a processor, a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state. At least one data point from each of the plurality of measurements is compared, via the processor, with a corresponding data point from a previously acquired data set from at least one other subject. At least one map is produced, via the processor, for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point. The brain activity is categorized, via the processor, in a plurality of networks in the brain based on the map.
  • FIG. 1 is a block diagram of an exemplary system for task-less mapping of brain activity
  • FIG. 2 is a block diagram of an exemplary computing device of the system shown in FIG. 1 ;
  • FIG. 3 is flow diagram of an exemplary method for task-less mapping of brain activity using the system shown in FIG. 1 ;
  • FIG. 4 is an image of seed ROIs for generation of correlation map data
  • FIG. 5 is a schematic of an exemplary standard multi-layer perceptron architecture and transfer function of the perceptron
  • FIG. 6 is a graph of a learning rate
  • FIG. 7 is a schematic of a voxel-wise classification
  • FIGS. 8A-8D are graphs depicting correlation maps
  • FIGS. 9A-9F are graphs depicting performance levels
  • FIG. 10 is a graph depicting search space for perceptron architecture
  • FIGS. 11A-11F are schematics of topographies in individual subjects
  • FIGS. 12A-12C are schematics of classification results
  • FIG. 13 is a scan of group averaged results
  • FIGS. 14A and 14B are graphs of exemplary evaluations
  • FIG. 15 is a scan of voxels
  • FIGS. 16A and 16B are scans of topography estimates.
  • the exemplary systems, apparatus, and methods described herein overcome at least some known disadvantages associated with at least some known brain mapping techniques, such as task-based and/or task-less systems. More specifically, the embodiments described herein include a computing device for use in a system for mapping brain activity of a subject that generally comprises a processor. The processor is programmed to select a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state. Moreover, the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject.
  • the processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point.
  • the processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map. By using previously acquired data points to categorize the brain activity in a plurality of networks in the brain of the subject, task-based techniques can be avoided. Moreover, by having the processor select the plurality of measurements, a user may no longer need to spend a considerable amount of time determining which measurements, such as voxels, to select.
  • FIG. 1 illustrates an exemplary system 100 for mapping brain activity of a subject (not shown).
  • brain activity includes the various activities within a brain of the subject that correspond to various tasks performed by the subject.
  • the brain transmits and receives signals in the form of hormones, nerve impulses, and chemical messengers that enable the subject to move, eat, sleep, and think.
  • system 100 is used to identify locations within a plurality of networks within the brain that are responsible for such brain activities.
  • system 100 includes a sensing system 102 that is configured to detect a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject during a resting state.
  • sensing system 102 is a magnetic resonance imaging device (MRI) that is configured to generate at least one spectroscopic signal representative of a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject during a resting state. More specifically, sensing system 102 may generate an altered magnetic field within the brain to measure various parameters of the brain.
  • MRI magnetic resonance imaging device
  • sensing system 102 may be a specialized MRI, such as a functional magnetic resonance imaging (fMRI) device that is used to measure a variation in blood flow (hemodynamic response) related to neural activity in the brain or spinal cord (not shown) of the subject.
  • sensing system 102 may be an electrocorticography device having at least one electrode (not shown) to measure at least one voltage fluctuation within the brain. It should be noted that the present disclosure is not limited to any one particular type of imaging and electrical technique or device, and one of ordinary skill in the art will appreciate that the current disclosure may be used in connection with any type of technique or device that enables system 100 to function as described herein.
  • system 100 also includes a computing device 104 coupled to sensing system 102 via a data conduit 106 .
  • the term “couple” is not limited to a direct mechanical, electrical, and/or communication connection between components, but may also include an indirect mechanical, electrical, and/or communication connection between multiple components.
  • Sensing system 102 may communicate with computing device 104 using a wired network connection (e.g., Ethernet or an optical fiber), a wireless communication means, such as radio frequency (RF), e.g., FM radio and/or digital audio broadcasting, an Institute of Electrical and Electronics Engineers (IEEE®) 802.11 standard (e.g., 802.11(g) or 802.11(n)), the Worldwide Interoperability for Microwave Access (WIMAX®) standard, a short-range wireless communication channel such as BLUETOOTH®, a cellular phone technology (e.g., the Global Standard for Mobile communication (GSM)), a satellite communication link, and/or any other suitable communication means.
  • RF radio frequency
  • IEEE® 802.11 standard e.g., 802.11(g) or 802.11(n)
  • WIMAX® Worldwide Interoperability for Microwave Access
  • BLUETOOTH® a short-range wireless communication channel
  • BLUETOOTH® a cellular phone technology
  • GSM
  • IEEE is a registered trademark of the Institute of Electrical and Electronics Engineers, Inc., of New York, N.Y.
  • WIMAX is a registered trademark of WiMax Forum, of Beaverton, Oreg.
  • BLUETOOTH is a registered trademark of Bluetooth SIG, Inc. of Kirkland, Wash.
  • computing device 104 is configured to receive at least one signal representative of a plurality of measurements of brain activity from sensing system 102 . More specifically, computing device 104 is configured to receive at least one signal representative of an altered magnetic field within the brain of the subject from sensing system 102 . Alternatively, computing device 104 may be configured to receive at least one signal representative of at least one voltage fluctuation within the brain from at least one electrode.
  • System 100 also includes a data management system 108 that is coupled to computing device 104 via a network 109 .
  • Data management system 108 may be any device capable of accessing network 109 including, without limitation, a desktop computer, a laptop computer, or other web-based connectable equipment.
  • data management system 108 includes a database 110 that includes previously acquired data of other subjects.
  • database 110 can be fully or partially implemented in a cloud computing environment such that data from the database is received from one or more computers (not shown) within system 100 or remote from system 100 .
  • the previously acquired data of the other subjects may include, for example, a plurality of measurements of brain activity that is representative of at least one parameter of a brain of each of the subjects during a resting state.
  • Database 110 can also include any additional information of each of the subjects that enables system 100 to function as described herein.
  • Data management system 108 may communicate with computing device 104 using a wired network connection (e.g., Ethernet or an optical fiber), a wireless communication means, such as, but not limited to radio frequency (RF), e.g., FM radio and/or digital audio broadcasting, an Institute of Electrical and Electronics Engineers (IEEE®) 802.11 standard (e.g., 802.11(g) or 802.11(n)), the Worldwide Interoperability for Microwave Access (WIMAX®) standard, a cellular phone technology (e.g., the Global Standard for Mobile communication (GSM)), a satellite communication link, and/or any other suitable communication means. More specifically, in the exemplary embodiment, data management system 108 transmits the data for the subjects to computing device 104 . While the data is shown as being stored in database 110 within data management system 108 , it should be noted that the data of the subjects may be stored in another system and/or device. For example, computing device 104 may store the data therein.
  • RF radio frequency
  • IEEE® Institute of Electrical
  • sensing system 102 uses a magnetic field to align the magnetization of some atoms in the brain of the subject and radio frequency fields to systematically alter the alignment of this magnetization. As such, rotating magnetic fields are produced and are detectable by a scanner (not shown) within sensing system 102 . More specifically, in the exemplary embodiment, sensing system 102 detects a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject during the resting state. Sensing system 102 also generates at least one spectroscopic signal representative of the plurality of measurements and transmits the signal(s) to computing device 104 via data conduit 106 .
  • computing device 104 produces at least one map, such as a functional connectivity map, for each of the measurements based on a comparison of at least one resting state data point of the subject and a corresponding data point from the previously acquired data set from at least one other subject.
  • computing device 104 uses the map to categorize or classify the brain activity in a plurality of networks in the brain.
  • FIG. 2 is a block diagram of computing device 104 .
  • computing device 104 includes a user interface 204 that receives at least one input from a user, such as an operator of sensing system 102 (shown in FIG. 1 ).
  • User interface 204 may include a keyboard 206 that enables the user to input pertinent information.
  • User interface 204 may also include, for example, a pointing device, a mouse, a stylus, a touch sensitive panel (e.g., a touch pad, a touch screen), a gyroscope, an accelerometer, a position detector, and/or an audio input interface (e.g., including a microphone).
  • a pointing device e.g., a mouse, a stylus, a touch sensitive panel (e.g., a touch pad, a touch screen), a gyroscope, an accelerometer, a position detector, and/or an audio input interface (e.g., including a microphone).
  • a touch sensitive panel
  • computing device 104 includes a presentation interface 207 that presents information, such as input events and/or validation results, to the user.
  • Presentation interface 207 may also include a display adapter 208 that is coupled to at least one display device 210 .
  • display device 210 may be a visual display device, such as a cathode ray tube (CRT), a liquid crystal display (LCD), an organic LED (OLED) display, and/or an “electronic ink” display.
  • presentation interface 207 may include an audio output device (e.g., an audio adapter and/or a speaker) and/or a printer.
  • Computing device 104 also includes a processor 214 and a memory device 218 .
  • Processor 214 is coupled to user interface 204 , presentation interface 207 , and to memory device 218 via a system bus 220 .
  • processor 214 communicates with the user, such as by prompting the user via presentation interface 207 and/or by receiving user inputs via user interface 204 .
  • the term “processor” refers generally to any programmable system including systems and microcontrollers, reduced instruction set circuits (RISC), application specific integrated circuits (ASIC), programmable logic circuits (PLC), and any other circuit or processor capable of executing the functions described herein.
  • RISC reduced instruction set circuits
  • ASIC application specific integrated circuits
  • PLC programmable logic circuits
  • memory device 218 includes one or more devices that enable information, such as executable instructions and/or other data, to be stored and retrieved.
  • memory device 218 includes one or more computer readable media, such as, without limitation, dynamic random access memory (DRAM), static random access memory (SRAM), a solid state disk, and/or a hard disk.
  • DRAM dynamic random access memory
  • SRAM static random access memory
  • solid state disk solid state disk
  • hard disk solid state disk
  • memory device 218 stores, without limitation, application source code, application object code, configuration data, additional input events, application states, assertion statements, validation results, and/or any other type of data.
  • Computing device 104 in the exemplary embodiment, may also include a communication interface 230 that is coupled to processor 214 via system bus 220 .
  • communication interface 230 is communicatively coupled to sensing system 102 and to data management system 108 (shown in FIG. 1 ).
  • processor 214 may be programmed by encoding an operation using one or more executable instructions and providing the executable instructions in memory device 218 .
  • processor 214 is programmed to select a plurality of measurements that are received from sensing system 102 of brain activity that is representative of at least one parameter of the brain of the subject during a resting state.
  • the plurality of measurements may include, for example, a plurality of voxels of at least one image of the subject's brain, wherein the image may be generated by processor 214 within computing device 104 .
  • the image may also be generated by an imaging device (not shown) that may be coupled to computing device 104 and sensing system 102 , wherein the imaging device may generate the image based on the data received from sensing system 102 and then the imaging device may transmit the image to computing device 104 for storage within memory device 218 .
  • the plurality of measurements may include any other type measurement of brain activity that enables system 100 to function as described herein.
  • Processor 214 may also be programmed to perform a correlation analysis. More specifically, in the exemplary embodiment, processor 214 may be programmed to compare at least one data point from each of the plurality of measurements with a corresponding data point from a previously acquired data set from at least one other subject. For example, processor 214 may be programmed to compare a resting state data point from each selected voxel from an image of the subject with a corresponding data point that is located within the same voxel of the previously acquired data set of the other subject. Processor 214 may also be programmed to produce at least one map (not shown in FIG. 2 ) of the brain of the subject, such as a functional connectivity map, for each of the plurality measurements.
  • processor 214 may also be programmed to produce at least one map (not shown in FIG. 2 ) of the brain of the subject, such as a functional connectivity map, for each of the plurality measurements.
  • the map is based on the comparison of the resting state data point and the corresponding previously acquired data point.
  • the map may illustrate the location within the brain of a measured brain activity.
  • Processor 214 may be programmed to produce the map by using the various compared data points in a known algorithm to calculate a plurality of outputs, such as, for example, at least one output vector.
  • a known algorithm to calculate a plurality of outputs, such as, for example, at least one output vector.
  • One algorithm that may be used is represented in Equation 1 below.
  • Equation 1 a and b represent activating function parameters.
  • the output represents a seven dimensional output vector and pinv represents a pseudo inverse function.
  • Processor 214 may also be programmed to categorize or classify the measured brain activity in a plurality of networks in the brain based on the map. For example, processor 214 may be programmed to categorize the measured brain activity to a particular neural network of the brain of the subject based on the location of the measured brain activity on the map of the subject's brain.
  • sensing system 102 detects a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject. Sensing system 102 transmits at least one signal representative of the measurements to computing device 104 via data conduit 106 . More specifically, the signals are transmitted to and received by communication interface 230 within computing device 104 . Communication interface 230 then transmits the signals to processor 214 for processing and/or to memory device 218 , wherein the data may be stored and transmitted to processor 214 at a later time. Processor 214 may generate an image of the plurality of measurements. Alternatively, sensing system 102 may transmit the signals to an imaging device (not shown), wherein an image of the measurements may be generated. The image may then be transmitted to computing device 104 , wherein the image is stored within memory device 218 and transmitted to processor 214 for processing.
  • data of other subjects may be transmitted to computing device 104 from database 110 (shown in FIG. 1 ) via network 109 (shown in FIG. 1 ). More specifically, the data may be received by communication interface 230 and then transmitted to processor 214 for processing and/or to memory device 218 , wherein the data may be stored and transmitted to processor 214 at a later time. Computing device 104 may obtain the data at any time during operation.
  • computing device 104 produces at least one map for each of the plurality of measurements received. More specifically, processor 214 first selects each of the plurality of measurements, received from sensing system 102 . For example, in the exemplary embodiment, processor 214 selects each of the voxels from the image. Alternatively, processor 214 may select any other types of measurements for brain activity that enables system 100 to function as described herein. Moreover, a user may see the image on the computing device 104 , via presentation interface 207 , and select the measurements, such as voxels, via user interface 204 .
  • processor 214 When each of the measurements has been selected, processor 214 then performs a correlation analysis. More specifically, processor 214 compares at least one data point from each of the selected measurements with a corresponding data point from a previously acquired data set from at least one other subject, wherein computing device 104 obtained the data set from database 110 . For example, processor 214 may compare at least one resting state data point from each selected voxel of the image of the subject with a data point that is located within the same voxel of the previously acquired data set of at least one other subject.
  • processor 214 When processor 214 has completed the correlation analysis, processor 214 then produces at least one map (not shown in FIG. 2 ) of the brain of the subject, such as a functional connectivity map, for each of the measurements. More specifically, processor 214 produces a map of the brain of the subject based on each of the comparisons of each of the resting state data points and the corresponding previously acquired data points. The map, for example, may illustrate the location within the brain of a measured brain activity. Processor 214 then categorizes or classifies the measured brain activity in a plurality of networks in the brain based on the map. For example, based on the location of the measured brain activity in the map, processor 214 categorizes the measured brain activity to a particular neural network of the brain of the subject. The map may be presented to the user via presentation interface 207 . Moreover, a textual representation and/or a graphical output for the various categorizations may also be presented to the user via presentation interface 207 .
  • FIG. 3 is flow diagram of an exemplary method 300 for task-less mapping of brain activity of a brain of a subject using system 100 (shown in FIG. 1 ).
  • a sensing system 102 (shown in FIG. 1 ) detects 302 a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject during a resting state.
  • Sensing system 102 transmits 304 at least one signal representative of the measurements to a computing device 104 (shown in FIGS. 1 and 2 ).
  • the signals are received 306 by a communication interface 230 (shown in FIG. 2 ).
  • the measurements are selected 308 by a processor 214 (shown in FIG. 2 ). At least one data point from each of the measurements is compared 310 with a corresponding data point from a previously acquired data set from at least one other subject.
  • At least one map for each of the measurements is produced 312 based on the comparison of the resting state data point and the corresponding previously acquired data point.
  • the brain activity is categorized 314 in a plurality of networks in the brain based on the map.
  • the map and/or an output for the categorization are displayed 316 to a user, via a presentation interface 207 (shown in FIG. 2 ).
  • perceptron training and testing used data sets previously acquired at the Neuroimaging Laboratories at the Washington University School of Medicine in St. Louis, Mo. All patients were young adults screened to exclude neurological impairment and psychotropic medications. Demographic information and acquisition parameters are given in Table 1 below.
  • Spurious variance was reduced by regression of nuisance waveforms derived from head motion correction and timeseries extracted from regions (of “non-interest”) in white matter and CSF.
  • Nuisance regressors included also the BOLD timeseries averaged over the brain, i.e., global signal regression (GSR).
  • GSR global signal regression
  • all computed correlations were effectively order 1 partial correlations controlling for variance shared across the brain.
  • GSR has been criticized on the grounds that it artificially generates anticorrelations.
  • GSR fits well as a step preceding principal component analysis because it generates approximately zero-centered correlation distributions.
  • GSR enhances the spatial specificity in subcortical seed regions and reduces structured noise.
  • the question of whether the left tail of a zero-centered correlation distribution (“anticorrelations”) is “false” or “tenuously interpretable” is irrelevant in the context of RSN classification.
  • Correlation maps were computed using standard seed-based procedures, i.e., by correlating the timeseries averaged over all voxels within the seed (generally, 5 mm spheres) against all other voxels, excluding the first 5 (pre-magnetization steady-state) frames of each fMRI run. Frame-censoring was employed with a threshold of 0.5% RMS frame-to-frame intensity change. Frame-censoring excluded 3.8 ⁇ 1.1% of all magnetization steady-state frames from the correlation mapping computations. Correlation maps were Fisher z-transformed prior to further analyses.
  • Cortical reconstruction and volume segmentation were performed using FreeSurfer. Adequate segmentation was verified by inspection of the FreeSurfer-generated results in each of the 21 training and 17 test datasets. Cortical and subcortical gray matter regions were selected from these segmentations, thresholded to obtain a conjunction of 30% of subjects, and then masked with an image of the average BOLD signal intensity across all subjects, thresholded at 80% of the mode value. This last step removes from consideration brain areas in which the BOLD signal is unreliable because of susceptibility artifacts. The resulting 30,981 voxels constituted the grey matter mask. This mask was applied to all correlation maps input to the classifier.
  • Task regions were generated by meta-analyses of task-fMRI studies.
  • Task-response foci were initially assigned to one of 10 functional networks in Table 2 below.
  • Each task fMRI study contributed a variable number of foci (Task ROIs column in Table 2).
  • Task foci were used as seeds to generate correlation maps in all 21 subjects in the training set. These maps then were entered into random effects analyses (against the null hypothesis of no correlation) to produce Gaussianized t-statistic (Z-score) images.
  • Z-score images representing seeds assigned to the same RSN were averaged. Additionally, a conjunction image representing at least 70% of random effects images for a given network (after thresholding at
  • Averaged Z-score images were masked to include only voxels contained in the conjunction. Peaks of the conjunction-masked average were selected as center coordinates for 6 mm spherical ROIs. Accordingly, the constraint employed was that all ROIs within a given network must be separated by at least 12 mm. This process resulted in a large set of ROIs that were operationally treated as provisional.
  • the provisional ROI set was iteratively refined by maximizing the spatial concordance between the correlation map obtained from each seed and the map obtained by pooling all seeds within the RSN to which the seed was assigned.
  • Pooled seed correlation maps were computed by averaging the time series across all seeds assigned to each RSN. The single seed and the pooled seed maps were averaged across subjects. RSN concordance was assessed as the spatial correlation between the (subject-averaged) single seed and the (subject-averaged) pooled seed maps. Seeds were considered outliers if their concordance estimate was less than 1.5 times the inter-quartile range below the median of all other seeds in the RSN.
  • Outlier seeds were reassigned to the RSN of greatest concordance, unless they were maximally concordant with the currently assigned RSN, in which case they were removed entirely. After reassignment and outlier rejection, new individual seed and pooled seed correlation maps were re-computed and the process was iterated. Convergence (no reassignments or outlier rejections) was achieved in 7 iterations. The cingulo-opercular (CO) network did not survive iterative refinement, and most seeds were reassigned to the ventral attention network or removed. Similarly, the auditory network was subsumed into the sensorimotor network and the originally distinct foveal and peripheral visual networks were combined into a single (VIS) network.
  • VIS single
  • Iterative refinement yielded 169 ROIs representing 7 RSNs with high intra- and low inter-network correlation, as shown in FIGS. 4 and 15 .
  • a nuisance category consisting of 6 ROIs in CSF spaces.
  • the latter enabled the classifier to separate correlation patterns representing CSF vs. true RSNs.
  • Computing correlation maps for each of the 175 seed regions in all 21 training subjects produced 3,675 images that were used as training data.
  • Each image in the training set was masked to include only grey matter voxels, producing a 3,675 ⁇ 30,981 matrix.
  • Each image was assigned to one RSN (see the description of iterative seed ROI refinement above and Table 2).
  • a multilayer perceptron was constructed to classify resting-state fMRI correlation maps into 7 canonical spatial patterns predefined as resting-state networks.
  • the core of the perceptron is an artificial neural network that includes an input, hidden, and output layer, each consisting of some number of nodes fully connecting to the next layer (all-to-all feed-forward). Training samples (correlation maps from a particular seed and subject) are passed into this feed-forward network and the output is compared to the correct RSN label, as specified in the fMRI task meta-analysis. The error in this comparison is used to update the connections, or weights, between layers to increase the performance of the classifier.
  • PCA principal component analysis
  • the input layer received the correlation map training data as vectors in PCA space (the value of a given correlation map projected along a particular PC).
  • the number of input nodes was a free parameter that depended on the number of PCs used to represent the data.
  • Each training example (a correlation map from a particular seed ROI/subject pair) was associated with a desired output value, d o (Eq. (7)), corresponding to the a priori RSN labels.
  • the goal of the training process is to compare the output to these desired values, thereby generating an error signal used to update connection weights.
  • the overall transfer function of the perceptron (Eq. (2)) corresponds to the detailed schematic of the propagation of inputs through the perceptron ( FIG. 5 , see legend for symbol definitions).
  • y o ⁇ o ( ⁇ h ⁇ ⁇ w h ⁇ ⁇ o ⁇ ( ⁇ ) ⁇ ⁇ h ( ⁇ i ⁇ ⁇ w i ⁇ ⁇ h ⁇ y i ) ) ( 2 )
  • the total input to each hidden node, v h is determined by the sum of all input nodes, weighted by the feed-forward connections (Eq. (3)). This sum is then transformed by the hidden layer activation function to compute the output value of the hidden layer node, y h (Eq. (4)).
  • v h ⁇ i ⁇ ⁇ w i ⁇ ⁇ h ⁇ y i ( 3 )
  • the output layer nodes operate in the same manner as hidden layer nodes (Eqs. (5) and (6)):
  • is the learning rate
  • y h is the value of hidden layer node h
  • ⁇ o is local error gradient at output node o.
  • the weights to the hidden layer from the input layer, w ih are adjusted according to Eq. (10).
  • w ih ( k+ 1) w ih ( k )+ ⁇ ( k ) ⁇ h ( k ) ⁇ y i ( k ) (10)
  • the local gradient at a hidden node, ⁇ h may be computed by back-propagation from the output layer.
  • the number of PCs sampled (N i ), and the number of nodes in the hidden layer (N h ) constitute hyper-parameters subject to optimization.
  • Overall RMS error was evaluated over a densely sampled N i ⁇ [5, 6600] ⁇ N h ⁇ [4, 5000] space.
  • a classifier was trained until test set error reached a minimum.
  • the architecture with the least error (minimum of eight repetitions for each coordinate) was selected ( FIG. 10 ).
  • the range sampled within x determined the amount of noise injected into the system, using values closer to zero over the course of cooling.
  • the maximum value of x was determined by the temperature, T, and the minimum value was determined so that the mean squared value of N was unity:
  • a correlation map was generated for every voxel in the brain and then classified using the trained and optimized perceptron. An overall schematic of this process is depicted in FIG. 10 .
  • a correlation map was produced for every point in the brain by correlating every voxel's BOLD time-course with every other voxel in the brain.
  • Each map was masked before classification to include only grey matter voxels producing a 65,549 (voxels within brain mask) ⁇ 30,981 (voxels within grey matter mask) element matrix ( FIG. 7 ).
  • FIG. 7 depicts only 7 output classes because one of the 8 outputs is a nuisance component used only in post-processing.
  • Classifier output values are approximately uniformly [0,1] distributed as a result of the logistic activation function on the output layer (Eq. (6)). Classifier values were then normalized within each voxel to sum to unity ( FIG. 7 ). This normalization penalized voxels that had high classification values for multiple networks. The presence of a CSF classification component further penalized RSN estimates in voxels exhibiting CSF-related correlation patterns. Within each network, classifier values were then converted back to an exactly uniform [0,1] distribution across voxels (rank-order transform). This transformation resulted in voxels ranked in membership for each network across the brain expressed as a percentile.
  • RSN topography estimates were projected to the cortical mid-thickness surface for each subject (after surface-registration across subjects). Averages were then computed across surface nodes. The standard deviation of classifier values was also calculated node-wise to illustrate regions of high variability. These group-level results were projected onto the group-average inflated surface. To visualize group level results in sub-cortical structures, classifier values were averaged voxel-wise across subjects. Group-average images were then re-sampled to 1 mm cubic voxels and overlaid on a co-registered MNI152 atlas target.
  • spatial correlation analysis ( FIG. 8B ) and principal component analysis ( FIG. 8C ) of the training data revealed distinct clustering corresponding to RSNs.
  • map-to-map spatial correlation matrix (averaged across subjects), training inputs showed high correlation with other inputs of the same RSN compared to inputs of other classes ( FIG. 8B ).
  • the map-to-map correlation matrix showed two major clusters, one corresponding to the DAN, VAN, VIS, and MOT networks, and the other corresponding to the FPC, LAN, and DMN networks. Projection of all 3,675 correlation maps into principal component space gave rise to partially overlapping clusters corresponding to 7 RSNs.
  • FIGS. 9A-9F shows the training performance for the perceptron optimized for overall performance (2500 input PCs, 22 hidden layer nodes).
  • the perceptron output node values represent an estimate of membership for each RSN.
  • the expectation value of all initial perceptron outputs is 0.5 ( FIGS. 9A-9C ) as the expected output value with zero-mean weights (v o ) is 0 (Eqs. (5) and (6)).
  • within-class output values increase towards unity (e.g., DMN output node values for DMN inputs, red traces in FIG. 9A ), while out-of-class output values decrease towards zero (DMN output value for non-DMN ROI-derived maps, all other traces in FIG. 9A ).
  • AUC Area under the ROC curve
  • Performance on the test data initially followed training performance until reaching a global maximum ( FIG. 9E ). This maximum occurred at varying iteration indices for different RSNs. Training beyond this point resulted in over-fitting, manifesting as decreasing test data performance despite increasing training performance. Inputs that were previously correctly classified in the test data became incorrectly classified ( FIGS. 9B and 9C ).
  • FIGS. 12A-12C addresses both the central tendency (top row) of each group as well as inter-subject variability (middle row). Average network topographies had higher values near locations of ROIs used to generate training maps. This is expected because voxels within ROIs are likely to have similar correlation maps to the ROI. High classification values (in the top 25%) were also found in contiguous regions not used to generate training data. For example, a lateral temporal region was classified as a fronto-parietal control region, and a dorsal pre-motor region was classified into the language network.
  • FIG. 13 Further evidence of external validity is shown in FIG. 13 .
  • thalamic voxels approximately corresponding to nucleus ventralis posterior were classified as SMN, substantially in agreement.
  • the present results exhibit a high degree of face validity with respect to the training data and previously reported RSN results ( FIGS. 11A-11F, 12A-12C, and 13 ).
  • components of the DMN used as seeds to generate the training data were classified as DMN in all subjects. This was true not only for easily classified networks (e.g., the DMN) but also for networks (e.g., VAN and LAN) that are inconsistently found by unsupervised procedures.
  • the results shown in FIGS. 11A-11F illustrate that the perceptron reliably classified RSNs in each test set individual (AUC>0.971), even in cases in which the RMS error was relatively high (>0.2).
  • FIGS. 11A-11F inter-individual differences were also evident ( FIGS. 11A-11F ). These differences systematically varied according to RSN and exhibited RSN-specific zones of high as well as low inter-individual variability ( FIGS. 12A-12C ). Easily classified voxels (i.e., with high classification values) generally showed the least inter-subject variability. Such regions, e.g., the posterior parietal component of the DMN ( FIGS. 12A-12C ), were surrounded by zones of high variability (e.g., ring around the angular gyms). The pre- and post-central gyri consistently showed high SMN classification values but were bordered by regions of high inter-subject SMN variability.
  • inter-subject variability was low also in areas with classification values near 0, particularly in areas typically anticorrelated with other networks (e.g., low DAN variance in the angular gyms, a component of the DMN; low DMN variance in MT+, a component of the DAN).
  • low DAN variance in the angular gyms a component of the DMN
  • low DMN variance in MT+ a component of the DAN
  • the fMRI data used in the present work were obtained in healthy, cooperative young adults. Hence, the fraction of frames excluded because of head motion was low (about 4%). The total quantity of fMRI data acquired in each individual was, by current standards, generous. However, fMRI data quantity clearly affects MLP performance (see 4.4.2 below and FIGS. 14A-14B ). Current results suggest that more data generally improves MLP performance. The impact of fMRI data quality and quantity on MLP performance in clinical applications remains to be determined. With regard to (ii), the observation of zones with high classifier values and low variance bordered by regions of high variance may reflect classification uncertainty in areas that truly represent more than one RSN, i.e., voxels with high participation coefficients.
  • inter-individual differences may truly reflect individual variability in RSN topography.
  • Previous work has demonstrated that inter-individual differences in task-evoked activity correspond to “transition zones” in resting state networks (e.g., the boundary between parietal DMN and DAN regions). These same regions appear in our inter-subject variance maps for both DMN and DAN ( FIGS. 12A-12C ).
  • areas of high RSN classification variability pre-frontal, parietal, lateral temporal
  • This correspondence may possibly be coincidental, but it is consistent with the hypothesis that later developing or evolutionarily more recent areas of the brain tend to be more variable across individuals.
  • the MLP also identified the parahippocampal gyms as DMN and a dorsal pre-motor region that has been associated with articulation of speech as LAN.
  • the right inferior cerebellum was first associated with language function by PET studies of semantic association tasks. Identification of this region here as part of the LAN network ( FIG. 13 , WTA, Z ⁇ 30) is doubly significant.
  • no cerebellar seeds were used to generate training data and, further, cerebellar voxels were excluded from the gray matter mask, hence, were not seen by the classifier.
  • Second, lateralized RSN components typically are not found by unsupervised seed-based correlation mapping.
  • the exemplary experiment, work demonstrates the potential of supervised classifiers to find networks that are subtle features of the BOLD correlation structure, possibly even minor sub-components within hierarchically organized RSNs, that nevertheless have high scientific and/or clinical value.
  • the LAN was specifically included here to meet the clinical imperative of localizing language function in the context of pre-operative neurosurgical planning.
  • the hierarchical scale of an RSN is reflected in training performance trajectories ( FIGS. 9E and F): in all (N i ⁇ N h ) architecture variants, the DMN was the first to be separated from other RSNs.
  • the DMN arguably is the most robust feature in the correlation structure of intrinsic brain activity. Its topography is very similar across RSN mapping strategies (specifically, spatial ICA and seed-based correlation mapping.
  • the DMN and regions anticorrelated with the DMN were well separated along the first principal component of the training data ( FIG. 6 ).
  • the sensorimotor and visual networks were next to achieve separation during classifier training. These networks are often seen at the next level down in the RSN hierarchy as offshoots of the anti-DMN or extrinsic system.
  • the dorsal attention network achieved only a small peak in error descent compared to other ‘extrinsic’ networks, though this occurred in close proximity (note overlap of DAN, MOT, VIS peaks in FIG. 9F ).
  • the LAN and VAN were last to achieve separation during training. This corresponds to the observation that LAN and VAN systems are typically found by analyses extending to lower levels of the RSN hierarchy.
  • the observer is a multi-layer perceptron and the task is to assign RSN labels to each voxel.
  • Performance is evaluated in terms of mean squared classification error and ROC analyses. It follows that MLP performance can be used to evaluate image quality across a wide range of variables, e.g., scanners, and acquisition parameters (e.g., TR, run length, resolution), preprocessing strategies (nuisance regression, filtering, spatial smoothing) and data representations (surface or volume based). This principle is demonstrated by systematically evaluating MLP performance in relation to quantity of fMRI data and seed ROI size.
  • FIG. 14A The relation between total quantity of fMRI data and MLP performance (test dataset RMS error) is shown in FIG. 14A .
  • the plotted points represent five replicate MLP training/test runs.
  • the parameterized function implies that classifier error monotonically decreases with increasing total fMRI data length but ultimately asymptotes at ⁇ 18% RMS (with 5 mm radius seeds and no simulated annealing).
  • the existence of this asymptote may indicate that resting-state brain networks are inherently non-separable in the sense of classification. This is consistent with the notion of “near decomposability” of hierarchical systems formed by multiple, sparsely inter-connected modules. This concept has since been extended to brain networks.
  • large seeds may compensate for mis-registration affine-coregistered, volume-preprocessed data.
  • Smaller seeds may be used in classifiers operating on non-linear, surface-coregistered, geodesically smoothed data.
  • the results shown in FIG. 14B reflect the effect of seed radius on the correlation maps used to train the MLP. It is formally possible for a corrupted training set to yield a better classifier as evaluated by test set classification error. Thus, the results shown in FIG. 14B should not be interpreted as unambiguously indicating that 10 mm radius seeds are optimal for correlation mapping.
  • the MLP RSN classifier operates at the voxel level via computed correlation maps. After training, it reliably identifies RSN topographies in individual subjects. Classification is rapid (2 minutes using Matlab running on Intel i7 processors) and automated, hence suitable for deployment in clinical environments. After training, classification is independent of any particular seed. Therefore, the trained MLP is expected to be robust to anatomical shifts and distortions, for example, owing to enlarged ventricles and mass effects or even loss of neural tissue (e.g., stroke).
  • the classifier was trained to operate in 3D image space for compatibility with clinical imaging formats.
  • the MLP concept can be readily adapted to operate on correlation maps represented on the cortical surface.
  • voxel-wise classifiers can be trained to classify subjects despite anatomical abnormalities (e.g., brain tumors) by altering the domain of the training set, i.e., excluding tumor voxels.
  • Another potentially useful MLP modification would be removal by regression of the relationship between correlation and distance to the seed. Such regression may decrease the reliance of the classifier on local connectivity, thereby reducing susceptibility to corruption by movement artifact.
  • the embodiments described herein enable a substantially efficient task-less system for brain mapping. More specifically, the embodiments described herein include a computing device for use in a system for mapping brain activity of a subject that generally comprises a processor.
  • the processor is programmed to select a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state.
  • the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject.
  • the processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point.
  • the processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map. By using previously acquired data points to categorize the brain activity in a plurality if networks in the brain of the subject, task-based techniques may be avoided. Moreover, by having the processor select the plurality of measurements, a user may no longer need to spend a considerable amount of time determining which measurements, such as voxels, to select.
  • system, apparatus, and method are described above in detail.
  • the system, apparatus, and method are not limited to the specific embodiments described herein, but rather, components of the system and apparatus, and/or steps of the methods may be utilized independently and separately from other components and/or steps described herein.
  • the system may also be used in combination with other apparatus, systems, and methods, and is not limited to practice with only the system as described herein. Rather, the exemplary embodiment can be implemented and utilized in connection with many other applications.
  • Embodiments of the invention may be described in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices.
  • the computer-executable instructions may be organized into one or more computer-executable components or modules.
  • program modules include, but are not limited to, routines, programs, objects, components, and data structures that perform particular tasks or implement particular abstract data types.
  • aspects of the invention may be implemented with any number and organization of such components or modules. For example, aspects of the invention are not limited to the specific computer-executable instructions or the specific components or modules illustrated in the figures and described herein.
  • Other embodiments of the invention may include different computer-executable instructions or components having more or less functionality than illustrated and described herein.
  • aspects of the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.
  • program modules may be located in both local and remote computer storage media including memory storage devices.
  • a computer executes computer-executable instructions embodied in one or more computer-executable components stored on one or more computer-readable media to implement aspects of the invention described and/or illustrated herein.

Abstract

A computing device for use in a system for mapping brain activity of a subject includes a processor. The processor is programmed to select a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state. Moreover, the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject. The processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point. The processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map.

Description

CROSS REFERENCE TO RELATED APPLICATION
This application claims priority to U.S. provisional application No. 61/558,751 filed Nov. 11, 2011, which is incorporated herein in its entirety.
BACKGROUND
The field of the invention relates generally to brain mapping systems and, more particularly, to systems and methods for task-less mapping of brain activity using resting state data collected from a brain of a subject.
Brain mapping includes a set of neuroscience techniques that are predicated on the mapping of biological quantities or properties onto spatial representations of a subject's brain resulting in at least one map. At least some known neuroimaging systems or techniques are used frequently in clinical and research settings for brain mapping such that brain function can be monitored. For example, functional magnetic resonance imaging (fMRI) may be used to enable researchers and clinicians to see visual images of the brain, wherein the images may be used to identify brain activity within a plurality of networks of the brain. One approach includes a task based technique wherein the fMRI may be used to detect correlations between brain activation and various tasks that a subject performs during a scan. Such task-based techniques can be useful in clinical applications. For example, the images obtained through fMRI may enable a surgeon to identify portions of the brain that are responsible for various functions and the surgeon may attempt to avoid contact with such portions while performing surgery on the brain.
However, task-based neuroimaging may not be suitable for all segments of a clinical population. For example, a toddler or a nervous patient may be unable to comprehend and/or perform various tasks. It was recently discovered, via fMRI, that even during the absence of overt tasks, fluctuations in brain activity are correlated across functionally-related cortical regions. Thus, the spatial and temporal evaluations of spontaneous neuronal activity has allowed mapping of these resting-state networks (RSNs) with a task-less technique. For this technique, at least one voxel within the image obtained by the fMRI is selected and a correlation analysis is performed to identify other voxels that correspond with the selected voxel. However, it may be challenging to identify which voxel to select. For example, an individual would require a great deal of expertise and resources to select a relevant voxel. In fact, selecting a voxel and/or processing information to select a voxel can be time consuming.
Accordingly, it is desirable to provide a system and method that can readily identify the voxels to select and, at substantially the same time, provide suitable results for accurate brain mapping.
BRIEF DESCRIPTION
In one aspect, a computing device for use in a system for mapping brain activity of a subject generally comprises a processor. The processor is programmed to select a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state. Moreover, the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject. The processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point. The processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map.
In another aspect, a system for mapping brain activity of a subject generally comprises a sensing system and a computing device that is coupled to the sensing system. The sensing system is configured to detect a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state. The computing device includes a communication interface that is configured to receive at least one signal representative of the measurements, and a processor that is coupled to the communication interface. The processor is programmed to select the measurements of brain activity. Moreover, the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject. The processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point. The processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map.
In yet another aspect, a method for mapping brain activity of a patient generally comprises selecting, via a processor, a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state. At least one data point from each of the plurality of measurements is compared, via the processor, with a corresponding data point from a previously acquired data set from at least one other subject. At least one map is produced, via the processor, for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point. The brain activity is categorized, via the processor, in a plurality of networks in the brain based on the map.
BRIEF DESCRIPTION OF THE DRAWINGS
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the U.S. Patent and Trademark Office upon request and payment of the necessary fee.
FIG. 1 is a block diagram of an exemplary system for task-less mapping of brain activity;
FIG. 2 is a block diagram of an exemplary computing device of the system shown in FIG. 1;
FIG. 3 is flow diagram of an exemplary method for task-less mapping of brain activity using the system shown in FIG. 1;
FIG. 4 is an image of seed ROIs for generation of correlation map data;
FIG. 5 is a schematic of an exemplary standard multi-layer perceptron architecture and transfer function of the perceptron;
FIG. 6 is a graph of a learning rate;
FIG. 7 is a schematic of a voxel-wise classification;
FIGS. 8A-8D are graphs depicting correlation maps;
FIGS. 9A-9F are graphs depicting performance levels;
FIG. 10 is a graph depicting search space for perceptron architecture;
FIGS. 11A-11F are schematics of topographies in individual subjects;
FIGS. 12A-12C are schematics of classification results;
FIG. 13 is a scan of group averaged results;
FIGS. 14A and 14B are graphs of exemplary evaluations;
FIG. 15 is a scan of voxels; and
FIGS. 16A and 16B are scans of topography estimates.
DETAILED DESCRIPTION OF THE DRAWINGS
The exemplary systems, apparatus, and methods described herein overcome at least some known disadvantages associated with at least some known brain mapping techniques, such as task-based and/or task-less systems. More specifically, the embodiments described herein include a computing device for use in a system for mapping brain activity of a subject that generally comprises a processor. The processor is programmed to select a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state. Moreover, the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject. The processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point. The processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map. By using previously acquired data points to categorize the brain activity in a plurality of networks in the brain of the subject, task-based techniques can be avoided. Moreover, by having the processor select the plurality of measurements, a user may no longer need to spend a considerable amount of time determining which measurements, such as voxels, to select.
FIG. 1 illustrates an exemplary system 100 for mapping brain activity of a subject (not shown). It should be noted that the term “brain activity” as used herein includes the various activities within a brain of the subject that correspond to various tasks performed by the subject. For example, the brain transmits and receives signals in the form of hormones, nerve impulses, and chemical messengers that enable the subject to move, eat, sleep, and think. In the exemplary embodiment, system 100 is used to identify locations within a plurality of networks within the brain that are responsible for such brain activities.
As seen in FIG. 1, system 100 includes a sensing system 102 that is configured to detect a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject during a resting state. In one suitable embodiment, sensing system 102 is a magnetic resonance imaging device (MRI) that is configured to generate at least one spectroscopic signal representative of a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject during a resting state. More specifically, sensing system 102 may generate an altered magnetic field within the brain to measure various parameters of the brain. In another suitable embodiment, sensing system 102 may be a specialized MRI, such as a functional magnetic resonance imaging (fMRI) device that is used to measure a variation in blood flow (hemodynamic response) related to neural activity in the brain or spinal cord (not shown) of the subject. In yet another suitable embodiment, sensing system 102 may be an electrocorticography device having at least one electrode (not shown) to measure at least one voltage fluctuation within the brain. It should be noted that the present disclosure is not limited to any one particular type of imaging and electrical technique or device, and one of ordinary skill in the art will appreciate that the current disclosure may be used in connection with any type of technique or device that enables system 100 to function as described herein.
In the exemplary embodiment, system 100 also includes a computing device 104 coupled to sensing system 102 via a data conduit 106. It should be noted that, as used herein, the term “couple” is not limited to a direct mechanical, electrical, and/or communication connection between components, but may also include an indirect mechanical, electrical, and/or communication connection between multiple components. Sensing system 102 may communicate with computing device 104 using a wired network connection (e.g., Ethernet or an optical fiber), a wireless communication means, such as radio frequency (RF), e.g., FM radio and/or digital audio broadcasting, an Institute of Electrical and Electronics Engineers (IEEE®) 802.11 standard (e.g., 802.11(g) or 802.11(n)), the Worldwide Interoperability for Microwave Access (WIMAX®) standard, a short-range wireless communication channel such as BLUETOOTH®, a cellular phone technology (e.g., the Global Standard for Mobile communication (GSM)), a satellite communication link, and/or any other suitable communication means. IEEE is a registered trademark of the Institute of Electrical and Electronics Engineers, Inc., of New York, N.Y. WIMAX is a registered trademark of WiMax Forum, of Beaverton, Oreg. BLUETOOTH is a registered trademark of Bluetooth SIG, Inc. of Kirkland, Wash.
In the exemplary embodiment, computing device 104 is configured to receive at least one signal representative of a plurality of measurements of brain activity from sensing system 102. More specifically, computing device 104 is configured to receive at least one signal representative of an altered magnetic field within the brain of the subject from sensing system 102. Alternatively, computing device 104 may be configured to receive at least one signal representative of at least one voltage fluctuation within the brain from at least one electrode.
System 100 also includes a data management system 108 that is coupled to computing device 104 via a network 109. Data management system 108 may be any device capable of accessing network 109 including, without limitation, a desktop computer, a laptop computer, or other web-based connectable equipment. More specifically, in the exemplary embodiment, data management system 108 includes a database 110 that includes previously acquired data of other subjects. In the exemplary embodiment, database 110 can be fully or partially implemented in a cloud computing environment such that data from the database is received from one or more computers (not shown) within system 100 or remote from system 100. In the exemplary embodiment, the previously acquired data of the other subjects may include, for example, a plurality of measurements of brain activity that is representative of at least one parameter of a brain of each of the subjects during a resting state. Database 110 can also include any additional information of each of the subjects that enables system 100 to function as described herein.
Data management system 108 may communicate with computing device 104 using a wired network connection (e.g., Ethernet or an optical fiber), a wireless communication means, such as, but not limited to radio frequency (RF), e.g., FM radio and/or digital audio broadcasting, an Institute of Electrical and Electronics Engineers (IEEE®) 802.11 standard (e.g., 802.11(g) or 802.11(n)), the Worldwide Interoperability for Microwave Access (WIMAX®) standard, a cellular phone technology (e.g., the Global Standard for Mobile communication (GSM)), a satellite communication link, and/or any other suitable communication means. More specifically, in the exemplary embodiment, data management system 108 transmits the data for the subjects to computing device 104. While the data is shown as being stored in database 110 within data management system 108, it should be noted that the data of the subjects may be stored in another system and/or device. For example, computing device 104 may store the data therein.
During operation, while the subject is in a resting state, sensing system 102 uses a magnetic field to align the magnetization of some atoms in the brain of the subject and radio frequency fields to systematically alter the alignment of this magnetization. As such, rotating magnetic fields are produced and are detectable by a scanner (not shown) within sensing system 102. More specifically, in the exemplary embodiment, sensing system 102 detects a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject during the resting state. Sensing system 102 also generates at least one spectroscopic signal representative of the plurality of measurements and transmits the signal(s) to computing device 104 via data conduit 106. Moreover, data of other subjects may be transmitted to computing device 104 from database 110 via network 109. As explained in more detail below, computing device 104 produces at least one map, such as a functional connectivity map, for each of the measurements based on a comparison of at least one resting state data point of the subject and a corresponding data point from the previously acquired data set from at least one other subject. Computing device 104 uses the map to categorize or classify the brain activity in a plurality of networks in the brain.
FIG. 2 is a block diagram of computing device 104. In the exemplary embodiment, computing device 104 includes a user interface 204 that receives at least one input from a user, such as an operator of sensing system 102 (shown in FIG. 1). User interface 204 may include a keyboard 206 that enables the user to input pertinent information. User interface 204 may also include, for example, a pointing device, a mouse, a stylus, a touch sensitive panel (e.g., a touch pad, a touch screen), a gyroscope, an accelerometer, a position detector, and/or an audio input interface (e.g., including a microphone).
Moreover, in the exemplary embodiment, computing device 104 includes a presentation interface 207 that presents information, such as input events and/or validation results, to the user. Presentation interface 207 may also include a display adapter 208 that is coupled to at least one display device 210. More specifically, in the exemplary embodiment, display device 210 may be a visual display device, such as a cathode ray tube (CRT), a liquid crystal display (LCD), an organic LED (OLED) display, and/or an “electronic ink” display. Alternatively, presentation interface 207 may include an audio output device (e.g., an audio adapter and/or a speaker) and/or a printer.
Computing device 104 also includes a processor 214 and a memory device 218. Processor 214 is coupled to user interface 204, presentation interface 207, and to memory device 218 via a system bus 220. In the exemplary embodiment, processor 214 communicates with the user, such as by prompting the user via presentation interface 207 and/or by receiving user inputs via user interface 204. The term “processor” refers generally to any programmable system including systems and microcontrollers, reduced instruction set circuits (RISC), application specific integrated circuits (ASIC), programmable logic circuits (PLC), and any other circuit or processor capable of executing the functions described herein. The above examples are exemplary only, and thus are not intended to limit in any way the definition and/or meaning of the term “processor.”
In the exemplary embodiment, memory device 218 includes one or more devices that enable information, such as executable instructions and/or other data, to be stored and retrieved. Moreover, memory device 218 includes one or more computer readable media, such as, without limitation, dynamic random access memory (DRAM), static random access memory (SRAM), a solid state disk, and/or a hard disk. In the exemplary embodiment, memory device 218 stores, without limitation, application source code, application object code, configuration data, additional input events, application states, assertion statements, validation results, and/or any other type of data. Computing device 104, in the exemplary embodiment, may also include a communication interface 230 that is coupled to processor 214 via system bus 220. Moreover, communication interface 230 is communicatively coupled to sensing system 102 and to data management system 108 (shown in FIG. 1).
In the exemplary embodiment, processor 214 may be programmed by encoding an operation using one or more executable instructions and providing the executable instructions in memory device 218. In the exemplary embodiment, processor 214 is programmed to select a plurality of measurements that are received from sensing system 102 of brain activity that is representative of at least one parameter of the brain of the subject during a resting state. The plurality of measurements may include, for example, a plurality of voxels of at least one image of the subject's brain, wherein the image may be generated by processor 214 within computing device 104. The image may also be generated by an imaging device (not shown) that may be coupled to computing device 104 and sensing system 102, wherein the imaging device may generate the image based on the data received from sensing system 102 and then the imaging device may transmit the image to computing device 104 for storage within memory device 218. Alternatively, the plurality of measurements may include any other type measurement of brain activity that enables system 100 to function as described herein.
Processor 214 may also be programmed to perform a correlation analysis. More specifically, in the exemplary embodiment, processor 214 may be programmed to compare at least one data point from each of the plurality of measurements with a corresponding data point from a previously acquired data set from at least one other subject. For example, processor 214 may be programmed to compare a resting state data point from each selected voxel from an image of the subject with a corresponding data point that is located within the same voxel of the previously acquired data set of the other subject. Processor 214 may also be programmed to produce at least one map (not shown in FIG. 2) of the brain of the subject, such as a functional connectivity map, for each of the plurality measurements. The map is based on the comparison of the resting state data point and the corresponding previously acquired data point. The map, for example, may illustrate the location within the brain of a measured brain activity. Processor 214 may be programmed to produce the map by using the various compared data points in a known algorithm to calculate a plurality of outputs, such as, for example, at least one output vector. One algorithm that may be used is represented in Equation 1 below.
input 1 = tanh - 1 ( [ ln ( 1 / output - 1 ) - a ] · pinv ( Weights hidden - output ) a ) · pinv ( Weights input - hidden ) b ( Eq . 1 )
In Equation 1, a and b represent activating function parameters. The output represents a seven dimensional output vector and pinv represents a pseudo inverse function.
Processor 214 may also be programmed to categorize or classify the measured brain activity in a plurality of networks in the brain based on the map. For example, processor 214 may be programmed to categorize the measured brain activity to a particular neural network of the brain of the subject based on the location of the measured brain activity on the map of the subject's brain.
During operation, as the subject is in a resting state, sensing system 102 detects a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject. Sensing system 102 transmits at least one signal representative of the measurements to computing device 104 via data conduit 106. More specifically, the signals are transmitted to and received by communication interface 230 within computing device 104. Communication interface 230 then transmits the signals to processor 214 for processing and/or to memory device 218, wherein the data may be stored and transmitted to processor 214 at a later time. Processor 214 may generate an image of the plurality of measurements. Alternatively, sensing system 102 may transmit the signals to an imaging device (not shown), wherein an image of the measurements may be generated. The image may then be transmitted to computing device 104, wherein the image is stored within memory device 218 and transmitted to processor 214 for processing.
Moreover, data of other subjects may be transmitted to computing device 104 from database 110 (shown in FIG. 1) via network 109 (shown in FIG. 1). More specifically, the data may be received by communication interface 230 and then transmitted to processor 214 for processing and/or to memory device 218, wherein the data may be stored and transmitted to processor 214 at a later time. Computing device 104 may obtain the data at any time during operation.
In the exemplary embodiment, computing device 104 produces at least one map for each of the plurality of measurements received. More specifically, processor 214 first selects each of the plurality of measurements, received from sensing system 102. For example, in the exemplary embodiment, processor 214 selects each of the voxels from the image. Alternatively, processor 214 may select any other types of measurements for brain activity that enables system 100 to function as described herein. Moreover, a user may see the image on the computing device 104, via presentation interface 207, and select the measurements, such as voxels, via user interface 204.
When each of the measurements has been selected, processor 214 then performs a correlation analysis. More specifically, processor 214 compares at least one data point from each of the selected measurements with a corresponding data point from a previously acquired data set from at least one other subject, wherein computing device 104 obtained the data set from database 110. For example, processor 214 may compare at least one resting state data point from each selected voxel of the image of the subject with a data point that is located within the same voxel of the previously acquired data set of at least one other subject.
When processor 214 has completed the correlation analysis, processor 214 then produces at least one map (not shown in FIG. 2) of the brain of the subject, such as a functional connectivity map, for each of the measurements. More specifically, processor 214 produces a map of the brain of the subject based on each of the comparisons of each of the resting state data points and the corresponding previously acquired data points. The map, for example, may illustrate the location within the brain of a measured brain activity. Processor 214 then categorizes or classifies the measured brain activity in a plurality of networks in the brain based on the map. For example, based on the location of the measured brain activity in the map, processor 214 categorizes the measured brain activity to a particular neural network of the brain of the subject. The map may be presented to the user via presentation interface 207. Moreover, a textual representation and/or a graphical output for the various categorizations may also be presented to the user via presentation interface 207.
FIG. 3 is flow diagram of an exemplary method 300 for task-less mapping of brain activity of a brain of a subject using system 100 (shown in FIG. 1). A sensing system 102 (shown in FIG. 1) detects 302 a plurality of measurements of brain activity that is representative of at least one parameter of the brain of the subject during a resting state. Sensing system 102 transmits 304 at least one signal representative of the measurements to a computing device 104 (shown in FIGS. 1 and 2). The signals are received 306 by a communication interface 230 (shown in FIG. 2). The measurements are selected 308 by a processor 214 (shown in FIG. 2). At least one data point from each of the measurements is compared 310 with a corresponding data point from a previously acquired data set from at least one other subject.
At least one map for each of the measurements is produced 312 based on the comparison of the resting state data point and the corresponding previously acquired data point. The brain activity is categorized 314 in a plurality of networks in the brain based on the map. The map and/or an output for the categorization are displayed 316 to a user, via a presentation interface 207 (shown in FIG. 2).
The embodiments of the system and method for task-less mapping of brain activity using resting state data of a brain of a subject, as described herein, were used in the following exemplary experiment.
Experiment
In the exemplary experiment, perceptron training and testing used data sets previously acquired at the Neuroimaging Laboratories at the Washington University School of Medicine in St. Louis, Mo. All patients were young adults screened to exclude neurological impairment and psychotropic medications. Demographic information and acquisition parameters are given in Table 1 below.
TABLE 1
Characteristics of the training test and validation data sets.
Dataset Training Optimization (Test) Validation
Number of 21 (7M + 14 F) 17 (8M + 9F) 10 (4M + 6F)
Subjects
Age 27.6 (23-35) years 23.1 (18-27) years 23.3 ± 3 years
Number of 128 × 6 runs 194 × 4 runs 100 × 9 runs
frames
TR (s) 2.16 2.16 3.03*
*The TR in the validation data set includes a one second pause between frames to accommodate simultaneous EEG recording.
In the exemplary experiment, all imaging was performed with a 3T Allegra scanner. Functional images were acquired using a BOLD contrast sensitive gradient echo echo-planar sequence [FOV=256 mm, flip angle=90°, 4 mm3 voxels, other parameters listed in Table 1] during which subjects were instructed to fixate on a visual cross-hair, remain still, and not fall asleep. Anatomical imaging included one sagittal T1-weighted magnetization prepared rapid gradient echo (MP-RAGE) scan (T1W) and one T2-weighted scan (T2W).
Initial fMRI preprocessing followed conventional practice known in the art. This included compensation for slice-dependent time shifts, elimination of systematic odd-even slice intensity differences due to interleaved acquisition, and rigid body correction for head movement within and across runs. Atlas transformation was achieved by composition of affine transforms connecting the fMRI volumes with the T2W and T1W structural images. Head movement correction was included with the atlas transformation in a single resampling that generated volumetric time series in 3 mm3 atlas space. Additional preprocessing in preparation for correlation mapping included spatial smoothing (6 mm FWHM Gaussian blur in each direction), voxel-wise removal of linear trends over each fMRI run, and temporal low-pass filtering retaining frequencies below 0.1 Hz.
Spurious variance was reduced by regression of nuisance waveforms derived from head motion correction and timeseries extracted from regions (of “non-interest”) in white matter and CSF. Nuisance regressors included also the BOLD timeseries averaged over the brain, i.e., global signal regression (GSR). Thus, all computed correlations were effectively order 1 partial correlations controlling for variance shared across the brain. GSR has been criticized on the grounds that it artificially generates anticorrelations. However, GSR fits well as a step preceding principal component analysis because it generates approximately zero-centered correlation distributions. As well, GSR enhances the spatial specificity in subcortical seed regions and reduces structured noise. The question of whether the left tail of a zero-centered correlation distribution (“anticorrelations”) is “false” or “tenuously interpretable” is irrelevant in the context of RSN classification.
Correlation maps were computed using standard seed-based procedures, i.e., by correlating the timeseries averaged over all voxels within the seed (generally, 5 mm spheres) against all other voxels, excluding the first 5 (pre-magnetization steady-state) frames of each fMRI run. Frame-censoring was employed with a threshold of 0.5% RMS frame-to-frame intensity change. Frame-censoring excluded 3.8±1.1% of all magnetization steady-state frames from the correlation mapping computations. Correlation maps were Fisher z-transformed prior to further analyses.
In the exemplary embodiment, Cortical reconstruction and volume segmentation were performed using FreeSurfer. Adequate segmentation was verified by inspection of the FreeSurfer-generated results in each of the 21 training and 17 test datasets. Cortical and subcortical gray matter regions were selected from these segmentations, thresholded to obtain a conjunction of 30% of subjects, and then masked with an image of the average BOLD signal intensity across all subjects, thresholded at 80% of the mode value. This last step removes from consideration brain areas in which the BOLD signal is unreliable because of susceptibility artifacts. The resulting 30,981 voxels constituted the grey matter mask. This mask was applied to all correlation maps input to the classifier. Individual surfaces were deformed to a common space, producing consistent assignment of surface vertex indices with respect to gyral features across subjects. Final volumetric results for each subject were sampled onto surface vertices by cubic spline interpolation onto mid-thickness cortical surface coordinates.
Seed regions were generated by meta-analyses of task-fMRI studies. Task-response foci were initially assigned to one of 10 functional networks in Table 2 below. Each task fMRI study contributed a variable number of foci (Task ROIs column in Table 2). Task foci were used as seeds to generate correlation maps in all 21 subjects in the training set. These maps then were entered into random effects analyses (against the null hypothesis of no correlation) to produce Gaussianized t-statistic (Z-score) images. Z-score images representing seeds assigned to the same RSN were averaged. Additionally, a conjunction image representing at least 70% of random effects images for a given network (after thresholding at |Z|>3) was produced. Averaged Z-score images were masked to include only voxels contained in the conjunction. Peaks of the conjunction-masked average were selected as center coordinates for 6 mm spherical ROIs. Accordingly, the constraint employed was that all ROIs within a given network must be separated by at least 12 mm. This process resulted in a large set of ROIs that were operationally treated as provisional.
TABLE 2
Studies of functional co-activation used to generate seed ROIs.
Provisional Final
Task Task seed seed
RSN paradigm fMRI contrast ROIs ROIs ROIs
DAN
1. Rapid Serial 1. Cue Type × 10  28 28
Visual event time
Presentation
2. Cue location ×
(RSVP) cue type ×
2. Rapid Serial event time
Visual
3. Event time
Presentation
(RSVP)
3. Posner
Cueing Task
VAN Posner Cueing Invalid vs. 2 19 15
Task Valid
CO* Mixed design Graph N/A 7
(10 different theoretic
tasks) analysis*
SMN Posner Cueing Target Period 11  37 39
Task
AN Various Stimulation vs. 2 12
auditory stimuli control
VIS Visual Peripheral 8 19 30
Localizer Foveal 2 12
FPC* Mixed design Graph N/A 11 12
(10 different theoretic
tasks) analysis*
LAN Perceptual vs. Sentence 13  17 13
Episodic Reading
Memory
Search
Paradigm
DMN Perceptual vs. Memory 4 42 32
Episodic Retrieval
Memory
Search
Paradigm
*Regions reported were themselves the result of a meta-analysis followed by refinement. Hence, these seeds were directly used as provisional ROIs.
In the exemplary embodiment, the provisional ROI set was iteratively refined by maximizing the spatial concordance between the correlation map obtained from each seed and the map obtained by pooling all seeds within the RSN to which the seed was assigned. Pooled seed correlation maps were computed by averaging the time series across all seeds assigned to each RSN. The single seed and the pooled seed maps were averaged across subjects. RSN concordance was assessed as the spatial correlation between the (subject-averaged) single seed and the (subject-averaged) pooled seed maps. Seeds were considered outliers if their concordance estimate was less than 1.5 times the inter-quartile range below the median of all other seeds in the RSN. Outlier seeds were reassigned to the RSN of greatest concordance, unless they were maximally concordant with the currently assigned RSN, in which case they were removed entirely. After reassignment and outlier rejection, new individual seed and pooled seed correlation maps were re-computed and the process was iterated. Convergence (no reassignments or outlier rejections) was achieved in 7 iterations. The cingulo-opercular (CO) network did not survive iterative refinement, and most seeds were reassigned to the ventral attention network or removed. Similarly, the auditory network was subsumed into the sensorimotor network and the originally distinct foveal and peripheral visual networks were combined into a single (VIS) network.
Iterative refinement yielded 169 ROIs representing 7 RSNs with high intra- and low inter-network correlation, as shown in FIGS. 4 and 15. To these were added a nuisance category consisting of 6 ROIs in CSF spaces. The latter enabled the classifier to separate correlation patterns representing CSF vs. true RSNs. Computing correlation maps for each of the 175 seed regions in all 21 training subjects produced 3,675 images that were used as training data. Each image in the training set was masked to include only grey matter voxels, producing a 3,675×30,981 matrix. Similarly, 17·517=2,975 images were computed in the test data set. Each image was assigned to one RSN (see the description of iterative seed ROI refinement above and Table 2).
A multilayer perceptron was constructed to classify resting-state fMRI correlation maps into 7 canonical spatial patterns predefined as resting-state networks. The core of the perceptron is an artificial neural network that includes an input, hidden, and output layer, each consisting of some number of nodes fully connecting to the next layer (all-to-all feed-forward). Training samples (correlation maps from a particular seed and subject) are passed into this feed-forward network and the output is compared to the correct RSN label, as specified in the fMRI task meta-analysis. The error in this comparison is used to update the connections, or weights, between layers to increase the performance of the classifier.
As an initial pre-processing step, the dimensionality of the input data was reduced by using principal component analysis (PCA). Representing correlation maps in terms of eigenvectors provides efficient computation, well-conditioned weight matrices, and a free parameter to represent the complexity of the input data (number of PCs). PCA was performed on the matrix of masked correlation images (21 subjects×175 seeds=3,675 images×30,981 voxels for PCA). Each correlation map in the training (3,675 images) and the test (2,975 images) data sets were then represented using a variable number of principal components (PCs).
The input layer received the correlation map training data as vectors in PCA space (the value of a given correlation map projected along a particular PC). Thus, the number of input nodes was a free parameter that depended on the number of PCs used to represent the data. Each training example (a correlation map from a particular seed ROI/subject pair) was associated with a desired output value, do (Eq. (7)), corresponding to the a priori RSN labels. The goal of the training process is to compare the output to these desired values, thereby generating an error signal used to update connection weights. The overall transfer function of the perceptron (Eq. (2)) corresponds to the detailed schematic of the propagation of inputs through the perceptron (FIG. 5, see legend for symbol definitions).
y o = φ o ( h w h o ( η ) · φ h ( i w i h · y i ) ) ( 2 )
The total input to each hidden node, vh, is determined by the sum of all input nodes, weighted by the feed-forward connections (Eq. (3)). This sum is then transformed by the hidden layer activation function to compute the output value of the hidden layer node, yh (Eq. (4)).
v h = i w i h · y i ( 3 ) y h = φ h ( v h ) = a · tanh ( b · v h ) ( 4 )
The output layer nodes operate in the same manner as hidden layer nodes (Eqs. (5) and (6)):
v o ( n ) = i w h o ( n ) · y h ( n ) ( 5 ) y o = φ o ( v o ) = 1 1 + - α · v o ( 6 )
The After propagation of the input data through the perceptron, the output value for each node, yo, was compared to the desired value, do, to find the error, eo (Eq. (7)).
e o(k)=d o(k)−y o(k)  (7)
The local gradient of the error at an output node is found by the product of this error and the inverse of the activating function applied to the output value:
δo =e o·φ′o(v o)  (8)
where the prime notation indicates the first derivative. After every iteration (n), the weights for the hidden to output layer connections were adjusted in the direction opposite of the gradient of the error:
w ho(k+1)=w ho(k)+η(k)·δo(ky h(k)  (9)
where η is the learning rate, yh is the value of hidden layer node h, and δo is local error gradient at output node o. Similarly, the weights to the hidden layer from the input layer, wih, are adjusted according to Eq. (10).
w ih(k+1)=w ih(k)+η(k)·δh(ky i(k)  (10)
The local gradient at a hidden node, δh, may be computed by back-propagation from the output layer.
δ h = - E γ h = φ h ( v h ) · o δ o · w h o ( 11 )
The learning rate parameter, η, was set empirically. A range of stable values was determined for a constant η, where instability was noted as divergence or rapid oscillation of classifier weights. The present results were obtained using an adaptive learning rate that increased as a sigmoid in log iteration index (FIG. 6). The initial learning rate was small (η(0)=A=5·10−4) to allow the classifier to begin a gentle descent in error gradient towards a stable solution. The learning rate increased exponentially (B=−3, Q=0.5), until saturating at an empirically determined upper limit of stability to (η(∞)=2·10−3).
Separation of classes was quantified using receiver operator characteristic analysis. Across a range of thresholds, the proportion of within-class output values above the threshold (true positive fraction, TPF) were compared to the number of out-of-class values above the threshold (false positive fraction, FPF). The TPF as a function of FPF defines the ROC curve. The area under the ROC curve (AUC) was used as a summary statistic of classification performance for each RSN class.
At logarithmically spaced intervals during the training process, training was paused and AUCs were calculated in a separate test data set. This procedure produced training trajectories indicating the relative performance for each RSN (FIG. 9D) throughout the training process. Peak performance for a given RSN was defined at the iteration producing the maximum AUC value in the test data (FIG. 9D). Overall performance was calculated as the average of AUC values across networks (FIG. 9D).
In the exemplary embodiment, the number of PCs sampled (Ni), and the number of nodes in the hidden layer (Nh) constitute hyper-parameters subject to optimization. Overall RMS error was evaluated over a densely sampled Niε[5, 6600]×Nhε[4, 5000] space. For each (Ni, Nh) coordinate, a classifier was trained until test set error reached a minimum. The architecture with the least error (minimum of eight repetitions for each coordinate) was selected (FIG. 10).
After identifying the architecture with least error in the test data set, performance was further optimized by simulated annealing, countering the tendency of perceptrons to become trapped in local minima Mimicking the random movement of atoms aligning in cooling metal, simulated annealing uses random perturbations of model parameters to find the global extremum in an objective function. Perturbations of steadily decreasing size (specified by a ‘cooling profile’) are guaranteed to find a global minimum with slow enough cooling, although, in practice, the necessary cooling profile is prohibitively slow. After training the perceptron until a minimum in RMS test set error, every weight, {wih} and {who}, was multiplied by a random coefficient. Training was then resumed to find a new minimum. If lower error was achieved, the new weights were accepted. This process was then repeated.
The value for each weight was determined by first sampling from a uniform distribution, xε[−1, 1], transformed by a hyperbolic function, N=(1−x)/(1+x). Thus each weight was multiplied by Nε[0,∞], and was thus unchanged when x=0. The range sampled within x determined the amount of noise injected into the system, using values closer to zero over the course of cooling. The maximum value of x was determined by the temperature, T, and the minimum value was determined so that the mean squared value of N was unity:
1 T - a a T ( x - 1 x + 1 ) 2 x = 1 ( 12 )
This choice of noise ensured that the sum of squares of the connection weights was unaltered by perturbation and that most weights were decreased, while a small selection was sporadically increased. A geometric cooling function (Eq. (13)) was used, which decreased over K1 perturbation epochs; this entire annealing process was repeated K2 times, each time with a slightly cooler temperature profile.
T k 1 ,k 2 =T 0 ·r (k 1 +3k 2 )  (13)
The following parameters were used: r=0.95, T0=0.4, K1=40, K2=20. To map RSNs in individual subjects, a correlation map was generated for every voxel in the brain and then classified using the trained and optimized perceptron. An overall schematic of this process is depicted in FIG. 10. A correlation map was produced for every point in the brain by correlating every voxel's BOLD time-course with every other voxel in the brain. Each map was masked before classification to include only grey matter voxels producing a 65,549 (voxels within brain mask)×30,981 (voxels within grey matter mask) element matrix (FIG. 7). This data was then projected onto the eigenvectors of the training data, reducing the dimensionality to 65,549×2500 (FIG. 7). Thus, all correlation maps were represented in the same input data space for classifier training and testing. The reduced whole-brain connectivity data was then propagated through the perceptron, with the first layer reducing the data to 22 features (65,549×22; FIG. 7), and the second layer producing RSN estimates (65,549×8, FIG. 7). However, FIG. 7 depicts only 7 output classes because one of the 8 outputs is a nuisance component used only in post-processing.
Classifier output values are approximately uniformly [0,1] distributed as a result of the logistic activation function on the output layer (Eq. (6)). Classifier values were then normalized within each voxel to sum to unity (FIG. 7). This normalization penalized voxels that had high classification values for multiple networks. The presence of a CSF classification component further penalized RSN estimates in voxels exhibiting CSF-related correlation patterns. Within each network, classifier values were then converted back to an exactly uniform [0,1] distribution across voxels (rank-order transform). This transformation resulted in voxels ranked in membership for each network across the brain expressed as a percentile.
To visualize group level results on the cortical surface, RSN topography estimates were projected to the cortical mid-thickness surface for each subject (after surface-registration across subjects). Averages were then computed across surface nodes. The standard deviation of classifier values was also calculated node-wise to illustrate regions of high variability. These group-level results were projected onto the group-average inflated surface. To visualize group level results in sub-cortical structures, classifier values were averaged voxel-wise across subjects. Group-average images were then re-sampled to 1 mm cubic voxels and overlaid on a co-registered MNI152 atlas target.
In the exemplary embodiment, spatial correlation analysis (FIG. 8B) and principal component analysis (FIG. 8C) of the training data (the correlation maps produced for each seed ROI) revealed distinct clustering corresponding to RSNs. In the map-to-map spatial correlation matrix (averaged across subjects), training inputs showed high correlation with other inputs of the same RSN compared to inputs of other classes (FIG. 8B). Additionally, the map-to-map correlation matrix showed two major clusters, one corresponding to the DAN, VAN, VIS, and MOT networks, and the other corresponding to the FPC, LAN, and DMN networks. Projection of all 3,675 correlation maps into principal component space gave rise to partially overlapping clusters corresponding to 7 RSNs. In the PC1×PC2 plane (FIG. 6), DAN (purple) and DMN (red) showed little overlap and appeared at opposite ends of the PC1 axis. MOT (light blue) and VIS (green) clusters were highly overlapping in this plane, but showed little overlap in the PC3×PC4 plane.
FIGS. 9A-9F shows the training performance for the perceptron optimized for overall performance (2500 input PCs, 22 hidden layer nodes). For every correlation map, the perceptron output node values represent an estimate of membership for each RSN. The expectation value of all initial perceptron outputs is 0.5 (FIGS. 9A-9C) as the expected output value with zero-mean weights (vo) is 0 (Eqs. (5) and (6)). As training progresses, within-class output values increase towards unity (e.g., DMN output node values for DMN inputs, red traces in FIG. 9A), while out-of-class output values decrease towards zero (DMN output value for non-DMN ROI-derived maps, all other traces in FIG. 9A).
Area under the ROC curve (AUC) trajectories are shown in FIG. 9D. This quantity, averaged across RSN classes, began near chance (0.65 after one iteration) and rose in later iterations. For all networks, the AUC exhibited a transient decrement in performance early in training. This feature corresponded to transient changes of slope in RMS error but did not produce concavity (local minima) in RMS error (FIG. 9E). Class separation was achieved at varying numbers of iterations for different RSNs. Across all perceptron architectures, the default mode network (red trace) always achieved asymptotic performance earliest, and the language network (orange) latest. Asymptotic performance for CSF classification occurred much later than any true RSN. Performance on the test data initially followed training performance until reaching a global maximum (FIG. 9E). This maximum occurred at varying iteration indices for different RSNs. Training beyond this point resulted in over-fitting, manifesting as decreasing test data performance despite increasing training performance. Inputs that were previously correctly classified in the test data became incorrectly classified (FIGS. 9B and 9C).
Over a dense sampling of input and hidden layer sizes (Ni×Nh), the perceptron was trained until the peak AUC could be determined (FIG. 10). The optimal overall performance for the perceptron was found at 2500 PCs and 22 hidden layer nodes (FIG. 10). The perceptron was trained with this architecture using 10 mm ROIs and the result was optimized through simulated annealing, yielding an over-all classification performance of 0.9822 (AUC) with 17.1% RMS error. The maximal AUC and minimal RMS error rates differed by network, as shown in Table 3.
TABLE 3
RSN classification performance.
Test (Optimization Set) Retest (Validation Set)
Accuracy Error Accuracy Error
Network (AUC) (RMS) (AUC) (RMS)
DAN 0.973 20.2% 0.973 20.1%
VAN 0.971 17.9% 0.979 17.6%
SMN 0.988 16.4% 0.994 17.2%
VIS 0.993 13.4% 0.998 12.7%
FPC 0.972 17.5% 0.989 14.8%
LAN 0.985 14.9% 0.991 14.4%
DMN 0.993 14.4% 0.990 17.6%
Mean 0.982 17.1% 0.988 16.6%
These values reflect MLP training with 10 mm radius seeds (FIGS. 14A and 14B) and optimization with simulated annealing. After completion of classifier training, voxel-wise connectivity patterns were classified in individual subjects in the test data set (FIG. 11A). RSN topography summaries were computed as winner-take-all maps (FIGS. 11A-11F and 12A-12C). Well-defined RSN topography was obtained in all subjects in the test and training groups. Specifically, the subject-wise mean and standard error of the AUC was 0.982±0.007, with the worst performing subject at 0.963. These figures corresponded to RMS error of 16.5±1.4% with the worst subject yielding 19.1%. RSNs were generally contiguous regions that conformed to previously described topography. The relationship of perceptron-defined RSNs to previous findings is discussed more fully below.
RSN topography estimates were averaged over all subjects in the training and test groups. FIGS. 12A-12C addresses both the central tendency (top row) of each group as well as inter-subject variability (middle row). Average network topographies had higher values near locations of ROIs used to generate training maps. This is expected because voxels within ROIs are likely to have similar correlation maps to the ROI. High classification values (in the top 25%) were also found in contiguous regions not used to generate training data. For example, a lateral temporal region was classified as a fronto-parietal control region, and a dorsal pre-motor region was classified into the language network. This type of result demonstrates external validity (or equivalently, generalizability) of perceptron classification, i.e., recovery of true features in RSNs not included in the training set. These features are also present in the results in individual subjects (FIG. 11A).
Further evidence of external validity is shown in FIG. 13. For example, thalamic voxels approximately corresponding to nucleus ventralis posterior were classified as SMN, substantially in agreement. Similarly, voxels in the posterior cerebellum (Crus I and II) and the cerebellar tonsils were classified as DMN (FIG. 13, Z=−30, Z=−47), substantially in agreement. These results are notable because neither cerebellar nor thalamic ROIs were used to generate training data. Further, no cerebellar voxels were within the grey matter mask, which means that the classifier successfully identified cerebellar ROIs purely on the basis of cortical connectivity maps. The perceptron generated asymmetric classification in the cerebellum for the VAN and LAN networks (Z=−30), contralateral to their asymmetric cerebral representation (Z=+47).
The present results (individual and group RSN topographies) exhibit a high degree of face validity with respect to the training data and previously reported RSN results (FIGS. 11A-11F, 12A-12C, and 13). Thus, for example, components of the DMN used as seeds to generate the training data were classified as DMN in all subjects. This was true not only for easily classified networks (e.g., the DMN) but also for networks (e.g., VAN and LAN) that are inconsistently found by unsupervised procedures. The results shown in FIGS. 11A-11F illustrate that the perceptron reliably classified RSNs in each test set individual (AUC>0.971), even in cases in which the RMS error was relatively high (>0.2).
However, inter-individual differences were also evident (FIGS. 11A-11F). These differences systematically varied according to RSN and exhibited RSN-specific zones of high as well as low inter-individual variability (FIGS. 12A-12C). Easily classified voxels (i.e., with high classification values) generally showed the least inter-subject variability. Such regions, e.g., the posterior parietal component of the DMN (FIGS. 12A-12C), were surrounded by zones of high variability (e.g., ring around the angular gyms). The pre- and post-central gyri consistently showed high SMN classification values but were bordered by regions of high inter-subject SMN variability. Interestingly, inter-subject variability was low also in areas with classification values near 0, particularly in areas typically anticorrelated with other networks (e.g., low DAN variance in the angular gyms, a component of the DMN; low DMN variance in MT+, a component of the DAN).
At least four factors potentially contribute to observed inter-subject classifier output variability: (i) limited or compromised fMRI data, (ii) limitations intrinsic to the MLP (iii) true inter-individual differences in RSN topography and (iv) misregistration. Each of the possibilities is discussed below.
With regard to (i), the fMRI data used in the present work were obtained in healthy, cooperative young adults. Hence, the fraction of frames excluded because of head motion was low (about 4%). The total quantity of fMRI data acquired in each individual was, by current standards, generous. However, fMRI data quantity clearly affects MLP performance (see 4.4.2 below and FIGS. 14A-14B). Current results suggest that more data generally improves MLP performance. The impact of fMRI data quality and quantity on MLP performance in clinical applications remains to be determined. With regard to (ii), the observation of zones with high classifier values and low variance bordered by regions of high variance may reflect classification uncertainty in areas that truly represent more than one RSN, i.e., voxels with high participation coefficients.
With regard to (iii), on the other hand, the presently observed inter-individual differences may truly reflect individual variability in RSN topography. Previous work has demonstrated that inter-individual differences in task-evoked activity correspond to “transition zones” in resting state networks (e.g., the boundary between parietal DMN and DAN regions). These same regions appear in our inter-subject variance maps for both DMN and DAN (FIGS. 12A-12C). We also note that areas of high RSN classification variability (pre-frontal, parietal, lateral temporal) broadly correspond to regions exhibiting the greatest expansion over the course of human development and evolution. This correspondence may possibly be coincidental, but it is consistent with the hypothesis that later developing or evolutionarily more recent areas of the brain tend to be more variable across individuals.
With regard to (iv), some proportion of the variability in observed RSN topography estimates may be explained by uncorrected anatomical variability. To investigate this possibility, the overall RSN standard deviation map (FIG. 16A) was compared to sulcal depth variability (FIG. 16B) and a weak spatial correlation (r=0.2) was found. By inspection, these maps were concordant only at a broad spatial scale: both showed low variability in primary motor/auditory/insular cortices and high variability elsewhere. Little correspondence was evident at finer scales (note lack of annular patterns in FIG. 16B). The degree to which anatomical variability contributes to spurious variance in RSN topography estimates may be addressed by measuring the degree to which non-linear or surface-based registration decreases inter-subject variance and increases overall classifier performance (higher AUC, lower RMSE).
Two distinct types of external validity, that is, correct classification outside the training set, are evident in our results. First, high overall classification performance was achieved for a priori seed-based correlation maps in test (98.2% AUC) and hold-out datasets (98.8% AUC). Performance was reliable in all subjects (97.1% worst-case AUC), which is critical in clinical applications. Second, and perhaps of greater scientific interest, the RSN estimates in areas not covered by seed regions were strongly concordant with previously reported task-based and resting-state fMRI results. For example, while no temporal FPC seed ROI was included in the training set, a posterior temporal gyms locus was classified as FPC the group level (FIGS. 12A-12C). Similarly, the MLP also identified the parahippocampal gyms as DMN and a dorsal pre-motor region that has been associated with articulation of speech as LAN. The right inferior cerebellum was first associated with language function by PET studies of semantic association tasks. Identification of this region here as part of the LAN network (FIG. 13, WTA, Z<−30) is doubly significant. First, no cerebellar seeds were used to generate training data and, further, cerebellar voxels were excluded from the gray matter mask, hence, were not seen by the classifier. Second, lateralized RSN components typically are not found by unsupervised seed-based correlation mapping.
These findings highlight the capabilities of supervised classifiers applied to the problem of identifying RSNs in individuals. The representation of language (primarily Broca's and Wernicke's areas) has been extensively studied using task-based fMRI and correlation mapping with a priori selected ROIs. However, the language network, as presently defined, typically is not recovered as such by unsupervised methods. Rather, components of the LAN are generally found only at fine-scale RSN descriptions. Thus, an RSN including Broca's and Wernicke's areas appears as the 11th of 23 components in; these same areas were identified as VAN and DMN. A component consistent with the presently defined LAN at a hierarchical level of 11 (but not 7) clusters has been found. Thus, the exemplary experiment, work demonstrates the potential of supervised classifiers to find networks that are subtle features of the BOLD correlation structure, possibly even minor sub-components within hierarchically organized RSNs, that nevertheless have high scientific and/or clinical value. The LAN was specifically included here to meet the clinical imperative of localizing language function in the context of pre-operative neurosurgical planning.
In the exemplary embodiment, the hierarchical scale of an RSN is reflected in training performance trajectories (FIGS. 9E and F): in all (Ni×Nh) architecture variants, the DMN was the first to be separated from other RSNs. The DMN arguably is the most robust feature in the correlation structure of intrinsic brain activity. Its topography is very similar across RSN mapping strategies (specifically, spatial ICA and seed-based correlation mapping. Here, the DMN and regions anticorrelated with the DMN were well separated along the first principal component of the training data (FIG. 6).
After the DMN, the sensorimotor and visual networks were next to achieve separation during classifier training. These networks are often seen at the next level down in the RSN hierarchy as offshoots of the anti-DMN or extrinsic system. The dorsal attention network achieved only a small peak in error descent compared to other ‘extrinsic’ networks, though this occurred in close proximity (note overlap of DAN, MOT, VIS peaks in FIG. 9F). In contrast, the LAN and VAN were last to achieve separation during training. This corresponds to the observation that LAN and VAN systems are typically found by analyses extending to lower levels of the RSN hierarchy.
In the exemplary embodiment, the observer is a multi-layer perceptron and the task is to assign RSN labels to each voxel. Performance is evaluated in terms of mean squared classification error and ROC analyses. It follows that MLP performance can be used to evaluate image quality across a wide range of variables, e.g., scanners, and acquisition parameters (e.g., TR, run length, resolution), preprocessing strategies (nuisance regression, filtering, spatial smoothing) and data representations (surface or volume based). This principle is demonstrated by systematically evaluating MLP performance in relation to quantity of fMRI data and seed ROI size.
The relation between total quantity of fMRI data and MLP performance (test dataset RMS error) is shown in FIG. 14A. The plotted points represent five replicate MLP training/test runs. RMS error as a function of data quantity was well fit (R2=0.994) by a three-parameter empirically derived hyperbolic function. The parameterized function implies that classifier error monotonically decreases with increasing total fMRI data length but ultimately asymptotes at ˜18% RMS (with 5 mm radius seeds and no simulated annealing). The existence of this asymptote may indicate that resting-state brain networks are inherently non-separable in the sense of classification. This is consistent with the notion of “near decomposability” of hierarchical systems formed by multiple, sparsely inter-connected modules. This concept has since been extended to brain networks.
The relationship between seed ROI radius and RMS classification error was explored using a perceptron architecture optimized with 5 mm radius seeds (2500 PCs, 22 hidden nodes). All seeds were masked to include only gray matter voxels. The results of systematically varying seed ROI size are shown in FIG. 14B. A clear minimum in RMS error was obtained with seeds of approximately 10 mm radius. Voxel-wise RSN topographies were qualitatively similar across ROI sizes, but larger seeds generated less noisy RSNs with more pronounced peaks. This result is unexpected, as it deviates from the current standard practice of using approximately 6 min radius seeds. There are several possible explanations for the present results. Large seeds may best match the characteristic dimensions of RSNs in the 7-network level description of the brain. Alternatively, large seeds may compensate for mis-registration affine-coregistered, volume-preprocessed data. Smaller seeds may be used in classifiers operating on non-linear, surface-coregistered, geodesically smoothed data. The results shown in FIG. 14B reflect the effect of seed radius on the correlation maps used to train the MLP. It is formally possible for a corrupted training set to yield a better classifier as evaluated by test set classification error. Thus, the results shown in FIG. 14B should not be interpreted as unambiguously indicating that 10 mm radius seeds are optimal for correlation mapping.
Inter-individual differences in computed RSN topographies may reflect multiple factors. Cross-gyral contamination due to the relatively large voxels used in this study (4 mm acquisition, 3 mm post-processing analyses) may limit the precision of RSN classification in the dataset. Potential strategies for validating perceptron-derived results include comparison with measures of structural (axonal) connectivity and invasive electrophysiologic recording.
The MLP RSN classifier operates at the voxel level via computed correlation maps. After training, it reliably identifies RSN topographies in individual subjects. Classification is rapid (2 minutes using Matlab running on Intel i7 processors) and automated, hence suitable for deployment in clinical environments. After training, classification is independent of any particular seed. Therefore, the trained MLP is expected to be robust to anatomical shifts and distortions, for example, owing to enlarged ventricles and mass effects or even loss of neural tissue (e.g., stroke).
In this experiment, the classifier was trained to operate in 3D image space for compatibility with clinical imaging formats. However, the MLP concept can be readily adapted to operate on correlation maps represented on the cortical surface. Similarly, voxel-wise classifiers can be trained to classify subjects despite anatomical abnormalities (e.g., brain tumors) by altering the domain of the training set, i.e., excluding tumor voxels. Another potentially useful MLP modification would be removal by regression of the relationship between correlation and distance to the seed. Such regression may decrease the reliance of the classifier on local connectivity, thereby reducing susceptibility to corruption by movement artifact.
As compared to known systems that are used for brain mapping, the embodiments described herein enable a substantially efficient task-less system for brain mapping. More specifically, the embodiments described herein include a computing device for use in a system for mapping brain activity of a subject that generally comprises a processor. The processor is programmed to select a plurality of measurements of brain activity that is representative of at least one parameter of a brain of the subject during a resting state. Moreover, the processor is programmed to compare at least one data point from each of the measurements with a corresponding data point from a previously acquired data set from at least one other subject. The processor is also programmed to produce at least one map for each of the measurements based on the comparison of the resting state data point and the corresponding previously acquired data point. The processor may also be programmed to categorize the brain activity in a plurality of networks in the brain based on the map. By using previously acquired data points to categorize the brain activity in a plurality if networks in the brain of the subject, task-based techniques may be avoided. Moreover, by having the processor select the plurality of measurements, a user may no longer need to spend a considerable amount of time determining which measurements, such as voxels, to select.
Exemplary embodiments of the system, apparatus, and method are described above in detail. The system, apparatus, and method are not limited to the specific embodiments described herein, but rather, components of the system and apparatus, and/or steps of the methods may be utilized independently and separately from other components and/or steps described herein. For example, but not limited to, the system may also be used in combination with other apparatus, systems, and methods, and is not limited to practice with only the system as described herein. Rather, the exemplary embodiment can be implemented and utilized in connection with many other applications.
Although specific features of various embodiments of the invention may be shown in some drawings and not in others, this is for convenience only. In accordance with the principles of the invention, any feature of a drawing may be referenced and/or claimed in combination with any feature of any other drawing.
Although described in connection with an exemplary computing system environment, embodiments of the invention are operational with numerous other general purpose or special purpose computing system environments or configurations. The computing system environment is not intended to suggest any limitation as to the scope of use or functionality of any aspect of the invention.
Embodiments of the invention may be described in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices. The computer-executable instructions may be organized into one or more computer-executable components or modules. Generally, program modules include, but are not limited to, routines, programs, objects, components, and data structures that perform particular tasks or implement particular abstract data types. Aspects of the invention may be implemented with any number and organization of such components or modules. For example, aspects of the invention are not limited to the specific computer-executable instructions or the specific components or modules illustrated in the figures and described herein. Other embodiments of the invention may include different computer-executable instructions or components having more or less functionality than illustrated and described herein. Aspects of the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
In operation, a computer executes computer-executable instructions embodied in one or more computer-executable components stored on one or more computer-readable media to implement aspects of the invention described and/or illustrated herein.
The order of execution or performance of the operations in embodiments of the invention illustrated and described herein is not essential, unless otherwise specified. That is, the operations may be performed in any order, unless otherwise specified, and embodiments of the invention may include additional or fewer operations than those disclosed herein. For example, it is contemplated that executing or performing a particular operation before, contemporaneously with, or after another operation is within the scope of aspects of the invention.
When introducing elements of aspects of the invention or the embodiments thereof, the articles “a,” “an,” “the,” and “said” are intended to mean that there are one or more of the elements. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that there may be additional elements other than the listed elements.
This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal language of the claims.

Claims (20)

What is claimed is:
1. A computing device for use in a system for task-less mapping of brain activity of an individual subject, the computing device comprising a processor programmed to:
select a plurality of time-series measurements of the brain activity obtained from the individual subject during a resting state, each selected time-series measurement corresponding to one location within a brain of the individual subject;
for each selected time-series measurement, assemble a correlation map comprising a plurality of elements, each element comprising a correlation between the selected time-series measurement and another time series measurement from the plurality of time-series measurements;
classify the resting state brain activity corresponding to each correlation map as at least one of a plurality of resting state networks by transforming each correlation map using a predetermined supervised classifier configured to transform a weighted sum of the elements of each correlation map to at least one output value, each output value indicating a membership of each correlation map within each corresponding resting state network of a plurality of resting state networks; and
produce at least one map of resting state network membership by combining the at least one output value associated with the selected time-series measurements;
wherein the predetermined supervised classifier is calibrated beforehand using a plurality of calibration time-series measurements corresponding to previously defined resting state networks obtained from a plurality of calibration subjects.
2. A computing device in accordance with claim 1, wherein the processor is programmed to select a plurality of time-series measurements associated with a plurality of voxels from an image of the brain.
3. A computing device in accordance with claim 1, further comprising a communication interface coupled to the processor and configured to receive at least one signal representative of the plurality of time-series measurements of the resting state brain activity.
4. A computing device in accordance with claim 3, wherein the communication interface is configured to receive at least one signal representative of at least one voltage fluctuation within the brain from at least one electrode.
5. A computing device in accordance with claim 3, wherein the communication interface is configured to receive at least one signal representative of an altered magnetic field within the brain from at least one magnetic resonance imaging device.
6. A computing device in accordance with claim 1, wherein the processor is programmed to produce a functional connectivity map for each of the plurality of time-series measurements based on the resting state network membership of each time-series measurement classified using the predetermined supervised classifier.
7. A computing device in accordance with claim 1, further comprising a presentation interface coupled to the processor and configured to display the at least one map for each of the plurality of time-series measurements.
8. A system for task-less mapping of brain activity of an individual subject, the system comprising:
a sensing system configured to detect a plurality of time-series measurements of the brain activity obtained from the individual subject during a resting state, each selected time-series measurement corresponding to one location within a brain of the individual subject; and
a computing device coupled to the sensing system, the computing device comprising:
a communication interface configured to receive at least one signal representative of the plurality of time-series measurements of the brain activity; and
a processor coupled to the communication interface and programmed to:
select the plurality of time-series measurements of the brain activity;
for each selected time-series measurement, assemble a correlation map comprising a plurality of elements, each element comprising a correlation between the selected time-series measurement and another time series measurement from the plurality of time-series measurements;
classify the resting state brain activity corresponding to each correlation map as at least one of a plurality of resting state networks by transforming each correlation map using a predetermined supervised classifier configured to transform a weighted sum of the elements of each correlation map to at least one output value, each output value indicating a membership of each correlation map within each corresponding resting state network of a plurality of resting state networks; and
produce at least one map of resting state network membership by combining the at least one output value associated with the selected time-series measurements;
wherein the predetermined supervised classifier is calibrated beforehand using a plurality of calibration time-series measurements corresponding to previously defined resting state networks obtained from a plurality of calibration subjects.
9. A system in accordance with claim 8, wherein the sensing system comprises a magnetic resonance imaging device.
10. A system in accordance with claim 9, wherein the communication interface is configured to receive at least one signal representative of an altered magnetic field within the brain from the magnetic resonance imaging device.
11. A system in accordance with claim 8, wherein the sensing system comprises an electrocorticography device having at least one electrode.
12. A system in accordance with claim 11, wherein the communication interface is configured to receive at least one signal representative of at least one voltage fluctuation within the brain from the at least one electrode.
13. A system in accordance with claim 8, wherein the processor is programmed to select a plurality of voxels from an image of the brain.
14. A system in accordance with claim 8, wherein the processor is programmed to produce a functional connectivity map for each of the plurality of time-series measurements based on the resting state network membership of each time-series measurement classified using the predetermined supervised classifier.
15. A system in accordance with claim 8, wherein the computing device further comprises a presentation interface coupled to the processor and configured to display the at least one map for each of the plurality of measurements.
16. A method for task-less mapping of brain activity of an individual subject, the method comprising:
selecting, via a processor, a plurality of time-series measurements the brain activity obtained from the individual subject during a resting state, each selected time-series measurement corresponding to one location within a brain of the individual subject;
for each selected time-series measurement, assembling, via the processor, a correlation map comprising a plurality of elements, each element comprising a correlation between the selected time-series measurement and another time series measurement from the plurality of time-series measurements;
classifying, via the processor, the resting state brain activity corresponding to each correlation map as at least one of a plurality of resting state networks by transforming each correlation map using a predetermined supervised classifier configured to transform a weighted sum of the elements of each correlation map to at least one output value, each output value indicating a membership of each correlation map within each corresponding resting state network of a plurality of resting state networks; and
producing, via the processor, at least one map of resting state network membership by combining the at least one output value associated with the selected time-series measurements;
wherein the predetermined supervised classifier is calibrated beforehand using a plurality of calibration time-series measurements corresponding to previously defined resting state networks obtained from a plurality of calibration subjects.
17. A method in accordance with claim 16, wherein selecting, via a processor, the plurality of time-series measurements further comprises selecting, via a processor, a plurality of time-series measurements associated with a plurality of voxels from an image of the brain.
18. A method in accordance with claim 16, further comprising receiving, via a communication interface, at least one signal representative of the plurality of time-series measurements of the resting state brain activity.
19. A method in accordance with claim 16, wherein producing, via the processor, at least one map further comprises producing a functional connectivity map for each of the plurality of time-series measurements based on the classification of each time-series measurement using the predetermined supervised classifier.
20. A method in accordance with claim 16, further comprising displaying the at least one map for each of the plurality of time-series measurements, via a presentation interface.
US13/673,816 2011-11-11 2012-11-09 System and method for task-less mapping of brain activity Active US9480402B2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US13/673,816 US9480402B2 (en) 2011-11-11 2012-11-09 System and method for task-less mapping of brain activity
US15/237,202 US10092246B2 (en) 2011-11-11 2016-08-15 System and method for task-less mapping of brain activity
US16/136,996 US10258289B2 (en) 2011-11-11 2018-09-20 System and method for task-less mapping of brain activity
US16/383,926 US11589826B2 (en) 2011-11-11 2019-04-15 System and method for task-less mapping of brain activity
US18/168,074 US20230181119A1 (en) 2011-11-11 2023-02-13 System and method for task-less mapping of brain activity

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161558751P 2011-11-11 2011-11-11
US13/673,816 US9480402B2 (en) 2011-11-11 2012-11-09 System and method for task-less mapping of brain activity

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US201161558751P Substitution 2011-11-11 2011-11-11

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/237,202 Continuation US10092246B2 (en) 2011-11-11 2016-08-15 System and method for task-less mapping of brain activity

Publications (2)

Publication Number Publication Date
US20130123607A1 US20130123607A1 (en) 2013-05-16
US9480402B2 true US9480402B2 (en) 2016-11-01

Family

ID=48281265

Family Applications (5)

Application Number Title Priority Date Filing Date
US13/673,816 Active US9480402B2 (en) 2011-11-11 2012-11-09 System and method for task-less mapping of brain activity
US15/237,202 Active US10092246B2 (en) 2011-11-11 2016-08-15 System and method for task-less mapping of brain activity
US16/136,996 Active US10258289B2 (en) 2011-11-11 2018-09-20 System and method for task-less mapping of brain activity
US16/383,926 Active 2034-05-21 US11589826B2 (en) 2011-11-11 2019-04-15 System and method for task-less mapping of brain activity
US18/168,074 Pending US20230181119A1 (en) 2011-11-11 2023-02-13 System and method for task-less mapping of brain activity

Family Applications After (4)

Application Number Title Priority Date Filing Date
US15/237,202 Active US10092246B2 (en) 2011-11-11 2016-08-15 System and method for task-less mapping of brain activity
US16/136,996 Active US10258289B2 (en) 2011-11-11 2018-09-20 System and method for task-less mapping of brain activity
US16/383,926 Active 2034-05-21 US11589826B2 (en) 2011-11-11 2019-04-15 System and method for task-less mapping of brain activity
US18/168,074 Pending US20230181119A1 (en) 2011-11-11 2023-02-13 System and method for task-less mapping of brain activity

Country Status (1)

Country Link
US (5) US9480402B2 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150272461A1 (en) * 2013-05-01 2015-10-01 Advanced Telecommunications Research Institute International Brain activity analyzing apparatus, brain activity analyzing method and biomarker apparatus
WO2018183887A1 (en) * 2017-03-30 2018-10-04 The Trustees Of Columbia University In The City Of New York System, method and computer-accessible medium for predicting response to electroconvulsive therapy based on brain functional connectivity patterns
US20190246915A1 (en) * 2016-09-09 2019-08-15 Olea Medical System and method for reconstructing a physiological signal of an artery/tissue/vein dynamic system of an organ in a surface space
US11273283B2 (en) 2017-12-31 2022-03-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US11311193B2 (en) 2017-03-30 2022-04-26 The Trustees Of Columbia University In The City Of New York System, method and computer-accessible medium for predicting response to electroconvulsive therapy based on brain functional connectivity patterns
US11364361B2 (en) 2018-04-20 2022-06-21 Neuroenhancement Lab, LLC System and method for inducing sleep by transplanting mental states
US11443429B2 (en) 2019-05-30 2022-09-13 Washington University Atlas registration for resting state network mapping in patients with brain tumors
US11452839B2 (en) 2018-09-14 2022-09-27 Neuroenhancement Lab, LLC System and method of improving sleep
US11704790B2 (en) 2017-09-26 2023-07-18 Washington University Supervised classifier for optimizing target for neuromodulation, implant localization, and ablation
US11717686B2 (en) 2017-12-04 2023-08-08 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to facilitate learning and performance
US11723579B2 (en) 2017-09-19 2023-08-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement
US11779218B2 (en) 2020-05-18 2023-10-10 The Trustees Of Columbia University In The City Of New York System, method and computer-accessible medium for predicting response to electroconvulsice therapy based on brain functional connectivity patterns
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
WO2024015938A1 (en) 2022-07-13 2024-01-18 Sora Neuroscience, Inc. Generating functional brain mappings and accompanying reference information

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10393839B2 (en) * 2012-02-03 2019-08-27 Arizona Board Of Regents On Behalf Of The University Of Arizona System and method for image processing with highly undersampled imaging data
US8977029B2 (en) * 2012-08-24 2015-03-10 Siemens Aktiengesellschaft Method and system for multi-atlas segmentation of brain computed tomography image data
US9662039B2 (en) * 2014-03-31 2017-05-30 The General Hospital Corporation System and method for functional brain organization mapping
TWI745321B (en) 2016-01-08 2021-11-11 馬來西亞商雲頂圖爾斯診斷中心有限公司 Method and system for determining network connections
US11062450B2 (en) 2016-09-13 2021-07-13 Ohio State Innovation Foundation Systems and methods for modeling neural architecture
DE102017208560A1 (en) * 2017-05-19 2018-11-22 Siemens Healthcare Gmbh Functional magnetic resonance imaging
US10588561B1 (en) * 2017-08-24 2020-03-17 University Of South Florida Noninvasive system and method for mapping epileptic networks and surgical planning
US10402726B1 (en) * 2018-05-03 2019-09-03 SparkCognition, Inc. Model building for simulation of one or more target features
WO2021263218A1 (en) * 2020-06-26 2021-12-30 The Salk Institute For Biological Stuides Generative manifold networks for prediction and simulation of complex systems
CN112037914B (en) * 2020-08-11 2021-06-01 深圳大学 Construction method, system and equipment of obsessive-compulsive disorder risk assessment model

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030229107A1 (en) 2001-11-02 2003-12-11 Ronald Cowan Magnetic resonance with stimulation
US20040096089A1 (en) 2002-08-16 2004-05-20 David Borsook Non-invasive functional imaging of peripheral nervous system activation in humans and animals
US20060074336A1 (en) * 2004-10-01 2006-04-06 Philip Grieve Method for the spatial mapping of functional brain electrical activity
US20070010732A1 (en) 2005-05-26 2007-01-11 Deyoe Edgar Method for measuring neurovascular uncoupling in fMRI
US7215122B2 (en) 2003-10-03 2007-05-08 Invivo Corporation Phantom for production of controllable fMRI signal
US20090012386A1 (en) 2007-07-06 2009-01-08 The President And Fellows Of Harvard College Systems and methods for pre-operatively identifying functional regions of a patient's brain to assist in the preparation of a contemplated surgery
US20090253982A1 (en) 2006-04-03 2009-10-08 Jiongjiong Wang Assessing subject's reactivity to psychological stress using fmri
US7715901B2 (en) 2002-05-08 2010-05-11 Yeda Research And Development Co. Ltd. Sensitized online BOLD-MRI imaging method
US7729755B2 (en) 2004-06-14 2010-06-01 Cephos Corp. Questions and control paradigms for detecting deception by measuring brain activity
US7894903B2 (en) 2005-03-24 2011-02-22 Michael Sasha John Systems and methods for treating disorders of the central nervous system by modulation of brain networks

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2217899A (en) * 1998-01-08 1999-07-26 Richard B. Levin Eeg based consciousness-alert monitoring system
US8190248B2 (en) * 2003-10-16 2012-05-29 Louisiana Tech University Foundation, Inc. Medical devices for the detection, prevention and/or treatment of neurological disorders, and methods related thereto
US9480425B2 (en) * 2008-04-17 2016-11-01 Washington University Task-less optical mapping of dynamic brain function using resting state functional connectivity
US20110301431A1 (en) * 2010-06-05 2011-12-08 The Board Of Trustees Of The Leland Stanford Junior University Methods of classifying cognitive states and traits and applications thereof

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030229107A1 (en) 2001-11-02 2003-12-11 Ronald Cowan Magnetic resonance with stimulation
US7715901B2 (en) 2002-05-08 2010-05-11 Yeda Research And Development Co. Ltd. Sensitized online BOLD-MRI imaging method
US20040096089A1 (en) 2002-08-16 2004-05-20 David Borsook Non-invasive functional imaging of peripheral nervous system activation in humans and animals
US7215122B2 (en) 2003-10-03 2007-05-08 Invivo Corporation Phantom for production of controllable fMRI signal
US7729755B2 (en) 2004-06-14 2010-06-01 Cephos Corp. Questions and control paradigms for detecting deception by measuring brain activity
US20060074336A1 (en) * 2004-10-01 2006-04-06 Philip Grieve Method for the spatial mapping of functional brain electrical activity
US7894903B2 (en) 2005-03-24 2011-02-22 Michael Sasha John Systems and methods for treating disorders of the central nervous system by modulation of brain networks
US20070010732A1 (en) 2005-05-26 2007-01-11 Deyoe Edgar Method for measuring neurovascular uncoupling in fMRI
US7469159B2 (en) 2005-05-26 2008-12-23 The Mcw Research Foundation, Inc. Method for measuring neurovascular uncoupling in fMRI
US20090253982A1 (en) 2006-04-03 2009-10-08 Jiongjiong Wang Assessing subject's reactivity to psychological stress using fmri
US20090012386A1 (en) 2007-07-06 2009-01-08 The President And Fellows Of Harvard College Systems and methods for pre-operatively identifying functional regions of a patient's brain to assist in the preparation of a contemplated surgery

Non-Patent Citations (87)

* Cited by examiner, † Cited by third party
Title
Astafiev et al., "Extrastriate body area in human occipital cortex responds to the performance of motor actions", Nature Neuroscience, 2004, pp. 542-548; vol. 7.
Barrett et al., "Objective assessment of image quality. III. ROC metrics, ideal observers, and likelihood-generating functions", Journal of the Optical Society of America A: Optics, Image Science, and Vision, 1998, pp. 1520-1535, vol. 15.
Beckman et al., "Investigations into resting-state connectivity using independent component analysis", Philosophical transactions of the Royal Society of London Series B, 2005, pp. 1001-1013, vol. 360.
Binder et al., "Mapping anterior temporal lobe language areas with FMRI: a multicenter normative study", NeuroImage, 2011, pp. 1465-1475; vol. 54, No. 2.
Biswal et al., "Functional connectivity in the motor cortex of resting human brain using echo-planer MRI", Magnetic Resonance Medicine, 1995, pp. 537-541, vol. 34, No. 4.
Boly et al.; "Hierarchical clustering of brain activity during human nonrapid eye movement sleep", Proceedings of the National Academy of Sciences USA, 2012, pp. 5856-5861, vol. 109, No. 15.
Briganti et al., "Reorganization of Functional Connectivity of Language Network in Patients with Brain Gliomas", American Journal of neuroradiology, 2012, pp. 1-8.
Buckner et al., "The organization of the human cerebellum estimated by intrinsic functional connectivity", Journal of Neurophysiology, 2011, pp. 2322-2345, vol. 106.
Buckner, "The serendipitous discovery of the brain's default network", NeuroImage, 2012, pp. 1137-1145, vol. 62.
Corbetta et al., "Voluntary orienting is dissociated from target detection in human posterior parietal cortex", Nature Neuroscience, 2000, pp. 292-297, vol. 3, No. 3.
Dale et al., "Cortical surface-based analysis. I. Segmentation and surface reconstruction", NeuroImage, 1999, pp. 179-194; vol. 9.
Damoiseaux et al., "Consistent resting-state networks across healthy subjects", Proceedings of the National Academy of Sciences USA, 2006, pp. 13848-13853; vol. 103; No. 37.
Damoiseaux et al., "Greater than the sum of its parts; a review of studies combining structural connectivity and resting-state functional connectivity", Brain Structure & Function, 2009, pp. 525-533, vol. 213.
Damoiseaux et al., "Reduced resting-state brain activity in the "default network" in normal aging", Cerebral Cortex, 2008, pp. 1856-1864, vol. 18.
Dosenbach et al., "A Core System for the Implementation of Task Sets", Neuron, 2006, pp. 799-812, vol. 50.
Dosenbach et al., "A dual-networks architecture of top-down control", Trends in Cognitive Sciences, pp. 99-105, vol. 12, No. 3.
Dosenbach et al.. "Distinct brain networks for adaptive and stable task control in humans", Proceedings of the National Academy of Sciences USA, 2007, pp. 11073-11078; vol. 104; No. 26.
Doucet et al., "Brain activity at rest: a multiscale hierarchical functional organization", Journal of Neurophysiology, 2011, pp. 2753-2763, vol. 105.
Dunmar et al., "Learning and Generalization in a Linear Perceptron Stochastically Trained with Noisy Data" Journal of Physics A: Mathematical and General, 1993, pp. 5767-5779, vol. 26, No. 21.
Fair et al., "Functional brain networks develop from a "local to distributed" organization", PLoS Computational Biology, 2009, 14 pages, vol. 5, No. 5.
Fair et al., A Method for Using Blocked and Event-Related FMRI Data to Study "Resting State" Functional Connectivity, Neuroimage. Mar. 2007 ; 35, 1, 396-405. *
Fox et al., "Clinical applications of resting state functional connectivity", Frontiers in Systems Neuroscience, 2010, 13 pages, vol. 4, Article 19.
Fox et al., "Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging", Nature Reviews Neuroscience, 2007, pp. 700-711, vol. 8.
Fox et al., "Spontaneous neuronal activity distinguishes human dorsal and ventral attention systems", Proceedings of the National Academy of Sciences USA, 2006, pp. 10046-10051, vol. 103, No. 26.
Fox et al., "The global signal and observed anticorrelated resting state brain networks", Journal of Neurophysiology, 2009, vol. 101, pp. 3270-3283.
Fox et al., "The human brain is intrinsically organized into dynamic, anticorrelated functional networks", Proceedings of the National Academy of Sciences USA, 2005, pp. 9673-9678; vol. 102; No. 27.
Ganmor et al., "Sparse low-order interaction network underlies a highly correlated and learnable neural population code", Proceedings of the National Academy of Sciences USA, 2011, pp. 9679-9684, vol. 108, No. 23.
Gaona et al., "Nonuniform High-Gamma (60-500 Hz) Power Changes Dissociate Cognitive Task and Anatomy in Human Cortex", The Journal of Neuroscience, 2011, pp. 2091-2100, vol. 31, No. 6.
Geman et al., "Stochastic relaxation, gibbs distributions, and the bayesian restoration of images", IEEE Transactions on Pattern Analysis and Machine Intelligence, 1984, pp. 721-741, vol. PAMI-6, No. 6.
Goldman et al. (Simultaneous EEG and fMRI of the alpha rhythm, Neuroreport. Dec. 20, 2002; 13(18): 2487-2492. *
Guimera et al., "Cartography of complex networks; modules and universal roles", Journal of Statistical Mechanics: Theory and Experiment, 2005, 17 pages.
Hampson et al., "Connectivity-behavior analysis reveals that functional connectivity between left BA39 and Broca's area varies with reading ability", NeuroImage, 2006, pp. 513-519, vol. 31.
He et al., "Breakdown of functional connectivity in frontoparietal networks underlies behavioral deficits in spatial neglect", Neuron, 2007, pp. 905-918, vol. 53.
He et al., "Electrophysiological correlates of the brain's intrinsic large-scale functional architecture", Proceedings of the National Academy of Sciences USA, 2008, pp. 16038-16044, vol. 105, No. 41.
Hickok et al., "Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language", Cognition, 2004, pp. 67-99, vol. 92.
Hill et al., "Similar patterns of cortical expansion during human development and evolution", Proceedings of the National Academy of Sciences USA, 2010, 6 pages.
Hornik et al., "Multilayer Feedforward Networks Are Universal Approximators", Neural Networks, 1989, pp. 359-366, vol. 2.
Kahn et al., "Distinct cortical anatomy linked to subregions of the medial temporal lobe revealed by intrinsic functional connectivity", Journal of Neurophysiology, 2008, pp. 129-139, vol. 100.
Kincade et al., "An event-related functional magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention",The Journal of Neuroscience, 2005, pp. 4593-4604, vol. 25, No. 18.
Kirkpatrick et al., "Optimization by Simulated Annealing", Science, 1983, pp. 671-680, vol. 220, No. 4598.
Kirkpatrick, "Optimization by Simulated Annealing: Quantitative Studies", Journal of Statistical Physics, 1984, pp. 975-986, vol. 34, Nos. 5/6.
Kupinski et al., "Experimental determination of object statistics from noisy images", Journal of the Optical Society of America A: Optics, Image Science, and Vision, 2003, pp. 421-429, vol. 20, No. 3.
Lecun et al., "Backpropagation Applied to Handwritten Zip Code Recognition" Neural Computation, 1989, pp. 541-551, vol. 1.
Lecun et al., "Handwritten Digit Recognition: Applications of Neural Network Chips and Automatic Learning", IEEE Communications Magazine, 1989, pp. 41-46.
Lee et al., "Clustering of resting state networks", PLoS One, 2012, 12 pages, vol. 7, No. 7.
Lemm et al., "Introduction to machine learning for brain imaging", NeutroImage, 2011, pp. 387-399, vol. 56.
Lippmann, "Pattern-Classification Using Neural Networks" IEEE Communications Magazine, 1989, pp. 47-64.
Lippmann, "Review of Neural Networks for Speech Recognition", Neural Computation, 1989, pp. 1-38, vol. 1.
Logethetis et al. "Interpreting the BOLD signal", Annual Review of Physiology, 2004, pp. 735-769, vol. 66.
Marrelec et al., "Assessing the influence of different ROI selection strategies on functional connectivity analyses of fMRI data acquired during steady-state conditions", PLoS One, 2011, 14 pages, vol. 6, No. 4.
Marrelec et al., "Regions, systems, and the brain: Hierarchical measures of functional integration in fMRI", Medical Image Analysis, 2008, pp. 484-496, vol. 12.
Mennes et al., "Inter-individual differences in resting-state functional connectivity predict task-induced BOLD activity", NeuroImage, 2010, pp. 1690-1701, vol. 50.
Meunier et al., "Modular and hierarchically modular organization of brain networks", Frontiers in Neuroscience, 2010, 11 pages, vol. 4, Article 200.
Miller et al., "Direct electrophysiological measurement of human default network areas", Proceedings of the National Academy of Sciences USA, 2009, pp. 12174-12177, vol. 106, No. 29.
Muller et al., "An Introduction to Kernel-Based Learning Algorithms", IEEE Transactions on Neural Networks, 2001, pp. 181-201, vol. 12, No. 2.
Murphy et al., "The impact of global signal regression on resting state correlations: are anti-correlated networks introduced?", NeuroImage, 2009, pp. 893-905, vol. 44, No. 3.
Petacchi et al., "Cerebellum and auditory function: an ALE meta-analysis of functional neuroimaging studies", Human Brain Mapping, 2005, pp. 118-128, vol. 25.
Petersen et al., "Positron emission tomographic studies of the cortical anatomy of single-word processing", Nature, 1988, pp. 585-589, vol. 331.
Plaut et al., "Experiments on Learning by Back Propagation", Technical Report CMU-CS-86-126, 1986, 45 pages.
Power et al., "Functional network organization of the human brain", Neuron, 2011, pp. 665-678, vol. 72.
Power et al., "Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion", NeuroImage, 2012, pp. 2142-2154, vol. 59.
Pravata et al., "Functional connectivity MR imaging of the language network in patients with drug-resistant epilepsy", American Journal of Neuroradiology, 2011, pp. 532-540, vol. 32.
Rosenblatt, "The perceptron: a probabilistic model for information storage and organization in the brain", Psychological Review, 1958, pp. 386-408, vol. 65, No. 6.
Rumelhart et al., "Learning representations by back-propagating errors", Nature, 1986, pp. 533-536, vol. 323.
Sestieri et al., "Attention to memory and the environment: functional specialization and dynamic competition in human posterior parietal cortex", The Journal of Neuroscience, 2010, pp. 8445-8456, vol. 30, No. 25.
Sestieri et al., "Episodic memory retrieval, parietal cortex, and the default mode network: functional and topographic analyses", The Journal of Neuroscience, 2011, pp. 4407-4420, vol. 31, No. 12.
Sharman et al., "Mapping connectivity in the cortical-subcortical motor circuits of Parkinson's disease patients", UMR-S975, CRICM-INSERM-UPMC-CNRS, 1 page.
Shulman et al., "Interaction of stimulus-driven reorienting and expectation in ventral and dorsal frontoparietal and basal ganglia-cortical networks", The Journal of Neuroscience, 2009, pp. 4392-4407, vol. 29, No. 14.
Shulman et al., "Right hemisphere dominance during spatial selective attention and target detection occurs outside the dorsal fronto-parietal network", The Journal of Neuroscience, 2010, pp. 3640-3651, vol. 30, No. 10.
Simon "Near-decomposability and complexity: How a mind resides in a brain", The Mind, the Brain, and Complex Adaptive Systems, 1995, pp. 25-43.
Smith et al., "Correspondence of the brain's functional architecture during activation and rest", Proceedings of the National Academy of Sciences USA, 2009, pp. 13040-13045, vol. 106, No. 31.
Smith et al., Correspondence of the brain's functional architecture during activation and rest. PNAS, Aug. 4, 2009, vol. 106, No. 31, 13040-13045, with Supporting information, Smith et al. 10.1073/pnas.0905267106, p. 1-10. *
Smyser et al., "Longitudinal Analysis of Neural Network Development in Preterm Infants", Cerebral Cortex, 2010, pp. 2852-2862, vol. 20, No. 285.
Spoormaker et al., "Development of a large-scale functional brain network during human non-rapid eye movement sleep", The Journal of Neuroscience, 2010, pp. 11379-11387, vol. 30, No. 34.
Spreng, "The fallacy of a "task-negative" network", Frontiers in Psychology, 2012, pp. 1-5, vol. 3, Article 145.
Sylvester et al., "Anticipatory and stimulus-evoked blood oxygenation level-dependent modulations related to spatial attention reflect a common additive signal", The Journal of Neuroscience, 2009, pp. 10671-10682, vol. 29, No. 34.
Sylvester et al., "Anticipatory suppression of nonattended locations in visual cortex marks target location and predicts perception", The Journal of Neuroscience, 2008, pp. 6549-6556, vol. 28, No. 26.
Sylvester et al., "Asymmetry of anticipatory activity in visual cortex predicts the locus of attention and perception", The Journal of Neuroscience, 2007, pp. 14424-14433, vol. 27, No. 52.
Tomasi et al., "Language network: segregation, laterality and connectivity", Molecular Psychiatry, 2012, No. 17.
Tosoni et al., "Distinct representations for shifts of spatial attention and changes of reward contingencies in the human brain", Cortex, 2012, pp. 1-17.
Van Dijk et al., "Intrinsic functional connectivity as a tool for human connectomics: theory, properties, and optimization", Journal of Neurophysiology, 2010, pp. 297-321, vol. 103.
Van Essen et al. "A Population-Average, Landmark-and Surface-based (PALS) Atlas of Human Cerebral Cortex", NeuroImage, 2005, pp. 635-662, vol. 28.
Van Essen et al., "An integrated software suite for surface-based analyses of cerebral cortex", Journal of the American Medical Informatics Association, 2001, pp. 443-459; vol. 8, No. 5.
Walther et al., "Simple line drawings suffice for functional MRI decoding of natural scene categories", Proceedings of the National Academy of Sciences USA, 2010, pp. 9661-9666, vol. 108, No. 23.
Xu et al., "The influence of carbon dioxide on brain activity and metabolism in conscious humans", Journal of Cerebral Blood Flow & Metabolism, 2011, pp. 58-67, vol. 31.
Yeo et al., "The organization of the human cerebral cortex estimated by intrinsic functional connectivity", Journal of Neurophysiology, 2011, 137 pages.
Zhang et al., "Intrinsic functional relations between cerebral cortex and thalamus", Journal of Neurophysiology, 2008, pp. 1740-1748, vol. 100.

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10357181B2 (en) * 2013-05-01 2019-07-23 Advanced Telecommunications Research Institute International Brain activity analyzing apparatus, brain activity analyzing method and biomarker apparatus
US20150272461A1 (en) * 2013-05-01 2015-10-01 Advanced Telecommunications Research Institute International Brain activity analyzing apparatus, brain activity analyzing method and biomarker apparatus
US20190246915A1 (en) * 2016-09-09 2019-08-15 Olea Medical System and method for reconstructing a physiological signal of an artery/tissue/vein dynamic system of an organ in a surface space
WO2018183887A1 (en) * 2017-03-30 2018-10-04 The Trustees Of Columbia University In The City Of New York System, method and computer-accessible medium for predicting response to electroconvulsive therapy based on brain functional connectivity patterns
US11311193B2 (en) 2017-03-30 2022-04-26 The Trustees Of Columbia University In The City Of New York System, method and computer-accessible medium for predicting response to electroconvulsive therapy based on brain functional connectivity patterns
US11331041B2 (en) 2017-03-30 2022-05-17 The Trustees Of Columbia University In The City Of New York System, method and computer-accessible medium for predicting response to electroconvulsive therapy based on brain functional connectivity patterns
US11723579B2 (en) 2017-09-19 2023-08-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement
US11704790B2 (en) 2017-09-26 2023-07-18 Washington University Supervised classifier for optimizing target for neuromodulation, implant localization, and ablation
US11717686B2 (en) 2017-12-04 2023-08-08 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to facilitate learning and performance
US11273283B2 (en) 2017-12-31 2022-03-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US11478603B2 (en) 2017-12-31 2022-10-25 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US11318277B2 (en) 2017-12-31 2022-05-03 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US11364361B2 (en) 2018-04-20 2022-06-21 Neuroenhancement Lab, LLC System and method for inducing sleep by transplanting mental states
US11452839B2 (en) 2018-09-14 2022-09-27 Neuroenhancement Lab, LLC System and method of improving sleep
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
US11443429B2 (en) 2019-05-30 2022-09-13 Washington University Atlas registration for resting state network mapping in patients with brain tumors
US11779218B2 (en) 2020-05-18 2023-10-10 The Trustees Of Columbia University In The City Of New York System, method and computer-accessible medium for predicting response to electroconvulsice therapy based on brain functional connectivity patterns
WO2024015938A1 (en) 2022-07-13 2024-01-18 Sora Neuroscience, Inc. Generating functional brain mappings and accompanying reference information

Also Published As

Publication number Publication date
US10258289B2 (en) 2019-04-16
US20190015050A1 (en) 2019-01-17
US10092246B2 (en) 2018-10-09
US20130123607A1 (en) 2013-05-16
US20160345911A1 (en) 2016-12-01
US11589826B2 (en) 2023-02-28
US20200237316A9 (en) 2020-07-30
US20190239818A1 (en) 2019-08-08
US20230181119A1 (en) 2023-06-15

Similar Documents

Publication Publication Date Title
US11589826B2 (en) System and method for task-less mapping of brain activity
US11704790B2 (en) Supervised classifier for optimizing target for neuromodulation, implant localization, and ablation
Hacker et al. Resting state network estimation in individual subjects
Ombao et al. Handbook of neuroimaging data analysis
Pruett Jr et al. Accurate age classification of 6 and 12 month-old infants based on resting-state functional connectivity magnetic resonance imaging data
Fukushima et al. MEG source reconstruction based on identification of directed source interactions on whole-brain anatomical networks
Liu A few thoughts on brain ROIs
Cociu et al. Multimodal functional and structural brain connectivity analysis in autism: a preliminary integrated approach with EEG, fMRI, and DTI
Griffis et al. Linking left hemispheric tissue preservation to fMRI language task activation in chronic stroke patients
US20220293244A1 (en) Methods and systems for resting state fmri brain mapping with reduced imaging time
Mullen The dynamic brain: Modeling neural dynamics and interactions from human electrophysiological recordings
Allen et al. A massive 7T fMRI dataset to bridge cognitive and computational neuroscience
Taya et al. Comparison method for community detection on brain networks from neuroimaging data
Eschenburg et al. Learning cortical parcellations using graph neural networks
Gordon et al. Human fronto-striatal connectivity is organized into discrete functional subnetworks
Good et al. Personalized connectome-based Modeling in patients with semi-acute phase TBI: relationship to acute neuroimaging and 6 month follow-up
Wu et al. Globally optimized fiber tracking and hierarchical clustering—a unified framework
US20230022257A1 (en) Determination of white-matter neurodegenerative disease biomarkers
D’Andrea et al. Substructure of the brain’s Cingulo-Opercular network
Eschenburg Discrete Parcels and Continuous Gradients: Algorithmic Analyses of Cortical Areal Architecture and Function
Mecklenbrauck et al. The significance of structural rich club hubs for the processing of hierarchical stimuli
US20220392058A1 (en) Processing of tractography results using an autoencoder
Donnelly-Kehoe et al. Consistent local dynamics in the brain across sessions are revealed by whole brain modeling of resting state activity
Liu Computational Methods for Neuroscience Discovery with Neuroimaging Data
Kuang et al. Sensitivity analysis of human brain structural network construction

Legal Events

Date Code Title Description
AS Assignment

Owner name: WASHINGTON UNIVERSITY, MISSOURI

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEUTHARDT, ERIC;CORBETTA, MAURIZIO;SNYDER, ABRAHAM;AND OTHERS;SIGNING DATES FROM 20111110 TO 20120203;REEL/FRAME:029512/0520

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4