Shared latent representations of speech production for cross-patient speech decoding.
The 23 matches
- [1] § Methods › Pitch subsampling ↔ aligned_decoding/processing_utils/poisson_disk_sampling.py, lines 9–82 · score 0.82 · Poisson disk sampling, desired pitch, subsampled electrodes, select electrodes
- [2] § Methods › Connectionist temporal classification recurrent neural network (CTC-RNN) decoding ↔ aligned_decoding/realtime_sim/realtime_nn_model.py, lines 101–150 · score 0.76 · stacked RNN model, sliding window, CTC loss, blank, stride, classification
- [3] § Results › Cross-patient alignment improves speech decoding in a simulated real-time environment ↔ aligned_decoding/scripts/train_ctc_rnn.py, lines 1–55 · score 0.72 · phoneme error rate, CTC RNN model, neural recording, phoneme sequences, speech decoding, loss
- [4] § Methods › Simulated real-time data generation ↔ aligned_decoding/realtime_sim/realtime_processing.py, lines 10–39 · score 0.72 · Bandpass filtering, High gamma, RMS, bins, power, bands
- [5] § Methods › Alignment of latent dynamics ↔ aligned_decoding/alignment/AlignCCA.py, lines 11–119 · score 0.71 · canonical correlations, target space, patient space, CCA alignment, latent dynamics, target patient
- [6] § Methods › Cross-patient projection ↔ aligned_decoding/alignment/JointPCA.py, lines 13–162 · score 0.70 · transformation matrices, PCA transform, PCA decomposition, latent space, optionally, components
- [7] § Results › High-resolution and broad coverage are critical to alignment ↔ aligned_decoding/processing_utils/poisson_disk_sampling.py, lines 9–82 · score 0.70 · Poisson disk sampling, sampled electrodes, pitch subsampled, mm, decoding
- [8] § Methods › Connectionist temporal classification recurrent neural network (CTC-RNN) decoding ↔ aligned_decoding/realtime_sim/realtime_datamodule.py, lines 578–724 · score 0.67 · dimensionality reduction, latent space, source patient, post, truncated, aligned cross patient
- [9] § Methods › High-gamma extraction ↔ aligned_decoding/realtime_sim/realtime_processing.py, lines 10–39 · score 0.66 · bandpass filtered signals, high gamma, Channels, neural, decoding
- [10] § Results › Cross-patient alignment preserves spatial articulator maps ↔ aligned_decoding/figure_analyses/supp/supp_fig_9.ipynb, lines 1241–1271 · score 0.64 · unaligned reconstruction, aligned reconstructed, cross patient speech, cross patient decoding, decoding accuracies, TME
- [11] § Methods › Cross-patient projection ↔ aligned_decoding/scripts/aligned_decode_svm.py, lines 74–115 · score 0.63 · bagged SVM classifier, fold cross validation, PCA, Cross patient, accuracy, trained
- [12] § Methods › Alignment of latent dynamics ↔ aligned_decoding/nn_models/data_utils/AlignCCA.py, lines 11–105 · score 0.62 · canonical correlations, target space, CCA alignment, latent dynamics, target patient, mapping
- [13] § Methods › Connectionist temporal classification recurrent neural network (CTC-RNN) decoding ↔ aligned_decoding/scripts/tune_ctc_rnn.py, lines 638–685 · score 0.61 · Hyperparameter optimization, CTC RNN, cross validation, target patient, fit, aligned decoding
- [14] § Methods › Connectionist temporal classification recurrent neural network (CTC-RNN) decoding ↔ aligned_decoding/scripts/tune_ctc_rnn_align.py, lines 581–628 · score 0.61 · Hyperparameter optimization, CTC RNN, cross validation, target patient, fit, aligned decoding
- [15] § Methods › Single-electrode articulator tuning ↔ aligned_decoding/scripts/aligned_decode_svm_ncv.py, lines 323–394 · score 0.59 · nested cross validation, linear discriminant, splitting, predict, fold, classify
- [16] § Methods › Single-electrode articulator tuning ↔ aligned_decoding/scripts/aligned_decode_grid_subsample.py, lines 271–340 · score 0.58 · nested cross validation, linear discriminant, splitting, predict, fold, classify
- [17] § Results › Cross-patient alignment improves speech decoding in a simulated real-time environment ↔ aligned_decoding/realtime_sim/realtime_nn_model.py, lines 101–150 · score 0.57 · sliding windows, error rate, RNN model, loss, classification, CTC
- [18] § Methods › Cross-patient projection ↔ aligned_decoding/scripts/aligned_decode_spatialAvg_subsample.py, lines 239–312 · score 0.56 · class weight, cross validation, bagged, kernel, predictions, folds
- [19] § Methods › Cross-patient phoneme decoding ↔ aligned_decoding/decoders/cross_pt_decoders.py, lines 89–180 · score 0.56 · latent dimensionality, cross patient sources, truncated, concatenated, variance, target patient
- [20] § Results › Cross-patient alignment preserves spatial articulator maps ↔ aligned_decoding/alignment/AlignCCA.py, lines 11–119 · score 0.56 · extract latent dynamics, CCA alignment, latent space, optionally, correlation, target patient
- [21] § Methods › Cross-patient projection ↔ aligned_decoding/figure_analyses/fig_3.ipynb, lines 693–763 · score 0.55 · ROC AUC, aligned reconstructions, compatibility, flattened, components, unaligned
- [22] § Methods › Latent dynamics extraction ↔ aligned_decoding/figure_analyses/fig_2.ipynb, lines 1037–1131 · score 0.55 · articulatory features, t-SNE, perplexity, latent dynamics, Silhouette, Clustering
- [23] § Methods › Latent dynamics extraction ↔ aligned_decoding/figure_analyses/supp/supp_fig_6_7.ipynb, lines 1044–1139 · score 0.55 · articulatory features, t-SNE, perplexity, latent dynamics, Silhouette, Clustering
Paper
Loaded from Europe PMC by your browser, not stored by OSCR: doi.org · Europe PMC
The paper is loaded when this pane is shown.
The authors' code
Python · 255 lines · 9.1 KB · MIT · 2 matches
- """Poisson disk sampling for spatially uniform electrode subsampling."""
- import numpy as np
- import scipy.io as sio
- import matplotlib.pyplot as plt
- import time
- def pitch_subsample_sig_channels(pt, pitch, data_path):
- """Subsamples electrodes at a given pitch and returns significant indices.
- Uses Poisson disk sampling to select electrodes at the specified pitch
- (inter-electrode spacing in mm), then identifies which of the sampled
- electrodes are significant. Recursively retries if no significant
- channels are sampled.
- Args:
- pt (str): Subject identifier string.
- pitch (float): Desired inter-electrode pitch in millimeters.
- data_path (str): Root directory containing subject data folders.
- Returns:
- ndarray: Indices of significant channels within the subsampled set.
- """
- # load in channel map
- chanMap = sio.loadmat(f'{data_path}/{pt}/{pt}_channelMap.mat')['chanMap']
- # load in significant channel data
- sigChan = np.squeeze(
- sio.loadmat(f'{data_path}/{pt}/{pt}_sigChannel.mat')['sigChannel'])
- # trim nan edges if necessary
- if chanMap.shape[1] == 24:
- chanMap = chanMap[:,1:-1]
- # to preserve pitch when sampling across different grid sizes, calculate
- # number of electrodes to sample based on the desired pitch
- if pt in ['S14', 'S22', 'S23', 'S26']:
- mmX = 11.3
- mmY = 22.5
- maxElec = 128
- elif pt in ['S33', 'S39', 'S58', 'S62']:
- mmX = 37.8
- mmY = 20.6
- maxElec = 256
- nElec = round(mmX * mmY / pitch**2)
- if nElec >= maxElec:
- # just sample all electrodes if we're sampling more than the max
- elecPt = np.arange(1, maxElec+1)
- else:
- # parameters for poisson disk sampling
- gridX, gridY = chanMap.shape
- domain = (gridX, gridY)
- spacing = np.floor(np.sqrt(gridX * gridY / nElec))
- # do poisson disk sampling and -1 to get 0-indexed
- elecIdx = poisson_disk_sampling(domain, spacing, nElec)
- elecIdx = np.round(elecIdx).astype(int) - 1
- # convert 2D coordinates to channel numbers
- elecPt = chanMap[elecIdx[:, 0], elecIdx[:, 1]]
- elecPt = np.nan_to_num(elecPt, nan=-1).astype(int)
- # check if we need to sample more electrodes
- if elecPt.shape[0] < nElec and spacing == 1:
- nRemaining = nElec - elecPt.shape[0]
- # get unsampled electrodes
- remainingElecs = np.setdiff1d(np.arange(1, gridX * gridY+1), elecPt)
- # uniformly sample remaining electrodes
- extraSampPt = np.random.choice(remainingElecs, nRemaining,
- replace=False)
- elecPt = np.concatenate((elecPt, extraSampPt))
- # get indices of significant channels in the subsampled set
- _, sigIdx, _ = np.intersect1d(sigChan, elecPt, return_indices=True)
- # do sampling over if we don't sample at least 1 significant channel
- if len(sigIdx) == 0:
- return pitch_subsample_sig_channels(pt, nElec, data_path)
- return sigIdx
- def poisson_disk_sampling(domain, spacing, nPoints, threshold=60,
- showIter=False, maxIter=1000):
- """
- Poisson Disk Sampling algorithm. Adapted from MATLAB code by Mohak Patel
- (Brown University, 2016). Follows the algorithm in Bridson 2007
- (https://www.cs.ubc.ca/~rbridson/docs/bridson-siggraph07-poissondisk.pdf).
- """
- ##### Initialize the grid #####
- ndim = len(domain)
- cellSize = spacing / np.sqrt(ndim)
- # Construct grid
- sGrid = [np.arange(1, s + 1, cellSize) for s in domain]
- sGrid = np.meshgrid(*sGrid, indexing='ij')
- sizeGrid = sGrid[0].shape
- # Flatten grid points into array of coordinates
- sGrid = np.column_stack([g.ravel() for g in sGrid])
- emptyGrid = np.ones(sGrid.shape[0], dtype=bool)
- nEmptyGrid = np.sum(emptyGrid)
- scoreGrid = np.zeros_like(emptyGrid, dtype=int)
- ##### Dart-throwing #####
- ptsCreated = 0
- pts = []
- iter = 0
- start = time.time()
- while ptsCreated < nPoints and nEmptyGrid > 0:
- if iter > maxIter:
- print(f'Reached max iterations with {ptsCreated} points. Trying sampling again.')
- return poisson_disk_sampling(domain, spacing, nPoints, threshold)
- availGrid = np.where(emptyGrid)[0]
- dataPts = np.minimum(nEmptyGrid, nPoints)
- # sample nPoints from available grid points
- sampPts = np.random.choice(availGrid, dataPts, replace=False)
- # dart throws
- tempPts = sGrid[sampPts] + cellSize * np.random.rand(dataPts, ndim)
- ### Find good dart throws ###
- if len(pts) > 0:
- allPts = np.vstack((pts, tempPts))
- else:
- allPts = tempPts
- # get distance to nearest neighbor
- neighDist = min_neighbor_distance(allPts, tempPts)
- # check which points are valid
- inDomain = np.all(tempPts < domain, axis=1) # within domain
- goodSpacing = neighDist > spacing # far enough from other points
- validPts = inDomain & goodSpacing
- scorePts = tempPts[~validPts, :] # keep scores from bad throws
- tempPts = tempPts[validPts, :] # save good throws
- ### update tracking grids ###
- # update empty grid
- emptyPts = np.floor((tempPts + cellSize - 1) / cellSize).astype(int)
- # convert to linear index
- emptyPtIdx = np.ravel_multi_index(emptyPts.T-1, sizeGrid)
- # emptyPtIdx = np.ravel_multi_index((emptyPts[:,0], emptyPts[:,1]), sizeGrid)
- emptyGrid[emptyPtIdx] = False
- # update score grid
- scorePts = np.floor((scorePts + cellSize - 1) / cellSize).astype(int)
- scorePtIdx = np.ravel_multi_index(scorePts.T-1, sizeGrid)
- # scorePtIdx = np.ravel_multi_index((scorePts[:,0], scorePts[:,1]), sizeGrid)
- scoreGrid[scorePtIdx] += 1
- # update empty grid if score grid has exceeded threshold
- emptyGrid = emptyGrid & (scoreGrid < threshold)
- # update quantities for next iteration
- nEmptyGrid = np.sum(emptyGrid)
- pts.extend(tempPts)
- ptsCreated += tempPts.shape[0]
- iter += 1
- if showIter:
- elapsed = time.time() - start
- print(f"Iteration: {iter} Points Created: {ptsCreated} "
- f"EmptyGrid: {nEmptyGrid} Total Time: {elapsed:.3f}")
- # trim points to nPoints if more are created in last iteration
- pts = np.vstack(pts)
- if ptsCreated > nPoints:
- ptIdxs = np.random.choice(pts.shape[0], nPoints, replace=False)
- pts = pts[ptIdxs]
- return pts
- def min_neighbor_distance(pts, newPts):
- """Computes the distance from each new point to its nearest neighbor.
- Because ``newPts`` is a subset of ``pts``, the true nearest neighbor is
- the second closest point (the first is the point itself).
- Args:
- pts (ndarray): All existing points with shape (n, ndim).
- newPts (ndarray): Query points with shape (m, ndim), must be a
- subset of ``pts``.
- Returns:
- ndarray: Array of length m with the nearest-neighbor distance for
- each query point.
- """
- # find distances to nearest neighbors
- _, D = knn_search(pts, newPts, 2)
- # since pts and newPts will include the same points, nearest neighbor
- # distance will be the second index, since the first will be the point
- # itself
- return D[:, 1]
- def knn_search(pts, newPts, k):
- """Brute-force k-nearest-neighbor search.
- Args:
- pts (ndarray): Reference points with shape (n, ndim).
- newPts (ndarray): Query points with shape (m, ndim).
- k (int): Number of nearest neighbors to return.
- Returns:
- tuple: (I, D) where I is an (m, k) integer array of neighbor indices
- into ``pts`` and D is an (m, k) float array of corresponding
- Euclidean distances, both sorted by ascending distance.
- """
- m = newPts.shape[0]
- D = np.zeros((m, k))
- I = np.zeros((m, k), dtype=int)
- for i in range(m):
- dist = np.sqrt(np.sum((pts - newPts[i])**2, axis=1))
- I[i] = np.argsort(dist)[:k]
- D[i] = np.sort(dist)[:k]
- return I, D
- if __name__ == '__main__':
- # testing the grid sampling
- gridX = 8
- gridY = 16
- for nElec in [10, 20, 30, 40, 50, 60, 70, 80, 90, 100, 100]:
- print('### Sampling for nElec =', nElec, '###')
- # nElec =
- domain = (gridX, gridY)
- spacing = np.floor(np.sqrt(gridX * gridY / nElec))
- # print(spacing)
- n_grids = 3
- saved_grids = np.zeros((n_grids, gridX, gridY))
- for i in range(n_grids):
- points = poisson_disk_sampling(domain, spacing, nElec)
- points = np.round(points).astype(int) - 1
- print(f'Sampled {points.shape[0]} points')
- grid = np.zeros((gridX, gridY))
- grid[points[:, 0], points[:, 1]] = 1
- # plt.figure(figsize=(8, 8))
- plt.imshow(grid.T, cmap='gray', origin='lower')
- plt.show()
- saved_grids[i] = grid
- # check that the grids are different
- n_unique_grids = np.unique(saved_grids, axis=0).shape[0]
- print(n_unique_grids, n_unique_grids == n_grids)
poisson_disk_sampling.py at commit a70f1ae, under MIT · at the source
Overview
- Department of Biomedical Engineering, Duke University,Durham, NC USA
- Present Address: McGovern Institute for Brain Research, Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology,Cambridge, MA USA
- Department of Neurosurgery, Duke School of Medicine,Durham, NC USA
- Present Address: Department of Neurosurgery, University of Utah,Salt Lake City, UT USA
- Department of Neurobiology, Duke School of Medicine,Durham, NC USA
- Duke Comprehensive Epilepsy Center, Duke University,Durham, NC USA
- Department of Neurology, Duke School of Medicine,Durham, NC USA
- Center for Cognitive Neuroscience, Duke University,Durham, NC USA
Abstract
The abstract is not reproduced here: the paper's license (CC BY-NC-ND) does not allow it. Read it in the paper, at the publisher or on Europe PMC.
Repositories
Its files are read in the Code ↔ Paper reader above, with 23 matches between paragraphs and lines of code.
gamaleldin/TME
ad1adf835e72dbba012406b5a3af30701adc8993, 8 September 2017Availability: 1 check, the latest on 27 September 2026: the link answers
- 27 September 2026: the link answers
30 files
- demo.m, MATLAB, 78 lines
- genTME/
fitMaxEntropy.m , MATLAB, 136 lines - genTME/
logObjectiveMaxEntropyTe , MATLAB, 79 linesnsor.m - genTME/
objectiveMaxEntropyTenso , MATLAB, 71 linesr.m - genTME/
sampleTME.m , MATLAB, 45 lines - startup.m, MATLAB, 21 lines
- test/
summarizeLDS.m , MATLAB, 58 lines - util/
checkgrad.m , MATLAB, 49 lines - util/
diagKronSum.m , MATLAB, 25 lines - util/
extractFeatures.m , MATLAB, 61 lines - util/
kron_mvprod.m , MATLAB, 34 lines - util/
lbfgsb/ , C/C++, 145 linesarray.h - util/
lbfgsb/ , C++, 101 linesarrayofmatrices.cpp - util/
lbfgsb/ , C/C++, 58 linesarrayofmatrices.h - util/
lbfgsb/ , C++, 143 lineslbfgsb.cpp - util/
lbfgsb/ , C++, 19 linesmatlabexception.cpp - util/
lbfgsb/ , C/C++, 28 linesmatlabexception.h - util/
lbfgsb/ , C++, 67 linesmatlabmatrix.cpp - util/
lbfgsb/ , C/C++, 75 linesmatlabmatrix.h - util/
lbfgsb/ , C++, 221 linesmatlabprogram.cpp - util/
lbfgsb/ , C/C++, 71 linesmatlabprogram.h - util/
lbfgsb/ , C++, 35 linesmatlabscalar.cpp - util/
lbfgsb/ , C/C++, 44 linesmatlabscalar.h - util/
lbfgsb/ , C++, 40 linesmatlabstring.cpp - util/
lbfgsb/ , C/C++, 41 linesmatlabstring.h - util/
lbfgsb/ , C++, 153 linesprogram.cpp - util/
lbfgsb/ , C/C++, 128 linesprogram.h - util/
minimize.m , MATLAB, 206 lines - util/
sumTensor.m , MATLAB, 22 lines - README.md, Text, 61 lines
coganlab/cross_patient_speech_decoding
a70f1ae711cf3627cf9357d2a72868a74f2d774f, 3 June 2026Availability: 1 check, the latest on 27 September 2026: the link answers
- 27 September 2026: the link answers
76 files
- aligned_decoding/
__init__.py , Python, 1 line - aligned_decoding/
alignment/ , Python, 285 lines, 2 matchesAlignCCA.py - aligned_decoding/
alignment/ , Python, 175 linesAlignMCCA.py - aligned_decoding/
alignment/ , Python, 211 lines, 1 matchJointPCA.py - aligned_decoding/
alignment/ , Python, 1 line__init__.py - aligned_decoding/
alignment/ , Python, 215 linesalignment_utils.py - aligned_decoding/
alignment/ , Python, 243 linesalignment_visualization. py - aligned_decoding/
alignment/ , Python, 68 linesmetrics.py - aligned_decoding/
decoders/ , Python, 1 line__init__.py - aligned_decoding/
decoders/ , Python, 445 lines, 1 matchcross_pt_decoders.py - aligned_decoding/
decomposition/ , Python, 79 linesDimRedReshape.py - aligned_decoding/
decomposition/ , Python, 114 linesNoCenterPCA.py - aligned_decoding/
decomposition/ , Python, 1 line__init__.py - aligned_decoding/
figure_analyses/ , Jupyter, 1,546 lines, 1 matchfig_2.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 1,468 lines, 1 matchfig_3.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 932 linesfig_4.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 494 linesfig_5.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 1,351 linesfig_6.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 558 linessupp/ supp_fig_10.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 645 linessupp/ supp_fig_11.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 516 linessupp/ supp_fig_12_13.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 510 linessupp/ supp_fig_14_15.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 574 linessupp/ supp_fig_16.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 598 linessupp/ supp_fig_17.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 610 linessupp/ supp_fig_18.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 922 linessupp/ supp_fig_19.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 376 linessupp/ supp_fig_2.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 168 linessupp/ supp_fig_20.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 542 linessupp/ supp_fig_21.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 583 linessupp/ supp_fig_22.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 220 linessupp/ supp_fig_23.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 683 linessupp/ supp_fig_24.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 684 linessupp/ supp_fig_25.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 694 linessupp/ supp_fig_26.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 677 linessupp/ supp_fig_27.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 581 linessupp/ supp_fig_4.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 638 linessupp/ supp_fig_5.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 1,551 lines, 1 matchsupp/ supp_fig_6_7.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 904 linessupp/ supp_fig_8.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 1,401 lines, 1 matchsupp/ supp_fig_9.ipynb - aligned_decoding/
nn_models/ , Python, 1 line__init__.py - aligned_decoding/
nn_models/ , Python, 264 lines, 1 matchdata_utils/ AlignCCA.py - aligned_decoding/
nn_models/ , Python, 1 linedata_utils/ __init__.py - aligned_decoding/
nn_models/ , Python, 210 linesdata_utils/ alignment_utils.py - aligned_decoding/
nn_models/ , Python, 90 linesdata_utils/ augmentations.py - aligned_decoding/
nn_models/ , Python, 574 linesdata_utils/ datamodules.py - aligned_decoding/
nn_models/ , Python, 889 linesmodels.py - aligned_decoding/
nn_models/ , Jupyter, 359 linestrain.ipynb - aligned_decoding/
processing_utils/ , Python, 1 line__init__.py - aligned_decoding/
processing_utils/ , Python, 239 linesdata_augmentation.py - aligned_decoding/
processing_utils/ , Jupyter, 237 linesdata_processing_test.ipy nb - aligned_decoding/
processing_utils/ , Python, 82 linesdata_saving.py - aligned_decoding/
processing_utils/ , Python, 186 linesfeature_data_from_mat.py - aligned_decoding/
processing_utils/ , Python, 114 linesgrid_subsampling.py - aligned_decoding/
processing_utils/ , Python, 255 lines, 2 matchespoisson_disk_sampling.py - aligned_decoding/
processing_utils/ , Python, 244 linessequence_processing.py - aligned_decoding/
processing_utils/ , Python, 136 linesspatial_avg_subsampling. py - aligned_decoding/
realtime_sim/ , Python, 1 line__init__.py - aligned_decoding/
realtime_sim/ , Python, 90 linesaugmentations.py - aligned_decoding/
realtime_sim/ , Python, 189 linesctc_decoder.py - aligned_decoding/
realtime_sim/ , Python, 895 lines, 1 matchrealtime_datamodule.py - aligned_decoding/
realtime_sim/ , Python, 324 lines, 2 matchesrealtime_nn_model.py - aligned_decoding/
realtime_sim/ , Python, 164 lines, 2 matchesrealtime_processing.py - aligned_decoding/
scripts/ , Python, 393 linesaligned_decode_cross_pat ient_subsample.py - aligned_decoding/
scripts/ , Python, 407 lines, 1 matchaligned_decode_grid_subs ample.py - aligned_decoding/
scripts/ , Python, 297 linesaligned_decode_nn.py - aligned_decoding/
scripts/ , Python, 395 linesaligned_decode_pitch_sub sample.py - aligned_decoding/
scripts/ , Python, 379 lines, 1 matchaligned_decode_spatialAv g_subsample.py - aligned_decoding/
scripts/ , Python, 296 lines, 1 matchaligned_decode_svm.py - aligned_decoding/
scripts/ , Python, 461 lines, 1 matchaligned_decode_svm_ncv.p y - aligned_decoding/
scripts/ , Python, 495 lines, 1 matchtrain_ctc_rnn.py - aligned_decoding/
scripts/ , Python, 207 linestrain_seq2seq.py - aligned_decoding/
scripts/ , Python, 1,145 lines, 1 matchtune_ctc_rnn.py - aligned_decoding/
scripts/ , Python, 1,062 lines, 1 matchtune_ctc_rnn_align.py - LICENSE, License, 21 lines
- README.md, Text, 29 lines
Zenodo 20531684
Availability: 1 check, the latest on 27 September 2026: the link answers (HTTP 200)
- 27 September 2026: the link answers (HTTP 200)
76 files
- aligned_decoding/
__init__.py , Python, 1 line - aligned_decoding/
alignment/ , Python, 285 linesAlignCCA.py - aligned_decoding/
alignment/ , Python, 175 linesAlignMCCA.py - aligned_decoding/
alignment/ , Python, 211 linesJointPCA.py - aligned_decoding/
alignment/ , Python, 1 line__init__.py - aligned_decoding/
alignment/ , Python, 215 linesalignment_utils.py - aligned_decoding/
alignment/ , Python, 243 linesalignment_visualization. py - aligned_decoding/
alignment/ , Python, 68 linesmetrics.py - aligned_decoding/
decoders/ , Python, 1 line__init__.py - aligned_decoding/
decoders/ , Python, 445 linescross_pt_decoders.py - aligned_decoding/
decomposition/ , Python, 79 linesDimRedReshape.py - aligned_decoding/
decomposition/ , Python, 114 linesNoCenterPCA.py - aligned_decoding/
decomposition/ , Python, 1 line__init__.py - aligned_decoding/
figure_analyses/ , Jupyter, 1,546 linesfig_2.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 1,468 linesfig_3.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 932 linesfig_4.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 494 linesfig_5.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 1,351 linesfig_6.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 558 linessupp/ supp_fig_10.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 645 linessupp/ supp_fig_11.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 516 linessupp/ supp_fig_12_13.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 510 linessupp/ supp_fig_14_15.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 574 linessupp/ supp_fig_16.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 598 linessupp/ supp_fig_17.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 610 linessupp/ supp_fig_18.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 922 linessupp/ supp_fig_19.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 376 linessupp/ supp_fig_2.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 168 linessupp/ supp_fig_20.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 542 linessupp/ supp_fig_21.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 583 linessupp/ supp_fig_22.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 220 linessupp/ supp_fig_23.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 683 linessupp/ supp_fig_24.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 684 linessupp/ supp_fig_25.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 694 linessupp/ supp_fig_26.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 677 linessupp/ supp_fig_27.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 581 linessupp/ supp_fig_4.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 638 linessupp/ supp_fig_5.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 1,551 linessupp/ supp_fig_6_7.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 904 linessupp/ supp_fig_8.ipynb - aligned_decoding/
figure_analyses/ , Jupyter, 1,401 linessupp/ supp_fig_9.ipynb - aligned_decoding/
nn_models/ , Python, 1 line__init__.py - aligned_decoding/
nn_models/ , Python, 264 linesdata_utils/ AlignCCA.py - aligned_decoding/
nn_models/ , Python, 1 linedata_utils/ __init__.py - aligned_decoding/
nn_models/ , Python, 210 linesdata_utils/ alignment_utils.py - aligned_decoding/
nn_models/ , Python, 90 linesdata_utils/ augmentations.py - aligned_decoding/
nn_models/ , Python, 574 linesdata_utils/ datamodules.py - aligned_decoding/
nn_models/ , Python, 889 linesmodels.py - aligned_decoding/
nn_models/ , Jupyter, 359 linestrain.ipynb - aligned_decoding/
processing_utils/ , Python, 1 line__init__.py - aligned_decoding/
processing_utils/ , Python, 239 linesdata_augmentation.py - aligned_decoding/
processing_utils/ , Jupyter, 237 linesdata_processing_test.ipy nb - aligned_decoding/
processing_utils/ , Python, 82 linesdata_saving.py - aligned_decoding/
processing_utils/ , Python, 186 linesfeature_data_from_mat.py - aligned_decoding/
processing_utils/ , Python, 114 linesgrid_subsampling.py - aligned_decoding/
processing_utils/ , Python, 255 linespoisson_disk_sampling.py - aligned_decoding/
processing_utils/ , Python, 244 linessequence_processing.py - aligned_decoding/
processing_utils/ , Python, 136 linesspatial_avg_subsampling. py - aligned_decoding/
realtime_sim/ , Python, 1 line__init__.py - aligned_decoding/
realtime_sim/ , Python, 90 linesaugmentations.py - aligned_decoding/
realtime_sim/ , Python, 189 linesctc_decoder.py - aligned_decoding/
realtime_sim/ , Python, 895 linesrealtime_datamodule.py - aligned_decoding/
realtime_sim/ , Python, 324 linesrealtime_nn_model.py - aligned_decoding/
realtime_sim/ , Python, 164 linesrealtime_processing.py - aligned_decoding/
scripts/ , Python, 393 linesaligned_decode_cross_pat ient_subsample.py - aligned_decoding/
scripts/ , Python, 407 linesaligned_decode_grid_subs ample.py - aligned_decoding/
scripts/ , Python, 297 linesaligned_decode_nn.py - aligned_decoding/
scripts/ , Python, 395 linesaligned_decode_pitch_sub sample.py - aligned_decoding/
scripts/ , Python, 379 linesaligned_decode_spatialAv g_subsample.py - aligned_decoding/
scripts/ , Python, 296 linesaligned_decode_svm.py - aligned_decoding/
scripts/ , Python, 461 linesaligned_decode_svm_ncv.p y - aligned_decoding/
scripts/ , Python, 495 linestrain_ctc_rnn.py - aligned_decoding/
scripts/ , Python, 207 linestrain_seq2seq.py - aligned_decoding/
scripts/ , Python, 1,145 linestune_ctc_rnn.py - aligned_decoding/
scripts/ , Python, 1,062 linestune_ctc_rnn_align.py - LICENSE, License, 21 lines
- README.md, Text, 27 lines
Code availability statement
The paper has a code availability statement. Its license (CC BY-NC-ND) does not allow reproducing it here; in short, from what the harvester recognized in it:
- it points to the authors' code: coganlab/
cross_patient_speech_dec oding
Read it in the paper: doi.org/10.1038/s41467-026-75455-1.
Tracing map
Proposed by the machine: these links were found in the paper and verified at the source, without human review. The map will receive a Zenodo DOI once one of the paper's authors has validated it with their ORCID.
What the map holds:
- 3 repositories of the authors' code, each at its verified commit, with its license and how the link was found in the paper;
- 177 scripts, each with its path and the digest of its content;
- 23 matches between paragraphs of the paper and lines of the code (method lexical-v1);
- neither the text of the paper nor the code itself.
Its JSON (tracing-map.json) is deposited on Zenodo with its DOI once the map is validated.
Data
No dataset and no data link were found in the paper.
Data availability statement
The paper has a data availability statement. Its license (CC BY-NC-ND) does not allow reproducing it here; in short, from what the harvester recognized in it:
- no repository, dataset or request procedure was recognized in it
Read it in the paper: doi.org/10.1038/s41467-026-75455-1.
Versions
The history of this record: each version stored by the harvester or made by a correction of its authors or of the maintainers of its code, and what changed in its facts. The texts of the paper (its abstract, its availability statements) are not part of it; versions that changed only those are not listed.
Version 1, 27 September 2026: the first record
Recorded: type, language, journal, volume, issue, pages, dates, 11 authors, 3 keywords, 8 MeSH terms, 3 funders, 52 references.
Cite
This paper
Spalding, Z., Duraivel, S., Rahimpour, S., Wang, C., Barth, K., Schmitz, C., Lad, S. P., Friedman, A. H., Southwell, D. G., Viventi, J., & Cogan, G. B. (2026). Shared latent representations of speech production for cross-patient speech decoding. Nature communications, 17(1), 8716. https://
BibTeX
@article{spalding2026sha
author = {Spalding, Z. and Duraivel, S. and Rahimpour, S. and Wang, C. and Barth, K. and Schmitz, C. and Lad, S. P. and Friedman, A. H. and Southwell, D. G. and Viventi, J. and Cogan, G. B.},
title = {{Shared latent representations of speech production for cross-patient speech decoding}},
journal = {Nature communications},
year = {2026},
month = jul,
volume = {17},
number = {1},
pages = {8716},
publisher = {Nature Publishing Group},
issn = {2041-1723},
doi = {10.1038/
url = {https://
pmid = {42463660},
pmcid = {PMC13490415}
}
RIS
TY - JOUR
AU - Spalding, Z.
AU - Duraivel, S.
AU - Rahimpour, S.
AU - Wang, C.
AU - Barth, K.
AU - Schmitz, C.
AU - Lad, S. P.
AU - Friedman, A. H.
AU - Southwell, D. G.
AU - Viventi, J.
AU - Cogan, G. B.
TI - Shared latent representations of speech production for cross-patient speech decoding
T2 - Nature communications
J2 - Nat Commun
PY - 2026
DA - 2026/
VL - 17
IS - 1
SP - 8716
SN - 2041-1723
PB - Nature Publishing Group
DO - 10.1038/
UR - https://
LA - en
ER -
CSL-JSON
{
"id": "10.1038/
"type": "article-journal",
"title": "Shared latent representations of speech production for cross-patient speech decoding",
"container-title": "Nature communications",
"author": [
{
"family": "Spalding",
"given": "Z."
},
{
"family": "Duraivel",
"given": "S."
},
{
"family": "Rahimpour",
"given": "S."
},
{
"family": "Wang",
"given": "C."
},
{
"family": "Barth",
"given": "K."
},
{
"family": "Schmitz",
"given": "C."
},
{
"family": "Lad",
"given": "S. P."
},
{
"family": "Friedman",
"given": "A. H."
},
{
"family": "Southwell",
"given": "D. G."
},
{
"family": "Viventi",
"given": "J."
},
{
"family": "Cogan",
"given": "G. B."
}
],
"container-title-short":
"volume": "17",
"issue": "1",
"page": "8716",
"DOI": "10.1038/
"PMID": "42463660",
"PMCID": "PMC13490415",
"ISSN": "2041-1723",
"publisher": "Nature Publishing Group",
"URL": "https://
"language": "en",
"issued": {
"date-parts": [
[
2026,
7,
16
]
]
}
}
The tracing map gets a citation of its own once an author has validated it and it has a DOI.
Similar papers
The papers with a page that share the most with this one: the tools found in their code, their categories, datasets, cited references and authors, the rarest counting most.
- [1] doi:10.1038/s41467-026-71284-4 [code]
- Encoding of speech modes and loudness in ventral precentral gyrus.Journal: Nature communicationsIn common: seaborn, scikit-learn, pandas, 3 other tools, cognitive, 7 references
- [2] doi:10.1038/s41586-026-10691-5 [code]
- Mapping the neuronal building blocks of human language with language models.Journal: NatureIn common: statsmodels, scikit-learn, pandas, 3 other tools, cognitive, 7 references
- [3] doi:10.1038/s42003-026-10957-8 [code]
- Brain defence by the extracellular matrix protein Cochlin.Journal: Communications biologyIn common: PyTorch Lightning, Keras, TensorFlow, 10 other tools
- [4] doi:10.1523/eneuro.0023-26.2026 [code]
- Real-Time Segmentation and Classification of Birdsong Syllables for Learning Experiments.Journal: eNeuroIn common: PyTorch Lightning, Keras, TensorFlow, 8 other tools, cognitive
- [5] doi:10.1073/pnas.2536563123 [code]
- Temporally structured motor and auditory representations in covert syllable production.Journal: Proceedings of the National Academy of Sciences of the United States of AmericaIn common: statsmodels, scikit-learn, pandas, 3 other tools, cognitive, 5 references
- [6] doi:10.1038/s41562-026-02414-7 [code]
- Optimized feature gains explain and predict successes and failures of human selective listening.Journal: Nature human behaviourIn common: PyTorch Lightning, TensorFlow, h5py, 8 other tools, cognitive
- [7] doi:10.7554/elife.109400 [code]
- High-fidelity neural speech reconstruction through an efficient acoustic-linguistic dual-pathway framework.Journal: eLifeIn common: PyTorch Lightning, PyTorch, SciPy, 2 other tools, intracranial EEG (iEEG / ECoG / SEEG), cognitive, 4 references
- [8] doi:10.1038/s41586-026-10331-y [code]
- Active dissociation of intracortical spiking and high gamma activity.Journal: NatureIn common: TensorFlow, h5py, scikit-learn, 4 other tools, 4 references
- [9] doi:10.1038/s42003-026-10169-0 [code]
- Shared representations in brains and models reveal a two-route cortical organization during scene perception.Journal: Communications biologyIn common: Plotly, h5py, statsmodels, 7 other tools, cognitive, 2 references
- [10] doi:10.1038/s41597-025-05174-7 [code]
- A large-scale MEG and EEG dataset for object recognition in naturalistic scenesJournal: n/aIn common: Keras, TensorFlow, Plotly, 8 other tools
Contribute
The authors of this paper can claim it, correct its record and validate its tracing map, and the maintainers of its code (its owner, or a public member of its organization) correct what it says of their repository; anyone signed in can ask for its removal. Every request goes to OSCR's own machine, which answers it; your account page follows them.
Sign in with ORCID to claim this paper as one of its authors, correct its record or validate its tracing map: when the paper's metadata lists your ORCID iD, you are recognized at once. Maintainers of its code: sign in with GitHub, then claim the repository on your account page.
Claim this paper
Correct its record
Say what each link of this record is, remove the ones that are not the paper's, add the ones that are missing. The correction becomes a new version of the record, in its Versions section.
Validate its tracing map
You validate the map as this page shows it: 3 repositories of the authors' code, each at its verified commit and with its license, 177 scripts, and 23 matches between paragraphs and code (see the Code and Map sections). It then receives a DOI on Zenodo, with you (your ORCID iD) and OSCR as its creators; the code itself is not deposited.
The map's fingerprint: sha256:856f0c885b469a2c…
Add the badge to its README
The badge links the code to this page. Copy one of these into the README of the paper's code: only you decide where it goes, and nothing is changed for you.
Markdown
[, paste the snippet at the top, then “Commit changes…” and, to review it first, “Create a new branch and start a pull request”. You open the pull request; OSCR asks for no permission.
Request its removal
To ask OSCR to remove this record, the copies of its authors' scripts or its tracing map, use the removal request page: signed in, you say who you are, what to remove and why, then review and confirm the request. Published rules decide every request (how).
Discussion, reproductions, activity
Discussion: questions and error reports about this paper and its code, from signed-in readers and its authors. It opens with sign-in.
Reproductions: reports from readers who ran the authors' code: what they reproduced, with which environment, commit and data. It opens with sign-in.
Activity: what happens around this paper: new versions of its record, its map's validation, discussions and reproductions. It opens with sign-in.
