OSCR

Subthalamic stimulation modulates working memory-related cortical dynamics in Parkinson's disease.

Code ↔ Paper

7 matches between paragraphs of the paper and lines of its authors' code, computed by the harvester (lexical-v1). Click a colored paragraph or line to see its counterpart.

The 7 matches
  1. [1] § Materials and methods › EEG data analysis ↔ main.py, lines 217–260 · score 0.71 · log transformed, 1–4 Hz, 4–8 Hz, delta, windows, theta
  2. [2] § Materials and methods › EEG data analysis ↔ project_package/project_functions/physio_features.py, lines 122–183 · score 0.61 · log transformed, spectrogram, signal, Median, windows, channels
  3. [3] § Materials and methods › Statistical analysis ↔ main.py, lines 527–553 · score 0.60 · task accuracy, task RT, frequency band, power, behavioural, EEG
  4. [4] § Materials and methods › Behavioural data analysis ↔ project_package/project_functions/behavioral_features.py, lines 266–368 · score 0.59 · positions correct, button presses, SDR task, Behavioural
  5. [5] § Materials and methods › Statistical analysis ↔ statistics.R, lines 121–171 · score 0.58 · dDBS, oDBS, spectral responses, models, stimulation
  6. [6] § Materials and methods › Patients ↔ project_package/project_functions/behavioral_features.py, lines 372–433 · score 0.51 · button press, oddball tasks, SDR tasks, scores, stimuli, patients
  7. [7] § Materials and methods › EEG data analysis ↔ project_package/project_functions/preprocessing.py, lines 551–698 · score 0.50 · notch filter, noise, preprocessing, EEG, stimulation

Paper

Loaded from Europe PMC by your browser, not stored by OSCR: doi.org · Europe PMC

The paper is loaded when this pane is shown.

The authors' code

Python · 704 lines · 27 KB · MIT · 2 matches

  1. # -*- coding: utf-8 -*-
  2. """End-to-end workflow for the working-memory EEG analysis."""
  4. #%%
  5. import ast
  6. import seaborn as sns
  7. from pathlib import Path
  8. import pickle as pkl
  9. import pandas as pd
  10. import matplotlib.pyplot as plt
  11. import numpy as np
  12. import mne
  13. from scipy import stats
  14. from project_package.project_functions.preprocessing import (preprocess,
  15. get_stim_info)
  16. from project_package.project_functions.behavioral_features import (evaluate_beh_patients,
  17. summarize_all_results)
  18. from project_package.project_functions.files_management import (get_available_measurements,
  19. divide_by_measurement_type)
  20. from project_package.project_functions.physio_features import (get_P300, clustInfo,
  21. epochs_permutation_test,
  22. tfa_epocher, meanpower,
  23. tf_data)
  24. from project_package.project_functions.statistics import (add_norm_values,
  25. add_baseline_values,
  26. corr_df, subsetter,
  27. significance_df, renamer,
  28. plot_for_stats)
  29. plt.rcParams["font.family"] = "Arial"
  32. #%% Define steps to be ran
  34. redo_preprocessing = False
  35. redo_timefrequency = False
  36. redo_permutation_test = False
  37. redo_P300 = False
  38. redo_behavioral = False
  39. plots_report = False
  40. plotP3waves = False
  42. #%% PATHS
  43. PROJECT_ROOT = Path(__file__).resolve().parent
  44. DATA_DIR = PROJECT_ROOT / 'data'
  45. METADATA_DIR = DATA_DIR / 'metadata'
  46. RAW_DATA_DIR = DATA_DIR / 'raw'
  47. PREPROCESSED_DATA_DIR = DATA_DIR / 'preprocessed'
  48. PROCESSED_DATA_DIR = DATA_DIR / 'processed'
  49. R_INPUT_DIR = DATA_DIR / 'r_inputs'
  50. RESULTS_DIR = PROJECT_ROOT / 'results'
  51. STATISTICS_RESULTS_DIR = RESULTS_DIR / 'statistics'
  52. FIGURES_DIR = RESULTS_DIR / 'figures'
  54. for folder in (PREPROCESSED_DATA_DIR, PROCESSED_DATA_DIR, R_INPUT_DIR,
  55. STATISTICS_RESULTS_DIR, FIGURES_DIR):
  56. folder.mkdir(parents=True, exist_ok=True)
  58. # Measurement and task metadata.
  59. subsetInfoPath = METADATA_DIR / 'Analizable_info.csv'
  60. stimInfoPath = METADATA_DIR / 'Stimulation_Info.csv'
  61. filenamesPath = METADATA_DIR / 'Data_file_names.csv'
  62. rightAnswersPath = METADATA_DIR / 'rightAnswers.txt'
  63. if not rightAnswersPath.exists():
  64. rightAnswersPath = None
  66. # Cached outputs used when the corresponding redo_* flag is False.
  67. P3infoPath = PROCESSED_DATA_DIR / 'p300potentialsinfo.pkl'
  68. behScoresPath = PROCESSED_DATA_DIR / 'behScores.pkl'
  69. prepInfoPath = PROCESSED_DATA_DIR / 'preprocessed_files_info_1.csv'
  71. # Data locations. Place private EEG files under these folders before running.
  72. rawDataPath = RAW_DATA_DIR
  73. prepPath = PREPROCESSED_DATA_DIR
  74. dataPath = prepPath
  78. # Available preprocessed files
  79. files = {}
  80. fileList, measStatus = get_available_measurements(filenamesPath, dataPath)
  81. files['SDR'], files['VDR'] = divide_by_measurement_type(fileList)
  83. # Oddball correspondences
  84. oddDict = {'VDR': 'acoustic',
  85. 'SDR': 'visual'}
  86. #%% PREPROCESS
  87. # ! This sections runs for a several hours if True
  88. manual_rejection = False
  89. preselected_bad_ch = True #To use bad channels selected before by hand as bad
  90. #Using it ensures the reproducibility of the results
  92. if redo_preprocessing:
  93. # Initiliaze preprocess info storage
  94. preprocess_info = pd.DataFrame(columns=['measurement', 'task', 'n_bad_ch', 'bad_ch',
  95. 'n_task_epochs', 'n_bad_task_epochs',
  96. 'n_oddball_epochs', 'n_bad_oddball_epochs',
  97. 'path'])
  98. filenames = [file.name for file in rawDataPath.glob('*raw.fif')]
  100. for file in filenames:
  101. if preselected_bad_ch:
  102. info = pd.read_csv(prepInfoPath)
  103. idx = info.loc[info['measurement'] == file.replace('raw.fif', '')].index[0]
  104. bad_ch = ast.literal_eval(info.at[idx, 'bad_ch'])
  105. else:
  106. bad_ch = None
  107. prep_info = preprocess(rawDataPath, file, prepPath, stimInfoPath,
  108. bad_ch = bad_ch, manual = manual_rejection)
  110. preprocess_info = pd.concat(
  111. [preprocess_info, pd.DataFrame([prep_info])],
  112. ignore_index=True
  113. )
  115. preprocess_info.to_csv(PROCESSED_DATA_DIR / 'preprocessingInfo.csv', index=False)
  117. dataPath = prepPath
  124. #%% BEHAVIORAL ANALYSIS
  125. # Raw evaluation
  126. # ! This sections runs for a couple of minutes if True
  128. #Results stored for each trial (not measurement!)
  129. if redo_behavioral:
  130. swapper = np.array([2, 3, 4, 5, 6, 7, 8, 1]) # For button label correction
  131. sdrScoreAll = evaluate_beh_patients(files['SDR'], 'SDR', rightAnswersPath, swapper)
  132. #outcome dictionaries contain dictionaries for each patient with the time points and trial-wise accuracy and RT
  133. vdrScoreAll = evaluate_beh_patients(files['VDR'], 'VDR', rightAnswersPath)
  134. vobScoreAll = evaluate_beh_patients(files['SDR'], 'oddball')
  135. aobScoreAll = evaluate_beh_patients(files['VDR'], 'oddball')
  137. #These results are already saved for whole measurement
  138. sensitivityVobAll = evaluate_beh_patients(files['SDR'], 'sensitivity')
  139. sensitivityAobAll = evaluate_beh_patients(files['VDR'], 'sensitivity')
  141. # Compute measurement total results
  142. sumResultsVdr = summarize_all_results(vdrScoreAll)
  143. sumResultsSdr = summarize_all_results(sdrScoreAll, sdr=True)
  144. sumResultsVob = summarize_all_results(vobScoreAll)
  145. sumResultsAob = summarize_all_results(aobScoreAll)
  147. behScores = {'VDR': sumResultsVdr,
  148. 'SDR': sumResultsSdr,
  149. 'vob': sumResultsVob,
  150. 'aob': sumResultsAob,
  151. 'vob_s': sensitivityVobAll,
  152. 'aob_s': sensitivityAobAll}
  154. #Save data
  155. behPath = PROCESSED_DATA_DIR / 'behScores.pkl'
  156. with behPath.open('wb') as file:
  157. pkl.dump(behScores, file)
  159. else:
  160. behPath = behScoresPath
  161. with behPath.open("rb") as file:
  162. behScores = pkl.load(file)
  163. sumResultsVdr, sumResultsSdr, sumResultsVob, sumResultsAob,\
  164. sensitivityVobAll, sensitivityAobAll = behScores.values()
  170. #%% EXTRACTION P300 FEATURES
  171. # ! This sections runs for a couple of minutes if True
  173. # to run the test and visualize channels chosen
  174. # It takes time because all V0 epochs are read and concatenated
  175. if redo_permutation_test:
  176. #Here only for visualization purposes, not to actually change cluster chosen
  177. #TODO: Does not work yet
  178. for task in ['VDR', 'SDR']:
  179. obs, clust, cluster_pv, H0 = epochs_permutation_test(files[task], oddDict[task], clustInfo=clustInfo)
  181. ##note that adj matrix has not been specified for the cluster perm, so interpretation is difficult
  183. clustInfo = {'acoustic': {'cluster': 46, 'chans': ['Cz','CPz','Pz','POz']},
  184. 'visual': {'cluster': 69, 'chans': ['Cz','CPz','Pz','POz']}}
  186. # dictionary clustInfo (imported from physio_features) has channels of the clusters
  187. # previously selected
  188. if redo_P300:
  189. P3info = {}
  190. features = ['peak', 'latency', 'amplitude']
  192. for file in fileList:
  193. eFile = file.replace('_p_raw', '_oe_epo')
  194. task = 'VDR' if 'VDR' in eFile else 'SDR'
  195. epochs = mne.read_epochs(eFile, preload=True).apply_baseline()
  196. epochs.pick_channels(clustInfo[oddDict[task]]['chans'])
  197. #TODO: this picks channels that belong to any cluster, maybe make it a bit more specific?
  198. P3info[eFile] = {}
  199. for k in epochs.event_id.keys():
  200. #print(k)
  201. if len(epochs[k])>0:
  203. P3info[eFile][k] = {f:v for f,v in zip(features, get_P300(epochs[k]))}
  205. P3Path = PROCESSED_DATA_DIR / 'p300potentialsinfo.pkl'
  206. with P3Path.open('wb') as file:
  207. pkl.dump(P3info, file)
  210. else:
  211. P3Path = P3infoPath
  212. with P3infoPath.open("rb") as file:
  213. P3info = pkl.load(file)
  215. #%% EXTRACTION TIME-FREQUENCY FEATURES
  217. t_window = 4 #seconds before and after cue for the epochs
  218. freqBands = {'delta (1-3)': (1, 4),
  219. 'theta (4-8)': (4, 9),
  220. 'alpha (9-14)': (9, 15),
  221. 'beta (15-30)': (15, 31),
  222. 'total (1-30)': (1,31)}
  224. baseline = {'VDR': (1.5, 3.5),
  225. 'SDR': (1.5,3.5)}
  227. TFPath = PROCESSED_DATA_DIR / 'timefrequencydata.pkl'
  229. tfaInfo = {}
  231. if redo_timefrequency:
  232. for file in fileList:
  233. filename = Path(file).name
  234. print(f'running TFA for {filename}')
  235. task = 'VDR' if 'VDR' in file else 'SDR'
  236. data = mne.io.read_raw_fif(file, preload=True)
  237. epochs = tfa_epocher(data, t_window=t_window)
  238. f, t, Sxx, BL, tfband = tf_data(epochs, freqBands=freqBands, log_transform=True,
  239. baseline=baseline[task])
  241. tfaInfo[filename] = tfband
  242. print(f'current keys in tfaInfo: {tfaInfo.keys()}')
  243. tfaData = {'Sxx':{}, 'BL': {}}
  244. tfaData['Sxx'][filename] = Sxx
  245. tfaData['BL'][filename] = BL
  247. # sxxpath = f'{file}_spectrum.pkl' #tfaspectra will contain the raw spectra for all channels
  248. # file = open(sxxpath, 'wb')
  249. # pkl.dump(Sxx, file)
  250. # file.close()
  251. TFpath = PROCESSED_DATA_DIR / f'{filename}_timefrequencydata_raw.pkl'
  252. with TFpath.open('wb') as file:
  253. pkl.dump(tfaData, file)
  255. with TFPath.open('wb') as file:
  256. pkl.dump(tfaInfo, file)
  257. print(f'dumped tfaInfo with keys: {tfaInfo.keys()}')
  258. else:
  259. with TFPath.open('rb') as file:
  260. tfaInfo=pkl.load(file)
  264. # else:
  265. # with open(TFPath, "rb") as pf:
  266. # tfaInfo = pkl.load(pf)
  268. ##read in one file to get time and frequency indices
  269. ##to save memory, they can also be generated as simple arrays
  270. epochs = tfa_epocher(mne.io.read_raw_fif(fileList[0], preload=True), t_window=t_window)
  271. f, t, _, _, _ = tf_data(epochs, freqBands=freqBands, log_transform=True,
  272. baseline=(0,0) )
  274. f = np.arange(1,31)
  275. t = np.linspace(-3.5,3.5,num=141)
  276. #extract raw spectra and relative spectra, plot along with topos
  277. over_time_abs = np.nan*np.zeros((len(fileList),len(f),len(t)))
  278. over_time_rel = over_time_abs.copy()
  280. over_chans_abs = np.nan*np.zeros((len(fileList),len(f), 64))
  281. over_chans_rel = over_chans_abs.copy()
  282. taskvec = np.nan*np.zeros(len(fileList))
  283. #read in single-subject spectra from pickle files
  284. for i,file in enumerate(fileList):
  286. print(i)
  287. filename = Path(file).name
  288. if 'VDR' in filename:
  289. taskvec[i] = 1
  290. elif 'SDR' in filename:
  291. taskvec[i] = 2
  292. TFpath = PROCESSED_DATA_DIR / f'{filename}_timefrequencydata_raw.pkl'
  293. with TFpath.open("rb") as pf:
  294. tfaData = pkl.load(pf)
  297. Sxx = np.array(list(tfaData['Sxx'].values()))
  298. rel = Sxx - np.array(list(tfaData['BL'].values()))
  300. Sxx = np.squeeze(Sxx)
  301. rel = np.squeeze(rel)
  302. if len(Sxx.shape) != 4:
  303. continue
  305. over_time_abs[i,:,:] = np.median(Sxx, (0,1))
  306. over_time_rel[i,:,:] = np.median(rel, (0,1))
  308. over_chans_abs[i,:,:] = np.median(Sxx, (0,3)).T
  309. over_chans_rel[i,:,:] = np.median(rel, (0,3)).T
  310. # tfaInfo[filename] = {band: np.nanmedian(rel[:,:,lo:hi,:]) for band, (lo,hi) in freqBands.items()}
  317. #TODO: include correlation topos!
  319. #%% relative spectra in both tasks
  320. fig,ax = plt.subplots(2,2) #for relative spectra in both tasks
  323. im2=ax[0,0].pcolor(np.nanmedian(over_time_rel[taskvec==2],0))
  324. ax[0,0].set_title('Spectral response (SDR)')
  325. cbar=plt.colorbar(im2, ax=ax[1,0])
  326. cbar.set_label('dB', rotation=270)
  330. im=ax[1,0].pcolor(np.nanmedian(over_time_rel[taskvec==1],0))
  331. ax[1,0].set_title('Spectral response (VDR)')
  332. cbar=plt.colorbar(im, ax=ax[0,0])
  333. cbar.set_label('dB', rotation=270)
  335. i=.1
  336. for band, (lo,hi) in freqBands.items():
  337. ax[1,1].plot(np.nanmedian(over_time_rel[taskvec==1,lo:hi,:],(1,0)),label=band, color=(i,i,.6))
  338. ax[1,1].legend()
  339. ax[0,1].plot(np.nanmedian(over_time_rel[taskvec==2,lo:hi,:],(1,0)),label=band, color=(i,i,.6))
  340. ax[0,1].legend()
  341. i+=.2
  345. ax[0,1].set_title('Frequency bands (SDR)')
  347. ax[1,1].set_title('Frequency bands (VDR)')
  350. lab='frequency [Hz]'
  351. ax[0,0].set_ylabel(lab)
  352. ax[1,0].set_ylabel(lab)
  354. lab='power [dB]'
  355. ax[0,1].set_ylabel(lab)
  356. ax[1,1].set_ylabel(lab)
  357. lab='time [s]'
  359. for i in range(2):
  360. for k in range(2):
  361. ax[i,k].set_xticks(range(len(t))[::10])
  362. ax[i,k].set_xticklabels(t[::10])
  363. ax[i,k].set_xlabel(lab)
  365. fig.set_size_inches(12,6)
  366. plt.tight_layout()
  367. plt.savefig(FIGURES_DIR / 'spectral_response.svg')
  368. #%% absolute spectrum
  369. plt.figure()
  370. plt.plot(np.nanmedian(over_time_abs, (0,2)))
  372. #%% relative spectrum topo
  373. from multichannel_tools.viz import my_topomap
  374. fig=plt.figure()
  375. i=0
  376. clim = {
  377. 'delta (1-3)':[0,1.5],
  378. 'theta (4-8)':[-.5,.5],
  379. 'alpha (9-14)':[-.4,.4],
  380. 'beta (15-30)':[-.3,.3]}
  381. for task,taski in {'SDR':2, 'VDR':1}.items():
  382. for band, (lo,hi) in freqBands.items():
  383. if band == 'total (1-30)':
  384. continue
  385. i+=1
  386. clo,chi = clim[band]
  387. plt.subplot(2,4,i)
  388. plt.title(f'{task}, {band}')
  389. my_topomap(np.nanmedian(over_chans_rel[taskvec==taski,lo:hi,:], (0,1) ), chans = epochs.info.ch_names, clim=(clo,chi))
  390. plt.gcf().set_size_inches(14,5)
  391. plt.savefig(FIGURES_DIR / 'spectral_response_topos.svg')
  399. #%% ALL FEATURES TOGETHER FOR STATISTICS
  400. # Build-up the master DataFrame with all variables by measurement
  402. #Grouping by stimulus type
  403. oddCategory = {'circle':'nontarget',
  404. 'lowPitch': 'nontarget',
  405. 'large': 'target',
  406. 'largeCircle': 'target',
  407. 'highPitch': 'target',
  408. 'distractor': 'distractor'}
  410. varsDict = {'info': ['ID', 'stimulation', 'task', 'time'],
  411. 'physio': ['P3distractoramplitude', 'P3distractorlatency',
  412. 'P3nontargetamplitude', 'P3nontargetlatency', 'P3targetamplitude',
  413. 'P3targetlatency'],#, 'TFalpha', 'TFbeta', 'TFdelta', 'TFtheta', 'TFtotal'],
  414. 'timefreq': ['TFalpha', 'TFbeta', 'TFdelta', 'TFtheta', 'TFtotal'],
  415. 'P3potentials' : ['P3distractoramplitude', 'P3distractorlatency',
  416. 'P3nontargetamplitude', 'P3nontargetlatency',
  417. 'P3targetamplitude', 'P3targetlatency'],
  418. 'behavior': ['oddballAcc', 'oddballRT', 'sensitivity', 'taskAcc', 'taskRT']}
  420. varsDict['physio'].extend(['TF'+k for k in freqBands.keys()])
  422. # Grand dict with all data
  423. pats = list(measStatus['ID'])
  424. measurements = list(measStatus.columns.delete(0))
  425. info = {}
  426. for p in pats:
  427. for m in measurements:
  428. if measStatus.loc[measStatus['ID'] == p][m].item():
  429. measurement = str(p) + '_' + m
  430. info[measurement] = {}
  431. #info: stim, task, time, ID
  432. info[measurement]['ID'] = p
  433. info[measurement]['stimulation'] = get_stim_info(stimInfoPath,
  434. measurement[:-4])
  435. info[measurement]['stimNum'] = 0 if info[measurement]['stimulation'] == 'OFF' else 1
  436. info[measurement]['task'] = m[-3:]
  437. info[measurement]['time'] = m[:-4]
  439. #results: acc ratio, response time, oddball acc, oddball rt, sensitivity idx
  440. if 'VDR' in m:
  441. task, oddball, sensitivity = sumResultsVdr, sumResultsAob, sensitivityAobAll
  442. else:
  443. task, oddball, sensitivity = sumResultsSdr, sumResultsVob, sensitivityVobAll
  445. if m in task[str(p)].keys():
  446. info[measurement]['taskAcc'] = task[str(p)][m][0]
  447. info[measurement]['taskRT'] = task[str(p)][m][1]
  448. info[measurement]['oddballAcc'] = oddball[str(p)][m][0]
  449. info[measurement]['oddballRT'] = oddball[str(p)][m][1]
  450. info[measurement]['sensitivity'] = sensitivity[str(p)][m][0]
  452. #physio features 1: p3 latency, p3 amplitude * stimuli
  453. p3data = P3info[[key for key in P3info.keys() if measurement in key][0]]
  454. for s in p3data: #stimulus type
  455. for f in p3data[s]: #feature
  456. cat = oddCategory[s]
  457. info[measurement]['P3'+cat+f] = p3data[s][f]
  459. #physio features 2: delta, theta, alpha, beta & total after cue
  460. tfdata = tfaInfo[[key for key in tfaInfo.keys() if measurement in key][0]]
  461. for b in tfdata:
  462. info[measurement]['TF'+b] = tfdata[b]
  464. # Convert to pandas data frame
  465. infoDf = pd.DataFrame(info.values())
  467. columnsNorm = varsDict['physio'] + varsDict['behavior']
  469. infoDf = add_norm_values(infoDf, columns=columnsNorm)
  471. # Save
  472. infoDf.to_csv(PROCESSED_DATA_DIR / 'infoDf.csv', index =False)
  474. #Do subsets according to analizable patients and save for analysis in R
  475. subsetInfo = pd.read_csv(subsetInfoPath, index_col=False)
  476. for ta in ['SDR', 'VDR']:
  477. for ti in ['short', 'long', 'all']:
  478. df = subsetter(infoDf, task = ta, time = ti, analizableDf = subsetInfo)
  479. df.to_csv(R_INPUT_DIR / f'{ta}_{ti}.csv', index=False)
  480. #
  481. #
  482. # # -> R : Run statistics.R saved in the same directory as this script
  483. #
  484. # #%% STATISTICS: FROM R
  485. # # Read what was run in R and convert to be used in the report
  486. # ttests = pd.read_csv(STATISTICS_RESULTS_DIR / 'tTestsResults.csv')
  487. # ttests = ttests.drop(0, axis=0).drop('Unnamed: 0', axis=1)
  488. # modelsResults = pd.read_csv(STATISTICS_RESULTS_DIR / 'GLMMresults.csv')
  489. # modelsResults = modelsResults.drop(0, axis=0).drop('Unnamed: 0', axis=1)
  490. #
  491. # #convert to DF with significance info
  492. # sigttests = significance_df(ttests)
  493. # sigmodels = significance_df(modelsResults)
  494. #
  495. # # Save for projects' documentation
  496. # sigttests.to_csv(STATISTICS_RESULTS_DIR / 'tTestsResultsSign.csv', index = False)
  497. # sigmodels.to_csv(STATISTICS_RESULTS_DIR / 'GLMMresultsSign.csv', index = False)
  499. #%% STATISTICS: CORRELATION BETWEEN PHYSIO AND BEHAVIORAL
  501. # Note : The data frames generated here compute correlation between all behavioral
  502. # and all physiological values of a measurement. In the documentation and data
  503. # interpretation only connected variables (time-frequency to VDR and SDR,
  504. # P3 to oddball) were considered
  506. #Generate correlation values between physio and behavioral data
  507. drop_columns = ['ID', 'stimulation', 'time', 'task']
  508. for t in ['short', 'long']:
  509. for task in ['SDR', 'VDR']:
  510. data = subsetter(infoDf, task=task, time=t, analizableDf = subsetInfo)
  511. corrDf = corr_df(data, varsDict['behavior'], varsDict['physio'], drop_columns=drop_columns)
  512. corrDf = significance_df(corrDf)
  513. corrDf.to_csv(STATISTICS_RESULTS_DIR / f'Corr{task}{t}.csv' )
  515. # Generate correlation values between long-term cognitive change and physio values
  516. for task in ['SDR', 'VDR']:
  517. data = subsetter(infoDf, task=task, time='long', analizableDf = subsetInfo)
  518. data = data[data['time'] != 'V0']
  519. colnames = [n + 'Norm' for n in varsDict['behavior']]
  520. corrDf = corr_df(data, colnames, varsDict['physio'], drop_columns=drop_columns)
  521. corrDf = significance_df(corrDf)
  522. corrDf.to_csv(STATISTICS_RESULTS_DIR / f'DiffsCorr{task}long.csv' )
  527. #TODO: add correlation topo here!!
  528. # Generate and store correlation values between baseline values and difference values from V4/V5
  529. infoDf = add_baseline_values(infoDf, columnsNorm)
  530. drop_columns = ['ID', 'stimulation', 'time', 'task']
  531. EEGcors_topo = {}
  532. for task in ['SDR', 'VDR']:
  533. EEGcors_topo[task]={}
  534. for stim in ['OMNI', 'DIR']:
  535. data = subsetter(infoDf, task=task, time='long', analizableDf = subsetInfo)
  536. data = data[data['time'] != 'V0']
  537. data = data[data['stimulation'] == stim]
  538. rownames = [n + 'BL' for n in varsDict['physio']]
  539. colnames = [n + 'Norm' for n in varsDict['behavior']]
  540. corrDf = corr_df(data, colnames, rownames, drop_columns=drop_columns)
  541. corrDf = significance_df(corrDf)
  542. corrDf.to_csv(STATISTICS_RESULTS_DIR / f'BLNormCorr{task}{stim}.csv' )
  544. #select elements in eeg data corresponding to current task and IDs
  545. sel = np.isin(infoDf.ID,data.ID)&np.isin(infoDf.time, ['V4','V5'])&(infoDf.task==task)
  546. if (stim=="DIR"):
  547. sel&=infoDf.ID!=0 #exclude patient 0 because of excess power
  548. for band, (lo,hi) in freqBands.items():
  549. accdat = infoDf.taskAccNorm.to_numpy()[sel]
  550. rtdat = infoDf.taskRTNorm.to_numpy()[sel]
  551. banddat = np.median(over_chans_rel[sel,lo:hi,:],1)
  552. EEGcors_topo[task][f'Acc_{band}'] = [stats.pearsonr(accdat, banddat[:,chan])[0] for chan in range(banddat.shape[1])]
  553. EEGcors_topo[task][f'RT_{band}'] = [stats.pearsonr(rtdat, banddat[:,chan])[0] for chan in range(banddat.shape[1])]
  555. #%% VISUALIZATIONS TO REPORT
  556. # Descriptive table for baseline behavioral results.
  558. #Table with average behavioral results at baseline
  559. behInfoDf = infoDf[['ID', 'time','task','taskAcc', 'taskRT', 'oddballAcc', 'oddballRT', 'sensitivity']]
  560. behInfoV0 = pd.DataFrame(index = ['SDR', 'VDR', 'auditory oddball', 'visual oddball'],
  561. columns = ['Accuracy mean', 'Accuracy SD', 'Response time mean',
  562. 'Response time SD', 'Sensitivity mean',
  563. 'Sensitivity SD'])
  564. dc = {'SDR': 'visual oddball',
  565. 'VDR':'auditory oddball'}
  566. df = behInfoDf[behInfoDf['time'] == 'V0']
  567. for task in ['SDR', 'VDR']:
  568. df = behInfoDf[behInfoDf['time'] == 'V0']
  569. df = df[df['task'] == task]
  570. behInfoV0.loc[(task, 'Accuracy mean')] = df['taskAcc'].mean()
  571. behInfoV0.loc[(task, 'Accuracy SD')] = df['taskAcc'].std()
  572. behInfoV0.loc[(task, 'Response time mean')] = df['taskRT'].mean()
  573. behInfoV0.loc[(task, 'Response time SD')] = df['taskRT'].std()
  574. behInfoV0.loc[(dc[task], 'Accuracy mean')] = df['oddballAcc'].mean()
  575. behInfoV0.loc[(dc[task], 'Accuracy SD')] = df['oddballAcc'].std()
  576. behInfoV0.loc[(dc[task], 'Response time mean')] = df['oddballRT'].mean()
  577. behInfoV0.loc[(dc[task], 'Response time SD')] = df['oddballRT'].std()
  578. behInfoV0.loc[(dc[task], 'Sensitivity mean')] = df['sensitivity'].mean()
  579. behInfoV0.loc[(dc[task], 'Sensitivity SD')] = df['sensitivity'].std()
  581. behInfoV0.to_csv(STATISTICS_RESULTS_DIR / 'baselinebehavioralresults.csv', index=False)
  582. #
  583. # #BOXPLOTS
  584. #
  585. # data = infoDf
  586. # depvar = ['taskAccNorm', 'taskAccNorm', 'TFalpha', 'TFbeta', 'TFbeta', 'TFdelta',
  587. # 'TFbeta', 'P3distractoramplitude', 'P3distractoramplitude']
  588. # indvar = ['stimulation', 'stimulation', 'time', 'time', 'stimulation', 'stimulation',
  589. # 'time', 'stimulation', 'stimulation']
  590. # hue = [None, None, 'stimulation', 'stimulation', None, None, 'stimulation',
  591. # None, None]
  592. # task = ['VDR', 'SDR', 'VDR', 'VDR', 'VDR', 'VDR', 'SDR', 'VDR', 'SDR']
  593. # time = ['long', 'long', 'short', 'short', 'long', 'long', 'long', 'short', 'short']
  594. # for i in range(len(depvar)):
  595. # plot_for_stats(data, depvar[i], indvar[i], hue=hue[i], task=task[i],
  596. # time=time[i], analizableDf=subsetInfo)
  597. #
  598. # #
  599. # if plotP3waves:
  600. # tasks = ['VDR', 'SDR']
  601. # for task in tasks:
  602. # filesV3 = [f for f in files[task] if 'V3' in f]
  603. # epochsdistV3 = {}
  604. # for f in filesV3:
  605. # measurement = f.split('/')[-1][:-14]
  606. # pat = int(measurement.split('_')[0])
  607. # if subsetInfo[subsetInfo['ID'] == pat][task+'_short'].item():
  608. # eFile = f.replace('_p_raw', '_oe_epo')
  609. # epochs = mne.read_epochs(eFile, preload=True).apply_baseline()
  610. # epochs.pick_channels(clustInfo[oddDict[task]]['chans'])
  611. # epochs = epochs['distractor'].apply_baseline()\
  612. # .get_data().mean(axis=0).std(axis=0)
  613. # stim = get_stim_info(stimInfoPath, measurement)
  614. # if stim not in epochsdistV3:
  615. # epochsdistV3[stim] = epochs
  616. # else:
  617. # epochsdistV3[stim] = np.dstack((epochsdistV3[stim], epochs))
  618. #
  619. # plt.figure()
  620. # colors=['mediumblue','limegreen' , 'deepskyblue','aquamarine', 'mediumblue', 'aquamarine', 'yellowgreen']
  621. # for i, stim in enumerate(['OFF', 'DIR', 'OMNI']):
  622. # array = epochsdistV3[stim].squeeze().mean(axis=1)
  623. # bl = array[0:1000].mean()
  624. # array = array - bl
  625. # error = epochsdistV3[stim].squeeze().std(axis=1)/np.sqrt(epochsdistV3[stim].shape[2])
  626. # time = np.linspace(-0.2, 1.0, 6001)
  627. # plt.plot(time,array, label = stim, color = colors[i])
  628. # plt.fill_between(time, array-error, array + error, alpha = 0.3, color=colors[i])
  629. #
  630. # plt.ylabel(renamer('P3distractoramplitude', task))
  631. # plt.xlabel('time [s]')
  632. # plt.legend()
  633. # sns.despine()
  634. #
  635. # # SCATTER PLOTS
  636. # # In different colors :)
  637. #
  638. # #Part 1[]
  639. # task = ['VDR', 'VDR']
  640. # time = ['short', 'long']
  641. # x=['TFalpha', 'TFtheta']
  642. # y=['taskAcc', 'taskAcc']
  643. # #stim = 'OMNI'
  644. #
  645. # color = ['deepskyblue','limegreen' ,'aquamarine', 'yellowgreen', 'mediumblue']
  646. # for i in range(len(task)):
  647. # data = subsetter(infoDf, task=task[i], time=time[i], analizableDf=subsetInfo)
  648. # plt.figure()
  649. # plt.scatter(data[x[i]],data[y[i]], color=color[0])
  650. # plt.xlabel(renamer(x[i], task[i]))
  651. # plt.ylabel(renamer(y[i], task[i]))
  652. # sns.despine()
  653. #
  654. # #Part 2 (changes)
  655. # task = 'VDR'
  656. # time = 'long'
  657. # x = 'TFbeta'
  658. # y = 'taskAccNorm'
  659. # data = subsetter(infoDf, task=task, time=time, analizableDf=subsetInfo)
  660. #
  661. # data = data[data['time'] != 'V0']
  662. # plt.figure()
  663. # plt.scatter(data[x],data[y], color=color[1])
  664. # plt.xlabel(renamer(x, task))
  665. # plt.ylabel(renamer(y, task))
  666. # sns.despine()
  667. #
  668. # #Part 3 (baseline -> change)
  669. #
  670. # task = [ 'VDR', 'SDR']
  671. # time = [ 'long', 'long']
  672. # x=['TFbetaBL', 'TFalphaBL']
  673. # y=[ 'taskAccNorm', 'taskAccNorm']
  674. # stim = ['OMNI', 'DIR']
  675. #
  676. # for i in range(len(task)):
  677. # data = subsetter(infoDf, task=task[i], time=time[i], analizableDf=subsetInfo)
  678. # data = data[data['stimulation'] == stim[i]]
  679. # data = data[data['time'] != 'V0']
  680. # plt.figure()
  681. # plt.scatter(data[x[i]],data[y[i]], color=color[2])
  682. # plt.xlabel(renamer(x[i], task[i]))
  683. # plt.ylabel(renamer(y[i], task[i]))
  684. # sns.despine()
  686. plt.figure()
  687. plt.subplot(2,2,1)
  688. plt.title('SDR / Accuracy')
  689. my_topomap(np.array(EEGcors_topo['SDR']['Acc_alpha (9-14)']), chans = epochs.ch_names)
  691. plt.subplot(2,2,2)
  692. plt.title('SDR / RT')
  693. my_topomap(np.array(EEGcors_topo['SDR']['RT_alpha (9-14)']), chans = epochs.ch_names)
  696. plt.subplot(2,2,3)
  697. plt.title('VDR / Accuracy')
  698. my_topomap(np.array(EEGcors_topo['VDR']['Acc_alpha (9-14)']), chans = epochs.ch_names)
  700. plt.subplot(2,2,4)
  701. plt.title('VDR / RT')
  702. my_topomap(np.array(EEGcors_topo['VDR']['RT_alpha (9-14)']), chans = epochs.ch_names)
  704. plt.savefig(FIGURES_DIR / 'EEG_cor_topos.png')

main.py at commit 0145cac, under MIT · at the source

Overview

Authors: Marius Keute1, Tianlu Wang1, Silvana Miranda Montenegro1, Maximilian Scherer1, Patrick Bookjans1, Bastian Brunnett1, Idil Cebi1,2, Luka Milosevic1,3,4, Daniel Weiss2, Alireza Gharabaghi1,4,5,6,7,8
ORCID iDs: Maximilian Scherer, Luka Milosevic, Daniel Weiss
  1. Institute for Neuromodulation and Neurotechnology, University Hospital and University of Tübingen, Tübingen 72076, Germany
  2. Center for Neurology, Department for Neurodegenerative Diseases, and Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen 72076, Germany
  3. Clinical and Computational Neuroscience, Krembil Research Institute, University Health Network, Toronto M5T 2S8, Canada
  4. Max Planck-University of Toronto Centre for Neural Science & Technology (MPUTC), Toronto M5T 2S8 (Canada)/Tübingen 72076, Germany
  5. Center for Digital Health (CDH), Tübingen 72076, Germany
  6. Cognitive Science Center (CSC), Tübingen 72076, Germany
  7. Center for Bionic Intelligence Tübingen Stuttgart (BITS), Tübingen 72076, Germany
  8. German Center for Mental Health (DZPG), Tübingen 72076, Germany
Institutions: University of Tübingen (Germany); Hertie Institute for Clinical Brain Research (Germany); University Health Network (Canada); University of Toronto (Canada); Krembil Research Institute; Deutsches Zentrum für Psychische Gesundheit (Germany)
Journal: Brain communications, volume 8, issue 5, article fcag328
Dates: received 11 June 2025; accepted 27 July 2026; published online 31 August 2026
Type: Research article · Language: English
License: CC BY
Identifiers: DOI 10.1093/braincomms/fcag328 · PMID 42712895 · PMCID PMC13550774 · OpenAlex W7204800039
Open access: gold, a free copy (OpenAlex)
Status: code verified
Categories: EEG (modality), human (organism), Parkinson's (population), cognitive (subfield)
Methods: Spectral & time-frequency, Preprocessing, Connectivity, Statistics, Smoothing, state filtering, decompositions, Physiology & signal measures
Keywords: deep brain stimulation, working memory, electroencephalography, Parkinson’s disease, subthalamic nucleus
Topic: Neurological disorders and treatments (Neurology, Medicine), according to OpenAlex
Funding: EU Joint Programme - Neurodegenerative Disease Research (EU-JPND 2022-130, 01ED2309); Abbott Northwestern Hospital Foundation; European Commission; St. Jude Medical
Citations: not cited yet (Europe PMC); 49 references in the paper

Abstract

The dynamic modulation of large-scale network activity, which is inherent to cognitive processes, is disrupted in Parkinson’s disease. Subthalamic deep brain stimulation can either improve or deteriorate cognition, particularly executive function, with these effects often going unnoticed during acute parameter optimization. This highlights the need for longer stimulation periods and more focused research on the underlying cortical mechanisms, which remain underexplored. This study was a prospective clinical trial involving nineteen people with Parkinson’s disease, who were evaluated off their medication at preoperative baseline and 6 months after deep brain stimulation implantation. Brain activity related to verbal and visuospatial working memory tasks was recorded using electroencephalography at both baseline and during follow-up evaluations conducted under stimulation. The follow-up assessments were carried out following 3-week periods of either omnidirectional or directional stimulation, applied in a randomized, double-blind, crossover design. Average postoperative working memory performance remained stable at the group level regardless of the stimulation condition for both verbal and visuospatial working memory tasks. However, at the individual level, higher alpha and beta power at baseline was associated with slower visuospatial working memory reaction time at follow-up. Additionally, reductions in theta and beta power during stimulation at follow-up correlated with better verbal working memory accuracy during the task and compared with baseline, respectively. These findings suggest that task-related electroencephalography may provide candidate physiological markers of individual working memory trajectories after subthalamic deep brain stimulation. Oscillatory brain activity may help to characterize stimulation-related cognitive variability beyond motor outcomes, but these exploratory findings require validation in larger cohorts before they can inform stimulation programming or closed-loop treatment strategies. Registration: ClinicalTrials.gov: NCT03548506

Reproduced under the paper's license (CC BY), from the paper cited above.

Repository

Its files are read in the Code ↔ Paper reader above, with 7 matches between paragraphs and lines of code.

neuromti/stn-dbs-working-memory-eeg

License: MIT
State: the link answers, verified on 27 September 2026
Evidence: files inventoried
Commit: 0145cacc0429658f04a480353f182c61034c8746, 19 May 2026
Languages: Python (8), R (1)
Size: 16 files, 9 scripts
Software Heritage: not archived
Found in: “Code availability”
Holds: README, license file, environment (requirements.txt, project_package/setup.py)
Not found: CITATION.cff, tests, continuous integration, documentation
Tools: NumPy (6 files), MNE-Python (5 files), pandas (5 files), SciPy (5 files), Matplotlib (4 files), seaborn (2 files), ggplot2 (1 file), lme4 (1 file), lmerTest (1 file), patchwork (1 file), reshape2 (1 file), tidyverse (1 file)
Availability: 1 check, the latest on 27 September 2026: the link answers
  • 27 September 2026: the link answers
11 files
At the source: github.com/neuromti/stn-dbs-working-memory-eeg

Code availability

The GitHub repository https://github.com/neuromti/stn-dbs-working-memory-eeg includes the analysis scripts for this study.

Reproduced under the paper's license (CC BY), from the paper cited above.

Tracing map

Proposed by the machine: these links were found in the paper and verified at the source, without human review. The map will receive a Zenodo DOI once one of the paper's authors has validated it with their ORCID.

What the map holds:

  • 1 repository of the authors' code, each at its verified commit, with its license and how the link was found in the paper;
  • 9 scripts, each with its path and the digest of its content;
  • 7 matches between paragraphs of the paper and lines of the code (method lexical-v1);
  • neither the text of the paper nor the code itself.

Its JSON (tracing-map.json) is deposited on Zenodo with its DOI once the map is validated.

Data

No dataset and no data link were found in the paper.

Data availability

Data are available upon request from the first author after institutional approval.

Reproduced under the paper's license (CC BY), from the paper cited above.

Versions

The history of this record: each version stored by the harvester or made by a correction of its authors or of the maintainers of its code, and what changed in its facts. The texts of the paper (its abstract, its availability statements) are not part of it; versions that changed only those are not listed.

Version 2, 28 September 2026

  • Funding: added EU Joint Programme – Neurodegenerative Disease Research: EU-JPND 2022-130, 01ED2309; Abbott Northwestern Hospital Foundation; European Commission; St. Jude Medical

Version 1, 27 September 2026: the first record

Recorded: type, language, journal, volume, issue, pages, dates, 10 authors, 5 keywords, 48 references.

Cite

This paper

Keute, M., Wang, T., Miranda Montenegro, S., Scherer, M., Bookjans, P., Brunnett, B., Cebi, I., Milosevic, L., Weiss, D., & Gharabaghi, A. (2026). Subthalamic stimulation modulates working memory-related cortical dynamics in Parkinson's disease. Brain communications, 8(5), fcag328. https://doi.org/10.1093/braincomms/fcag328

BibTeX

@article{keute2026subthalamic,
author = {Keute, Marius and Wang, Tianlu and Miranda Montenegro, Silvana and Scherer, Maximilian and Bookjans, Patrick and Brunnett, Bastian and Cebi, Idil and Milosevic, Luka and Weiss, Daniel and Gharabaghi, Alireza},
title = {{Subthalamic stimulation modulates working memory-related cortical dynamics in Parkinson's disease}},
journal = {Brain communications},
year = {2026},
month = aug,
volume = {8},
number = {5},
pages = {fcag328},
publisher = {Oxford University Press},
issn = {2632-1297},
doi = {10.1093/braincomms/fcag328},
url = {https://doi.org/10.1093/braincomms/fcag328},
pmid = {42712895},
pmcid = {PMC13550774}
}

RIS

TY - JOUR
AU - Keute, Marius
AU - Wang, Tianlu
AU - Miranda Montenegro, Silvana
AU - Scherer, Maximilian
AU - Bookjans, Patrick
AU - Brunnett, Bastian
AU - Cebi, Idil
AU - Milosevic, Luka
AU - Weiss, Daniel
AU - Gharabaghi, Alireza
TI - Subthalamic stimulation modulates working memory-related cortical dynamics in Parkinson's disease
T2 - Brain communications
J2 - Brain Commun
PY - 2026
DA - 2026/08/31
VL - 8
IS - 5
SP - fcag328
SN - 2632-1297
PB - Oxford University Press
DO - 10.1093/braincomms/fcag328
UR - https://doi.org/10.1093/braincomms/fcag328
LA - en
ER -

CSL-JSON

{
"id": "10.1093/braincomms/fcag328",
"type": "article-journal",
"title": "Subthalamic stimulation modulates working memory-related cortical dynamics in Parkinson's disease",
"container-title": "Brain communications",
"author": [
{
"family": "Keute",
"given": "Marius"
},
{
"family": "Wang",
"given": "Tianlu"
},
{
"family": "Miranda Montenegro",
"given": "Silvana"
},
{
"family": "Scherer",
"given": "Maximilian"
},
{
"family": "Bookjans",
"given": "Patrick"
},
{
"family": "Brunnett",
"given": "Bastian"
},
{
"family": "Cebi",
"given": "Idil"
},
{
"family": "Milosevic",
"given": "Luka"
},
{
"family": "Weiss",
"given": "Daniel"
},
{
"family": "Gharabaghi",
"given": "Alireza"
}
],
"container-title-short": "Brain Commun",
"volume": "8",
"issue": "5",
"page": "fcag328",
"DOI": "10.1093/braincomms/fcag328",
"PMID": "42712895",
"PMCID": "PMC13550774",
"ISSN": "2632-1297",
"publisher": "Oxford University Press",
"URL": "https://doi.org/10.1093/braincomms/fcag328",
"language": "en",
"issued": {
"date-parts": [
[
2026,
8,
31
]
]
}
}

The tracing map gets a citation of its own once an author has validated it and it has a DOI.

Similar papers

The papers with a page that share the most with this one: the tools found in their code, their categories, datasets, cited references and authors, the rarest counting most.

[1] doi:10.1162/imag.a.1245 [code]
Towards precision EEG connectomics: Evaluating the benefits of dense sampling.
Journal: Imaging neuroscience (Cambridge, Mass.)
In common: MNE-Python, lmerTest, lme4, 9 other tools, EEG
[2] doi:10.1162/imag.a.105 [code]
Right posterior theta reflects human parahippocampal phase resetting by salient cues during goal-directed navigation
Journal: —
In common: MNE-Python, lmerTest, lme4, 8 other tools, EEG, cognitive
[3] doi:10.1093/cercor/bhag077 [code]
The longitudinal development of intrinsic timescales in infancy and their relation to alpha brain rhythm.
Journal: Cerebral cortex (New York, N.Y. : 1991)
In common: MNE-Python, lmerTest, lme4, 8 other tools, EEG
[4] doi:10.1016/j.xcrm.2026.102766 [code]
A longitudinal single-cell and spatial multiomic atlas of pediatric high-grade glioma.
Journal: Cell reports. Medicine
In common: lmerTest, lme4, reshape2, 8 other tools
[5] doi:10.1093/nc/niag029 [code]
A data-driven approach to identifying and evaluating connectivity-based neural correlates of conscious visual perception.
Journal: Neuroscience of consciousness
In common: MNE-Python, lmerTest, patchwork, 7 other tools, cognitive, 1 reference
[6] doi:10.1038/s41598-026-58505-y [code]
Remoteness sensitive theta network dynamics during early autobiographical memory access.
Journal: Scientific reports
In common: MNE-Python, lme4, reshape2, 7 other tools, EEG, cognitive
[7] doi:10.1162/imag.a.1321 [code]
Phase similarity between similar objects indicates representational merging across retrieval training but not sleep.
Journal: Imaging neuroscience (Cambridge, Mass.)
In common: MNE-Python, lmerTest, lme4, 6 other tools, EEG, cognitive, 1 reference
[8] doi:10.1093/cercor/bhag113 [code]
Long-term reliability and stability of parameterized resting state EEG: evidence from a five-year follow-up.
Journal: Cerebral cortex (New York, N.Y. : 1991)
In common: MNE-Python, lmerTest, lme4, 7 other tools, EEG
[9] doi:10.7554/elife.107088 [code]
Development of auditory and spontaneous movement responses to music over the first postnatal year.
Journal: eLife
In common: MNE-Python, lme4, reshape2, 7 other tools, EEG
[10] doi:10.1162/imag.a.1347 [code]
Neural and behavioural correlates of theory of mind reasoning in five-year-old children born preterm.
Journal: Imaging neuroscience (Cambridge, Mass.)
In common: lmerTest, lme4, reshape2, 7 other tools

Contribute

The authors of this paper can claim it, correct its record and validate its tracing map, and the maintainers of its code (its owner, or a public member of its organization) correct what it says of their repository; anyone signed in can ask for its removal. Every request goes to OSCR's own machine, which answers it; your account page follows them.

Sign in with ORCID to claim this paper as one of its authors, correct its record or validate its tracing map: when the paper's metadata lists your ORCID iD, you are recognized at once. Maintainers of its code: sign in with GitHub, then claim the repository on your account page.

Request its removal

To ask OSCR to remove this record, the copies of its authors' scripts or its tracing map, use the removal request page: signed in, you say who you are, what to remove and why, then review and confirm the request. Published rules decide every request (how).

Discussion, reproductions, activity

Discussion: questions and error reports about this paper and its code, from signed-in readers and its authors. It opens with sign-in.

Reproductions: reports from readers who ran the authors' code: what they reproduced, with which environment, commit and data. It opens with sign-in.

Activity: what happens around this paper: new versions of its record, its map's validation, discussions and reproductions. It opens with sign-in.