Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
253 commits
Select commit Hold shift + click to select a range
3695567
updted UoI_VAR tutorial notebook
yaoyXu Feb 13, 2025
a7c9cc4
MPI example script
yaoyXu Feb 14, 2025
8997b7a
updated log_logistics functions to be compatible with python 3.12
yaoyXu Feb 18, 2025
afc4905
nersc work starts
balewski Feb 18, 2025
f03111b
ok
balewski Feb 19, 2025
3d523c6
ok
balewski Feb 20, 2025
f598a32
ok
balewski Feb 20, 2025
8be3122
ok
balewski Feb 20, 2025
69ee729
ok
balewski Feb 21, 2025
922ce5d
prediction and connectivity matrix construction
yaoyXu Feb 21, 2025
33e1d09
adding exponential decay to experimental data works
balewski Feb 21, 2025
06dd9fc
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Feb 21, 2025
5434f49
ok
balewski Feb 22, 2025
54ee8a6
MPI test script update
yaoyXu Feb 26, 2025
75d7143
ok
balewski Feb 27, 2025
0b44479
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Feb 27, 2025
8fa4c71
ok
balewski Mar 12, 2025
988a9ab
ok
balewski Mar 12, 2025
fd48077
ok
balewski Mar 12, 2025
47513dd
ok
balewski Mar 13, 2025
9d460d7
ok
balewski Mar 14, 2025
fb9ba2d
stable fitting code works
balewski Mar 15, 2025
dc3a0a7
ok
balewski Mar 15, 2025
65557d0
ok
balewski Mar 16, 2025
2dd2b8d
ok
balewski Mar 24, 2025
939285e
optimized VAR-LASSO model for MPI fit
yaoyXu Mar 27, 2025
e0ecb21
debugged new MPi implemtnation and added updated script to causal_net…
yaoyXu Mar 27, 2025
07615f5
now using sparse represeatation for the design matrix
yaoyXu Mar 28, 2025
4be8e60
ok
balewski Mar 28, 2025
38f9530
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Mar 28, 2025
ab05136
fixed toy example script bug
yaoyXu Mar 28, 2025
dd6c8f1
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Mar 28, 2025
4cd8209
large scale fit works
balewski Mar 30, 2025
42d0583
ok
balewski Mar 31, 2025
e340ea7
ok
balewski Apr 7, 2025
411e06d
ok
balewski Apr 13, 2025
98ab25e
ok
balewski Apr 13, 2025
2c0057c
ok
balewski Apr 24, 2025
00d58ae
ok
balewski Apr 29, 2025
880b282
dale-gen works
balewski Apr 30, 2025
d06f0af
ok
balewski May 2, 2025
7031204
ok
balewski May 7, 2025
daa96fa
code cleand up and works for simu
balewski May 13, 2025
5c691be
ADMM implementation
yaoyXu May 15, 2025
0110859
new example test code
yaoyXu May 15, 2025
e82f5fe
ok
balewski May 18, 2025
eb6d8a8
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski May 18, 2025
bc8c7f6
ok
balewski May 18, 2025
5029b04
ok
balewski May 18, 2025
90ed2da
ok
balewski May 19, 2025
7da3c7d
Initial parameter are now normally distributed; warm starting admm la…
yaoyXu May 16, 2025
7f17f90
warm start implemetation for ADMM
yaoyXu May 19, 2025
037a898
ok
balewski May 20, 2025
c300fa2
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski May 20, 2025
c8c94d4
adaptive scheme for ADMM hyperparameter rho; base.py now working with…
yaoyXu May 20, 2025
7b0b6a9
streamlined base.py to do VAR and LASSO fitting
yaoyXu May 21, 2025
bea0d19
ok
balewski May 21, 2025
349cfee
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski May 21, 2025
dda361e
ok
balewski May 21, 2025
1509312
added manual adjustment for rho scaling
yaoyXu May 21, 2025
052aa76
ok
balewski May 21, 2025
f7f71be
erge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski May 21, 2025
465b4b3
ok
balewski May 21, 2025
9e3ee78
ok
balewski May 22, 2025
29dbf80
ok
balewski May 23, 2025
0e9834a
debugged initial rho scaling and dual toleracne formula
yaoyXu May 25, 2025
9b6878e
ok
balewski May 26, 2025
a0244a9
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski May 26, 2025
aa99651
fix bug
balewski May 26, 2025
f810e94
fixed bug
yaoyXu May 26, 2025
dee597c
ok
balewski May 26, 2025
5fad49d
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski May 26, 2025
5489434
slight clean up
yaoyXu May 29, 2025
3f71f1c
ok
balewski May 30, 2025
67e2705
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski May 30, 2025
055bfb6
ok
balewski May 30, 2025
6d70d6f
ok
balewski May 31, 2025
447f504
bebugged convergence criteria and soft-threshold method
yaoyXu Jun 5, 2025
32e2caf
ok
balewski Jun 10, 2025
289269f
ok
balewski Jun 19, 2025
95c98aa
ok
balewski Jun 19, 2025
f7e4b4b
ok
balewski Jun 22, 2025
55ff239
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Jun 22, 2025
d34ea0d
ok
balewski Jun 28, 2025
6c028b9
ok
balewski Jun 29, 2025
9713590
ok
balewski Jun 29, 2025
0e508ac
ok
balewski Jun 29, 2025
7c10e8f
ok
balewski Jul 1, 2025
8673857
discrete-time dynamic gaussain input generator
yaoyXu Jul 1, 2025
d0ad405
ok
balewski Jul 5, 2025
52941f5
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Jul 5, 2025
eacd548
ok
balewski Jul 6, 2025
26e2c95
ok
balewski Jul 7, 2025
8892292
ok
balewski Jul 7, 2025
588fd33
work on ver2
balewski Jul 9, 2025
3a380b8
ok
balewski Jul 10, 2025
02ed089
shuffle code
balewski Jul 11, 2025
418efda
ver3 w/ UoI works
balewski Jul 11, 2025
0ce2792
ok
balewski Jul 16, 2025
9e1270a
ok
balewski Jul 18, 2025
effc41e
ok
balewski Jul 19, 2025
eddcd6c
ok
balewski Jul 19, 2025
00e9648
ok
balewski Jul 19, 2025
6100b4c
ok
balewski Jul 19, 2025
7bda777
ok
balewski Jul 19, 2025
544ff9c
ok
balewski Jul 20, 2025
d0671d8
ok
balewski Jul 26, 2025
22528ac
ok
balewski Jul 29, 2025
0f9c02e
ok
balewski Jul 31, 2025
37e1c21
works
balewski Aug 7, 2025
ee7a298
before 4-GPU optimization
balewski Aug 8, 2025
87c0334
4-GPU enabled
balewski Aug 8, 2025
cf91825
cleanup
balewski Aug 9, 2025
a2f898f
ok
balewski Aug 10, 2025
99e4a2f
start of real data fit
balewski Aug 16, 2025
3aac0ae
ok
balewski Aug 19, 2025
eb1eaf9
all works and is consistent
balewski Aug 20, 2025
110349e
channles sorted by freq , works
balewski Aug 24, 2025
2637336
ok
balewski Aug 24, 2025
71a8b29
ok
balewski Aug 30, 2025
992d56e
ok
balewski Aug 31, 2025
0421690
UoI-Poisson update
yaoyXu Sep 1, 2025
0dd754c
UoI-poisson update2
yaoyXu Sep 1, 2025
a4177f7
ok
balewski Sep 10, 2025
69b04ae
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Sep 10, 2025
07936c0
ok
balewski Sep 13, 2025
ba1e0f5
ver5e uses plain Lasso, ver6 uses bootstrap, selector uses FDR
balewski Sep 13, 2025
5fed84a
row-wise FDR works, on real data
balewski Sep 14, 2025
df18cd9
cleanup
balewski Sep 15, 2025
d88965c
refactored again
balewski Sep 15, 2025
f584345
real data processed
balewski Sep 16, 2025
896b438
ok
balewski Sep 21, 2025
e697e96
tested and worsk
balewski Oct 2, 2025
acceefd
refactored, works
balewski Oct 4, 2025
453d783
mixer works, model has lag=1
balewski Oct 5, 2025
5399142
ok
balewski Oct 7, 2025
ae40b54
UoI-VAR Poisson with FDR selection criteria
yaoyXu Oct 25, 2025
7d3ef39
UoI-VAR Poisson with FDR selection criteria
yaoyXu Oct 25, 2025
32f19c3
UoI-VAR Poisson with FDR selection criteria
yaoyXu Oct 25, 2025
c0458e1
oI-VAR Poisson with FDR selection criteria
yaoyXu Oct 25, 2025
2b6b554
remove unused loss
balewski Oct 28, 2025
b47ff71
dedicated poisson-fdr
balewski Oct 29, 2025
8872ff2
wiht output for L1 loss and access to set fdr_raterate
yaoyXu Oct 29, 2025
d9c2853
ok
balewski Nov 2, 2025
906b0df
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Nov 2, 2025
8db7f68
works for FDR
balewski Nov 2, 2025
ff06deb
better formatted IO
balewski Nov 3, 2025
5c28a64
minor bug fix
balewski Nov 4, 2025
6c1fd01
ok
balewski Nov 5, 2025
2acbe45
Added l1 support count ouput, and fix the FDR input array bug
yaoyXu Nov 19, 2025
1731907
ok
balewski Dec 7, 2025
93d13fc
ok
balewski Dec 8, 2025
0ac9834
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Dec 8, 2025
e8c4621
ok
balewski Dec 9, 2025
78dea4c
ok
balewski Dec 20, 2025
e54955b
ok1
balewski Feb 12, 2026
37a0d7f
ok
balewski Feb 18, 2026
b296266
ok
balewski Feb 18, 2026
12a168d
ok
balewski Feb 19, 2026
18a0a3d
ok
balewski Feb 20, 2026
19e50b2
ok
balewski Feb 20, 2026
47f5eeb
ok
balewski Feb 20, 2026
1238399
ok
balewski Feb 20, 2026
597a865
ok
balewski Feb 20, 2026
59f2442
ok
balewski Feb 20, 2026
ead9a9f
ok
balewski Feb 20, 2026
1925b8d
ok
balewski Feb 22, 2026
f7e514a
non-stat ver2 in progress
balewski Feb 24, 2026
ead6595
tunned for N60 - perfect
balewski Feb 26, 2026
2127b45
ok
balewski Feb 26, 2026
79d2e5e
ok
balewski Feb 26, 2026
55ed975
ok
balewski Feb 27, 2026
d3de804
mok
balewski Feb 28, 2026
a987bb0
before removing decode_dwell_sec
balewski Mar 1, 2026
73eb2e3
ok
balewski Mar 2, 2026
db370f7
lasso+R+L1prune works for 1 state
balewski Mar 3, 2026
b3f3885
lasso works for 1-state 15 Hz
balewski Mar 3, 2026
54fa61a
before prism_Mstep_train3.py changes
balewski Mar 4, 2026
0035a56
Mstep is not working well
balewski Mar 4, 2026
f97883b
Mtrain switched from S_hat to C_hat - works very well
balewski Mar 4, 2026
fb51be9
ok
balewski Mar 5, 2026
1c3c4ea
Estep,Mstep ok, before big merge
balewski Mar 5, 2026
106da8d
start EM-train
balewski Mar 5, 2026
8491c5f
all works, but small changes will be made to match to latex
balewski Mar 5, 2026
9c82d57
ok
balewski Mar 5, 2026
6026449
ok
balewski Mar 6, 2026
ac31719
ok
balewski Mar 9, 2026
2355717
after talking to kris
balewski Mar 10, 2026
4068080
4:1 exc works better
balewski Mar 10, 2026
f9d1f40
reorganized delay-ops
balewski Mar 10, 2026
ad8db48
ok
balewski Mar 12, 2026
c32be5e
all works, before removing freq-weights
balewski Mar 13, 2026
d4044ee
freq-dependent weights removed, all works
balewski Mar 13, 2026
52a0d23
works, but Bm has mainor offset
balewski Mar 19, 2026
caffe1b
ok
balewski Mar 22, 2026
d1141e7
ok
balewski Mar 22, 2026
d0abaf8
ok
balewski Mar 23, 2026
0ac7b3f
ok
balewski Mar 24, 2026
726472e
ok
balewski Mar 24, 2026
2a46c40
ok
balewski Mar 24, 2026
6658f09
ok
balewski Mar 24, 2026
9b7a0b0
ok
balewski Mar 25, 2026
b9bf4ce
works on 1 GPU
balewski Mar 25, 2026
8d68674
4GPU works at 12%
balewski Mar 25, 2026
32156cf
4GPU ok, but A-diag & B are corrrelated
balewski Mar 25, 2026
3261ba5
addel lr_kappa decay
balewski Mar 25, 2026
825f76d
ok
balewski Mar 25, 2026
4d1e9c2
ok
balewski Mar 30, 2026
c11c9b3
ok
balewski Apr 1, 2026
f2947ed
ok
balewski Apr 1, 2026
8c1fc3e
ok
balewski Apr 4, 2026
bacb6f3
ok
balewski Apr 4, 2026
81e0cf6
ok
balewski Apr 5, 2026
2068e3a
ok
balewski Apr 16, 2026
e18e200
ok
balewski Apr 18, 2026
693bf2c
ok
balewski Apr 18, 2026
73cbdf1
ok
balewski May 3, 2026
533ff12
ok
balewski May 3, 2026
45e6048
dasd
balewski May 3, 2026
aa98247
ok
balewski May 4, 2026
c2fcd89
ok
balewski May 4, 2026
174873a
ok
balewski May 7, 2026
0b833bd
ok
balewski May 19, 2026
5e33dc2
Resolve merge conflict by keeping remote PDF
balewski May 19, 2026
d42db99
work on experiment
balewski May 20, 2026
ff48959
ok
balewski May 21, 2026
a41cca1
reasonable real data results
balewski May 22, 2026
36cfec6
restored prpe bio
balewski May 23, 2026
4d97ab5
ok
balewski May 23, 2026
888245d
ok
balewski May 24, 2026
247bccd
rhoMax is soft
balewski May 25, 2026
a653957
just reorganized directories
balewski Jun 11, 2026
fb2c288
ok
balewski Jun 11, 2026
5e9a90d
before refactoring for EM-FDR-Bag
balewski Jun 14, 2026
5f8899b
basic EM_FDR_Bags_train works, needs lot of cleanup
balewski Jun 15, 2026
cab432f
ok
balewski Jun 15, 2026
dfcd54e
ok
balewski Jun 16, 2026
90e9f9c
reformat: Dale low is now for columns, for math to look naturally
balewski Jun 16, 2026
cb01fe2
ok
balewski Jun 16, 2026
feaa907
loc_xy stored differently, new plotting scheme, bags not changed
balewski Jun 19, 2026
5f45d2e
refactored and works for both simu & exper
balewski Jun 20, 2026
3574069
works for simu & exper
balewski Jun 20, 2026
f571d72
ok
balewski Jun 21, 2026
f1a9bbd
ok
balewski Jun 21, 2026
4a67a11
ok
balewski Jun 21, 2026
c9b0e20
Merge branch 'uoi-var' of github.com:BouchardLab/pyuoi into uoi-var
balewski Jun 21, 2026
8e2c303
ok
balewski Jun 26, 2026
6b81809
ok
balewski Jun 30, 2026
0f27136
added de-bias fit and it works
balewski Jul 4, 2026
e6810d6
ok
balewski Jul 7, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 28 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -108,4 +108,31 @@ ENV/
.vscode

# lbfgs solver stuff
pyuoi/lbfgs/_lowlevel.c
_lowlevel.c

*~
out/
*.prof
dataDale/
*.png
*.npy
data/
model/
\#*
*.h5
.cursor
*.npz
old/
result/
.bash_history
.viminfo
.ipython/
.jupyter/
.local/
.emacs.d/
.lesshst
*.aux
*.toc
*.out
.codex
*.dvi
80 changes: 80 additions & 0 deletions causal_net/Readme
Original file line number Diff line number Diff line change
@@ -0,0 +1,80 @@
Detailed manual at
https://docs.google.com/document/d/1Ou98jsFpTR7s3cTf6AQwF92tqd2guwA_cGuvQrm8RSE/edit?usp=sharing


IMG=nersc/causal-net:v3 # Mar 28
IMG=nersc/causal-net:v4 # May 13

export OMP_NUM_THREADS=2
salloc -q interactive -C cpu --image=$IMG -t 4:00:00 -A m2043 -N 1


Directory structure to stor real and simulated data
/global/cfs/cdirs/m2043/causal_inference/dale-gen-sim-may27/input_uoi/

basePath=/global/homes/b/balewski/prjs/bioDataVault2025/causalNet_tmp/

exp_raw/ raw data from experiment
gen_dale/ daleMatrix+samples for generated network
input_uoi/ data formatted for UoI
model_uoi/ UoI fit output
postproc/ any final analysis


A------ dale matrix generator + simulator
runs on PM w/o image, just load python



= = = = = OLD = = = = = = =
Deplyting software - for now as root
Must be repeated for each image start


cd pyuoi
pip install -e .[dev]

cd ../toys/

mkdir 2025_UoI-VAR
cd 2025_UoI-VAR
git clone -b uoi-var https://github.com/BouchardLab/pyuoi.git

# build podman image using podman build -f ubu24-casual-net.dockerfile -t balewski/casual-net:p1 .


# start image

IMG=balewski/casual-net:p1
WORK_DIR=/2025_UoI-VAR
DATA_VAULT=/shared_volumes/dataVault2025

eval podman run -it \
--volume /shared_volumes/$WORK_DIR:$WORK_DIR \
--volume $DATA_VAULT:/dataVault2025 \
--workdir $WORK_DIR \
$IMG /bin/bash

# inside image
cd ../pyuoi
cd /2025_UoI-VAR
pip install -e .[dev]

python <<EOF
import matplotlib
import matplotlib.pyplot as plt
import numpy as np

from sklearn.linear_model import LinearRegression, LassoCV

from pyuoi.linear_model import *
from pyuoi.datasets import make_linear_regression
import pandas as pd
from scipy.linalg import solve_discrete_lyapunov
from examples.var_utils import *
from tqdm import tqdm
EOF




Loading