Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
215 commits
Select commit Hold shift + click to select a range
5ac8adf
ssd cache
addloopy Jul 7, 2025
203860e
ssd cache impl
addloopy Jul 9, 2025
75026da
patch and lru
addloopy Jul 10, 2025
3b662db
patch and lru
addloopy Jul 10, 2025
7836000
patch and lru
addloopy Jul 11, 2025
e7f32a5
optimization and refactor
addloopy Jul 14, 2025
e7e54e2
optimization and refactor
addloopy Jul 19, 2025
165ba85
optimization and refactor
addloopy Jul 20, 2025
d572f07
optimization and refactor
addloopy Jul 22, 2025
a828625
optimization
a0d00kc Jul 22, 2025
d1ae47d
optimization and refactor
addloopy Jul 22, 2025
d291a31
optimization and refactor
addloopy Jul 24, 2025
269f231
refactor and optim
addloopy Jul 28, 2025
1a5433f
refactor and optim
addloopy Aug 8, 2025
50b29b9
refactor and optim
addloopy Aug 12, 2025
d4a6bb0
refactor and optim
addloopy Aug 12, 2025
2f10201
refactor and optim
addloopy Aug 12, 2025
f00c69a
refactor and optim
addloopy Aug 12, 2025
b42a0fe
refactor and optim
addloopy Aug 13, 2025
fbfc5c7
refactor and optim
addloopy Aug 13, 2025
1df7fb2
refactor and optim
addloopy Aug 13, 2025
ae53d7f
refactor and optim
addloopy Aug 13, 2025
9cba305
refactor and optim
addloopy Aug 13, 2025
43047a5
refactor and optim
addloopy Aug 31, 2025
2710ab6
refactor and optim
addloopy Aug 31, 2025
e4973b0
make runnable on vm
nileshsolankimeesho Nov 18, 2025
c3fa3a5
make runnable on vm
nileshsolankimeesho Nov 18, 2025
690b5d5
clear files before run
nileshsolankimeesho Nov 18, 2025
4e26452
add latency tracking
nileshsolankimeesho Nov 20, 2025
b868e6e
shard 1 readers 1 writers 1
nileshsolankimeesho Nov 20, 2025
3f34872
keys per shard 128M
nileshsolankimeesho Nov 20, 2025
d3bfdfe
keys per shard 67M
nileshsolankimeesho Nov 20, 2025
8a7e733
insert and get strategy random
nileshsolankimeesho Nov 21, 2025
bce8df9
remove pre populate loop
nileshsolankimeesho Nov 21, 2025
d82daa7
fix
nileshsolankimeesho Nov 21, 2025
914c0d4
test strategy random
nileshsolankimeesho Nov 25, 2025
cc5e506
dead lock fix
nileshsolankimeesho Nov 25, 2025
3074192
add gausian curve for probability
nileshsolankimeesho Nov 25, 2025
ce907d3
add test run plans
nileshsolankimeesho Nov 25, 2025
3065d94
1 reader 1 writer
nileshsolankimeesho Nov 25, 2025
652e0a9
1 read 1 write worker
nileshsolankimeesho Nov 25, 2025
cee892e
2 shard 2 write 2 worker
nileshsolankimeesho Nov 25, 2025
7e267e5
4 4 4 shard,write,read
nileshsolankimeesho Nov 25, 2025
6f62ac9
10 10 10
nileshsolankimeesho Nov 25, 2025
2a81a9c
50 15 15
nileshsolankimeesho Nov 25, 2025
87d1e8b
80 shards 1 read 1 writer
nileshsolankimeesho Nov 25, 2025
00667af
1 1 1
nileshsolankimeesho Nov 25, 2025
b034b13
freecache becnhmarks
nileshsolankimeesho Dec 1, 2025
d2b2b83
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
c1892eb
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
29d4a28
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
b5a3cd3
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
85e2614
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
c263d60
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
cf06db3
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
de00341
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
5fe91a4
free cache benchmarks
nileshsolankimeesho Dec 2, 2025
be1ada8
Add read batching
nileshsolankimeesho Dec 9, 2025
f0a761b
read batching tests
nileshsolankimeesho Dec 9, 2025
cf2a2c1
read batching tests
nileshsolankimeesho Dec 9, 2025
e6952df
read batching tests
nileshsolankimeesho Dec 9, 2025
3d25e7b
read batching tests
nileshsolankimeesho Dec 9, 2025
1b6d198
read batching tests
nileshsolankimeesho Dec 9, 2025
09e75db
read batching tests
nileshsolankimeesho Dec 9, 2025
3862006
read batching tests
nileshsolankimeesho Dec 9, 2025
5c4af56
read batching tests
nileshsolankimeesho Dec 9, 2025
479ade0
read batching tests
nileshsolankimeesho Dec 9, 2025
1b1d937
read batching tests
nileshsolankimeesho Dec 9, 2025
d72871b
read batching tests
nileshsolankimeesho Dec 9, 2025
a52218e
read batching tests
nileshsolankimeesho Dec 9, 2025
4bde8fc
read batching tests
nileshsolankimeesho Dec 9, 2025
063433c
read batching tests
nileshsolankimeesho Dec 9, 2025
a3a67e6
read batching tests
nileshsolankimeesho Dec 9, 2025
0175c1f
read batching tests
nileshsolankimeesho Dec 9, 2025
25a84b9
read batching tests
nileshsolankimeesho Dec 9, 2025
3a7d0c8
read batching tests
nileshsolankimeesho Dec 9, 2025
5b57f9a
read batching tests
nileshsolankimeesho Dec 9, 2025
29142a1
read batching tests
nileshsolankimeesho Dec 9, 2025
2c6e89a
read batching tests
nileshsolankimeesho Dec 9, 2025
b5f0331
read batching tests
nileshsolankimeesho Dec 9, 2025
547ae8f
read batching tests
nileshsolankimeesho Dec 9, 2025
ec356b6
read batching tests
nileshsolankimeesho Dec 9, 2025
2035dd6
read batching tests
nileshsolankimeesho Dec 9, 2025
befdf5d
read batching tests
nileshsolankimeesho Dec 9, 2025
5f1aaa2
read batching tests
nileshsolankimeesho Dec 9, 2025
b1700ac
read batching tests
nileshsolankimeesho Dec 9, 2025
8ef9ad7
read batching tests
nileshsolankimeesho Dec 9, 2025
92b7a3c
read batching tests
nileshsolankimeesho Dec 9, 2025
b637b9a
read batching tests
nileshsolankimeesho Dec 9, 2025
d0eaac4
read batching tests
nileshsolankimeesho Dec 9, 2025
b7c94e8
read batching tests
nileshsolankimeesho Dec 9, 2025
b3a364e
read batching tests
nileshsolankimeesho Dec 9, 2025
07d053f
Pull Develop
Adit2607 Dec 9, 2025
b49733a
read batching tests
nileshsolankimeesho Dec 9, 2025
1d07823
read batching tests
nileshsolankimeesho Dec 9, 2025
c7d1971
read batching tests
nileshsolankimeesho Dec 9, 2025
c56c6d1
read batching tests
nileshsolankimeesho Dec 9, 2025
25d65a0
read batching tests
nileshsolankimeesho Dec 9, 2025
7c6dadf
read batching tests
nileshsolankimeesho Dec 9, 2025
1041e1b
read batching tests
nileshsolankimeesho Dec 9, 2025
c086988
read batching tests
nileshsolankimeesho Dec 9, 2025
70328dd
run metrics logged to csv
nileshsolankimeesho Dec 12, 2025
184cb3a
run metrics fixes
nileshsolankimeesho Dec 16, 2025
874b39e
lockless improvements
nileshsolankimeesho Dec 17, 2025
7e2ea67
Merge pull request #253 from Meesho/feat/ssd-cache-lockless
nileshsolankimeesho Dec 17, 2025
b1b6f2b
undo testing change
nileshsolankimeesho Dec 22, 2025
3827098
add badger
nileshsolankimeesho Dec 24, 2025
3b72387
externaize the package for cache so it can be imported
nileshsolankimeesho Dec 24, 2025
b8ffbaf
do not start lockless functions if lockless not enabled
nileshsolankimeesho Jan 9, 2026
bfd1337
should rewrite logic off for now
nileshsolankimeesho Jan 9, 2026
90cae0f
change shard cache metric maps to sync maps
nileshsolankimeesho Jan 9, 2026
19887a9
improve metrics package
nileshsolankimeesho Jan 12, 2026
0d014c4
move metrics to pkg
nileshsolankimeesho Jan 12, 2026
8a56a25
full sampling rate
nileshsolankimeesho Jan 13, 2026
f565b32
fix metrics
nileshsolankimeesho Jan 13, 2026
f76e9e8
fix metrics
nileshsolankimeesho Jan 13, 2026
626ded4
fix metrics
nileshsolankimeesho Jan 13, 2026
4eb459d
include fine grained stats
nileshsolankimeesho Jan 15, 2026
54ddd21
correct stats
nileshsolankimeesho Jan 19, 2026
f5a1d6c
remove syncpool changes
nileshsolankimeesho Jan 19, 2026
1788d64
grid search fixes
nileshsolankimeesho Jan 21, 2026
97da61e
clear files at mountpoint on start
nileshsolankimeesho Jan 22, 2026
56a5080
fixed delete manager and added file stats
nileshsolankimeesho Jan 22, 2026
659d8e2
fix filewrite error after first punch hole
nileshsolankimeesho Jan 22, 2026
900845b
console logger fixes
nileshsolankimeesho Feb 10, 2026
7d279f5
console logger fixes
nileshsolankimeesho Feb 10, 2026
e92786d
add direct statsd metrics for latencies
nileshsolankimeesho Feb 10, 2026
1ce67d1
direct statsD metric for write latency
nileshsolankimeesho Feb 10, 2026
903165d
try lockless
nileshsolankimeesho Feb 10, 2026
b0a8e47
return error on trim needed
nileshsolankimeesho Feb 10, 2026
f16d4a6
add pread and pwrite latencies
nileshsolankimeesho Feb 11, 2026
dcac7f9
remove dsync from pwrite
nileshsolankimeesho Feb 11, 2026
0b27e24
remove o-direct from write path
nileshsolankimeesho Feb 11, 2026
aeeff96
error read if more than 1ms
nileshsolankimeesho Feb 11, 2026
aeb8bd3
revert ticker
nileshsolankimeesho Feb 11, 2026
cbc6d3d
add memtable chunking on flush
nileshsolankimeesho Feb 11, 2026
e3abf42
chunk size smaller
nileshsolankimeesho Feb 11, 2026
710c80e
stats time wasted in lock
nileshsolankimeesho Feb 11, 2026
8fb761f
simplify metrics
nileshsolankimeesho Feb 12, 2026
f1d3b26
implement iouring
nileshsolankimeesho Feb 12, 2026
98362c2
change lock position for rlock
nileshsolankimeesho Feb 12, 2026
0afc603
metable chunk size 16*4
nileshsolankimeesho Feb 12, 2026
02f92f7
fix rb loop
nileshsolankimeesho Feb 12, 2026
fbaa622
correct the mutex used for rlock
nileshsolankimeesho Feb 12, 2026
5036e0b
implement iouring batching
nileshsolankimeesho Feb 12, 2026
8c510a3
add pread metric and change iouring to wait 500microsecs
nileshsolankimeesho Feb 13, 2026
f2126ff
change write iouring batch size
nileshsolankimeesho Feb 13, 2026
a9cefea
fix iouring write
nileshsolankimeesho Feb 13, 2026
737e651
track chunked pwrite and pread latency
nileshsolankimeesho Feb 13, 2026
399d797
iouring no wait fixes
nileshsolankimeesho Feb 17, 2026
93c7164
remove metrics and use statsD only
nileshsolankimeesho Feb 20, 2026
7025143
add more metrics
nileshsolankimeesho Feb 22, 2026
213d00c
parallelize iourings
nileshsolankimeesho Feb 22, 2026
08c3475
add iouring size metrics
nileshsolankimeesho Feb 22, 2026
fa4e31c
disable metrics by default
nileshsolankimeesho Feb 23, 2026
af09e73
disable metrics by default
nileshsolankimeesho Feb 23, 2026
36de0fa
wait 1 milli second
nileshsolankimeesho Feb 23, 2026
0602210
remove profiling and reduce aligned page count
nileshsolankimeesho Feb 24, 2026
ccb8465
4 iorings
nileshsolankimeesho Feb 24, 2026
cc7b1ce
2 io urings
nileshsolankimeesho Feb 24, 2026
4709067
cleanup remove lockless code
nileshsolankimeesho Feb 25, 2026
551a910
fix metrics
nileshsolankimeesho Feb 25, 2026
9a53fb2
remove redundant property
nileshsolankimeesho Feb 25, 2026
064833e
wait 2 ms for batching
nileshsolankimeesho Feb 25, 2026
40da2b4
fix badger
nileshsolankimeesho Feb 25, 2026
71e8010
fix metric
nileshsolankimeesho Feb 25, 2026
9ef9416
fix metric
nileshsolankimeesho Feb 25, 2026
57865bb
change metric behaviour
nileshsolankimeesho Feb 25, 2026
b44abf0
take rlock back to original place
nileshsolankimeesho Feb 26, 2026
f507906
use xsync map instead of regular sync map
nileshsolankimeesho Feb 26, 2026
ffdb578
add xsync map
nileshsolankimeesho Feb 26, 2026
34b8fe0
500 micro seconds
nileshsolankimeesho Mar 2, 2026
e34bc0d
2 rings
nileshsolankimeesho Mar 2, 2026
37be852
use old native map
nileshsolankimeesho Mar 3, 2026
1dd27aa
fix locking
nileshsolankimeesho Mar 3, 2026
12bfacf
single ring wait 100microsec
nileshsolankimeesho Mar 3, 2026
b21dd4c
smaller wait duration
nileshsolankimeesho Mar 3, 2026
9305c6d
implement sqpoll
nileshsolankimeesho Mar 3, 2026
4590a2f
sqpoll changes and window time 0
nileshsolankimeesho Mar 3, 2026
487dd61
two sqpol rings
nileshsolankimeesho Mar 3, 2026
6bd6cfb
seperate io_uring collect and submit
nileshsolankimeesho Mar 3, 2026
6efb971
fix ring depth based on fio tests
nileshsolankimeesho Mar 4, 2026
c9194e2
change to 2 rings capped at 16 max in flight
nileshsolankimeesho Mar 4, 2026
2bacba1
single ring 16 depth
nileshsolankimeesho Mar 4, 2026
6482591
24 queue depth
nileshsolankimeesho Mar 4, 2026
2b1f022
code cleanup
nileshsolankimeesho Mar 5, 2026
66c7d2f
cleanup dependencies
nileshsolankimeesho Mar 9, 2026
9d7a9f8
Merge pull request #352 from Meesho/flashring-externalize-cleanup
nileshsolankimeesho Mar 9, 2026
81aa1e9
increase iouring batch size when running in concurrent mode
nileshsolankimeesho Mar 10, 2026
5d5a245
fix file wrap around badcr32 issue
nileshsolankimeesho Mar 10, 2026
c59b06b
fix wrap around hit rate
nileshsolankimeesho Mar 23, 2026
fa26ef0
predictor scoring metric
nileshsolankimeesho Mar 30, 2026
c3529a7
add predictor metrics
nileshsolankimeesho Mar 30, 2026
938d1d3
add frequency metrics for predictor
nileshsolankimeesho Mar 30, 2026
e0ac365
frequency band setup fix for predictor
nileshsolankimeesho Mar 30, 2026
caaa2f3
add frequency distribution of keys for setting correct gridsearch values
nileshsolankimeesho Apr 1, 2026
30a774d
fix frequency counter and add recency metric
nileshsolankimeesho Apr 3, 2026
8135a16
fix last acccess
nileshsolankimeesho Apr 3, 2026
8f5fb32
fix encoder changes
nileshsolankimeesho Apr 3, 2026
ec13b25
implement delete for debug purposes
nileshsolankimeesho Apr 3, 2026
0bd8958
implement mget
nileshsolankimeesho Apr 10, 2026
d7e1bbf
staggered memtable flush
nileshsolankimeesho Apr 10, 2026
a99dbac
stagger flush advance without writing garbage data
nileshsolankimeesho Apr 10, 2026
4f36768
write iouring optimization
nileshsolankimeesho Apr 10, 2026
b6d39df
implement coalesce the requests
nileshsolankimeesho Apr 13, 2026
b632f93
fix coalescing
nileshsolankimeesho Apr 13, 2026
4cf3437
change the max slab allocator to 64kb
nileshsolankimeesho Apr 13, 2026
f22d3cd
change inflight configuration
nileshsolankimeesho Apr 14, 2026
60805be
use without sqpoll
nileshsolankimeesho Apr 15, 2026
2c52d08
use 2 sqpoll enabled rings
nileshsolankimeesho Apr 15, 2026
8c88aff
4 sqpoll rings
nileshsolankimeesho Apr 15, 2026
b28d08b
increase ring depth
nileshsolankimeesho Apr 15, 2026
6e8cedb
1 ring 512 depth
nileshsolankimeesho Apr 15, 2026
cf0dfdd
untrack unnecessary files
nileshsolankimeesho May 5, 2026
805ae14
Merge branch 'develop' into flashring-externalize
nileshsolankimeesho May 5, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,8 @@ dist/
.idea/
.vscode/
workspace/
.vscode/
.cursor/
__pycache__/
java-sdk/onfs/feature-store-client/target/
java-sdk/onfs/feature-store-flink-connector-sdk-flink1x/target/
Expand All @@ -15,6 +17,15 @@ java-sdk/onfs/feature-store-core/target/
.internal-configs/
.dev-toggle-state
.go.mod.appended


flashring/performance_results.csv
flashring/mem.prof
flashring/flashring
flashring/flashringtest



horizon/pem/*.pem
horizon/pem/*.key
horizon/configs/*.pem
Expand Down
Loading
Loading