Skip to content
This repository was archived by the owner on Sep 2, 2022. It is now read-only.

raft: add consensus capability across nodes #8

Draft
SUMUKHA-PK wants to merge 887 commits into
base: master
Choose a base branch
from
Draft

raft: add consensus capability across nodes #8

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
887 commits
Select commit Hold shift + click to select a range
51c70d3
fixes #162
SUMUKHA-PK May 27, 2020
d90b5e0
Add mock example
tpdenk May 27, 2020
1d63d0d
Update internal/parser/simple_parser_rules.go
SUMUKHA-PK May 27, 2020
bafdb1b
Update internal/parser/error_reporter.go
SUMUKHA-PK May 27, 2020
65327f3
Merge pull request #163 from tomarrell/SumukhaPK-parser-bugs
tpdenk May 27, 2020
1e01aae
some testing code
SUMUKHA-PK May 28, 2020
5a97108
Merge branch 'master' of https://github.com/tomarrell/lbadd into raft
SUMUKHA-PK May 28, 2020
e1ed1b9
fixes #164,#165,#166
SUMUKHA-PK May 28, 2020
007bb2a
Merge pull request #167 from tomarrell/SumukhaPK-parser-patch
tpdenk May 28, 2020
8325f93
Merge branch 'master' of https://github.com/tomarrell/lbadd into raft
SUMUKHA-PK May 28, 2020
0bc66af
Add support for DELETE statements
tpdenk May 28, 2020
e49c183
basic raft testing framework setup
SUMUKHA-PK May 28, 2020
cba4a77
basic raft testing framework setup
SUMUKHA-PK May 28, 2020
136614d
basic raft testing framework setup
SUMUKHA-PK May 28, 2020
8e88fee
Merge pull request #168 from tomarrell/137-support-delete-statement
tpdenk May 28, 2020
b9885e2
Add support for DROP statements
tpdenk May 28, 2020
da59c00
Merge pull request #169 from tomarrell/139-drop-statement
SUMUKHA-PK May 28, 2020
68a886e
Add structures for update
tpdenk May 28, 2020
7e60042
adds a viable raft test
SUMUKHA-PK May 29, 2020
2761a37
Add support for UPDATE statement
tpdenk May 29, 2020
f175d2b
Merge pull request #170 from tomarrell/138-update
SUMUKHA-PK May 29, 2020
a9362e5
Improve structure for golden testing
tpdenk May 29, 2020
e13bec7
Add golden tests for drop
tpdenk May 29, 2020
9d92d79
Add more golden tests for select
tpdenk May 29, 2020
a756998
Add drop tests
tpdenk May 29, 2020
362d4cf
Add VALUES golden test
tpdenk May 29, 2020
6aca36b
Add golden tests for UPDATE
tpdenk May 29, 2020
2cae7d0
Merge pull request #171 from tomarrell/136-insert
tpdenk Jun 2, 2020
7ca3fb1
Add support for INSERT
tpdenk Jun 2, 2020
ec47fea
Update internal/compiler/command/command.go
SUMUKHA-PK Jun 3, 2020
7128578
Merge branch 'master' into 136-insert
SUMUKHA-PK Jun 3, 2020
8c79eb0
Merge pull request #172 from tomarrell/136-insert
SUMUKHA-PK Jun 3, 2020
959f1c6
Merge branch 'master' of https://github.com/tomarrell/lbadd into raft
SUMUKHA-PK Jun 5, 2020
7ec53fa
Remove executor
tpdenk Jun 5, 2020
6bc9244
Introduce engine
tpdenk Jun 5, 2020
358fa9f
Improve godoc
tpdenk Jun 5, 2020
5cde671
Fix typo
tpdenk Jun 5, 2020
07c9ebc
Add a few decoding function to the converter
tpdenk Jun 6, 2020
a06d5a9
Add a page abstraction
tpdenk Jun 6, 2020
893a23c
Add a slotted page implementation
tpdenk Jun 6, 2020
0151cfd
Add delete and get method to page
tpdenk Jun 6, 2020
9d5644d
Create blackbox tests
tpdenk Jun 6, 2020
dffe4b6
Add test and support for deletion of cells
tpdenk Jun 6, 2020
bb06a43
Add missing godoc
tpdenk Jun 6, 2020
089e19e
Make cell count internal and add a dirty flag
tpdenk Jun 7, 2020
7ae4eed
Add a page mock
tpdenk Jun 7, 2020
7c68a2e
Merge branch 'master' into raft
SUMUKHA-PK Jun 7, 2020
457d4f3
Implement a simple LRU page cache
tpdenk Jun 9, 2020
38d9f47
a basic complete cluster mock raft test
SUMUKHA-PK Jun 12, 2020
9d7b000
Merge branch 'raft' of https://github.com/tomarrell/lbadd into raft
SUMUKHA-PK Jun 12, 2020
bf4312c
this commit adds a working raft test to base future tests off of
SUMUKHA-PK Jun 12, 2020
972f849
raft tests in progress
SUMUKHA-PK Jun 13, 2020
81005b3
raft tests in progress
SUMUKHA-PK Jun 13, 2020
55ecf62
progress in adding complete testing of raft
SUMUKHA-PK Jun 13, 2020
aac650f
triage on tests and lower layers
SUMUKHA-PK Jun 14, 2020
5b0d140
triage on tests and lower layers
SUMUKHA-PK Jun 14, 2020
3dbee4e
Remove current page implementation
tpdenk Jun 16, 2020
1cee316
Add v1 page implementation without store functionality
tpdenk Jun 16, 2020
3457be5
a well rounded base for raft test is created
SUMUKHA-PK Jun 17, 2020
ca08f13
Remove converter as it's obsolete
tpdenk Jun 18, 2020
ff1faf0
Add storage functionality
tpdenk Jun 18, 2020
80895af
Rename offset to slot
tpdenk Jun 19, 2020
b9c1e99
Make store functionality work (with tests)
tpdenk Jun 19, 2020
5f5952f
Add a page loader
tpdenk Jun 19, 2020
e9d5bf1
this commit adds a new method to relay data from a follower to the le…
SUMUKHA-PK Jun 21, 2020
cc9ca03
this commit adds a new method to relay data from a follower to the le…
SUMUKHA-PK Jun 21, 2020
d388f37
this commit adds a new method to relay data from a follower to the le…
SUMUKHA-PK Jun 21, 2020
9a932cc
this commit cleans up some comments
SUMUKHA-PK Jun 21, 2020
df33de3
this commit ensures that the server closes in the test
SUMUKHA-PK Jun 21, 2020
b53750a
Implement and specify part of the file format
tpdenk Jun 22, 2020
0123d40
Add documentation
tpdenk Jun 22, 2020
6d1959a
Implement page defragmentation
tpdenk Jun 23, 2020
91356c0
Test cell deletion
tpdenk Jun 23, 2020
c18ffa5
Only flush if page is dirty
tpdenk Jun 23, 2020
154327f
Add more validating functions
tpdenk Jun 23, 2020
2a26df8
Add type system for runtime
tpdenk Jun 23, 2020
cb798c1
Add pageCache to engine
tpdenk Jun 23, 2020
12a388b
Add cache tests
tpdenk Jun 23, 2020
16e034a
Define result
tpdenk Jun 23, 2020
de16058
moved LogData's variable from string to a compiled code; has some TOD…
SUMUKHA-PK Jun 24, 2020
8792b6c
moved LogData's variable from string to a compiled code; has some TOD…
SUMUKHA-PK Jun 24, 2020
d92ef6e
Add a simple profiler for the engine
tpdenk Jun 24, 2020
e9e0afc
Trigger CI
SUMUKHA-PK Jun 24, 2020
c286fe2
Trigger CI
SUMUKHA-PK Jun 24, 2020
fe28198
Implement a type system
tpdenk Jun 24, 2020
ca0ab8c
Add basic profiling options
tpdenk Jun 24, 2020
5f99184
Add builtin functions and use profiling
tpdenk Jun 24, 2020
09f8a9e
Add testing framework for parser->engine e2e tests
tpdenk Jun 24, 2020
350d323
Add a date type
tpdenk Jun 25, 2020
0e86523
Fix usage and evaluation of function values
tpdenk Jun 25, 2020
13cbc34
Refactor the type system
tpdenk Jun 25, 2020
ffff33a
Add godoc
tpdenk Jun 25, 2020
61c789f
Improve godoc
tpdenk Jun 25, 2020
db8d556
Add doc on page layout
tpdenk Jun 26, 2020
7b9cfb4
Add info about cells
tpdenk Jun 26, 2020
8b66d7f
Test
tpdenk Jun 26, 2020
c2eff01
Test
tpdenk Jun 26, 2020
a7d49e2
Test
tpdenk Jun 26, 2020
c2b8337
Test
tpdenk Jun 26, 2020
30124c3
Clean up type system
tpdenk Jun 29, 2020
6328d57
Move string tests to value tests
tpdenk Jun 29, 2020
daad9b5
Add godoc
tpdenk Jun 29, 2020
e025b90
this commits adds implementation of converting message to command typ…
SUMUKHA-PK Jun 30, 2020
79cd3ae
this commits adds implementation of converting message to command typ…
SUMUKHA-PK Jun 30, 2020
22600e1
this commits adds implementation of converting message to command typ…
SUMUKHA-PK Jun 30, 2020
cb1db20
this commits adds implementation of converting message to command typ…
SUMUKHA-PK Jun 30, 2020
bd883a8
Improve on the type system and run go generate
tpdenk Jul 1, 2020
0c33953
Add literal parser and support for numeric literal
tpdenk Jul 1, 2020
161fb04
Create tests to reflect requirements of #188
tpdenk Jul 1, 2020
efb21d6
Fix #188
tpdenk Jul 1, 2020
04a6c6e
this commit implements and tests converting message from command
SUMUKHA-PK Jul 2, 2020
ecf1e05
Add more godoc and another test for builtin max
tpdenk Jul 2, 2020
78382e7
Introduce a string representation for profiles
tpdenk Jul 2, 2020
8c3ea22
Create an example test case with profiling
tpdenk Jul 2, 2020
11fa3ac
Add documentation on profile package
tpdenk Jul 2, 2020
4f27111
Implement random function
tpdenk Jul 2, 2020
c86da7f
Add example tests with engine options
tpdenk Jul 2, 2020
44a90fb
this commit completes implementation and testing of conversion of com…
SUMUKHA-PK Jul 2, 2020
464719f
this commit completes implementation and testing of conversion of com…
SUMUKHA-PK Jul 2, 2020
a91559b
moved the old stop-gap arrangement of replication to the new conversi…
SUMUKHA-PK Jul 2, 2020
fe86835
this commit implements corrections suggested
SUMUKHA-PK Jul 3, 2020
e145c85
a basic idea for #174
SUMUKHA-PK Jul 5, 2020
7a8e61b
this commit adds a basic test framework for integration of raft modul…
SUMUKHA-PK Jul 8, 2020
b884065
fixed staticcheck errors
SUMUKHA-PK Jul 8, 2020
43f75ba
fixed errors
SUMUKHA-PK Jul 8, 2020
a026b24
Introduce a config page
tpdenk Jul 8, 2020
86d68b5
Introduce NULLs into Comparator implementations
tpdenk Jul 8, 2020
0c85613
Make tests also compare a Go string
tpdenk Jul 9, 2020
0e9a36e
Remove obsolete length check of parser errors
tpdenk Jul 9, 2020
c7a0170
Merge package ID from branch raft
tpdenk Jul 10, 2020
e718cf2
fixes #190
SUMUKHA-PK Jul 10, 2020
e498ad9
minor changes to fix #190
SUMUKHA-PK Jul 10, 2020
f05cb3a
fixes #191
SUMUKHA-PK Jul 10, 2020
02e960a
Merge pull request #192 from tomarrell/parser-patch
tpdenk Jul 10, 2020
03257a2
Merge branch 'master' into engine
tpdenk Jul 10, 2020
b465c52
Fix slack link
tomarrell Jul 10, 2020
164f492
Implement projection
tpdenk Jul 10, 2020
e14c42b
Add godoc
tpdenk Jul 10, 2020
eb29cdc
Update internal/engine/error.go
tpdenk Jul 10, 2020
4f64a98
Remove todos
tpdenk Jul 10, 2020
05d1103
Merge branch 'engine' of github.com:tomarrell/lbadd into engine
tpdenk Jul 10, 2020
cc49763
Remove database package
tpdenk Jul 10, 2020
f023d21
Update internal/engine/expression.go
tpdenk Jul 10, 2020
1427b99
Update internal/engine/numeric_parser.go
tpdenk Jul 10, 2020
6be3efb
Update internal/engine/expression.go
tpdenk Jul 10, 2020
a35032e
Merge branch 'master' into engine
tpdenk Jul 10, 2020
1cb364b
Fix test failure
tpdenk Jul 10, 2020
b8a67fe
Bump github.com/google/go-cmp from 0.4.0 to 0.5.0
dependabot-preview[bot] Jul 10, 2020
2b62e6d
Create dependabot.yml
tpdenk Jul 10, 2020
c8052f1
Bump golang.org/x/text from 0.3.2 to 0.3.3
dependabot-preview[bot] Jul 10, 2020
f26a3c4
Bump github.com/spf13/afero from 1.2.2 to 1.3.1
dependabot-preview[bot] Jul 10, 2020
6837ea8
Bump github.com/rs/zerolog from 1.18.0 to 1.19.0
dependabot-preview[bot] Jul 10, 2020
5bbcb3a
Bump github.com/stretchr/testify from 1.5.1 to 1.6.1
dependabot-preview[bot] Jul 10, 2020
24f0599
Merge pull request #195 from tomarrell/TimSatke-patch-1
tpdenk Jul 10, 2020
6acf3c9
Merge branch 'master' into dependabot/go_modules/github.com/google/go…
tpdenk Jul 10, 2020
36a03c2
Merge pull request #194 from tomarrell/dependabot/go_modules/github.c…
tpdenk Jul 10, 2020
558ecb8
Merge branch 'master' into dependabot/go_modules/golang.org/x/text-0.3.3
tpdenk Jul 10, 2020
e101773
Merge pull request #196 from tomarrell/dependabot/go_modules/golang.o…
tpdenk Jul 10, 2020
9498eff
Merge branch 'master' into dependabot/go_modules/github.com/spf13/afe…
tpdenk Jul 10, 2020
69c7656
Merge pull request #197 from tomarrell/dependabot/go_modules/github.c…
tpdenk Jul 10, 2020
bbe1cd6
Merge branch 'master' into dependabot/go_modules/github.com/rs/zerolo…
tpdenk Jul 10, 2020
bba6865
Merge pull request #198 from tomarrell/dependabot/go_modules/github.c…
tpdenk Jul 10, 2020
e463785
Merge branch 'master' into dependabot/go_modules/github.com/stretchr/…
tpdenk Jul 10, 2020
14ef8d1
Merge pull request #199 from tomarrell/dependabot/go_modules/github.c…
tpdenk Jul 10, 2020
a16a3bf
Merge branch 'master' into engine
tpdenk Jul 10, 2020
7c2c4b2
Embed a pointer
tpdenk Jul 10, 2020
15a41cf
go mod tidy
tpdenk Jul 10, 2020
189fec9
Merge branch 'raft' of https://github.com/tomarrell/lbadd into raft
SUMUKHA-PK Jul 10, 2020
8a51bd4
Update internal/engine/storage/db_test.go
tpdenk Jul 10, 2020
ddeda0a
this commit adds a self sufficient skeleton for a raft test framework
SUMUKHA-PK Jul 11, 2020
67aabc0
fixed staticcheck errors
SUMUKHA-PK Jul 11, 2020
0bed533
fixed staticcheck errors
SUMUKHA-PK Jul 11, 2020
e8c3b86
Merge pull request #179 from tomarrell/engine
tpdenk Jul 12, 2020
ba0982f
this commit refreshes the idea of the framework and adds error checki…
SUMUKHA-PK Jul 13, 2020
bc74c82
merge master
SUMUKHA-PK Jul 13, 2020
e6abf6a
this commit adds engine execution to the node package, tidies go mod …
SUMUKHA-PK Jul 13, 2020
42e3f30
fix staticcheck errors
SUMUKHA-PK Jul 13, 2020
3d88649
Bump github.com/spf13/afero from 1.3.1 to 1.3.2
dependabot[bot] Jul 14, 2020
b3260ab
go mod tidy
tpdenk Jul 14, 2020
33e45a6
Merge pull request #204 from tomarrell/dependabot/go_modules/github.c…
tpdenk Jul 14, 2020
d40d8cc
Fix PRs #203 and #205
tpdenk Jul 14, 2020
f32d1a0
Merge pull request #206 from tomarrell/TimSatke-patch-3
tpdenk Jul 14, 2020
b07117f
Implement arithmetic expressions
tpdenk Jul 20, 2020
79131f0
Implement arithmetic operations for Real type
tpdenk Jul 20, 2020
673ed1c
suppress warning until used
tpdenk Jul 20, 2020
e50e2b2
Implement Add for StringType
tpdenk Jul 20, 2020
56bd86a
Fix typo
tpdenk Jul 20, 2020
3a7a323
Merge pull request #207 from tomarrell/expressions
tpdenk Jul 20, 2020
f001d72
Make update flag consistent with other fixture tests
tpdenk Jul 20, 2020
d6e4eac
Merge pull request #208 from tomarrell/TimSatke-patch-1
tpdenk Jul 20, 2020
80a150d
this commit adds a network test framework and implements starting up …
SUMUKHA-PK Jul 20, 2020
127e675
merge master
SUMUKHA-PK Jul 20, 2020
814b25e
Add full roundtrip fuzzing
tpdenk Jul 20, 2020
99caded
Move and extend corpus
tpdenk Jul 20, 2020
8cb95fa
Add corpus test
tpdenk Jul 20, 2020
cf0afd9
Merge pull request #209 from tomarrell/fuzzing
tpdenk Jul 20, 2020
3a85472
go mod tidy
tpdenk Jul 20, 2020
b153a32
Merge pull request #213 from tomarrell/TimSatke-patch-1
SUMUKHA-PK Jul 20, 2020
f74284f
fixes #212
SUMUKHA-PK Jul 21, 2020
bae3487
Bump github.com/google/go-cmp from 0.5.0 to 0.5.1
dependabot[bot] Jul 22, 2020
3482786
Update go.sum
tpdenk Jul 27, 2020
5f20625
Merge pull request #214 from tomarrell/dependabot/go_modules/github.c…
tpdenk Jul 27, 2020
3e5d5e2
this commit fixes some bugs in the scanner
SUMUKHA-PK Jul 28, 2020
ff0331e
Implement basic selection
tpdenk Jul 30, 2020
0cc002f
Merge pull request #215 from tomarrell/201
SUMUKHA-PK Jul 31, 2020
0e6b6c4
this commit mends some issues in the scanner and parser
SUMUKHA-PK Jul 31, 2020
778f129
merge master
SUMUKHA-PK Jul 31, 2020
afa81d5
fixes #210, #211, amends some errors in the parser and scanner, adds …
SUMUKHA-PK Jul 31, 2020
f5b4a4c
fixed corpus tests
SUMUKHA-PK Jul 31, 2020
634b1fc
Fix indentation
tpdenk Jul 31, 2020
cad2486
fixed suggested changes
SUMUKHA-PK Jul 31, 2020
b4633e4
Merge branch 'parser-patch' of https://github.com/tomarrell/lbadd int…
SUMUKHA-PK Jul 31, 2020
aecfc43
removed go mod tmp
SUMUKHA-PK Jul 31, 2020
c94b8bf
Merge pull request #216 from tomarrell/parser-patch
tpdenk Jul 31, 2020
1c640a1
merge master
SUMUKHA-PK Jul 31, 2020
91d71aa
this commit mends some issues in conversion of command to message
SUMUKHA-PK Jul 31, 2020
57c03a1
this commit mends some parts of message to command and vice-versa con…
SUMUKHA-PK Aug 1, 2020
81e240a
moved raft from ancestor origin
SUMUKHA-PK Aug 8, 2020
5117cf4
merge master
SUMUKHA-PK Aug 8, 2020
3904589
merge master, added to CODEOWNERS, removed stale data
SUMUKHA-PK Aug 8, 2020
77f4a01
removed stale data
SUMUKHA-PK Aug 8, 2020
980975f
Cluster test suggestion
tpdenk Aug 14, 2020
36ef1d4
Work around Join
tpdenk Aug 14, 2020
464a448
Add connecting connections to cluster
tpdenk Aug 14, 2020
4579ecb
this commit has the first functioning test of raft that confirms that…
SUMUKHA-PK Sep 10, 2020
ed0d0b8
merge master
SUMUKHA-PK Sep 10, 2020
ca9005f
this commit adds comprehensive testing methods and some tests for the…
SUMUKHA-PK Sep 22, 2020
f46bf7f
this commit tries implementing support for crash recovery in raft
SUMUKHA-PK Oct 23, 2020
49faa22
this commit makes the concensus module robust to node failures and so…
SUMUKHA-PK Oct 26, 2020
dee3f53
this commit adds comments in the raft module
SUMUKHA-PK Oct 28, 2020
7c614cb
this commit has a heirarchical ctx passed to leader operations and a …
SUMUKHA-PK Oct 30, 2020
5126aa0
merge master
SUMUKHA-PK Oct 30, 2020
afbde1e
apparent fix in cluster, raft is breaking
SUMUKHA-PK Feb 9, 2021
6d527f4
this commit fixes the cluster communication problem and then adds som…
SUMUKHA-PK Mar 8, 2021
9606ac6
merge master
SUMUKHA-PK Mar 9, 2021
f84932e
this commit adds more raft tests and removes an old test in scanner
SUMUKHA-PK Mar 9, 2021
494723d
this commit rethinks the restarting of a node, passes CI
SUMUKHA-PK Mar 9, 2021
d71c13e
merge master
SUMUKHA-PK Mar 13, 2021
ab12319
merge master
SUMUKHA-PK Mar 13, 2021
ee02fd6
this commit removes a merge conflict in the overview document
SUMUKHA-PK Mar 13, 2021
2eec177
this commit finally removes the deadlock mutex, adds some implementat…
SUMUKHA-PK Mar 15, 2021
fc1ecf0
this commit fixes one of the raft test
SUMUKHA-PK Mar 16, 2021
0b0b70b
this commit adds some changes for append entries, closer to a complet…
SUMUKHA-PK Apr 15, 2021
941b22e
this commit adds multiple tests for append entries, validating the ap…
SUMUKHA-PK Apr 25, 2021
591a443
this commit fixes a race condition
SUMUKHA-PK Apr 25, 2021
10cc2a1
Merge branch 'master' of https://github.com/xqueries/xdb into raft
SUMUKHA-PK Apr 25, 2021
ceeaeee
merge master
SUMUKHA-PK Apr 25, 2021
4efb51b
this commit tidies up go.mod
SUMUKHA-PK Jul 29, 2021
a10bb7d
this commit tidies up go.mod
SUMUKHA-PK Jul 29, 2021
2f98fef
this commit creates a skeleton structure for future tests and impleme…
SUMUKHA-PK Jul 31, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .github/CODEOWNERS
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
# global code owners
* @TimSatke

internal/parser @SUMUKHA-PK
internal/parser @SUMUKHA-PK
internal/raft @SUMUKHA-PK
2 changes: 1 addition & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,4 @@
*.log
/xdb
/xdb-fuzz.zip
.idea/
.idea/
1 change: 0 additions & 1 deletion SECURITY.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,4 +18,3 @@ When building from source, please always use the latest version of Go that is av
If you detect a vulnerability, please open a common issue.
As there is no release intended for production use, vulnerabilities are not required to be handled critically yet.
This will change as soon as we have our first production release.
See issue [#92](https://github.com/xqueries/xdb/issues/92) for more info.
2 changes: 1 addition & 1 deletion driver/driver_test.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ func TestStatement(t *testing.T) {

assert := assert.New(t)

pool, err := sql.Open("add", LocalDatabaseAddress)
pool, err := sql.Open("xdb", LocalDatabaseAddress)
assert.NoError(err)
assert.NoError(pool.Ping())
defer func() {
Expand Down
11 changes: 11 additions & 0 deletions go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,12 +3,23 @@ module github.com/xqueries/xdb
go 1.13

require (
github.com/golang/protobuf v1.5.2
github.com/google/go-cmp v0.5.5
github.com/niemeyer/pretty v0.0.0-20200227124842-a10e7caefd8e // indirect
github.com/google/go-cmp v0.5.6
github.com/oklog/ulid v1.3.1
github.com/rs/zerolog v1.21.0
github.com/spf13/afero v1.6.0
github.com/spf13/cobra v1.1.3
github.com/stretchr/testify v1.7.0
golang.org/x/mod v0.4.2 // indirect
golang.org/x/net v0.0.0-20210226172049-e18ecbb05110
golang.org/x/sync v0.0.0-20201020160332-67f06af15bc9
golang.org/x/sys v0.0.0-20210415045647-66c3f260301c // indirect
golang.org/x/text v0.3.6
golang.org/x/tools v0.1.0
google.golang.org/protobuf v1.26.0
gopkg.in/check.v1 v1.0.0-20200227125254-8fa46927fb4f // indirect
golang.org/x/net v0.0.0-20210405180319-a5a99cb37ef4
golang.org/x/sync v0.0.0-20210220032951-036812b2e83c
golang.org/x/text v0.3.6
Expand Down
22 changes: 16 additions & 6 deletions go.sum
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,10 +54,14 @@ github.com/golang/mock v1.3.1/go.mod h1:sBzyDLLjw3U8JLTeZvSv8jJB+tU5PVekmnlKIyFU
github.com/golang/protobuf v1.2.0/go.mod h1:6lQm79b+lXiMfvg/cZm0SGofjICqVBUtrP5yJMmIC1U=
github.com/golang/protobuf v1.3.1/go.mod h1:6lQm79b+lXiMfvg/cZm0SGofjICqVBUtrP5yJMmIC1U=
github.com/golang/protobuf v1.3.2/go.mod h1:6lQm79b+lXiMfvg/cZm0SGofjICqVBUtrP5yJMmIC1U=
github.com/golang/protobuf v1.5.0/go.mod h1:FsONVRAS9T7sI+LIUmWTfcYkHO4aIWwzhcaSAoJOfIk=
github.com/golang/protobuf v1.5.2 h1:ROPKBNFfQgOUMifHyP+KYbvpjbdoFNs+aK7DXlji0Tw=
github.com/golang/protobuf v1.5.2/go.mod h1:XVQd3VNwM+JqD3oG2Ue2ip4fOMUkwXdXDdiuN0vRsmY=
github.com/google/btree v0.0.0-20180813153112-4030bb1f1f0c/go.mod h1:lNA+9X1NB3Zf8V7Ke586lFgjr2dZNuvo3lPJSGZ5JPQ=
github.com/google/btree v1.0.0/go.mod h1:lNA+9X1NB3Zf8V7Ke586lFgjr2dZNuvo3lPJSGZ5JPQ=
github.com/google/go-cmp v0.2.0/go.mod h1:oXzfMopK8JAjlY9xF4vHSVASa0yLyX7SntLO5aqRK0M=
github.com/google/go-cmp v0.3.0/go.mod h1:8QqcDgzrUqlUb/G2PQTWiueGozuR1884gddMywk6iLU=
github.com/google/go-cmp v0.5.5/go.mod h1:v8dTdLbMG2kIc/vJvl+f65V22dbkXbowE6jgT/gNBxE=
github.com/google/go-cmp v0.5.6 h1:BKbKCqvP6I+rmFHt06ZmyQtvB8xAkWdhFyr0ZUNZcxQ=
github.com/google/go-cmp v0.5.6/go.mod h1:v8dTdLbMG2kIc/vJvl+f65V22dbkXbowE6jgT/gNBxE=
github.com/google/martian v2.1.0+incompatible/go.mod h1:9I4somxYTbIHy5NJKHRl3wXiIaQGbYVAs8BPL6v8lEs=
Expand Down Expand Up @@ -103,7 +107,6 @@ github.com/kisielk/gotool v1.0.0/go.mod h1:XhKaO+MFFWcvkIS/tQcRk01m1F5IRFswLeQ+o
github.com/konsorten/go-windows-terminal-sequences v1.0.1/go.mod h1:T0+1ngSBFLxvqU3pZ+m/2kptfBszLMUkC4ZK/EgS/cQ=
github.com/kr/fs v0.1.0/go.mod h1:FFnZGqtBN9Gxj7eW1uZ42v5BccTP0vu6NEaFoC2HwRg=
github.com/kr/logfmt v0.0.0-20140226030751-b84e30acd515/go.mod h1:+0opPa2QZZtGFBFZlji/RkVcI2GknAs/DXo4wKdlNEc=
github.com/kr/pretty v0.1.0 h1:L/CwN0zerZDmRFUapSPitk6f+Q3+0za1rQkzVuMiMFI=
github.com/kr/pretty v0.1.0/go.mod h1:dAy3ld7l9f0ibDNOQOHHMYYIIbhfbHSm3C4ZsoJORNo=
github.com/kr/pty v1.1.1/go.mod h1:pFQYn66WHrOpPYNljwOMqo10TkYh1fy3cYio2l3bCsQ=
github.com/kr/text v0.1.0 h1:45sCR5RtlFHMR4UwH9sdQ5TC8v0qDQCHnXt+kaKSTVE=
Expand All @@ -124,6 +127,8 @@ github.com/mitchellh/mapstructure v1.1.2/go.mod h1:FVVH3fgwuzCH5S8UJGiWEs2h04kUh
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd/go.mod h1:6dJC0mAP4ikYIbvyc7fijjWJddQyLn8Ig3JB5CqoB9Q=
github.com/modern-go/reflect2 v1.0.1/go.mod h1:bx2lNnkwVCuqBIxFjflWJWanXIb3RllmbCylyMrvgv0=
github.com/mwitkow/go-conntrack v0.0.0-20161129095857-cc309e4a2223/go.mod h1:qRWi+5nqEBWmkhHvq77mSJWrCKwh8bxhgT7d/eI7P4U=
github.com/niemeyer/pretty v0.0.0-20200227124842-a10e7caefd8e h1:fD57ERR4JtEqsWbfPhv4DMiApHyliiK5xCTNVSPiaAs=
github.com/niemeyer/pretty v0.0.0-20200227124842-a10e7caefd8e/go.mod h1:zD1mROLANZcx1PVRCS0qkT7pwLkGfwJo4zjcN/Tysno=
github.com/oklog/ulid v1.3.1 h1:EGfNDEx6MqHz8B3uNV6QAib1UR2Lm97sHi3ocA6ESJ4=
github.com/oklog/ulid v1.3.1/go.mod h1:CirwcVhetQ6Lv90oh/F+FBtV6XMibvdAFo93nm5qn4U=
github.com/pascaldekloe/goe v0.0.0-20180627143212-57f6aae5913c/go.mod h1:lzWF7FIEvWOWxwDKqyGYQf6ZUaNfKdP144TG7ZOy1lc=
Expand All @@ -133,8 +138,6 @@ github.com/pkg/errors v0.8.1/go.mod h1:bwawxfHBFNV+L2hUp1rHADufV3IMtnDRdf1r5NINE
github.com/pkg/errors v0.9.1/go.mod h1:bwawxfHBFNV+L2hUp1rHADufV3IMtnDRdf1r5NINEl0=
github.com/pkg/sftp v1.10.1/go.mod h1:lYOWFsE0bwd1+KfKJaKeuokY15vzFx25BLbzYYoAxZI=
github.com/pmezard/go-difflib v1.0.0 h1:4DBwDE0NGyQoBHbLQYPwSUPoCMWR5BEzIk/f1lZbAQM=
github.com/pmezard/go-difflib v1.0.0 h1:4DBwDE0NGyQoBHbLQYPwSUPoCMWR5BEzIk/f1lZbAQM=
github.com/pmezard/go-difflib v1.0.0/go.mod h1:iKH77koFhYxTK1pcRnkKkqfTogsbg7gZNVY4sRDYZ/4=
github.com/pmezard/go-difflib v1.0.0/go.mod h1:iKH77koFhYxTK1pcRnkKkqfTogsbg7gZNVY4sRDYZ/4=
github.com/posener/complete v1.1.1/go.mod h1:em0nMJCgc9GFtwrmVmEMR/ZL6WyhyjMBndrE9hABlRI=
github.com/prometheus/client_golang v0.9.1/go.mod h1:7SWBe2y4D6OKWSNQJUaRYU/AaXPKyh/dDVn+NZz0KFw=
Expand Down Expand Up @@ -172,6 +175,7 @@ github.com/spf13/pflag v1.0.5 h1:iy+VFUOCP1a+8yFto/drg2CJ5u0yRoB7fZw3DKv/JXA=
github.com/spf13/pflag v1.0.5/go.mod h1:McXfInJRrz4CZXVZOBLb0bTZqETkiAhM9Iw0y3An2Bg=
github.com/spf13/viper v1.7.0/go.mod h1:8WkrPz2fc9jxqZNCJI/76HCieCp4Q8HaLFoCha5qpdg=
github.com/stretchr/objx v0.1.0/go.mod h1:HFkY916IF+rwdDfMAkV7OtwuqBVzrE8GR6GFx+wExME=
github.com/stretchr/objx v0.1.1 h1:2vfRuCMp5sSVIDSqO8oNnWJq7mPa6KVP3iPIwFBuy8A=
github.com/stretchr/objx v0.1.1/go.mod h1:HFkY916IF+rwdDfMAkV7OtwuqBVzrE8GR6GFx+wExME=
github.com/stretchr/testify v1.2.2/go.mod h1:a8OnRcib4nhh0OaRAV+Yts87kKdq0PP7pXfy6kDkUVs=
github.com/stretchr/testify v1.3.0/go.mod h1:M5WIy9Dh21IEIfnGCwXGc5bZfKNJtfHm1UVUgZn+9EI=
Expand Down Expand Up @@ -205,11 +209,9 @@ golang.org/x/exp v0.0.0-20191030013958-a1ab85dbe136/go.mod h1:JXzH8nQsPlswgeRAPE
golang.org/x/image v0.0.0-20190227222117-0694c2d4d067/go.mod h1:kZ7UVZpmo3dzQBMxlp+ypCbDeSB+sBbTgSJuh5dn5js=
golang.org/x/image v0.0.0-20190802002840-cff245a6509b/go.mod h1:FeLwcggjj3mMvU+oOTbSwawSJRM1uh48EjtB4UJZlP0=
golang.org/x/lint v0.0.0-20181026193005-c67002cb31c3/go.mod h1:UVdnD1Gm6xHRNCYTkRU2/jEulfH38KcIWyp/GAMgvoE=
golang.org/x/lint v0.0.0-20181026193005-c67002cb31c3/go.mod h1:UVdnD1Gm6xHRNCYTkRU2/jEulfH38KcIWyp/GAMgvoE=
golang.org/x/lint v0.0.0-20190227174305-5b3e6a55c961/go.mod h1:wehouNa3lNwaWXcvxsM5YxQ5yQlVC4a0KAMCusXpPoU=
golang.org/x/lint v0.0.0-20190301231843-5614ed5bae6f/go.mod h1:UVdnD1Gm6xHRNCYTkRU2/jEulfH38KcIWyp/GAMgvoE=
golang.org/x/lint v0.0.0-20190313153728-d0100b6bd8b3/go.mod h1:6SW0HCj/g11FgYtHlgUYUwCkIfeOF89ocIRzGO/8vkc=
golang.org/x/lint v0.0.0-20190313153728-d0100b6bd8b3/go.mod h1:6SW0HCj/g11FgYtHlgUYUwCkIfeOF89ocIRzGO/8vkc=
golang.org/x/lint v0.0.0-20190409202823-959b441ac422/go.mod h1:6SW0HCj/g11FgYtHlgUYUwCkIfeOF89ocIRzGO/8vkc=
golang.org/x/lint v0.0.0-20190909230951-414d861bb4ac/go.mod h1:6SW0HCj/g11FgYtHlgUYUwCkIfeOF89ocIRzGO/8vkc=
golang.org/x/lint v0.0.0-20190930215403-16217165b5de/go.mod h1:6SW0HCj/g11FgYtHlgUYUwCkIfeOF89ocIRzGO/8vkc=
Expand All @@ -235,6 +237,8 @@ golang.org/x/net v0.0.0-20190503192946-f4e77d36d62c/go.mod h1:t9HGtf8HONx5eT2rtn
golang.org/x/net v0.0.0-20190603091049-60506f45cf65/go.mod h1:HSz+uSET+XFnRR8LxR5pz3Of3rY3CfYBVs4xY44aLks=
golang.org/x/net v0.0.0-20190620200207-3b0461eec859/go.mod h1:z5CRVTTTmAJ677TzLLGU+0bjPO0LkuOLi4/5GtJWs/s=
golang.org/x/net v0.0.0-20201021035429-f5854403a974/go.mod h1:sp8m0HH+o8qH0wwXwYZr8TS3Oi6o0r6Gce1SSxlDquU=
golang.org/x/net v0.0.0-20210226172049-e18ecbb05110 h1:qWPm9rbaAMKs8Bq/9LRpbMqxWRVUAQwMI9fVrssnTfw=
golang.org/x/net v0.0.0-20210226172049-e18ecbb05110/go.mod h1:m0MpNAwzfU5UDzcl9v0D8zg8gWTRqZa9RBIspLL5mdg=
golang.org/x/net v0.0.0-20210405180319-a5a99cb37ef4 h1:4nGaVu0QrbjT/AK2PRLuQfQuh6DJve+pELhqTdAj3x0=
golang.org/x/net v0.0.0-20210405180319-a5a99cb37ef4/go.mod h1:p54w0d4576C0XHj96bSt6lcn1PtDYWL6XObtHCRCNQM=
golang.org/x/oauth2 v0.0.0-20180821212333-d2e6202438be/go.mod h1:N/0e6XlmueqKjAGxoOufVs8QHGRruUQn6yWY3a++T0U=
Expand Down Expand Up @@ -265,6 +269,8 @@ golang.org/x/sys v0.0.0-20200930185726-fdedc70b468f/go.mod h1:h1NjWce9XRLGQEsW7w
golang.org/x/sys v0.0.0-20201119102817-f84b799fce68/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs=
golang.org/x/sys v0.0.0-20210119212857-b64e53b001e4/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs=
golang.org/x/sys v0.0.0-20210330210617-4fbd30eecc44/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs=
golang.org/x/sys v0.0.0-20210415045647-66c3f260301c h1:6L+uOeS3OQt/f4eFHXZcTxeZrGCuz+CLElgEBjbcTA4=
golang.org/x/sys v0.0.0-20210415045647-66c3f260301c/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs=
golang.org/x/sys v0.0.0-20210510120138-977fb7262007 h1:gG67DSER+11cZvqIMb8S8bt0vZtiN6xWYARwirrOSfE=
golang.org/x/sys v0.0.0-20210510120138-977fb7262007/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/term v0.0.0-20201126162022-7de9c90e9dd1/go.mod h1:bj7SfCRtBDWHUb9snDiAeCFNEtKQo2Wmx5Cou7ajbmo=
Expand Down Expand Up @@ -323,10 +329,14 @@ google.golang.org/genproto v0.0.0-20191108220845-16a3f7862a1a/go.mod h1:n3cpQtvx
google.golang.org/grpc v1.19.0/go.mod h1:mqu4LbDTu4XGKhr4mRzUsmM4RtVoemTSY81AxZiDr8c=
google.golang.org/grpc v1.20.1/go.mod h1:10oTOabMzJvdu6/UiuZezV6QK5dSlG84ov/aaiqXj38=
google.golang.org/grpc v1.21.1/go.mod h1:oYelfM1adQP15Ek0mdvEgi9Df8B9CZIaU1084ijfRaM=
google.golang.org/protobuf v1.26.0-rc.1/go.mod h1:jlhhOSvTdKEhbULTjvd4ARK9grFBp09yW+WbY/TyQbw=
google.golang.org/protobuf v1.26.0 h1:bxAC2xTBsZGibn2RTntX0oH50xLsqy1OxA9tTL3p/lk=
google.golang.org/protobuf v1.26.0/go.mod h1:9q0QmTI4eRPtz6boOQmLYwt+qCgq0jsYwAQnmE0givc=
gopkg.in/alecthomas/kingpin.v2 v2.2.6/go.mod h1:FMv+mEhP44yOT+4EoQTLFTRgOQ1FBLkstjWtayDeSgw=
gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=
gopkg.in/check.v1 v1.0.0-20180628173108-788fd7840127 h1:qIbj1fsPNlZgppZ+VLlY7N33q108Sa+fhmuc+sWQYwY=
gopkg.in/check.v1 v1.0.0-20180628173108-788fd7840127/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=
gopkg.in/check.v1 v1.0.0-20200227125254-8fa46927fb4f h1:BLraFXnmrev5lT+xlilqcH8XK9/i0At2xKjWk4p6zsU=
gopkg.in/check.v1 v1.0.0-20200227125254-8fa46927fb4f/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=
gopkg.in/errgo.v2 v2.1.0/go.mod h1:hNsd1EY+bozCKY1Ytp96fpM3vjJbqLJn88ws8XvfDNI=
gopkg.in/ini.v1 v1.51.0/go.mod h1:pNLf8WUiyNEtQjuu5G5vTm06TEv9tsIgeAvK8hOrP4k=
gopkg.in/resty.v1 v1.12.0/go.mod h1:mDo4pnntr5jdWRML875a/NmxYqAlA73dVijT2AXvQQo=
Expand Down
0 internal/network/errors.go → internal/network/error.go
View file
Open in desktop
File renamed without changes.
4 changes: 3 additions & 1 deletion internal/network/example_test.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ import (
"log"

"github.com/rs/zerolog"
"github.com/xqueries/xdb/internal/id"
"github.com/xqueries/xdb/internal/network"
)

Expand All @@ -26,7 +27,8 @@ func ExampleServer() {

<-srv.Listening() // wait for the server to come up

client, _ := network.DialTCP(ctx, ":59513")
clientID := id.Create()
client, _ := network.DialTCP(ctx, clientID, ":59513")
defer func() {
_ = client.Close()
}()
Expand Down
82 changes: 82 additions & 0 deletions internal/network/mocks/conn.go
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions internal/network/mocks/doc.go
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
// Package mocks provides generated mock implementations for easy testing.
package mocks
20 changes: 9 additions & 11 deletions internal/network/server.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,10 @@ package network

import (
"context"
"fmt"
"io"
"net"

"github.com/xqueries/xdb/internal/id"
)

// ConnHandler is a handler function for handling new connections. It will be
Expand All @@ -29,11 +30,16 @@ type Server interface {
// Addr returns the address that this server is listening to.
Addr() net.Addr

// OwnID returns the ID of this server. The remote ID of any connection is
// the own ID of another server.
OwnID() id.ID
// OnConnect sets a callback that will be executed whenever a new connection
// connects to this server.
OnConnect(ConnHandler)
}

//go:generate mockery -case=snake -name=Conn

// Conn describes a network connection. One can send a message with Conn.Send,
// and receive one with Conn.Receive. Unlike an io.Writer, the data that is
// passed into Send is guaranteed to be returned in a single Receive call on the
Expand All @@ -42,9 +48,8 @@ type Server interface {
type Conn interface {
io.Closer

// ID returns the ID of this connection. It can be used to uniquely identify
// this connection globally.
ID() ID
// RemoteID returns the own ID of the server that this connection points to.
RemoteID() id.ID
// Send sends the given payload to the remote part of this connection. The
// message will not be chunked, and can be read with a single call to
// Conn.Receive.
Expand All @@ -53,10 +58,3 @@ type Conn interface {
// is a byte slice that was sent with a single call to Conn.Send.
Receive(context.Context) ([]byte, error)
}

// ID describes an identifier that is used for connections. An ID has to be
// unique application-wide. IDs must not be re-used.
type ID interface {
fmt.Stringer
Bytes() []byte
}
Loading