Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
132 commits
Select commit Hold shift + click to select a range
e458d38
write RFC about calculated channel extraction
pjdotson Jun 9, 2026
404ef64
Merge branch 'rc' into sy-4348-refactor-channel-service-so-it-doesnt-…
pjdotson Jun 10, 2026
1a13679
Merge branch 'rc' into sy-4348-refactor-channel-service-so-it-doesnt-…
pjdotson Jun 11, 2026
6132eaa
wip: checkpoint before merging rc
pjdotson Jun 12, 2026
c56945e
Merge remote-tracking branch 'origin/rc' into sy-4348-refactor-channe…
pjdotson Jun 12, 2026
a01c267
More changes
pjdotson Jun 12, 2026
82b40db
Some service renamings
pjdotson Jun 12, 2026
7f7191f
change renaming stuff
pjdotson Jun 12, 2026
9ba6bb5
More renamings to distchannel
pjdotson Jun 12, 2026
aad2a7c
change state config dependency
pjdotson Jun 12, 2026
94ec055
Merge branch 'rc' into sy-4348-refactor-channel-service-so-it-doesnt-…
pjdotson Jun 12, 2026
7baf698
More renamings
pjdotson Jun 12, 2026
1ef8eed
Migrate line plot migration as well
pjdotson Jun 12, 2026
12d4bff
more refactors
pjdotson Jun 12, 2026
60b1291
rename
pjdotson Jun 12, 2026
23abfaa
Merge branch 'rc' into sy-4348-refactor-channel-service-so-it-doesnt-…
pjdotson Jun 12, 2026
ff3b5d5
refactor some things
pjdotson Jun 12, 2026
93c9287
More consolidations
pjdotson Jun 12, 2026
9d3c1ed
Change a few last things
pjdotson Jun 12, 2026
4fe7ee4
Remove dead code
pjdotson Jun 12, 2026
80c639f
More fixes
pjdotson Jun 12, 2026
3aa3a2b
move
pjdotson Jun 13, 2026
1589a98
Merge branch 'rc' into sy-4348-refactor-channel-service-so-it-doesnt-…
pjdotson Jun 15, 2026
13d2b81
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 15, 2026
a7c8e3d
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 16, 2026
bb570b1
SY-4331: Relocate channel schema and generated code to the service layer
pjdotson Jun 16, 2026
33478e7
SY-4331: Reduce the distribution channel to a minimal type and allocator
pjdotson Jun 16, 2026
7be6d79
SY-4331: Move channel table, retrieval, and lifecycle to the service …
pjdotson Jun 16, 2026
bf994db
SY-4331: Update tests for the channel service-layer move
pjdotson Jun 16, 2026
247c458
SY-4331: Keep the distribution layer free of service-layer imports
pjdotson Jun 16, 2026
b9ae29f
SY-4331: Move channel license verification to the service layer
pjdotson Jun 16, 2026
6d4e103
SY-4331: Simplify the distribution channel proto and test its translator
pjdotson Jun 16, 2026
874649a
SY-4331: Move channel name validation to the service layer
pjdotson Jun 16, 2026
6c77de2
SY-4331: Remove channel ontology helpers and NewRandomName from the d…
pjdotson Jun 16, 2026
625d432
SY-4331: Rename distribution channel allocator methods and move Parse…
pjdotson Jun 16, 2026
92c2669
SY-4331: Consolidate the distribution channel proto into one file
pjdotson Jun 16, 2026
99db841
Another refactoring commit
pjdotson Jun 16, 2026
b48efd8
Update dist/channel/pb
pjdotson Jun 17, 2026
d620975
More dist layer refactors
pjdotson Jun 17, 2026
6ac72ea
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 17, 2026
09cce8e
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 17, 2026
b7a800c
Remove ContainsKeys
pjdotson Jun 17, 2026
9394832
fix merge issues
pjdotson Jun 17, 2026
ad129bb
make sure writer doesn't use channel.Retriever
pjdotson Jun 17, 2026
f512367
wip: checkpoint before merging rc
pjdotson Jun 18, 2026
7a73178
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 18, 2026
745b716
Update distribution layer control channel code
pjdotson Jun 18, 2026
653e4db
kv renaming
pjdotson Jun 18, 2026
403810d
update distribution layer.go
pjdotson Jun 18, 2026
eb89caf
some test improvements and stuff
pjdotson Jun 18, 2026
40e7eb2
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 18, 2026
39d18cc
Formatting
pjdotson Jun 18, 2026
d240b66
Improve tests
pjdotson Jun 18, 2026
f0acf19
Split dist channel service methods
pjdotson Jun 18, 2026
c96e053
Update channel and channel_test
pjdotson Jun 18, 2026
699b2b8
Update mocks
pjdotson Jun 18, 2026
e709d1f
remove context.Background()s
pjdotson Jun 19, 2026
c6c214c
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 19, 2026
91f3164
add documentation
pjdotson Jun 19, 2026
ae940e9
Add x/go and docs
pjdotson Jun 19, 2026
a5bf2c0
test updates
pjdotson Jun 19, 2026
dca21e3
Remove junk from channel service
pjdotson Jun 19, 2026
7e42262
service layer updates
pjdotson Jun 19, 2026
a56f3dd
move things around
pjdotson Jun 19, 2026
04803cd
change framer codec stuff
pjdotson Jun 19, 2026
aa9e9ef
transport layer changes
pjdotson Jun 19, 2026
c6bcfe8
Remove unused params
pjdotson Jun 19, 2026
7630ef0
transport mocks
pjdotson Jun 19, 2026
052fee5
New thing
pjdotson Jun 19, 2026
967d4f0
Updates
pjdotson Jun 19, 2026
164c932
changes
pjdotson Jun 19, 2026
bc1e8b7
back to service layer
pjdotson Jun 19, 2026
99d142c
Transport layer changes
pjdotson Jun 19, 2026
ac6eba2
API + transport layer changes
pjdotson Jun 19, 2026
8778e0f
remove framer wrap
pjdotson Jun 19, 2026
5b93e6a
some test changes
pjdotson Jun 19, 2026
57010c7
Update test code
pjdotson Jun 19, 2026
41134ba
Change service dependency
pjdotson Jun 19, 2026
b63a0c9
Standardize tests
pjdotson Jun 19, 2026
0e63c6d
rerun oracle sync
pjdotson Jun 19, 2026
2c05748
Fix suite tests
pjdotson Jun 19, 2026
42b6c06
some changes
pjdotson Jun 19, 2026
1f1408f
Update framer codec
pjdotson Jun 19, 2026
4b1a210
Update codec interface
pjdotson Jun 19, 2026
e58c7d2
Final framer codec updates
pjdotson Jun 19, 2026
e40a37d
More updates
pjdotson Jun 19, 2026
6efb8e9
service layer writer shim
pjdotson Jun 19, 2026
c80b1d6
updates ts-db
pjdotson Jun 19, 2026
3f86d77
fix some things
pjdotson Jun 22, 2026
7ada6ec
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 22, 2026
63e11f1
Fix formatting
pjdotson Jun 22, 2026
452a0f8
Update start.go calls
pjdotson Jun 22, 2026
bd6d703
Updates
pjdotson Jun 22, 2026
ab9e032
Update distribution layer.go
pjdotson Jun 22, 2026
cb5e932
Update dist mock
pjdotson Jun 22, 2026
32ab082
Cut down on bloat in tests
pjdotson Jun 22, 2026
da6f7cb
Update framer and channel things
pjdotson Jun 22, 2026
f280291
Update dist mock
pjdotson Jun 22, 2026
5f74dd7
Update distribution transport stuff
pjdotson Jun 22, 2026
24dcb61
Update gRPC and dist framer tests
pjdotson Jun 22, 2026
eab0e45
More transport updates
pjdotson Jun 22, 2026
d5e1b60
more updates
pjdotson Jun 22, 2026
7f86abd
more
pjdotson Jun 22, 2026
e298741
finish trans layer
pjdotson Jun 22, 2026
3e07631
Method renames
pjdotson Jun 22, 2026
c813785
Update analyzer and everything else good in this world
pjdotson Jun 22, 2026
b98bba6
New update
pjdotson Jun 22, 2026
e44da9d
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 23, 2026
53c0541
Fix tests
pjdotson Jun 23, 2026
527f734
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 23, 2026
3e3cb74
Updates to service-layer channel and framer
pjdotson Jun 23, 2026
9b0d283
comment formatting
pjdotson Jun 23, 2026
eafb628
Remove some unneeded things from channel service
pjdotson Jun 23, 2026
049aa93
standardize writer.go
pjdotson Jun 23, 2026
83dc597
Simplify test packages
pjdotson Jun 23, 2026
73e17e2
More cleanups
pjdotson Jun 23, 2026
2d84835
simplify channel package
pjdotson Jun 23, 2026
266469d
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 23, 2026
ea58314
Fix tests from merge
pjdotson Jun 23, 2026
7265010
Update channel service
pjdotson Jun 23, 2026
158366a
plump
pjdotson Jun 23, 2026
05e8750
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 23, 2026
96b3caf
add statusSvc to tests
pjdotson Jun 24, 2026
bb61ce0
Update files to test package
pjdotson Jun 24, 2026
76f67c2
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 24, 2026
d656c6c
Add leaklint analyzer and enforce goroutine-leak checks
pjdotson Jun 24, 2026
638dfc6
Merge branch 'rc' into sy-4331-move-most-channel-functionality-to-ser…
pjdotson Jun 26, 2026
d874309
Remove leaklint analyzer and goroutine-leak check enforcement
pjdotson Jun 26, 2026
10debe9
Remove unrelated changes to leak_test.go, aspen kv, and cesium
pjdotson Jun 27, 2026
9656f23
Basic updates
pjdotson Jun 27, 2026
5c82e09
remove changes from `rc`
pjdotson Jun 27, 2026
cba32fc
Use freighter grpc testutil StartServer in channel suite test
pjdotson Jun 27, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
41 changes: 20 additions & 21 deletions client/cpp/channel/proto.gen.h

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

8 changes: 4 additions & 4 deletions client/cpp/channel/types.gen.h

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

28 changes: 14 additions & 14 deletions core/cmd/start/start.go
Original file line number Diff line number Diff line change
Expand Up @@ -201,24 +201,24 @@ func BootupCore(ctx context.Context, onServerStarted chan struct{}, cfgs ...Core
)

if distributionLayer, err = distribution.OpenLayer(ctx, distribution.LayerConfig{
Instrumentation: cfg.Child("distribution"),
AdvertiseAddress: cfg.listenAddress,
PeerAddresses: cfg.peers,
AspenTransport: aspenTransport,
Transport: distTransport,
Verifier: cfg.verifier,
Storage: storageLayer,
ValidateChannelNames: cfg.validateChannelNames,
Instrumentation: cfg.Child("distribution"),
AdvertiseAddress: cfg.listenAddress,
PeerAddresses: cfg.peers,
AspenTransport: aspenTransport,
Transport: distTransport,
Storage: storageLayer,
}); !ok(err, distributionLayer) {
return err
}

if serviceLayer, err = service.OpenLayer(ctx, service.LayerConfig{
Instrumentation: cfg.Child("service"),
Distribution: distributionLayer,
Security: securityProvider,
Storage: storageLayer,
RootCredentials: cfg.rootCredentials,
Instrumentation: cfg.Child("service"),
Distribution: distributionLayer,
Security: securityProvider,
Storage: storageLayer,
RootCredentials: cfg.rootCredentials,
Verifier: cfg.verifier,
ValidateChannelNames: cfg.validateChannelNames,
}); !ok(err, serviceLayer) {
return err
}
Expand All @@ -243,8 +243,8 @@ func BootupCore(ctx context.Context, onServerStarted chan struct{}, cfgs ...Core
if transportLayer, err = transport.NewLayer(transport.LayerConfig{
Instrumentation: cfg.Child("transport"),
API: apiLayer,
Channel: serviceLayer.Channel,
Router: r,
Channel: distributionLayer.Channel,
}); !ok(err, nil) {
return err
}
Expand Down
14 changes: 12 additions & 2 deletions core/pkg/api/arc/arc_suite_test.go
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ import (
"github.com/synnaxlabs/synnax/pkg/service/access/rbac"
"github.com/synnaxlabs/synnax/pkg/service/access/rbac/policy"
"github.com/synnaxlabs/synnax/pkg/service/access/rbac/role"
arc "github.com/synnaxlabs/synnax/pkg/service/arc"
"github.com/synnaxlabs/synnax/pkg/service/arc"
"github.com/synnaxlabs/synnax/pkg/service/auth"
"github.com/synnaxlabs/synnax/pkg/service/channel"
"github.com/synnaxlabs/synnax/pkg/service/label"
Expand Down Expand Up @@ -77,6 +77,16 @@ var _ = BeforeSuite(func(ctx SpecContext) {
Label: labelSvc,
Search: searchIdx,
}))
channelSvc := MustOpen(channel.OpenService(ctx, channel.ServiceConfig{
Channel: node.Channel,
DB: node.DB,
HostResolver: node.Cluster,
Ontology: node.Ontology,
Group: node.Group,
Status: statSvc,
Search: node.Search,
}))

rackSvc := MustOpen(rack.OpenService(ctx, rack.ServiceConfig{
DB: db,
Ontology: otg,
Expand All @@ -97,7 +107,7 @@ var _ = BeforeSuite(func(ctx SpecContext) {
arcSvc = MustOpen(arc.OpenService(ctx, arc.ServiceConfig{
DB: db,
Ontology: otg,
Channel: channel.Wrap(node.Channel),
Channel: channelSvc,
Task: taskSvc,
Search: searchIdx,
}))
Expand Down
4 changes: 2 additions & 2 deletions core/pkg/api/channel/BUILD.bazel
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ proto_library(
srcs = ["pb/channel.proto"],
visibility = ["//visibility:public"],
deps = [
"//core/pkg/distribution/channel:channel_proto",
"//core/pkg/service/channel:channel_proto",
"//core/pkg/service/status:status_proto",
"//x/go/control:control_proto",
],
Expand All @@ -18,7 +18,7 @@ cpp_grpc_library(
protos = [":channel_proto"],
visibility = ["//visibility:public"],
deps = [
"//core/pkg/distribution/channel:channel_grpc",
"//core/pkg/service/channel:channel_grpc",
"//core/pkg/service/status:status_grpc",
"//x/go/control:control_grpc",
],
Expand Down
4 changes: 2 additions & 2 deletions core/pkg/api/channel/channel.go
Original file line number Diff line number Diff line change
Expand Up @@ -329,7 +329,7 @@ func (s *Service) Delete(
if err := s.access.NewEnforcer(tx).Enforce(ctx, access.Request{
Subject: auth.GetSubject(ctx),
Action: access.ActionDelete,
Objects: req.Keys.OntologyIDs(),
Objects: channel.OntologyIDsFromKeys(req.Keys),
}); err != nil {
return types.Nil{}, err
}
Expand Down Expand Up @@ -370,7 +370,7 @@ func (s *Service) Rename(
if err := s.access.NewEnforcer(tx).Enforce(ctx, access.Request{
Subject: auth.GetSubject(ctx),
Action: access.ActionUpdate,
Objects: req.Keys.OntologyIDs(),
Objects: channel.OntologyIDsFromKeys(req.Keys),
}); err != nil {
return types.Nil{}, err
}
Expand Down
12 changes: 6 additions & 6 deletions core/pkg/api/channel/pb/channel.pb.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions core/pkg/api/channel/pb/channel.proto
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ syntax = "proto3";

package api.channel.pb;

import "core/pkg/distribution/channel/pb/channel.proto";
import "core/pkg/service/channel/pb/channel.proto";
import "core/pkg/service/status/pb/status.proto";
import "x/go/control/pb/control.proto";

Expand Down Expand Up @@ -52,7 +52,7 @@ message Channel {
string expression = 10;
// operations contains optional aggregation operations (min, max, avg) applied to
// channel data over time or triggered by a reset channel.
repeated .distribution.channel.pb.Operation operations = 11;
repeated .service.channel.pb.Operation operations = 11;
// concurrency sets the policy for concurrent writes to the channel's data. Only virtual
// channels can have a policy of shared concurrency.
.x.control.pb.Concurrency concurrency = 12;
Expand Down
10 changes: 5 additions & 5 deletions core/pkg/api/channel/pb/translator.gen.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 5 additions & 5 deletions core/pkg/api/channel/types.gen.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading