Skip to content

Commit 3446613

Browse files
committed
dashboard/app: use machines with more memory for batch processing
8 cores, 12 gig machines can't process quarter long aggregation for some reason. The process requires only 1 gig and do the stream processing. It is something else I don't fully understand. Local experiments show high memory consumptions by the git processes.
1 parent e95de19 commit 3446613

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

dashboard/app/batch_main.go

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ func createScriptJob(ctx context.Context, projectID, jobNamePrefix, script strin
4646
ComputeResource: &batchpb.ComputeResource{
4747
// CpuMilli is milliseconds per cpu-second. This means the task requires 8 whole CPUs.
4848
CpuMilli: 8000,
49-
MemoryMib: 12 * 1024,
49+
MemoryMib: 30 * 1024,
5050
},
5151
MaxRunDuration: &durationpb.Duration{
5252
Seconds: timeout,
@@ -62,8 +62,8 @@ func createScriptJob(ctx context.Context, projectID, jobNamePrefix, script strin
6262
Instances: []*batchpb.AllocationPolicy_InstancePolicyOrTemplate{{
6363
PolicyTemplate: &batchpb.AllocationPolicy_InstancePolicyOrTemplate_Policy{
6464
Policy: &batchpb.AllocationPolicy_InstancePolicy{
65-
ProvisioningModel: batchpb.AllocationPolicy_SPOT,
66-
MachineType: "c3-highcpu-8",
65+
ProvisioningModel: batchpb.AllocationPolicy_STANDARD,
66+
MachineType: "e2-standard-8",
6767
},
6868
},
6969
InstallOpsAgent: true,

0 commit comments

Comments
 (0)