How will we handle running code and storing data?

[dynamixbot]

Well obviously we aren't gonna do this stuff on our daily drived computers so these are my proposed two options:

Local: We make a NAS (Network-attached Storage) using a Raspberry Pi 5 (also runs code). This is the entire detailed thing for local.

• The things we need: A Pi 5, A Penta SATA hat for the Pi 5 by Radxa some SSD's from either Crucial or Samsung and a active heatsink for the Pi 5.

• Specifications: A 2.4 GHz quad-core Arm CPU, with cryptography extensions. 800 MHz VideoCore VII GPU for anything we might want to do. 8GB of LPDDR4X RAM. 2TB of SSD storage and 1 gigabit ethernet with plenty of I/O.

• Procedure: First buy the stuff we need. Then, put the flex connector of the SATA hat into the PCIe slot. Then, put the other side into the SATA hat's port. Attach the active cooler of the Pi 5 and then attach the SATA hat on top of the Pi. Attach the SSD's to the SATA slots and we are good to go with assembly.

• How each SSD is used: 2 SSD's store the English part of the forums we browse. The 3rd SSD will store everything else than the forums. And the 4th SSD stores the largest category on Scratch, Scratch around the world accounting for 99.7% of posts on the Scratch Forums. Currently no data backup, so put UPS for Pi...A

• Cost: The price of the main rack costs about 150$ If you include SSD's then it's about 350$. Although costs to maintain is near 0.

Cloud: We can make this in the Cloud using Google Cloud because Google. Details below.

• The things we need: Google Cloud Storage and Cloud Run

• Specifications: God knows but we know we have 4TB of storage

• Procedure: Buy Google Cloud Storage plan on free tier. Then start paying.

• Cost: 173$ PER MONTH

so now @redstone-dev choice (also all of this storage issue idk how to do. this is just me being me and doing random stuff.)

[EngineerRunner]

well, the same question comes up as always. who's paying? do you have $400 laying around or a job that pays over $180/month? because i don't think anybody here will want to pay that when an even better and cheaper idea would be to grab an old office computer (like a dell or smthn, doesn't really matter) off ebay and throw a few HDDs in there. that way, we'd be able to simply scale up the storage by buying some more cheap hard drives, and we'd also have the 250gb-1tb hard drive that comes with it. you're thinking way overkill for this small project (we prob wouldn't even need active cooling if we decide to go for a pi for, and we definitely wouldn't need ssds), and you aren't even putting yourself forward as the one who's gonna pay.

[dynamixbot]

well, the same question comes up as always. who's paying? do you have $400 laying around or a job that pays over $180/month? because i don't think anybody here will want to pay that when an even better and cheaper idea would be to grab an old office computer (like a dell or smthn, doesn't really matter) off ebay and throw a few HDDs in there. that way, we'd be able to simply scale up the storage by buying some more cheap hard drives, and we'd also have the 250gb-1tb hard drive that comes with it. you're thinking way overkill for this small project (we prob wouldn't even need active cooling if we decide to go for a pi for, and we definitely wouldn't need ssds), and you aren't even putting yourself forward as the one who's gonna pay.

i have an old dell computer

[Sid72020123]

Maybe use the free tier of MongoDB Atlas?
Or use Deta Space. You can use to store images too!

[dynamixbot]

well, the same question comes up as always. who's paying? do you have $400 laying around or a job that pays over $180/month? because i don't think anybody here will want to pay that when an even better and cheaper idea would be to grab an old office computer (like a dell or smthn, doesn't really matter) off ebay and throw a few HDDs in there. that way, we'd be able to simply scale up the storage by buying some more cheap hard drives, and we'd also have the 250gb-1tb hard drive that comes with it. you're thinking way overkill for this small project (we prob wouldn't even need active cooling if we decide to go for a pi for, and we definitely wouldn't need ssds), and you aren't even putting yourself forward as the one who's gonna pay.

aws lambda is free for compute.

[redstone-dev]

Cloud sounds expensive. I could hack something up in a few hours on my Pi and maybe give access to y'all through ssh, however. I'd need to find storage but I do have quite a bit of money I've been saving up, so we could get a reasonable storage configuration and a few performance upgrades for my Pi. Keep in mind that I do not want to buy a whole new Pi lol, so I'll just make do with my Pi 4B (which is still powerful enough to drive two 4K displays at 60fps, mind you).

[ahypnoman]

What is storage needed for if this is tapping in to the Scratch API? (I don't mean for Voyager, given that's now a separate project)

[redstone-dev]

What is storage needed for if this is tapping in to the Scratch API? (I don't mean for Voyager, given that's now a separate project)

I agree that the amount of storage is 50 magnitudes of overkill. You do need storage to be able to run the SQLite database, but that still shouldn't be that much of a problem.

[dynamixbot]

Cloud sounds expensive. I could hack something up in a few hours on my Pi and maybe give access to y'all through ssh, however. I'd need to find storage but I do have quite a bit of money I've been saving up, so we could get a reasonable storage configuration and a few performance upgrades for my Pi. Keep in mind that I do not want to buy a whole new Pi lol, so I'll just make do with my Pi 4B (which is still powerful enough to drive two 4K displays at 60fps, mind you).

the pi 4b could easily do it. no need for nas thing i said.

What is storage needed for if this is tapping in to the Scratch API? (I don't mean for Voyager, given that's now a separate project)

I agree that the amount of storage is 50 magnitudes of overkill. You do need storage to be able to run the SQLite database, but that still shouldn't be that much of a problem.

Voyager is still part of SnarpleDev i think. Also, the reason i said that most likely inaccurate number is beacuse there are about 6.5 MILLION posts on scratch.

[NotFenixio]

We don't need to put all the 6.5 million posts on caché...

[dynamixbot]

We don't need to put all the 6.5 million posts on caché...

not on cache... on some hdd or ssd

[dynamixbot]

UPDATE:
Scratch now has 1,000,000,000 projects... shit.

[EngineerRunner]

UPDATE:
Scratch now has 1,000,000,000 projects... shit.

nowhere near all of them are shared, and we have almost no reason to cache projects since there's an actual api

[dynamixbot]

UPDATE:
Scratch now has 1,000,000,000 projects... shit.

nowhere near all of them are shared, and we have almost no reason to cache projects since there's an actual api

oh right i forgot about that

[dynamixbot]

closing this because @redstone-dev pi might work