dump MySQL to AWS S3

[simsong]

This dumps all of the MySQL databases to AWS S3.
It will be called from a cron job on a daily basis in the production environment.

[sbarber2]

I think given that the test runs are failing that at least one change to the repo is needed!

[sbarber2]

Ah, yes it would,

…

On Thu, Apr 10, 2025 at 10:17 PM Simson L. Garfinkel < ***@***.***> wrote: ***@***.**** commented on this pull request. ------------------------------ In deploy/app/dbmaint.py <#688 (comment)>: > + """Backup to an sqlfile""" + if os.path.exists(fname): + raise FileExistsError(f"{fname} exists") + dbreader = dbfile.DBMySQLAuth.FromConfig(config['dbreader']) + cmd = ['mysqldump','-h' + dbreader.host,'-u' + dbreader.user, '-p' + dbreader.password, '--single-transaction', '--no-tablespaces'] + if all_databases: + cmd.append('--all-databases') + else: + cmd.append(dbreader.database) + if fname.startswith('s3://'): + print("Dumping to ",fname) + with subprocess.Popen(['aws','s3','cp','-',fname], stdin=subprocess.PIPE) as p_s3: + subprocess.run(cmd, stdout=p_s3.stdin) + print("done") + return + with open(fname,'w') as outfile: Won't the return statement in line 378 prevent that? — Reply to this email directly, view it on GitHub <#688 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAFQOBYCVSS65SX4OZY3CJD2Y4Q4RAVCNFSM6AAAAAB2WDPA2GVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDONJZGAYDAOBSGY> . You are receiving this because you commented.Message ID: ***@***.***>

[simsong]

If you think that adding and else would be more clear, we can do that.

[codecov]

Codecov Report

Attention: Patch coverage is 72.00000% with 7 lines in your changes missing coverage. Please review.

Project coverage is 74.80%. Comparing base (29b3693) to head (7ae27a1).
Report is 64 commits behind head on main.

Files with missing lines	Patch %	Lines
deploy/app/dbmaint.py	56.25%	7 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #688      +/-   ##
==========================================
+ Coverage   70.37%   74.80%   +4.42%     
==========================================
  Files          36       37       +1     
  Lines        3885     4564     +679     
  Branches       64       68       +4     
==========================================
+ Hits         2734     3414     +680     
+ Misses       1126     1125       -1     
  Partials       25       25              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[sbarber2]

typo in latest comment: arts vs args; see comment

[simsong]

@sbarber2 ready for you.

[sbarber2]

OK, thanks. This all looks good.