Skip to content

trer #4835

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 15 commits into
base: main
Choose a base branch
from
Open

trer #4835

Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
61 changes: 61 additions & 0 deletions .github/workflows/codacy.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
# This workflow uses actions that are not certified by GitHub.
# They are provided by a third-party and are governed by
# separate terms of service, privacy policy, and support
# documentation.

# This workflow checks out code, performs a Codacy security scan
# and integrates the results with the
# GitHub Advanced Security code scanning feature. For more information on
# the Codacy security scan action usage and parameters, see
# https://github.com/codacy/codacy-analysis-cli-action.
# For more information on Codacy Analysis CLI in general, see
# https://github.com/codacy/codacy-analysis-cli.

name: Codacy Security Scan

on:
push:
branches: [ "main" ]
pull_request:
# The branches below must be a subset of the branches above
branches: [ "main" ]
schedule:
- cron: '31 14 * * 1'

permissions:
contents: read

jobs:
codacy-security-scan:
permissions:
contents: read # for actions/checkout to fetch code
security-events: write # for github/codeql-action/upload-sarif to upload SARIF results
actions: read # only required for a private repository by github/codeql-action/upload-sarif to get the Action run status
name: Codacy Security Scan
runs-on: ubuntu-latest
steps:
# Checkout the repository to the GitHub Actions runner
- name: Checkout code
uses: actions/checkout@v4

# Execute Codacy Analysis CLI and generate a SARIF output with the security issues identified during the analysis
- name: Run Codacy Analysis CLI
uses: codacy/codacy-analysis-cli-action@d840f886c4bd4edc059706d09c6a1586111c540b
with:
# Check https://github.com/codacy/codacy-analysis-cli#project-token to get your project token from your Codacy repository
# You can also omit the token and run the tools that support default configurations
project-token: ${{ secrets.CODACY_PROJECT_TOKEN }}
verbose: true
output: results.sarif
format: sarif
# Adjust severity of non-security issues
gh-code-scanning-compat: true
# Force 0 exit code to allow SARIF file generation
# This will handover control about PR rejection to the GitHub side
max-allowed-issues: 2147483647

# Upload the SARIF file generated in the previous step
- name: Upload SARIF results file
uses: github/codeql-action/upload-sarif@v3
with:
sarif_file: results.sarif
18 changes: 18 additions & 0 deletions .github/workflows/docker-image.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
name: Docker Image CI

on:
push:
branches: [ "main" ]
pull_request:
branches: [ "main" ]

jobs:

build:

runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v4
- name: Build the Docker image
run: docker build . --file Dockerfile --tag my-image-name:$(date +%s)
51 changes: 51 additions & 0 deletions .github/workflows/jekyll-gh-pages.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
# Sample workflow for building and deploying a Jekyll site to GitHub Pages
name: Deploy Jekyll with GitHub Pages dependencies preinstalled

on:
# Runs on pushes targeting the default branch
push:
branches: ["main"]

# Allows you to run this workflow manually from the Actions tab
workflow_dispatch:

# Sets permissions of the GITHUB_TOKEN to allow deployment to GitHub Pages
permissions:
contents: read
pages: write
id-token: write

# Allow only one concurrent deployment, skipping runs queued between the run in-progress and latest queued.
# However, do NOT cancel in-progress runs as we want to allow these production deployments to complete.
concurrency:
group: "pages"
cancel-in-progress: false

jobs:
# Build job
build:
runs-on: ubuntu-latest
steps:
- name: Checkout
uses: actions/checkout@v4
- name: Setup Pages
uses: actions/configure-pages@v5
- name: Build with Jekyll
uses: actions/jekyll-build-pages@v1
with:
source: ./
destination: ./_site
- name: Upload artifact
uses: actions/upload-pages-artifact@v3

# Deployment job
deploy:
environment:
name: github-pages
url: ${{ steps.deployment.outputs.page_url }}
runs-on: ubuntu-latest
needs: build
steps:
- name: Deploy to GitHub Pages
id: deployment
uses: actions/deploy-pages@v4
34 changes: 34 additions & 0 deletions .github/workflows/python-package-conda.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
name: Python Package using Conda

on: [push]

jobs:
build-linux:
runs-on: ubuntu-latest
strategy:
max-parallel: 5

steps:
- uses: actions/checkout@v4
- name: Set up Python 3.10
uses: actions/setup-python@v3
with:
python-version: '3.10'
- name: Add conda to system path
run: |
# $CONDA is an environment variable pointing to the root of the miniconda directory
echo $CONDA/bin >> $GITHUB_PATH
- name: Install dependencies
run: |
conda env update --file environment.yml --name base
- name: Lint with flake8
run: |
conda install flake8
# stop the build if there are Python syntax errors or undefined names
flake8 . --count --select=E9,F63,F7,F82 --show-source --statistics
# exit-zero treats all errors as warnings. The GitHub editor is 127 chars wide
flake8 . --count --exit-zero --max-complexity=10 --max-line-length=127 --statistics
- name: Test with pytest
run: |
conda install pytest
pytest
21 changes: 21 additions & 0 deletions SECURITY.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
# Security Policy

## Supported Versions

Use this section to tell people about which versions of your project are
currently being supported with security updates.

| Version | Supported |
| ------- | ------------------ |
| 5.1.x | :white_check_mark: |
| 5.0.x | :x: |
| 4.0.x | :white_check_mark: |
| < 4.0 | :x: |

## Reporting a Vulnerability

Use this section to tell people how to report a vulnerability.

Tell them where to go, how often they can expect to get an update on a
reported vulnerability, what to expect if the vulnerability is accepted or
declined, etc.
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,6 @@ sagemaker
sagemaker-experiments
scipy
torchnet
transformers==4.38.0
transformers==4.48.0
smdebug
humanize
2 changes: 1 addition & 1 deletion aws_sagemaker_studio/streamlit_demo/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,5 @@ boto3==1.26.73
pandas==1.5.3
Pillow==9.4.0
streamlit==1.20.0
torch==1.13.1
torch==2.4.0
torchvision==0.14.1
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
sagemaker==1.72.0
sagemaker==2.237.3
awscli
watchtower==1.0.0
Original file line number Diff line number Diff line change
@@ -1,2 +1,66 @@
sagemaker==1.72.0
awscli>=1.18.140
annotated-types==0.7.0
antlr4-python3-runtime==4.9.3
anyio==4.9.0
attrs==23.2.0
awscli==1.38.18
boto3==1.37.18
botocore==1.37.18
certifi==2025.1.31
charset-normalizer==3.4.1
click==8.1.8
cloudpickle==3.1.1
colorama==0.4.6
dill==0.3.9
docker==7.1.0
docutils==0.16
exceptiongroup==1.2.2
fastapi==0.115.11
google-pasta==0.2.0
h11==0.14.0
idna==3.10
importlib-metadata==6.11.0
jmespath==1.0.1
jsonschema==4.23.0
jsonschema-specifications==2024.10.1
markdown-it-py==3.0.0
mdurl==0.1.2
mock==4.0.3
multiprocess==0.70.17
numpy==1.26.4
omegaconf==2.2.3
packaging==24.2
pandas==2.2.3
pathos==0.3.3
platformdirs==4.3.7
pox==0.3.5
ppft==1.7.6.9
protobuf==5.29.4
psutil==7.0.0
pyasn1==0.6.1
pydantic==2.10.6
pydantic-core==2.27.2
pygments==2.19.1
python-dateutil==2.9.0.post0
pytz==2025.1
pyyaml==6.0.2
referencing==0.36.2
requests==2.32.3
rich==13.9.4
rpds-py==0.23.1
rsa==4.7.2
s3transfer==0.11.4
sagemaker==2.237.3
sagemaker-core==1.0.25
schema==0.7.7
six==1.17.0
smdebug-rulesconfig==1.0.1
sniffio==1.3.1
starlette==0.46.1
tblib==3.0.0
tqdm==4.67.1
typing-extensions==4.12.2
tzdata==2025.1
urllib3==1.26.20
uvicorn==0.34.0
watchtower==1.0.0
zipp==3.21.0
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
boto3
transformers
pytorch_lightning==1.0.2
pytorch_lightning==2.4.0
sentencepiece
Original file line number Diff line number Diff line change
@@ -1,5 +1,56 @@
boto3
transformers
pytorch_lightning==1.0.2
sentencepiece
protobuf==3.20.0
aiohappyeyeballs==2.6.1
aiohttp==3.11.14
aiosignal==1.3.2
async-timeout==5.0.1
attrs==25.3.0
boto3==1.37.18
botocore==1.37.18
certifi==2025.1.31
charset-normalizer==3.4.1
filelock==3.18.0
frozenlist==1.5.0
fsspec[http]==2025.3.0
huggingface-hub==0.29.3
idna==3.10
jinja2==3.1.6
jmespath==1.0.1
lightning-utilities==0.14.2
markupsafe==3.0.2
mpmath==1.3.0
multidict==6.2.0
networkx==3.2.1
numpy==2.0.2
nvidia-cublas-cu12==12.4.5.8
nvidia-cuda-cupti-cu12==12.4.127
nvidia-cuda-nvrtc-cu12==12.4.127
nvidia-cuda-runtime-cu12==12.4.127
nvidia-cudnn-cu12==9.1.0.70
nvidia-cufft-cu12==11.2.1.3
nvidia-curand-cu12==10.3.5.147
nvidia-cusolver-cu12==11.6.1.9
nvidia-cusparse-cu12==12.3.1.170
nvidia-cusparselt-cu12==0.6.2
nvidia-nccl-cu12==2.21.5
nvidia-nvjitlink-cu12==12.4.127
nvidia-nvtx-cu12==12.4.127
packaging==24.2
propcache==0.3.0
python-dateutil==2.9.0.post0
pytorch-lightning==2.4.0
pyyaml==6.0.2
regex==2024.11.6
requests==2.32.3
s3transfer==0.11.4
safetensors==0.5.3
sentencepiece==0.2.0
six==1.17.0
sympy==1.13.1
tokenizers==0.21.1
torch==2.6.0
torchmetrics==1.7.0
tqdm==4.67.1
transformers==4.50.0
triton==3.2.0
typing-extensions==4.12.2
urllib3==1.26.20
yarl==1.18.3
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
transformers==4.36.2
transformers==4.48.0
peft==0.4.0
accelerate==0.21.0
bitsandbytes==0.40.2
Expand Down
Original file line number Diff line number Diff line change
@@ -1 +1 @@
transformers==4.6.0
transformers==4.48.0
2 changes: 1 addition & 1 deletion sagemaker-script-mode/pytorch_bert/code/requirements.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
transformers==3.3.1
transformers==4.48.0
Original file line number Diff line number Diff line change
@@ -1 +1 @@
transformers==4.38.0
transformers==4.48.0
Original file line number Diff line number Diff line change
Expand Up @@ -4,4 +4,4 @@ transformers
accelerate
sagemaker
botocore
pytorch-lightning==1.9.4
pytorch-lightning==2.4.0