-
Notifications
You must be signed in to change notification settings - Fork 6
Transformer Refresh #129
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: dev
Are you sure you want to change the base?
Transformer Refresh #129
Conversation
This adds the same constant amount to the estimate for the stitched IP verification simulation which was already present for the RTL simulation performance measurement, but also adds the option to overwrite this via the LIVENESS_THRESHOLD in both cases.
See iksnagreb/onnx-passes@16f869c for details on the new data layout annotation and conversion
Note: This is a minimally invasive adaptation to make the attention operator handle the batch/head dimension which is not squeezed out of the model anymore. A proper refactoring should be done later. Includes a bugfix to the code generation for thresholds embedded into the attention operator: Apprently comp::less is correct after all...
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
Total missing docstrings: 34 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
Total missing docstrings: 34 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
Total missing docstrings: 34 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
This makes it more convenient to reuse the same dataflow build config for different models, which usually require different verification data.
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
📄 src/finn/interface/run_finn.py:
Total missing docstrings: 50 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
📄 src/finn/interface/run_finn.py:
Total missing docstrings: 50 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
Note: This is not included by default, as inserting DWCs is already part of the default step_set_fifo_depth.
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
📄 src/finn/interface/run_finn.py:
Total missing docstrings: 50 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
Note: This is merely a workaround, a proper fix to address changing types after reordering should follow.
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
📄 src/finn/interface/run_finn.py:
📄 src/finn/transformation/streamline/reorder.py:
Total missing docstrings: 129 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
📄 src/finn/interface/run_finn.py:
📄 src/finn/transformation/fpgadataflow/attention_heads.py:
📄 src/finn/transformation/streamline/reorder.py:
Total missing docstrings: 139 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
📄 src/finn/interface/run_finn.py:
📄 src/finn/transformation/fpgadataflow/attention_heads.py:
📄 src/finn/transformation/streamline/reorder.py:
Total missing docstrings: 139 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
📄 src/finn/interface/run_finn.py:
📄 src/finn/transformation/fpgadataflow/attention_heads.py:
📄 src/finn/transformation/streamline/reorder.py:
Total missing docstrings: 139 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
|
📋 Docstring Check Report Checked files:
❌ Docstring check failed! Missing Docstrings Details:📄 src/finn/custom_op/fpgadataflow/attention.py:
📄 src/finn/interface/run_finn.py:
📄 src/finn/transformation/fpgadataflow/attention_heads.py:
📄 src/finn/transformation/streamline/reorder.py:
Total missing docstrings: 139 How to Fix:Please add docstrings to the missing functions, classes, and modules listed above. Docstring Guidelines:
Raw output from docstring checker |
Not sure if this should actually be merged...
TODO: ...