This repository has been archived by the owner on Aug 23, 2020. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 370
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
109 changed files
with
7,117 additions
and
2,350 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,23 @@ | ||
| <h2>Responsible disclosure policy</h2> | ||
|
|
||
| At the IOTA Foundation, we consider the security of our systems a top priority. But no matter how much effort we put into system security, there can still be vulnerabilities present. If you've discovered a vulnerability, please follow the guidelines below to report it to our security team: | ||
| <ul> | ||
| <li>E-mail your findings to [email protected]. If the report contains highly sensitive information, please consider encrypting your findings using our [email protected] (466385BD0B40D9550F93C04746A440CCE5664A64) PGP key.</li> | ||
| </ul> | ||
| Please follow these rules when testing/reporting vulnerabilities: | ||
| <ul> | ||
| <li>Do not take advantage of the vulnerability you have discovered, for example by downloading more data than is necessary to demonstrate the vulnerability.</li> | ||
| <li>Do not read, modify or delete data that isn't you own.</li> | ||
| <li>We ask that you do not to disclosure the problem to third parties until it has been resolved.</li> | ||
| <li>The scope of the program is limited to technical vulnerabilities in IOTA Foundations's web applications and open source software packages distributed through GitHub, please do not try to test physical security or attempt phishing attacks against our employees, and so on.</li> | ||
| <li>Out of concern for the availability of our services to all users, please do not attempt to carry out DoS attacks, leverage black hat SEO techniques, spam people, and do other similarly questionable things. We also discourage the use of any vulnerability testing tools that automatically generate significant volumes of traffic.</li> | ||
| </ul> | ||
| What we promise: | ||
| <ul> | ||
| <li>We will respond to your report within 3 business days with our evaluation of the report and an expected resolution date.</li> | ||
| <li>If you have followed the instructions above, we will not take any legal action against you in regard to the report.</li> | ||
| <li>We will keep you informed during all stages of resolving the problem.</li> | ||
| <li>To show our appreciation for your effort and cooperation during the report, we will list your name and a link to a personal website/social network profile on the page below so that the public can know you've helped keep the IOTA Foundation secure.</li> | ||
| </ul> | ||
| We sincerely appreciate the efforts of security researchers in keeping our community safe. | ||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,2 @@ | ||
| # LocalSnapshots.ixi | ||
| A tool for fetching data from a running node's local snapshots. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,58 @@ | ||
| var System = java.lang.System; | ||
|
|
||
| var snapshotState = com.iota.iri.service.snapshot.snapshotState; | ||
| var snapshotMeta = com.iota.iri.service.snapshot.snapshotMetaData; | ||
|
|
||
| var snapshotProvider = IOTA.snapshotProvider; | ||
|
|
||
| var iri = com.iota.iri; | ||
| var Callable = iri.service.CallableRequest; | ||
| var Response = iri.service.dto.IXIResponse; | ||
| var ErrorResponse = iri.service.dto.ErrorResponse; | ||
|
|
||
|
|
||
| function getInitialSnapshotClone(){ | ||
| return snapshotProvider.getInitialSnapshot().clone(); | ||
| } | ||
|
|
||
| function getLatestSnapshotClone(){ | ||
| return snapshotProvider.getLatestSnapshot().clone(); | ||
| } | ||
|
|
||
|
|
||
| function getSnapshotState(){ | ||
| var ledgerState = getInitialSnapshotClone(); | ||
|
|
||
| return Response.create({ | ||
| index: ledgerState.getIndex(), | ||
| state: ledgerState.getBalances() | ||
| }); | ||
|
|
||
| } | ||
|
|
||
| function getSnapshotMetaData(){ | ||
| var ledgerState = getInitialSnapshotClone(); | ||
|
|
||
| return Response.create({ | ||
| index: ledgerState.getIndex(), | ||
| metaData: ledgerState.getSeenMilestones() | ||
| }); | ||
| } | ||
|
|
||
|
|
||
| function getSnapshotIndexes(){ | ||
| //console.log("Fetching balances"); | ||
| var ledgerState = getLatestSnapshotClone(); | ||
|
|
||
| return Response.create({ | ||
| initialIndex: ledgerState.getInitialIndex(), | ||
| currentIndex: ledgerState.getIndex(), | ||
| }); | ||
| } | ||
|
|
||
|
|
||
|
|
||
|
|
||
| API.put("getIndexes", new Callable({ call: getSnapshotIndexes })) | ||
| API.put("getState", new Callable({ call: getSnapshotState })) | ||
| API.put("getMetaData", new Callable({ call: getSnapshotMetaData })) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,3 @@ | ||
| { | ||
| "main": "index.js" | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -8,6 +8,7 @@ | |
| install_requires=[ | ||
| 'pyota', | ||
| 'aloe', | ||
| 'pyyaml' | ||
| ] | ||
| ) | ||
| 'pyyaml', | ||
| ] | ||
| ) | ||
|
|
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
79 changes: 79 additions & 0 deletions
79
python-regression/tests/features/machine6/6_local_snapshots_tests.feature
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,79 @@ | ||
| Feature: Test Bootstrapping With LS | ||
| A test to determine whether or not nodes can bootstrap and sync correctly from Local Snapshot Files and DB's. One | ||
| permanode will be started containing all the relevant files/folders for a full sync upon start. Two more nodes will | ||
| be started, connected to this node and one another: One will have only a DB and snapshot file, while the other will | ||
| have only the snapshot meta and state file, along with the spent addresses DB and the snapshot file. All three nodes | ||
| should sync with one another. And a snapshot should be taken on the node started with just a DB. | ||
| [NodeA: Permanode, NodeB: Just DB, NodeC: Just LS Files] | ||
|
|
||
| Scenario: PermaNode is synced | ||
| Check that the permanode has been started correctly and is synced. | ||
|
|
||
| #First make sure nodes are neighbored | ||
| Given "nodeA" and "nodeB" are neighbors | ||
| And "nodeA" and "nodeC" are neighbors | ||
|
|
||
| When we wait "30" second/seconds | ||
| Then "nodeA" is synced up to milestone 10321 | ||
|
|
||
|
|
||
| Scenario: DB node is synced, and files contain expected values | ||
| Check that the node started with just a DB is synced correctly, and that the proper addresses and hashes have been | ||
| stored correctly. | ||
|
|
||
| #First make sure nodes are neighbored | ||
| Given "nodeB" and "nodeA" are neighbors | ||
| And "nodeB" and "nodeC" are neighbors | ||
|
|
||
| #Give the node time to finish syncing properly, then make sure that the node is synced to the latest milestone. | ||
| And we wait "30" second/seconds | ||
| Then "nodeB" is synced up to milestone 10321 | ||
| And A local snapshot was taken on "nodeB" at index 10220 | ||
|
|
||
| When reading the local snapshot state on "nodeB" returns with: | ||
| |keys |values |type | | ||
| |address |LS_TEST_STATE_ADDRESSES |staticValue | | ||
|
|
||
| And reading the local snapshot metadata on "nodeB" returns with: | ||
| |keys |values |type | | ||
| |hashes |LS_TEST_MILESTONE_HASHES |staticValue | | ||
|
|
||
|
|
||
| Scenario: LS File node is synced | ||
| Check that the node started with just LS Files is synced correctly. | ||
|
|
||
| #First make sure nodes are neighbored | ||
| Given "nodeC" and "nodeA" are neighbors | ||
| And "nodeC" and "nodeB" are neighbors | ||
|
|
||
| #Give the node time to finish syncing properly, then make sure that the node is synced to the latest milestone. | ||
| When we wait "30" second/seconds | ||
| Then "nodeC" is synced up to milestone 10321 | ||
|
|
||
|
|
||
| Scenario: Check DB for milestone hashes | ||
| Give the db-less node some time to receive the latest milestones from the permanode, then check if the milestones | ||
| are present in the new node. | ||
|
|
||
| #First make sure nodes are neighbored | ||
| Given "nodeC" and "nodeA" are neighbors | ||
| And we wait "60" second/seconds | ||
|
|
||
| When "checkConsistency" is called on "nodeC" with: | ||
| |keys |values |type | | ||
| |tails |LS_TEST_MILESTONE_HASHES |staticValue | | ||
|
|
||
| Then the response for "checkConsistency" should return with: | ||
| |keys |values |type | | ||
| |state |True |bool | | ||
|
|
||
|
|
||
| Scenario: Old transactions are pruned | ||
| Takes a node with a large db and transaction pruning enabled, and checks to make sure that the transactions below | ||
| the pruning depth are no longer present. | ||
|
|
||
| Given "checkConsistency" is called on "nodeD" with: | ||
| |keys |values |type | | ||
| |tails |LS_PRUNED_TRANSACTIONS |staticValue | | ||
|
|
||
| Then the response for "checkConsistency" should return null |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,60 @@ | ||
| default_args: &args | ||
| ['--testnet-coordinator', | ||
| 'EFPNKGPCBXXXLIBYFGIGYBYTFFPIOQVNNVVWTTIYZO9NFREQGVGDQQHUUQ9CLWAEMXVDFSSMOTGAHVIBH', | ||
| '--mwm', | ||
| '1', | ||
| '--milestone-start', | ||
| '0', | ||
| '--testnet-no-coo-validation', | ||
| 'true', | ||
| '--testnet', | ||
| 'true', | ||
| '--snapshot', | ||
| './snapshot.txt', | ||
| '--local-snapshots-pruning-enabled', | ||
| 'true', | ||
| '--local-snapshots-pruning-delay', | ||
| '10000' | ||
| ] | ||
|
|
||
| default_ixi: &ixi | ||
| ['IXI/LocalSnapshots.ixi'] | ||
|
|
||
| java_options: -agentlib:jdwp=transport=dt_socket,server=y,address=8000,suspend=n -javaagent:/opt/jacoco/lib/jacocoagent.jar=destfile=/iri/jacoco.exec,output=file,append=true,dumponexit=true | ||
|
|
||
| defaults: &db_full | ||
| db: https://s3.eu-central-1.amazonaws.com/iotaledger-dbfiles/dev/LS_Test_All_Files.tar | ||
| db_checksum: 4628789811b4ccbcc3cd898debff0e1b256a1cfdd636c7b5e1beb43fed461091 | ||
| iri_args: *args | ||
| ixis: *ixi | ||
|
|
||
| db_with_snapshot: &db_with_snapshot | ||
| db: https://s3.eu-central-1.amazonaws.com/iotaledger-dbfiles/dev/LS_Test_DB_and_Snapshot.tar | ||
| db_checksum: eabb81b0570a20e8d1c65c3d29e4b4e723de537ebca0eada536e3155d5a96972 | ||
| iri_args: *args | ||
| ixis: *ixi | ||
|
|
||
| db_with_ls_files: &db_with_LS_files | ||
| db: https://s3.eu-central-1.amazonaws.com/iotaledger-dbfiles/dev/LS_Test_LS_Files_and_Snapshot.tar | ||
| db_checksum: 87fdc9c37a6b98ec8623a5b07c49737681b7b7ac36252ab2e18cc75999f766b6 | ||
| iri_args: *args | ||
| ixis: *ixi | ||
|
|
||
| db_for_pruning: &db_for_pruning | ||
| db: https://s3.eu-central-1.amazonaws.com/iotaledger-dbfiles/dev/PruningTestDB.tar | ||
| db_checksum: 15122ba80c0a03dc5b6b4186e5d880d0a1a15b5a6de48bafe4002c4c9b682221 | ||
| iri_args: *args | ||
|
|
||
|
|
||
| nodes: | ||
| nodeA: #name | ||
| <<: *db_full | ||
|
|
||
| nodeB: | ||
| <<: *db_with_snapshot | ||
|
|
||
| nodeC: | ||
| <<: *db_with_LS_files | ||
|
|
||
| nodeD: | ||
| <<: *db_for_pruning |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.