Commit Graph

1882 Commits

Author SHA1 Message Date
a600769d69 Add test-input example (#1624) 2022-01-27 12:48:52 -08:00
d358938895 Working in retry to test endpoint during integration test. (#1565) 2022-01-27 11:00:22 -08:00
b49d140ff0 Add fuzzer_target_options to libfuzzer basic template (#1610) 2022-01-26 20:31:13 -08:00
6100191aaf Fixing VMSS Re-Image 7-Day Timer (#1616)
* Fixing VMSS Re-Image 7-Day Timer

* Updating use of TimeStamp to created_at

* Renaming.

* Updating field name.

* Removing test chagne.

* Updating query to work if init_at entry does not exist yet.

* Changing timer for testing.

* Adding field comment.

* Formatting models.py

* Fixing where save is called.

* Adidng logging.

* Removing logging. Ready for merge.

* Update src/pytypes/onefuzztypes/models.py

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* Formatting.

* Updating datetime.

* Testing after datetime change.

* Removing test.

Co-authored-by: nharper285 <nharper285@gmail.com>
Co-authored-by: Joe Ranweiler <joe@lemma.co>
2022-01-26 17:40:27 -08:00
f374801d35 Re-Image Functionality Now Includes 'Upgrade' Call (#1612)
* Re-Image Functionality Now Includes 'Upgrade' Call

* Fixing call.

* Fixing testing change.

* Shrinking timedelta even more.

* Update nodes.py

* Update scalesets.py

* Update nodes.py

* Update nodes.py

* Fixing merge.

* Revert "Fixing merge."

This reverts commit ab4d2a54c3.

* Adding comment and logging to new upgrade call.

* Removing old logging statement.

Co-authored-by: nharper285 <nharper285@gmail.com>
2022-01-26 10:42:03 -08:00
2ad37bdfb0 Remove in-agent tracking of child process perf stats (#1608) 2022-01-25 15:06:10 -08:00
464940d716 bumpt azure-mgmt-compute to 24.0.1 (#1599) 2022-01-22 08:25:06 -08:00
348398eb1e fix build break (#1594)
Co-authored-by: stas <statis@microsoft.com>
2022-01-21 02:35:09 +00:00
13e52308f2 Bump azure-identity to 1.7.1 (#1586) 2022-01-19 16:09:37 -08:00
6901cd15ff bump azure-functions to 1.8.0 (#1582) 2022-01-14 22:34:01 -08:00
f02f3f0ae2 Updating AAD Docs and UserAssignment Roel Description. (#1581)
* Updating doc and role description.

* Update src/deployment/deploy.py

Co-authored-by: Cheick Keita <kcheick@gmail.com>

* Update docs/AADEntitites.md

Co-authored-by: Cheick Keita <kcheick@gmail.com>

Co-authored-by: nharper285 <nharper285@gmail.com>
Co-authored-by: Cheick Keita <kcheick@gmail.com>
2022-01-14 10:02:14 -08:00
7c3beb4d6f Bump tokio from 1.14.0 to 1.15.0 in /src/proxy-manager (#1530)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.14.0 to 1.15.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.14.0...tokio-1.15.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2022-01-13 14:15:49 -08:00
5083dc6e03 bump azure-core to 1.21.1 (#1579) 2022-01-13 09:34:44 -08:00
9092276d96 bump jinja2 to 3.0.3 (#1577) 2022-01-12 18:30:25 -08:00
1731ca4dde Bump requests to 2.27.1 (#1567)
Co-authored-by: stas <statis@microsoft.com>
2022-01-12 07:29:34 -08:00
d28ad25e46 Integrate Cobertura format and output as file in coverage container (#1572)
* Integrate cobertura format and output as file in coverage container

* cobertura output file is txt, not json

* Format

* xml file not txt

* Improved syntax
2022-01-10 19:02:01 -08:00
e89e7b2166 Added function for converting coverage source format to Cobertura xml (#1533)
* function to convert source format to cobertura xml, column removed from source format and corresponding tests and uses, todo: fix cobertura test

* Fixed test for source to cobertura xml function

* Added SourceCoverage columns, associated tests and uses back in, ran rustfmt

* Improved result resolution in test, removed some commented out code

* Removed unrequired elements and attributes according to cobertura/reportgenerator schema

* Updated test, fixed missed error

* Improved XML to work best with ReportGenerator format

* Format change

* Order matter, don't format

* Undid order, included xml in toml
2022-01-07 15:36:08 -08:00
c3ab5089e8 Generate source-line coverage in task (#1535) 2022-01-07 14:58:37 -08:00
f505ece25f Fixing proxy tag issue. (#1568) 2022-01-07 13:10:10 -08:00
3058f10349 Upgrade to sha2 0.10.1 (#1566) 2022-01-06 13:02:57 -08:00
83e48e7e7b Adding new InstanceConfig value for VMSS & VM tags (#1560)
* Adding new instanceconfig value for tags.

* Removing bad import.

* Updating where tags are generated.

* Updating tag generation for scalesets.

* Updating tag generation in vm.

* Updating vm tag generation.

* Updating vm tag generation.

* Fixing extension.

* Fixing import.

* Fixing typing.

* Fixing get_vm calls.

* Fixing calls to get_vm.

* Fixing optional tag.
2022-01-05 13:16:03 -08:00
c5421894c1 bump azure-cli and azure-cli-core to 2.31.0 (#1557)
* bump azure-cli and azure-cli-core to 2.31.0

and all required dependencies

* Update src/cli/onefuzz/cred_wrapper.py

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* updating credential wrapper

* Update src/cli/onefuzz/azure_identity_credential_adapter.py

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* updating credential wrapper

* .

Co-authored-by: stas <statis@microsoft.com>
Co-authored-by: Joe Ranweiler <joe@lemma.co>
2022-01-05 07:11:24 -08:00
5515aa1819 Move call to check_access to call_if (#1472)
* Move call to check_access to call_if

* fix logic

* Update src/api-service/__app__/onefuzzlib/endpoint_authorization.py
2022-01-04 00:34:03 +00:00
bb98bf3c46 Bump tokio from 1.14.0 to 1.15.0 in /src/agent (#1528)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.14.0 to 1.15.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.14.0...tokio-1.15.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-03 15:37:14 -08:00
9b75356375 Bump serde_json from 1.0.72 to 1.0.73 in /src/proxy-manager (#1522)
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.72 to 1.0.73.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.72...v1.0.73)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-21 17:52:28 -08:00
91630f2a28 Adding AutoConfig Properties. (#1541)
Co-authored-by: nharper285 <nharper285@gmail.com>
2021-12-21 13:41:40 -08:00
27569a167f Bump serde_json from 1.0.72 to 1.0.73 in /src/agent (#1521)
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.72 to 1.0.73.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.72...v1.0.73)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-20 18:18:23 -08:00
9f60213591 Bump procfs from 0.11.1 to 0.12.0 in /src/agent (#1519)
Bumps [procfs](https://github.com/eminence/procfs) from 0.11.1 to 0.12.0.
- [Release notes](https://github.com/eminence/procfs/releases)
- [Commits](https://github.com/eminence/procfs/compare/v0.11.1...v0.12.0)

---
updated-dependencies:
- dependency-name: procfs
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-20 16:11:06 -08:00
4f285e09dc Bump async-trait from 0.1.51 to 0.1.52 in /src/agent (#1517)
Bumps [async-trait](https://github.com/dtolnay/async-trait) from 0.1.51 to 0.1.52.
- [Release notes](https://github.com/dtolnay/async-trait/releases)
- [Commits](https://github.com/dtolnay/async-trait/compare/0.1.51...0.1.52)

---
updated-dependencies:
- dependency-name: async-trait
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-20 14:41:01 -08:00
70c89ba7c6 Bump serde from 1.0.130 to 1.0.131 in /src/proxy-manager (#1514)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.130 to 1.0.131.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.130...v1.0.131)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-20 10:10:47 -08:00
f2b22c6d1c Avoid leaking unused file and cache data (#1539) 2021-12-18 10:24:23 -08:00
4ae962f6f0 Use symbol path when searching for PDBs for source coverage (#1538) 2021-12-17 15:53:07 -08:00
07094f7446 Fixing python call in check-pr. (#1540)
Co-authored-by: nharper285 <nharper285@gmail.com>
2021-12-17 14:44:24 -08:00
97f04c27af Don't cache debuginfo sessions (#1534) 2021-12-17 12:59:17 -08:00
1de2cc841d Check-pr creates and uses SP. (#1504)
* Check-pr creates and uses SP.

* flake8.

* flake8.

* Fixing var name.

* Fixing deploy.py

* Looking for client_secret

* Change to check_output.

* mypy fix.

* Fixing check-pr

* working version.

* lint

* Updating arg text.

* Removing redundant functionality.

* Changing register codepath and adding flag.

* Removing pycache file.

* Fixing unattended flag.

* Adding space.

* Fixing a few calls.

* Removing file.

* Removing python3.

* Removing old file.

* Adding wait into registration.py

* Formatting registration.py.

* Removing space.

* Adding retry logic to check-pr.

* Formatting.

* Retriggering.

* Retriggering.

* Calling sp_create and adding retry to authorize.

* Fixing syntax.

* Removing comments.

* Adding another retry.

* Retriggering.

* Retriggering.

* Retriggering.

* Trying to find error.

* Adding retry logic.

* Increasing sleep.

* Fixing formatting.

* Retriggering.

* Removing bad file.

* Trying out retry for logger.

* typevar issue?

* Re-adding.

* Retriggering.

* retriggering.

* Retriggering.

Co-authored-by: nharper285 <nharper285@gmail.com>
Co-authored-by: Cheick Keita <kcheick@gmail.com>
2021-12-17 09:44:04 -08:00
bb972c22f4 pin mypy to 0.910 (#1531)
https://github.com/samuelcolvin/pydantic/issues/3528

https://github.com/python/mypy/issues/6617#issuecomment-892438903
https://github.com/samuelcolvin/pydantic/pull/3175#issuecomment-914897604

updating mypy in build yml and requirements to 0.910

Co-authored-by: stas <statis@microsoft.com>
2021-12-16 14:13:54 -08:00
396f337589 Bump sysinfo from 0.21.1 to 0.21.2 in /src/agent (#1513)
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo) from 0.21.1 to 0.21.2.
- [Release notes](https://github.com/GuillaumeGomez/sysinfo/releases)
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GuillaumeGomez/sysinfo/commits)

---
updated-dependencies:
- dependency-name: sysinfo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-15 11:02:21 -08:00
acbb4f8f8e To downgrade futures crates to 0.3.17, revert "Combined dependabot changes from PR's: (#1492)" (#1525)
This reverts commit 9ee0e8d6c8.
2021-12-14 15:44:21 -08:00
03dba6f163 Implement collection of source line coverage (#1518)
Implement source line coverage recording for both Linux and Windows.
2021-12-14 08:33:41 -08:00
7cabc6b924 Remove generic reset command (#1511)
* Remove generic reset command

Remove ability to reset containers by type.
Work item #1508

* Test to see if we are getting timeouts when attempting to get a queue message.

* Remove exception handling for timeout.
2021-12-13 17:21:39 -08:00
94e29047d7 Fixing agent code. (#1516)
* Fixing agent code.

* Update src/agent/stacktrace-parser/src/lib.rs

Co-authored-by: Cheick Keita <kcheick@gmail.com>

* Update src/agent/stacktrace-parser/src/lib.rs

Co-authored-by: Cheick Keita <kcheick@gmail.com>

* Formatting lib.rs

* Adding additional fix.

* Correct regex fix.

* Fixing var names.

* working to remove more clippy issues.

* Removing clippy and adding allows.

* Fixing tag for dead code

* Trying to figure out issue.

* Fixing jobs.rs.

* Adding tag.

* Running into syntax errors.

* Adding newline.

* Trying to add tag correctly.

* Another windows clippy fix.

* Adding allow tag to struct that appears used.

Co-authored-by: nharper285 <nharper285@gmail.com>
Co-authored-by: Cheick Keita <kcheick@gmail.com>
2021-12-10 14:32:44 -08:00
3ffd7c4ca2 Bump sha2 from 0.9.8 to 0.10.0 in /src/agent (#1510)
Bumps [sha2](https://github.com/RustCrypto/hashes) from 0.9.8 to 0.10.0.
- [Release notes](https://github.com/RustCrypto/hashes/releases)
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.8...sha2-v0.10.0)

---
updated-dependencies:
- dependency-name: sha2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-08 12:28:15 -08:00
03cd7cb134 Bump cpp_demangle from 0.3.4 to 0.3.5 in /src/agent (#1507)
Bumps [cpp_demangle](https://github.com/gimli-rs/cpp_demangle) from 0.3.4 to 0.3.5.
- [Release notes](https://github.com/gimli-rs/cpp_demangle/releases)
- [Changelog](https://github.com/gimli-rs/cpp_demangle/blob/master/CHANGELOG.md)
- [Commits](https://github.com/gimli-rs/cpp_demangle/compare/0.3.4...0.3.5)

---
updated-dependencies:
- dependency-name: cpp_demangle
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-06 21:55:53 -08:00
67669678af Bump reqwest from 0.11.6 to 0.11.7 in /src/proxy-manager (#1502)
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.6 to 0.11.7.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.6...v0.11.7)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-06 15:02:27 -08:00
de2cd313e2 Bump reqwest from 0.11.6 to 0.11.7 in /src/agent (#1501)
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.6 to 0.11.7.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.6...v0.11.7)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-06 11:14:58 -08:00
66902c74f8 Bump clap from 2.33.3 to 2.34.0 in /src/proxy-manager (#1496)
Bumps [clap](https://github.com/clap-rs/clap) from 2.33.3 to 2.34.0.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/commits)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-03 15:52:09 -08:00
8cdfeb8b93 Bump clap from 2.33.3 to 2.34.0 in /src/agent (#1495)
Bumps [clap](https://github.com/clap-rs/clap) from 2.33.3 to 2.34.0.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/commits)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-03 13:31:48 -08:00
08691c007f Integration tests reliability fixes (#1505)
* only reimage nodes that are in the done state

* ignore done message when the node is deleted

* log warning instead of error when receiving a heartbeat from a deleted node
2021-12-03 10:08:30 -08:00
d8fd5d5ce5 Bump anyhow from 1.0.44 to 1.0.51 in /src/proxy-manager (#1489)
Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.44 to 1.0.51.
- [Release notes](https://github.com/dtolnay/anyhow/releases)
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.44...1.0.51)

---
updated-dependencies:
- dependency-name: anyhow
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org>
2021-12-02 17:55:43 -08:00
e4e4671038 Require explicit call to async Expand::machine_id() (#1468)
* Add line to each new Expand created in tasks to get machine_id async at that time

* Modified machine_id function to be async in order to not have nested tokio runtimes, modified test accordingly

* Ran rustfmt

* Update src/agent/onefuzz/src/expand.rs

Add comment to indicate proper use of machine_id function

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* Update src/agent/onefuzz/src/expand.rs

Add comment to indicate proper use of machine_id function

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* Added additional calls to new async machine_id and converted functions to be async as needed

* Format

Co-authored-by: Hayley Call <hacall@microsoft.com>
Co-authored-by: Joe Ranweiler <joe@lemma.co>
2021-12-02 13:42:47 -08:00