George Pollard
18e99cdd2f
Use --locked when installing Rust pre-reqs ( #3139 )
2023-05-29 11:05:09 +12:00
dependabot[bot]
a390822124
Bump path-absolutize from 3.0.11 to 3.1.0 in /src/agent ( #3088 )
...
Bumps [path-absolutize](https://github.com/magiclen/path-absolutize ) from 3.0.11 to 3.1.0.
- [Commits](https://github.com/magiclen/path-absolutize/compare/v3.0.11...v3.1.0 )
---
updated-dependencies:
- dependency-name: path-absolutize
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-25 23:47:08 +00:00
dependabot[bot]
223a90c593
Bump clap from 4.2.4 to 4.3.0 in /src/agent ( #3118 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.2.4 to 4.3.0.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.2.4...clap_complete-v4.3.0 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-25 23:25:15 +00:00
George Pollard
be56814e43
Bump azure_* crates to 0.12 ( #3132 )
2023-05-25 09:30:16 -04:00
Cheick Keita
dc0e7f76b3
fix logic to set check_fuzzer_help ( #3130 )
2023-05-24 09:22:27 -07:00
Cheick Keita
213fc2471f
fix comment explaining why a validator is needed on the templates ( #3125 )
2023-05-24 15:47:47 +00:00
George Pollard
66b990bb7e
Bring ErrorCode enums into sync ( #3129 )
...
ErrorCode enums on Python & C# side had gotten out of sync. This can cause the CLI to fail to parse responses.
2023-05-24 08:41:41 -04:00
George Pollard
5048e6d50c
Allow use of readonly_inputs
for qemu_user
template ( #3116 )
...
* Allow use of readonly_inputs for qemu_user template
* formatting fix
2023-05-19 12:33:49 +12:00
George Pollard
dc66164cda
Increase lock wait timeout for qemu_user setup ( #3114 )
2023-05-17 20:55:47 +00:00
George Pollard
2f478d6c0b
Expand valid scaleset names ( #3045 )
...
Scaleset names are now permitted to be any (valid) strings, instead of only GUIDs. When we generate a scaleset name it is now based upon the pool name; for example the pool `pool` might get a scaleset named `pool-3b24ba211cad4b078655914754485838`.
This should be backwards-compatible since GUIDs are [already serialized to table storage as strings](dddcfa4949/src/ApiService/ApiService/onefuzzlib/orm/EntityConverter.cs (L190-L191)
), so this simply loosens the restrictions placed upon them.
Scaleset IDs now have a strong type in the same way as other IDs; this helps to avoid mixing them up with other strings. Because of this I found one bug in the scaleset search query logic due to Pool ID/VMSS ID confusion. As part of fixing this I've changed the scaleset search query to only return nodes from the table rather than querying Azure to find a list; this seems to be sufficient for the CLI.
2023-05-17 09:58:58 +12:00
Noah McGregor Harper
d84b72b5fd
Initial Custom Metrics - Node & Task Heartbeat ( #3082 )
...
* Refactor logging to use and new function queue
* Testing setup of custom metric.
* Changing host.json
* Updating log interface.
* changes.
* Fix encoding.
* Updating.
* Updating tests.
* Adding metrics to program
* Pushing latest changes.
* Update interface references.
* Removing string type.
* Add string back.
* Getting additional data for task heartbeat.
* Removing additional fields.
* Removing containers.
* Cleaning up.
* Adding feature flag.
* Adding bicep changes.
* Fixing tests.
* Fixing test metrics.
* Removing most of tests.
* Telemetry Refact Round 2.
* Updated metrics.
* Remove custom metric function.
* Syncing events.cs
* Making optional.
* Using events as metric dimensions.
* Fixing ORM tests.
* Remove metric records.
* Removing bad test.
* Remove testmetrics.'
* Adding test back.
* Improving custom dimensions serialization.
* Update src/ApiService/ApiService/onefuzzlib/Metrics.cs
Co-authored-by: Cheick Keita <kcheick@gmail.com>
* Reverting change.
---------
Co-authored-by: Cheick Keita <kcheick@gmail.com>
2023-05-16 13:17:28 -07:00
Cheick Keita
64782d7e9b
fix tests ( #3107 )
2023-05-16 12:37:48 -07:00
Cheick Keita
f6473c6b3e
Refactoring log upload ( #3087 )
...
This is refactoring of our log uploading process.
- The process that upload the logs lives with the agent instead of the task
- The task now logs to a file and to the console.
- The task log file is synchronized to the log container periodically
2023-05-16 18:56:42 +00:00
Teo Voinea
760e7d6c7f
Fix bug when truncating certain reports ( #3103 )
...
* Fix bug when truncating certain reports
* Update src/ApiService/ApiService/onefuzzlib/Utils.cs
Co-authored-by: George Pollard <porges@porg.es>
* PR suggestion
---------
Co-authored-by: George Pollard <porges@porg.es>
2023-05-16 13:18:05 +00:00
George Pollard
f4ab22d570
Checkout compiler-rt sparsely ( #3101 )
2023-05-15 10:52:01 -07:00
Cheick Keita
447b4c65f4
Add more context to the deletion of nodes ( #3102 )
...
* Add more context to the deletion of nodes
* Update src/ApiService/ApiService/onefuzzlib/ScalesetOperations.cs
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
* adding NODE_DELETED error code
---------
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
2023-05-12 19:20:59 +00:00
George Pollard
13b727201a
Add an event for Repro VM creation ( #3091 )
2023-05-10 22:28:22 +00:00
Cheick Keita
93b582f92e
Match the agent version to the server ( #3093 )
...
* match the agent version to the server
* fix node state
2023-05-10 20:01:49 +00:00
Teo Voinea
69171af55d
Deserialize user info when pulling from blob ( #3089 )
2023-05-08 15:12:54 +00:00
Marc Greisen
4044e5cc1a
Fix typo in parameter name and set default value to true. ( #3085 )
2023-05-04 13:30:07 -07:00
Cheick Keita
bb1a54470a
Fix logic of marking task as failed ( #3083 )
...
* Fix logic of markaing task as failed
- Do not mark task as failed if it is already in the shutting down state
- accumulate errors when setting task error to understand the context
- refactor the Error record
* fix tests
* format
* Fix build
* Update src/ApiService/ApiService/onefuzzlib/ImageReference.cs
Co-authored-by: George Pollard <porges@porg.es>
* Update src/ApiService/ApiService/onefuzzlib/ProxyOperations.cs
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
---------
Co-authored-by: George Pollard <porges@porg.es>
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
2023-05-04 19:50:46 +00:00
Cheick Keita
d237563988
Collect additional report field in an ExtensionData property ( #3079 )
...
* Collect additional report field in an ExtensionData property
* typo fix
2023-05-04 12:14:23 -07:00
Teo Voinea
f3ec0e5741
Add another truncation case ( #3075 )
...
* Add another truncation case
* fmt
2023-05-02 11:27:13 -07:00
Teo Voinea
16ebd2ddfe
Include exception information ( #3077 )
2023-05-02 08:49:04 -04:00
George Pollard
6397803eb2
Allow libfuzzer verification to retry ( #3032 )
...
Closes #2862 by brute force.
We’ve seen cases where it takes some time for an executable with a KnownDlls override to actually work after the node is restarted; thus, we now allow verification to take some time (currently up to a minute) to validate that a libfuzzer-based fuzzer actually works.
2023-04-28 01:14:27 +00:00
Teo Voinea
333702aa1e
Rework events ( #3069 )
...
* Start reworking events
* Trying things out
* .
* Add versioning, create events container in deploy script
* Improve gitignore
* Making the types line up
* Lets see how it works
* .
* Add CLI for querying event
* Linting
* Update src/ApiService/ApiService/Functions/Events.cs
Co-authored-by: George Pollard <porges@porg.es>
* almost done testing
* Added test
---------
Co-authored-by: George Pollard <porges@porg.es>
2023-04-27 20:10:39 +00:00
dependabot[bot]
4e307334ee
Bump winreg from 0.10.1 to 0.50.0 in /src/agent ( #2958 )
...
Bumps [winreg](https://github.com/gentoo90/winreg-rs ) from 0.10.1 to 0.50.0.
- [Release notes](https://github.com/gentoo90/winreg-rs/releases )
- [Changelog](https://github.com/gentoo90/winreg-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/gentoo90/winreg-rs/compare/v0.10.1...v0.50.0 )
---
updated-dependencies:
- dependency-name: winreg
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-27 16:24:28 +12:00
dependabot[bot]
f164dbadec
Bump clap from 4.1.14 to 4.2.4 in /src/agent ( #3056 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.1.14 to 4.2.4.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.1.14...v4.2.4 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-27 14:56:58 +12:00
dependabot[bot]
c3b64ccd7d
Bump tokio from 1.27.0 to 1.28.0 in /src/proxy-manager ( #3068 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.27.0 to 1.28.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.27.0...tokio-1.28.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-27 02:16:08 +00:00
dependabot[bot]
c0a8040b5a
Bump tokio from 1.27.0 to 1.28.0 in /src/agent ( #3067 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.27.0 to 1.28.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.27.0...tokio-1.28.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-27 13:57:09 +12:00
dependabot[bot]
57f3f8b41a
Bump Azure.Messaging.EventGrid from 4.10.0 to 4.15.0 in /src/ApiService ( #3037 )
...
* Bump Azure.Messaging.EventGrid from 4.10.0 to 4.15.0 in /src/ApiService
Bumps [Azure.Messaging.EventGrid](https://github.com/Azure/azure-sdk-for-net ) from 4.10.0 to 4.15.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases )
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Messaging.EventGrid_4.10.0...Azure.Messaging.EventGrid_4.15.0 )
---
updated-dependencies:
- dependency-name: Azure.Messaging.EventGrid
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* dotnet restore
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-27 00:12:01 +00:00
Cheick Keita
cbac57d4d0
Tweaking some of the parameter fo the logging ( #3070 )
2023-04-26 16:11:35 -07:00
George Pollard
13aca52afe
Make check-dependencies lowercase ( #3066 )
2023-04-26 08:24:31 -04:00
George Pollard
001c5a2367
Change --check_fuzzer_help
to --no_check_fuzzer_help
( #3063 )
...
Because `--check_fuzzer_help` is a positive flag (defaults to `True`), there is no way to change it to `False`, because specifying it on the command line sets it to `True`. Change the flag to a negative one instead, named `--no_check_fuzzer_help`.
2023-04-26 16:26:07 +12:00
dependabot[bot]
c24ea52285
Bump regex from 1.7.1 to 1.8.1 in /src/agent ( #3052 )
...
Bumps [regex](https://github.com/rust-lang/regex ) from 1.7.1 to 1.8.1.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.7.1...1.8.1 )
---
updated-dependencies:
- dependency-name: regex
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-25 21:46:02 +00:00
Cheick Keita
7f1257b696
Add command to download the blob content to a file ( #3060 )
2023-04-25 16:15:58 +00:00
Cheick Keita
a268bc9c7c
Add New Endpoint to update the pool authentication ( #3059 )
...
* check that the node in managed before sending the stop message
* added endpoint to update the pool
* Update src/ApiService/ApiService/Functions/Pool.cs
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
---------
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
2023-04-24 21:52:13 +00:00
Teo Voinea
63de1e3915
Make our validation errors more specific ( #3053 )
2023-04-24 11:18:54 -04:00
George Pollard
49240ba46d
Bump Rust version to 1.69 ( #3049 )
...
* Bump Rust version to 1.69
* Bump clap to fix clippy lints
See: https://github.com/clap-rs/clap/issues/4733
2023-04-21 09:56:40 -04:00
George Pollard
44afdb32eb
elsa::sync::FrozenMap now implements Default ( #3044 )
2023-04-20 23:56:54 +00:00
Joe Ranweiler
73c3adaa47
Don't consume S_LABEL
symbols from PDBs ( #3046 )
...
* Don't consume `S_LABEL` symbols from PDBs
* Suppress lint
2023-04-20 23:14:53 +00:00
Adam
980d52f7ed
Update integration tests to ubuntu 20.04 ( #3047 )
...
* update images to ubuntu 20.04 in tests
2023-04-20 21:24:57 +00:00
dependabot[bot]
d4004f490a
Bump nix from 0.25.0 to 0.26.2 in /src/agent ( #2814 )
...
* Bump nix from 0.25.0 to 0.26.2 in /src/agent
Bumps [nix](https://github.com/nix-rust/nix ) from 0.25.0 to 0.26.2.
- [Release notes](https://github.com/nix-rust/nix/releases )
- [Changelog](https://github.com/nix-rust/nix/blob/v0.26.2/CHANGELOG.md )
- [Commits](https://github.com/nix-rust/nix/compare/v0.25.0...v0.26.2 )
---
updated-dependencies:
- dependency-name: nix
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update pete, ctrlc
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-20 20:49:26 +00:00
George Pollard
0432829736
Include coverage percentage in Cobertura reports ( #3034 )
...
Closes #2824 . ReportGenerator does not use this information, but I noticed that it was missing when using PyCobertura to generate a report.
2023-04-19 15:24:48 -07:00
Cheick Keita
aa28550aad
update the ado logic to consume the list of existing items once ( #3014 )
...
* update the ado logic to consume the list of existing items once
* format
* Update src/ApiService/ApiService/onefuzzlib/notifications/Ado.cs
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
* Adding a notification testing endpoint
* fix tests
* format
* regen docs
* update logic
* format
* fix dummy name
* mypy fix
* make mypy happy
* bandit fix
* renaming
* address PR Comment
---------
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
2023-04-19 14:27:16 -07:00
George Pollard
6f06b8ffd4
Add basic test for coverage
example and library ( #3035 )
...
The coverage code is not currently exercised by any test.
* Add a test to the `coverage` example so that it can run in PR builds.
* Specify `--all-targets` so that example tests are run.
* Install and use [`nextest`](https://nexte.st/ ) instead of the standard test runner.
* This will parallelize test runs across binaries so the overall test run is faster.
* Make sleep duration of agent configurable and reduce it in the test run so that it doesn't wait for 30 seconds.
2023-04-19 09:10:28 -04:00
dependabot[bot]
f11ae85930
Bump Azure.Identity from 1.6.0 to 1.8.2 in /src/ApiService ( #2972 )
...
* Bump Azure.Identity from 1.6.0 to 1.8.2 in /src/ApiService
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net ) from 1.6.0 to 1.8.2.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases )
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Identity_1.6.0...Azure.Identity_1.8.2 )
---
updated-dependencies:
- dependency-name: Azure.Identity
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* Dotnet restore
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-19 02:02:08 +00:00
George Pollard
4084d0a72e
Basic Linux ARM64 build ( #3030 )
...
* Attempt an ARM64 build
* Try bumping unwind
* Fixup uses of RIP
* Update check-dependencies.sh
* Further fix
* Platform-specific output directories
* Further fix
* Don't actually copy ARM64 binaries yet
2023-04-19 01:01:36 +00:00
dependabot[bot]
31de900f92
Bump System.IdentityModel.Tokens.Jwt from 6.22.1 to 6.29.0 in /src/ApiService ( #3023 )
...
* Bump System.IdentityModel.Tokens.Jwt in /src/ApiService
Bumps [System.IdentityModel.Tokens.Jwt](https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet ) from 6.22.1 to 6.29.0.
- [Release notes](https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet/releases )
- [Changelog](https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet/blob/dev/CHANGELOG.md )
- [Commits](https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet/compare/6.22.1...6.29.0 )
---
updated-dependencies:
- dependency-name: System.IdentityModel.Tokens.Jwt
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* dotnet restore
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-19 10:03:04 +12:00
George Pollard
bd2b109929
Use insta
crate for snapshot tests of stacktrace parsing ( #3027 )
...
* Use insta for snapshot tests
* Update pre-reqs to also install cargo-insta
2023-04-18 09:38:59 -04:00