2148 Commits

Author SHA1 Message Date
Cheick Keita
bb1a54470a
Fix logic of marking task as failed (#3083)
* Fix logic of markaing task as failed
- Do not mark task as failed if it is already in the shutting down state
- accumulate errors when setting task error to understand the context
- refactor the Error record

* fix tests

* format

* Fix build

* Update src/ApiService/ApiService/onefuzzlib/ImageReference.cs

Co-authored-by: George Pollard <porges@porg.es>

* Update src/ApiService/ApiService/onefuzzlib/ProxyOperations.cs

Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>

---------

Co-authored-by: George Pollard <porges@porg.es>
Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
2023-05-04 19:50:46 +00:00
Cheick Keita
d237563988
Collect additional report field in an ExtensionData property (#3079)
* Collect additional report field in an ExtensionData property

* typo fix
2023-05-04 12:14:23 -07:00
Teo Voinea
f3ec0e5741
Add another truncation case (#3075)
* Add another truncation case

* fmt
2023-05-02 11:27:13 -07:00
Teo Voinea
16ebd2ddfe
Include exception information (#3077) 2023-05-02 08:49:04 -04:00
George Pollard
6397803eb2
Allow libfuzzer verification to retry (#3032)
Closes #2862 by brute force.

We’ve seen cases where it takes some time for an executable with a KnownDlls override to actually work after the node is restarted; thus, we now allow verification to take some time (currently up to a minute) to validate that a libfuzzer-based fuzzer actually works.
2023-04-28 01:14:27 +00:00
Teo Voinea
333702aa1e
Rework events (#3069)
* Start reworking events

* Trying things out

* .

* Add versioning, create events container in deploy script

* Improve gitignore

* Making the types line up

* Lets see how it works

* .

* Add CLI for querying event

* Linting

* Update src/ApiService/ApiService/Functions/Events.cs

Co-authored-by: George Pollard <porges@porg.es>

* almost done testing

* Added test

---------

Co-authored-by: George Pollard <porges@porg.es>
2023-04-27 20:10:39 +00:00
dependabot[bot]
4e307334ee
Bump winreg from 0.10.1 to 0.50.0 in /src/agent (#2958)
Bumps [winreg](https://github.com/gentoo90/winreg-rs) from 0.10.1 to 0.50.0.
- [Release notes](https://github.com/gentoo90/winreg-rs/releases)
- [Changelog](https://github.com/gentoo90/winreg-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/gentoo90/winreg-rs/compare/v0.10.1...v0.50.0)

---
updated-dependencies:
- dependency-name: winreg
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-27 16:24:28 +12:00
dependabot[bot]
f164dbadec
Bump clap from 4.1.14 to 4.2.4 in /src/agent (#3056)
Bumps [clap](https://github.com/clap-rs/clap) from 4.1.14 to 4.2.4.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v4.1.14...v4.2.4)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-27 14:56:58 +12:00
dependabot[bot]
c3b64ccd7d
Bump tokio from 1.27.0 to 1.28.0 in /src/proxy-manager (#3068)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.27.0 to 1.28.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.27.0...tokio-1.28.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-27 02:16:08 +00:00
dependabot[bot]
c0a8040b5a
Bump tokio from 1.27.0 to 1.28.0 in /src/agent (#3067)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.27.0 to 1.28.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.27.0...tokio-1.28.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-27 13:57:09 +12:00
dependabot[bot]
57f3f8b41a
Bump Azure.Messaging.EventGrid from 4.10.0 to 4.15.0 in /src/ApiService (#3037)
* Bump Azure.Messaging.EventGrid from 4.10.0 to 4.15.0 in /src/ApiService

Bumps [Azure.Messaging.EventGrid](https://github.com/Azure/azure-sdk-for-net) from 4.10.0 to 4.15.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases)
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Messaging.EventGrid_4.10.0...Azure.Messaging.EventGrid_4.15.0)

---
updated-dependencies:
- dependency-name: Azure.Messaging.EventGrid
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* dotnet restore

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-27 00:12:01 +00:00
Cheick Keita
cbac57d4d0
Tweaking some of the parameter fo the logging (#3070) 2023-04-26 16:11:35 -07:00
George Pollard
13aca52afe
Make check-dependencies lowercase (#3066) 2023-04-26 08:24:31 -04:00
George Pollard
001c5a2367
Change --check_fuzzer_help to --no_check_fuzzer_help (#3063)
Because `--check_fuzzer_help` is a positive flag (defaults to `True`), there is no way to change it to `False`, because specifying it on the command line sets it to `True`. Change the flag to a negative one instead, named `--no_check_fuzzer_help`.
2023-04-26 16:26:07 +12:00
dependabot[bot]
c24ea52285
Bump regex from 1.7.1 to 1.8.1 in /src/agent (#3052)
Bumps [regex](https://github.com/rust-lang/regex) from 1.7.1 to 1.8.1.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.7.1...1.8.1)

---
updated-dependencies:
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-25 21:46:02 +00:00
Cheick Keita
7f1257b696
Add command to download the blob content to a file (#3060) 2023-04-25 16:15:58 +00:00
Cheick Keita
a268bc9c7c
Add New Endpoint to update the pool authentication (#3059)
* check that the node in managed before sending the stop message

* added endpoint to update the pool

* Update src/ApiService/ApiService/Functions/Pool.cs

Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>

---------

Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
2023-04-24 21:52:13 +00:00
Teo Voinea
63de1e3915
Make our validation errors more specific (#3053) 2023-04-24 11:18:54 -04:00
George Pollard
49240ba46d
Bump Rust version to 1.69 (#3049)
* Bump Rust version to 1.69

* Bump clap to fix clippy lints

See: https://github.com/clap-rs/clap/issues/4733
2023-04-21 09:56:40 -04:00
George Pollard
44afdb32eb
elsa::sync::FrozenMap now implements Default (#3044) 2023-04-20 23:56:54 +00:00
Joe Ranweiler
73c3adaa47
Don't consume S_LABEL symbols from PDBs (#3046)
* Don't consume `S_LABEL` symbols from PDBs

* Suppress lint
2023-04-20 23:14:53 +00:00
Adam
980d52f7ed
Update integration tests to ubuntu 20.04 (#3047)
* update images to ubuntu 20.04 in tests
2023-04-20 21:24:57 +00:00
dependabot[bot]
d4004f490a
Bump nix from 0.25.0 to 0.26.2 in /src/agent (#2814)
* Bump nix from 0.25.0 to 0.26.2 in /src/agent

Bumps [nix](https://github.com/nix-rust/nix) from 0.25.0 to 0.26.2.
- [Release notes](https://github.com/nix-rust/nix/releases)
- [Changelog](https://github.com/nix-rust/nix/blob/v0.26.2/CHANGELOG.md)
- [Commits](https://github.com/nix-rust/nix/compare/v0.25.0...v0.26.2)

---
updated-dependencies:
- dependency-name: nix
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update pete, ctrlc

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-20 20:49:26 +00:00
George Pollard
0432829736
Include coverage percentage in Cobertura reports (#3034)
Closes #2824. ReportGenerator does not use this information, but I noticed that it was missing when using PyCobertura to generate a report.
2023-04-19 15:24:48 -07:00
Cheick Keita
aa28550aad
update the ado logic to consume the list of existing items once (#3014)
* update the ado logic to consume the list of existing items once

* format

* Update src/ApiService/ApiService/onefuzzlib/notifications/Ado.cs

Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>

* Adding a notification testing endpoint

* fix tests

* format

* regen docs

* update logic

* format

* fix dummy name

* mypy fix

* make mypy happy

* bandit fix

* renaming

* address PR Comment

---------

Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
2023-04-19 14:27:16 -07:00
George Pollard
6f06b8ffd4
Add basic test for coverage example and library (#3035)
The coverage code is not currently exercised by any test.

* Add a test to the `coverage` example so that it can run in PR builds.
* Specify `--all-targets` so that example tests are run.
* Install and use [`nextest`](https://nexte.st/) instead of the standard test runner.
  * This will parallelize test runs across binaries so the overall test run is faster.
* Make sleep duration of agent configurable and reduce it in the test run so that it doesn't wait for 30 seconds.
2023-04-19 09:10:28 -04:00
dependabot[bot]
f11ae85930
Bump Azure.Identity from 1.6.0 to 1.8.2 in /src/ApiService (#2972)
* Bump Azure.Identity from 1.6.0 to 1.8.2 in /src/ApiService

Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.6.0 to 1.8.2.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases)
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Identity_1.6.0...Azure.Identity_1.8.2)

---
updated-dependencies:
- dependency-name: Azure.Identity
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Dotnet restore

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-19 02:02:08 +00:00
George Pollard
4084d0a72e
Basic Linux ARM64 build (#3030)
* Attempt an ARM64 build

* Try bumping unwind

* Fixup uses of RIP

* Update check-dependencies.sh

* Further fix

* Platform-specific output directories

* Further fix

* Don't actually copy ARM64 binaries yet
2023-04-19 01:01:36 +00:00
dependabot[bot]
31de900f92
Bump System.IdentityModel.Tokens.Jwt from 6.22.1 to 6.29.0 in /src/ApiService (#3023)
* Bump System.IdentityModel.Tokens.Jwt in /src/ApiService

Bumps [System.IdentityModel.Tokens.Jwt](https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet) from 6.22.1 to 6.29.0.
- [Release notes](https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet/releases)
- [Changelog](https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet/blob/dev/CHANGELOG.md)
- [Commits](https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet/compare/6.22.1...6.29.0)

---
updated-dependencies:
- dependency-name: System.IdentityModel.Tokens.Jwt
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* dotnet restore

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-19 10:03:04 +12:00
George Pollard
bd2b109929
Use insta crate for snapshot tests of stacktrace parsing (#3027)
* Use insta for snapshot tests

* Update pre-reqs to also install cargo-insta
2023-04-18 09:38:59 -04:00
George Pollard
03e5efffe0
Update packages from CG report (#3031)
* Update Azure.Data.Tables

* Update wiremock, h2, hyper
2023-04-18 00:54:45 +00:00
George Pollard
256f261f2c
Parse .NET exception stacks in crash output (#2988) 2023-04-18 10:50:02 +12:00
Adam
5bbf95eb66
Release 8.0.0 (#3013)
* Release-8.0.0
---------
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2023-04-17 12:03:08 -07:00
George Pollard
dc7d5ec2d5
Remove old RUSTSEC suppression (#3017) 2023-04-13 09:01:51 -04:00
Teo Voinea
c105423d14
Add maxPerPage to ORM (#3016)
* Add support for maxPerPage in OMR

* Fix small bug
2023-04-12 20:37:56 +00:00
Teo Voinea
41fa0a78bb
Cap recursion in ORM (#2992)
* Add new command

* Update remaining jinja templates and references to use scriban

* almost done

* making progress

* Add 2 cases to stop OOM exceptions in the future

* More logs

* PR feedback

* Remove unnecessary changes

* 🧹

* PR comments
2023-04-13 08:22:39 +12:00
George Pollard
ace0ccc2d8
cargo update -p hyper (#3008) 2023-04-11 22:37:36 +00:00
George Pollard
f84b9c1a88
Bump Xunit (#3009) 2023-04-11 20:50:46 +00:00
Noah McGregor Harper
169cef7a06
Remove Additional config params - require on each request (#3000)
* Only Overrite Config Cache

* Lint

* Fixing isort.

* Removing expiry.

* Removing import.

* Removing config params.

* Remove bad import.

* Adjusting to type changes.

* Remove whitespace.

* Formatting.

* Formatting.

* null check.

* Formatting.
2023-04-11 11:35:09 -07:00
Adam
77c42930a6
adding updated key vault policy for Microsoft.Azure.WebSites (#3006)
* Fixes permissions on access policy needed for SSL cert syncing
2023-04-11 10:07:37 -07:00
George Pollard
a39666021a
Unify some crate versions (#3010)
In Component Governance we have a bunch of crates which are consumed twice under different versions in the `agent` and `proxy-manager` components. Try to unify some of these to reduce the overall dependency count (and potentially help with build times).
2023-04-11 09:10:49 -04:00
George Pollard
4dcc49cfb0
Use global.json to specify .NET version (#3007)
Rather than specifying this in `ci.yml`, specify it in the `global.json` file. This allows us to share the version amongst several workflows (and ADO pipelines) without needing to synchronize them.
2023-04-11 01:29:34 +00:00
dependabot[bot]
0ae81b2987
Bump gimli from 0.26.2 to 0.27.2 in /src/agent (#2836)
Bumps [gimli](https://github.com/gimli-rs/gimli) from 0.26.2 to 0.27.2.
- [Release notes](https://github.com/gimli-rs/gimli/releases)
- [Changelog](https://github.com/gimli-rs/gimli/blob/master/CHANGELOG.md)
- [Commits](https://github.com/gimli-rs/gimli/compare/0.26.2...0.27.2)

---
updated-dependencies:
- dependency-name: gimli
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-11 00:35:10 +00:00
dependabot[bot]
d108706353
Bump rayon from 1.6.1 to 1.7.0 in /src/agent (#2990)
Bumps [rayon](https://github.com/rayon-rs/rayon) from 1.6.1 to 1.7.0.
- [Release notes](https://github.com/rayon-rs/rayon/releases)
- [Changelog](https://github.com/rayon-rs/rayon/blob/master/RELEASES.md)
- [Commits](https://github.com/rayon-rs/rayon/compare/rayon-core-v1.6.1...rayon-core-v1.7.0)

---
updated-dependencies:
- dependency-name: rayon
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-11 00:16:27 +00:00
dependabot[bot]
c35c312eaf
Bump iced-x86 from 1.17.0 to 1.18.0 in /src/agent (#2880)
Bumps [iced-x86](https://github.com/icedland/iced) from 1.17.0 to 1.18.0.
- [Release notes](https://github.com/icedland/iced/releases)
- [Commits](https://github.com/icedland/iced/compare/v1.17.0...v1.18.0)

---
updated-dependencies:
- dependency-name: iced-x86
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-10 23:49:19 +00:00
dependabot[bot]
ebbedb7af1
Bump Microsoft.Azure.Functions.Worker.Extensions.Storage from 5.0.0 to 5.0.1 in /src/ApiService (#2969)
* Bump Microsoft.Azure.Functions.Worker.Extensions.Storage

Bumps [Microsoft.Azure.Functions.Worker.Extensions.Storage](https://github.com/Azure/azure-functions-dotnet-worker) from 5.0.0 to 5.0.1.
- [Release notes](https://github.com/Azure/azure-functions-dotnet-worker/releases)
- [Changelog](https://github.com/Azure/azure-functions-dotnet-worker/blob/main/release_notes.md)
- [Commits](https://github.com/Azure/azure-functions-dotnet-worker/commits/storage-extension-5.0.1)

---
updated-dependencies:
- dependency-name: Microsoft.Azure.Functions.Worker.Extensions.Storage
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* Dotnet restore

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George Pollard <gpollard@microsoft.com>
2023-04-11 11:21:14 +12:00
Adam
ab2958a6ac
Add custom domain cert KeyVault access policy to deployment (#3004)
* added certificate key vault access policy
2023-04-10 22:13:50 +00:00
Cheick Keita
e35b9fa0c7
Pass the task tags to the agent (#2895)
* Pass the task tags to the agent

* build fix

* build fix

* format
2023-04-10 21:57:15 +00:00
Cheick Keita
35e9effe4d
Allow the duration of the tasks to be specified in the template (#2997) 2023-04-10 19:16:48 +00:00
Adam
4195fc8533
updating rust dependency crossbeam-channel to 0.5.8 (#3002) 2023-04-10 11:49:27 -07:00