Commit Graph

1882 Commits

Author SHA1 Message Date
7c53762e8e Bump serde from 1.0.127 to 1.0.128 in /src/proxy-manager (#1164)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.127 to 1.0.128.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.127...v1.0.128)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: bmc-msft <41130664+bmc-msft@users.noreply.github.com>
2021-08-23 18:45:11 +00:00
c725b65fd5 Bump nom from 6.1.2 to 7.0.0 in /src/agent (#1165)
Bumps [nom](https://github.com/Geal/nom) from 6.1.2 to 7.0.0.
- [Release notes](https://github.com/Geal/nom/releases)
- [Changelog](https://github.com/Geal/nom/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Geal/nom/compare/6.1.2...7.0.0)

---
updated-dependencies:
- dependency-name: nom
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: bmc-msft <41130664+bmc-msft@users.noreply.github.com>
2021-08-23 18:19:47 +00:00
2a2844ae7a enable configuring proxy VM sku (#1128) 2021-08-23 16:04:59 +00:00
d1f58e6807 Bump serde from 1.0.127 to 1.0.128 in /src/agent (#1167)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.127 to 1.0.128.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.127...v1.0.128)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: bmc-msft <41130664+bmc-msft@users.noreply.github.com>
2021-08-23 15:33:21 +00:00
9845da7944 Bump procfs from 0.9.1 to 0.10.0 in /src/agent (#1166) 2021-08-23 14:57:42 +00:00
d2faf7c66d Fix case of logger format string specifier (#1160)
Fix a log statement with an invalid format string specifier. At runtime, the invalid specifier causes the service to throw a `ValueError`. This is typically invoked in the `agent_can_schedule` function [here](https://github.com/microsoft/onefuzz/blob/main/src/api-service/__app__/agent_can_schedule/__init__.py#L33).
2021-08-23 14:37:01 +00:00
8270ca2763 Bump iced-x86 from 1.13.0 to 1.14.0 in /src/agent (#1163) 2021-08-20 16:11:37 +00:00
7b740a6a28 Bump nix from 0.22.0 to 0.22.1 in /src/agent (#1158) 2021-08-16 20:31:03 +00:00
ee64aa4cc1 Bump memmap2 from 0.3.0 to 0.3.1 in /src/agent (#1157) 2021-08-16 19:56:14 +00:00
29d117b7dc Bump anyhow from 1.0.42 to 1.0.43 in /src/proxy-manager (#1155) 2021-08-16 19:35:24 +00:00
e01111049a Bump anyhow from 1.0.42 to 1.0.43 in /src/agent (#1156) 2021-08-16 19:10:05 +00:00
994bbe02f7 Synchronize update of Linux dependencies (#1152)
Resolves errors in #1141 and #1150.

To avoid this in the future, we need a feature similar to dependabot/dependabot-core#1296, or which lets us gate updates on (in this case) `pete`.
2021-08-16 16:19:33 +00:00
2fcb499888 Merge pull request from GHSA-q5vh-6whw-x745
* verify aad tenants, primarily needed in multi-tenant deployments

* add logging and fix trailing slash for issuer

* handle call_if* not supporting additional argument callbacks

* add logging

* include new datatype in webhook docs

* fix pytypes unit tests

Co-authored-by: Brian Caswell <bmc@shmoo.com>
2021-08-13 14:50:54 -04:00
ba3a6eab04 Bump tokio from 1.9.0 to 1.10.0 in /src/proxy-manager (#1151) 2021-08-13 14:14:04 +00:00
75b78428cd Bump tokio from 1.9.0 to 1.10.0 in /src/agent (#1149) 2021-08-13 13:43:49 +00:00
5a8a1c998e Enable ado render testing (#1144) 2021-08-12 16:38:49 +00:00
92ce90adb4 update sysinfo to 0.20.0 (#1145) 2021-08-12 09:21:00 -04:00
332dfd9983 add srcview crate (#1142) 2021-08-11 18:32:57 -04:00
f6923f9d00 Bump ctrlc from 3.1.9 to 3.2.0 in /src/agent (#1134) 2021-08-11 21:36:12 +00:00
0403a761e3 Bump tui from 0.15.0 to 0.16.0 in /src/agent (#1135) 2021-08-11 21:09:34 +00:00
2bda5853c7 Bump env_logger from 0.8.4 to 0.9.0 in /src/agent (#1137) 2021-08-11 20:40:14 +00:00
9de91b0563 Bump proc-maps from 0.1.8 to 0.1.9 in /src/agent (#1133) 2021-08-11 19:19:51 +00:00
9fb283eb80 Bump serde-xml-rs from 0.4.1 to 0.5.0 in /src/agent (#1138) 2021-08-11 18:05:44 +00:00
825ff70573 Bump env_logger from 0.8.4 to 0.9.0 in /src/proxy-manager (#1132) 2021-08-11 17:40:29 +00:00
ab0a13dd9c Bump flume from 0.10.7 to 0.10.8 in /src/agent (#1140) 2021-08-11 12:39:56 -04:00
d2332b8519 don't retry on service-level errors (#1129) 2021-08-11 11:34:54 -04:00
36292ca385 redirect output of supervisor by executing a child process (#1109) 2021-08-09 15:21:44 -04:00
338b541a94 expose coverage as an optional directory that gets synced to supervisor tasks (#1123)
Addresses #1122
2021-08-06 19:13:23 +00:00
e00d22b2c8 address clippy warnings (#1125) 2021-08-06 10:26:45 -04:00
5efc676f9a update memoization to 0.4.0 (#1124)
This primarily meant to enable addressing a warning for caching functions without arguments.

https://github.com/lonelyenvoy/python-memoization/releases/tag/v0.4.0
2021-08-05 15:48:10 +00:00
39bd0d2ca7 don't overload list builtin (#1120) 2021-08-02 13:51:35 -04:00
0b40abd0ef address clippy warnings from 0.1.54 (#1118) 2021-08-02 12:05:27 -04:00
cfe0ec8d5f address lint issues (#1117) 2021-08-02 12:05:10 -04:00
95e2ecff3d fix format in notification (#1115) 2021-08-02 12:04:46 -04:00
3be29cbfe9 update 3rd-party rust prereqs (#1116) 2021-08-02 12:04:21 -04:00
4e5a454049 limit the azcopy concurrency (#1112) 2021-07-29 20:52:49 -04:00
aa1bdeaad7 fix the premium storage account utilities (#1111) 2021-07-29 19:56:44 -04:00
9ec7e7a20a process all expired nodes rather than those not already marked for deletion (#1103)
This makes sure debug_keep_node is reset and the rest of the reimage processing occurs regardless of reimage_requested and delete_requested being set.

Without this, nodes that are marked `debug_keep_node` do not get reimaged/deleted.
2021-07-27 00:53:04 +00:00
0e27256faf Remove signalr from endpoints (#1102)
This is a follow-on PR from #1100
2021-07-23 15:47:08 +00:00
7e6a42cdd6 require {input} in target_env or target_options for generator and coverage tasks (#1106)
Fixes #925
2021-07-23 14:58:42 +00:00
b90ee03fd9 tasks must use pools not VMs (#1105)
using config.vm depricated prior to 1.0.0
2021-07-23 14:10:51 +00:00
55366e751a allow pools & scalesets set to shutdown to halt (#1104)
Currently, if a pool or scaleset is set to `shutdown`, it cannot be set to `halt`.

While moving from `halt` to `shutdown` would cause issues, moving from `shutdown` to `halt` is fine.
2021-07-23 13:14:47 +00:00
5be9c4dcee relay SignalR integrations through a storage queue (#1100)
The SignalR integration from Azure Functions does not have automatic retry.  When the SignalR instance has issues, all other APIs fail.

To make the service resilient to SignalR outages, this bounces SignalR events through an Azure Storage queue.

NOTE: This PR does not remove the integration from all of the functions.  That is intended to be done as a follow-on PR.
2021-07-22 18:10:20 +00:00
ee3d0871f2 handle azure-mgmt expired auth tokens by clearing the client cache and retrying (#1099)
In order to reduce how frequently the IMS is hit from the service, the service caches the azure-mgmt clients between API calls.  While the management APIs should have some amount of authentication expiration redundancy built in, not all of them do.

This is seen with `ClientAuthenticationError`, most often with the nested exception record of `ExpiredAuthenticationToken`.

This wraps all of the compute layer functionality with a wrapper that checks if there has been an exception, and retries the request.
2021-07-22 18:01:02 +00:00
3289644d2b automatically clean PII after retention period (#1051)
This PR removes PII from Jobs, Tasks, and Repros after 18 months.  

This PR also removes notifications tied to a container that has not been used in a task for 18 months.  This is done due to notifications having arbitrarily complex mechanisms for storing PII (typically the "assignee").
2021-07-22 17:12:08 +00:00
d50c5e0d09 enable the supervisor to handle longer service outages (#1098) 2021-07-21 17:03:06 -04:00
75d71209b8 verify {input} is used by target_env or target_options in coverage task (#1097) 2021-07-21 16:41:56 -04:00
3269dbb1aa delete secret on object delete (#1085) 2021-07-21 16:04:27 -04:00
041d3cc204 ignore table exists errors from integration testing at the azure functions layer (#1096) 2021-07-21 13:29:13 -04:00
198d765cb4 Add generic_analysis example that performs coverage analysis (#1072)
This adds an example script and tool that enables LLVM source-based coverage using the `generic_analysis` task.

This provides:
1. sample python script that launches the template and then the analysis task
1. sample `analysis_exe` wrapper script that launches the LLVM coverage tools
1. sample libfuzzer target for the example
1. walk through submitting the jobs and inspecting the results
2021-07-21 17:12:24 +00:00