Commit Graph

719 Commits

Author SHA1 Message Date
bb6d083768 Enable unmanaged registrations and configuration by environment variables (#318) 2020-11-18 12:19:09 -05:00
e47e89609a Use Storage Account types, rather than account_id (#320)
We need to move to supporting data sharding.

One of the steps towards that is stop passing around `account_id`, rather we need to specify the type of storage we need.
2020-11-18 14:06:14 +00:00
52eca33237 Move more run-time actions to setup-time (#317)
This script moves more of the run-time actions to setup-time.  This is important for running fuzzing within docker containers, such that installing llvm & gdb is done as part of the container, rather than on each launch.
2020-11-18 10:13:01 +00:00
64bd389eb7 Declarative templates (#266) 2020-11-17 16:00:09 -05:00
ce3356d597 Add SDK Feature Flags (#313)
## Summary of the Pull Request

This enables feature flags for the SDK, which enables gating access to preview features to those that have specifically asked for them.  This is intended to be used within #266.

Note, this change also moves to using a `pydantic` model for the config, rather than hand-crafted JSON dicts.
2020-11-17 15:40:16 +00:00
c4f266ee00 fix webhook events doc link (#316) 2020-11-16 18:45:54 -05:00
41271c62e0 Release 1.8.0 (#315) 1.8.0 2020-11-16 17:56:50 -05:00
02600320b7 Don't reset webhooks by default (#307) 2020-11-16 16:51:32 -05:00
beea318968 Add User Info to created tasks (#303)
This PR makes user information from JWT tokens available as part of a Task.

Included changes:
* Renamed `verify_token` to `call_if_agent`, since this function is specific to agent token verification
* Renames `is_authorized` to `is_agent`, since this function checks if the token is an agent
* Adds support for unmanaged nodes in `is_agent` (see #133 for information) 
* Saves the user information from the JWT token on task create as part of `TaskConfig`

Note, `TaskConfig` is what is provided to notification templates.  This enables Github issues and ADO work items to tie back to the user that created the task.

Note, while `upn` _usually_ means email for AAD user tokens.  If we were going to make use of the email address, we should perform a graph lookup based on the `oid`, but we're not.
2020-11-13 11:50:52 +00:00
31f099d3d4 Event based webhooks (#296) 2020-11-12 17:44:42 -05:00
693c988854 add symbols for windows agents (#306) 2020-11-12 15:46:32 -05:00
484b5318d3 fix the labels used in issue templates (#302) 2020-11-12 14:00:06 -05:00
f700a06e49 Don't store the sccache directory as part of the Rust Prereqs (#301) 2020-11-12 13:58:51 -05:00
a0b5d10c81 Add target_workers to TaskUnitConfig (#305) 2020-11-12 13:22:53 -05:00
30ba30d609 Add --upgrade to the Azure Devops deployment pipeline (#304) 2020-11-12 11:34:31 -05:00
87085bc48a Change prepare_test_result to take reference (#297)
Originally used move to avoid copying, but the copy is cheap in the
normal case (no exceptions) and is more usable this way.
2020-11-11 21:48:08 -08:00
b6be6e30cb Release 1.7.0 (#299) 1.7.0 2020-11-11 21:40:32 -05:00
61b3f87dd4 prevent users from enabling public access to containers (#300) 2020-11-11 20:36:49 -05:00
c56f72b37c Make supervisor heartbeat only fire on main loop progress (#283) 2020-11-11 18:30:02 -05:00
ca209eb543 refactor agent_events handler (#261) 2020-11-11 18:28:16 -05:00
382003e4d0 Comment update to register app as owner (#262) 2020-11-11 17:58:30 -05:00
4e138b0bef cli debug command to ssh/rdp to a specific node (#298) 2020-11-11 17:14:02 -05:00
9e24754150 Windows debugger updates (#294)
* Set execution context while handling breakpoint

If we don't do this, the caller will see incorrect state such
as the wrong rip.

* Improve debugger logging messages
* Tiny tweak to breakpoint data type
* Suspend threads while single stepping over breakpoint
* Fix get_current_thread_id to return actual id
2020-11-11 12:09:18 -08:00
5c45d85359 Don't use HTTP 404 on agent refresh error (#287) 2020-11-11 12:33:27 -05:00
c70007d5df include deleting unique_inputs on containers.reset (#290) 2020-11-11 12:33:03 -05:00
dec1a2d7b0 removing nodes whose ground truth is not avail (#275) 2020-11-11 12:20:05 -05:00
8678755b71 Render envelope.event as json (#288) 2020-11-11 12:18:32 -05:00
7b34cf23f2 reduce calls to containers.list() (#289) 2020-11-11 12:18:14 -05:00
3e4b26951e pin urllib3 for deployment prereqs (#292) 2020-11-11 12:17:58 -05:00
ba59230187 fix create_vmss log message (#293) 2020-11-11 12:17:42 -05:00
3cade0800d Autoscale test: I (#278) 2020-11-11 10:53:47 -05:00
439a58f8a2 Add uninstrumented block coverage recording (#280) 2020-11-11 07:20:38 -05:00
e638908aac Add application-insights debug cli (#281) 2020-11-11 06:17:43 -05:00
daba3232bc Use a shortened machine_id, similar to other UUIDs (#286) 2020-11-11 05:41:24 -05:00
82806b1cf2 Keeps task/node association until the nodes are reimaged (#273) 2020-11-10 17:41:51 -05:00
5797fa1f3a adding ypy on tests (#279) 2020-11-10 11:09:18 -05:00
81a04ed81d Make the role assignment step optional in the deployment (#271) 2020-11-10 09:11:34 -05:00
4cafee9bbf Sorting params for Task creation (#274) 2020-11-09 16:52:09 -05:00
bbee84ab1f Storing the user assigned managed identity in the scaleset table (#255) 2020-11-05 18:36:59 -05:00
b5578381ce default TTL for queued messages to infinite (#259) 2020-11-04 15:41:05 -05:00
600b3efdf7 Address formatting in logging in registration.py (#258) 2020-11-03 16:16:18 -05:00
04643a9eed fixing libfuzzer_merge (#240) 2020-11-03 15:46:18 -05:00
46064fb70b Tests for scaleset size validation (#243) 2020-11-03 11:40:09 -05:00
4ef489b397 adding node shutdown (#252) 2020-11-03 11:39:51 -05:00
0e04309e33 Adding linting for contrib/deploy-onefuzz-via-azure-devops (#256) 2020-11-03 11:39:33 -05:00
ffeee8e57e Release 1.6.0 (#248) 1.6.0 2020-11-03 10:34:52 -05:00
15a783cf0f fix reading instance_id on follow-on deploy (#253) 2020-11-02 19:15:44 -05:00
08065f477e fixing GraphQueryError (#251) 2020-11-02 16:56:48 -05:00
6c598773dd add instance_id generated at install time (#245) 2020-11-02 14:27:51 -05:00
89ebc7be50 Adding version as a param to dev-deploy script (#239) 2020-11-02 14:05:13 -05:00