58091c2859
Add Compute Gallery images support ( #1450 )
2021-11-18 12:20:29 -08:00
76000db559
Check logging from error to debug, since ( #1447 )
...
1) having error logged fails `integration-test.py`
2) Method returns `None` and caller should decide whether this is an error or not
Co-authored-by: stas <statis@microsoft.com >
2021-11-11 14:55:57 -08:00
c2bfa2a132
NSG feature branch cleanup. ( #1422 )
2021-11-04 18:59:23 -07:00
93d2d8d1b7
associate subnets with NSG ( #1393 )
...
* associate subnets with NSG
change NSG rule protocol to ANY
* subnet wait
* Improve NSG update logic
validate that subnet nsg is set before getting it's id (#1409 )
Co-authored-by: stas <statis@microsoft.com >
2021-11-04 18:59:23 -07:00
cbe6ef8e40
Update NSGs after changes to instance config ( #1385 )
...
* Refactor set_admins into configuration.py and update deployment params with nsg_config
* Fixing arguments.
* Param takes in network config json
* Fixing Client in deploy
* removing import
* Adding onefuzztypes to reqs.txt
* Reverting to single list
* Removing imports.
* Retriggering build
* Setting specific pip version for local testing.
* Removing imports?
* More imports.
* Fixing formatting.
* Updating how to parse nsg param.
* Removing old logging statements.
* Fixing types.
* REmoving bad log
* Removing local pip version.
* Removing comments
* fixing
* Formatting
* Fixing .split()
* Adding NSG rule checks and type.
* Formatting.
* Formatting.
* Removing imports.
* Fixing formatting.
* Testing formatting.
* Retrigger?
* New InstanceConfigClient class.
* Retrigger.
* Cherry picked commit.
* Reformatting.
* Actually fixing formatting.
* Fixing table_service call.
* Fixing return statement and nsg_rule pass.
* Full config.
* Removing commented out code.
* Fixing logic.
* Adding wildcard check.
* Code for updating NSGs when instance_config updated.
* Updating argument to set_allowed_rules
* Updating model to no longer be optional.
* Fixing args for set_allowed_rules
* trying to fix calls to get_nsg
* Updating calls to nsg lib
* Fixing imports.
* Updating calls to set_allowed and creating constructor for NSGConfig type.
* Removing constructor and manually setting default ip
* Fixing models.
* Hopefully fixing docs.
* Fix set_allowed call
* Adding error handling for update config.
* Changing to error check.
* Fixing error call.
* Fixing imports.
* Adding empty() function on request.
* Removing empty function.
* Fixing files for update.
* Fixing nsg.py.
* Fixing imports.
* removing commented code.
Co-authored-by: nharper285 <nharper285@gmail.com >
Update configuration.py to check for 'block all' configuration. (#1394 )
* Creating InstanceConfig Attributes for NSG Refactor (#1331 )
* Updating instance_config
* Updating attribute names.
* Updating list factory.
* Updating config attributes.
Co-authored-by: nharper285 <nharper285@gmail.com >
* NSG deployment on a creation of new debug/repro proxy. (#1340 )
Co-authored-by: stas <statis@microsoft.com >
* Build fix (#1374 )
* Bump reqwest from 0.11.4 to 0.11.5 in /src/proxy-manager (#1336 )
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.4 to 0.11.5.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump reqwest from 0.11.4 to 0.11.5 in /src/agent (#1335 )
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.4 to 0.11.5.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Work around for newly-upgraded pip breaking pip-licenses (#1346 )
* Work around for newly upgrdaded pip breaking pip-licenses (can be reverted once https://github.com/raimon49/pip-licenses/issues/113 is fixed)
* Update .github/workflows/ci.yml
Co-authored-by: Joe Ranweiler <joe@lemma.co >
Co-authored-by: stas <statis@microsoft.com >
Co-authored-by: Joe Ranweiler <joe@lemma.co >
* Bump iced-x86 from 1.14.0 to 1.15.0 in /src/agent (#1337 )
Bumps [iced-x86](https://github.com/icedland/iced ) from 1.14.0 to 1.15.0.
- [Release notes](https://github.com/icedland/iced/releases )
- [Commits](https://github.com/icedland/iced/compare/v1.14.0...v1.15.0 )
---
updated-dependencies:
- dependency-name: iced-x86
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* revert pip breaking pip-licenses workaround (#1348 )
Co-authored-by: stas <statis@microsoft.com >
* Bump thiserror from 1.0.29 to 1.0.30 in /src/proxy-manager (#1341 )
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.29 to 1.0.30.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.29...1.0.30 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump thiserror from 1.0.29 to 1.0.30 in /src/agent (#1342 )
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.29 to 1.0.30.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.29...1.0.30 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump strum from 0.21.0 to 0.22.0 in /src/agent (#1343 )
Bumps [strum](https://github.com/Peternator7/strum ) from 0.21.0 to 0.22.0.
- [Release notes](https://github.com/Peternator7/strum/releases )
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Peternator7/strum/commits )
---
updated-dependencies:
- dependency-name: strum
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump azure cli to 2.27.2 (#1355 )
* Bump azure cli to 2.27.2
* fixing up add-corpus-storage-account script
Co-authored-by: stas <statis@microsoft.com >
* Bump azure-identity to 1.6.1 (#1356 )
Co-authored-by: stas <statis@microsoft.com >
* Bump strum_macros from 0.21.1 to 0.22.0 in /src/agent (#1344 )
Bumps [strum_macros](https://github.com/Peternator7/strum ) from 0.21.1 to 0.22.0.
- [Release notes](https://github.com/Peternator7/strum/releases )
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Peternator7/strum/commits )
---
updated-dependencies:
- dependency-name: strum_macros
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org >
* Bump sysinfo from 0.20.4 to 0.20.5 in /src/agent (#1353 )
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo ) from 0.20.4 to 0.20.5.
- [Release notes](https://github.com/GuillaumeGomez/sysinfo/releases )
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GuillaumeGomez/sysinfo/commits )
---
updated-dependencies:
- dependency-name: sysinfo
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Release 3.2.0 (#1361 )
* Release 3.2.0
* Added python dependencies
* Update CHANGELOG.md
Co-authored-by: Cheick Keita <kcheick@gmail.com >
* Update CHANGELOG.md
Co-authored-by: Joe Ranweiler <joe@lemma.co >
* Update grammar
* Update CHANGELOG.md
Co-authored-by: Joe Ranweiler <joe@lemma.co >
Co-authored-by: Cheick Keita <kcheick@gmail.com >
Co-authored-by: Joe Ranweiler <joe@lemma.co >
* Temporarily ignore non-actionable `cargo audit` errors (#1365 )
* Azure DevOps notifications not appearing (#1370 )
Co-authored-by: stas <statis@microsoft.com >
* Bump procfs from 0.10.1 to 0.11.0 in /src/agent (#1360 )
Bumps [procfs](https://github.com/eminence/procfs ) from 0.10.1 to 0.11.0.
- [Release notes](https://github.com/eminence/procfs/releases )
- [Commits](https://github.com/eminence/procfs/compare/v0.10.1...v0.11.0 )
---
updated-dependencies:
- dependency-name: procfs
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org >
* Bump structopt from 0.3.23 to 0.3.25 in /src/agent (#1364 )
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.23 to 0.3.25.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.23...v0.3.25 )
---
updated-dependencies:
- dependency-name: structopt
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump reqwest from 0.11.5 to 0.11.6 in /src/proxy-manager (#1367 )
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.5 to 0.11.6.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.5...v0.11.6 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: stas <statis@microsoft.com >
Co-authored-by: Joe Ranweiler <joe@lemma.co >
Co-authored-by: Marc Greisen <marc@greisen.org >
Co-authored-by: Cheick Keita <kcheick@gmail.com >
Co-authored-by: Joe Ranweiler <joranwei@microsoft.com >
* Delete NSG if no resources associated with it (#1358 )
Co-authored-by: stas <statis@microsoft.com >
* Update NSGs after changes to instance config (#1385 )
* Refactor set_admins into configuration.py and update deployment params with nsg_config
* Fixing arguments.
* Param takes in network config json
* Fixing Client in deploy
* removing import
* Adding onefuzztypes to reqs.txt
* Reverting to single list
* Removing imports.
* Retriggering build
* Setting specific pip version for local testing.
* Removing imports?
* More imports.
* Fixing formatting.
* Updating how to parse nsg param.
* Removing old logging statements.
* Fixing types.
* REmoving bad log
* Removing local pip version.
* Removing comments
* fixing
* Formatting
* Fixing .split()
* Adding NSG rule checks and type.
* Formatting.
* Formatting.
* Removing imports.
* Fixing formatting.
* Testing formatting.
* Retrigger?
* New InstanceConfigClient class.
* Retrigger.
* Cherry picked commit.
* Reformatting.
* Actually fixing formatting.
* Fixing table_service call.
* Fixing return statement and nsg_rule pass.
* Full config.
* Removing commented out code.
* Fixing logic.
* Adding wildcard check.
* Code for updating NSGs when instance_config updated.
* Updating argument to set_allowed_rules
* Updating model to no longer be optional.
* Fixing args for set_allowed_rules
* trying to fix calls to get_nsg
* Updating calls to nsg lib
* Fixing imports.
* Updating calls to set_allowed and creating constructor for NSGConfig type.
* Removing constructor and manually setting default ip
* Fixing models.
* Hopefully fixing docs.
* Fix set_allowed call
* Adding error handling for update config.
* Changing to error check.
* Fixing error call.
* Fixing imports.
* Adding empty() function on request.
* Removing empty function.
* Fixing files for update.
* Fixing nsg.py.
* Fixing imports.
* removing commented code.
Co-authored-by: nharper285 <nharper285@gmail.com >
* Aligning feature branch with main (#1389 )
* Bump reqwest from 0.11.4 to 0.11.5 in /src/proxy-manager (#1336 )
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.4 to 0.11.5.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump reqwest from 0.11.4 to 0.11.5 in /src/agent (#1335 )
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.4 to 0.11.5.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Work around for newly-upgraded pip breaking pip-licenses (#1346 )
* Work around for newly upgrdaded pip breaking pip-licenses (can be reverted once https://github.com/raimon49/pip-licenses/issues/113 is fixed)
* Update .github/workflows/ci.yml
Co-authored-by: Joe Ranweiler <joe@lemma.co >
Co-authored-by: stas <statis@microsoft.com >
Co-authored-by: Joe Ranweiler <joe@lemma.co >
* Bump iced-x86 from 1.14.0 to 1.15.0 in /src/agent (#1337 )
Bumps [iced-x86](https://github.com/icedland/iced ) from 1.14.0 to 1.15.0.
- [Release notes](https://github.com/icedland/iced/releases )
- [Commits](https://github.com/icedland/iced/compare/v1.14.0...v1.15.0 )
---
updated-dependencies:
- dependency-name: iced-x86
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* revert pip breaking pip-licenses workaround (#1348 )
Co-authored-by: stas <statis@microsoft.com >
* Bump thiserror from 1.0.29 to 1.0.30 in /src/proxy-manager (#1341 )
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.29 to 1.0.30.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.29...1.0.30 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump thiserror from 1.0.29 to 1.0.30 in /src/agent (#1342 )
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.29 to 1.0.30.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.29...1.0.30 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump strum from 0.21.0 to 0.22.0 in /src/agent (#1343 )
Bumps [strum](https://github.com/Peternator7/strum ) from 0.21.0 to 0.22.0.
- [Release notes](https://github.com/Peternator7/strum/releases )
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Peternator7/strum/commits )
---
updated-dependencies:
- dependency-name: strum
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump azure cli to 2.27.2 (#1355 )
* Bump azure cli to 2.27.2
* fixing up add-corpus-storage-account script
Co-authored-by: stas <statis@microsoft.com >
* Bump azure-identity to 1.6.1 (#1356 )
Co-authored-by: stas <statis@microsoft.com >
* Bump strum_macros from 0.21.1 to 0.22.0 in /src/agent (#1344 )
Bumps [strum_macros](https://github.com/Peternator7/strum ) from 0.21.1 to 0.22.0.
- [Release notes](https://github.com/Peternator7/strum/releases )
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Peternator7/strum/commits )
---
updated-dependencies:
- dependency-name: strum_macros
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org >
* Bump sysinfo from 0.20.4 to 0.20.5 in /src/agent (#1353 )
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo ) from 0.20.4 to 0.20.5.
- [Release notes](https://github.com/GuillaumeGomez/sysinfo/releases )
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GuillaumeGomez/sysinfo/commits )
---
updated-dependencies:
- dependency-name: sysinfo
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Release 3.2.0 (#1361 )
* Release 3.2.0
* Added python dependencies
* Update CHANGELOG.md
Co-authored-by: Cheick Keita <kcheick@gmail.com >
* Update CHANGELOG.md
Co-authored-by: Joe Ranweiler <joe@lemma.co >
* Update grammar
* Update CHANGELOG.md
Co-authored-by: Joe Ranweiler <joe@lemma.co >
Co-authored-by: Cheick Keita <kcheick@gmail.com >
Co-authored-by: Joe Ranweiler <joe@lemma.co >
* Temporarily ignore non-actionable `cargo audit` errors (#1365 )
* Azure DevOps notifications not appearing (#1370 )
Co-authored-by: stas <statis@microsoft.com >
* Bump procfs from 0.10.1 to 0.11.0 in /src/agent (#1360 )
Bumps [procfs](https://github.com/eminence/procfs ) from 0.10.1 to 0.11.0.
- [Release notes](https://github.com/eminence/procfs/releases )
- [Commits](https://github.com/eminence/procfs/compare/v0.10.1...v0.11.0 )
---
updated-dependencies:
- dependency-name: procfs
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org >
* Bump structopt from 0.3.23 to 0.3.25 in /src/agent (#1364 )
Bumps [structopt](https://github.com/TeXitoi/structopt ) from 0.3.23 to 0.3.25.
- [Release notes](https://github.com/TeXitoi/structopt/releases )
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.23...v0.3.25 )
---
updated-dependencies:
- dependency-name: structopt
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump reqwest from 0.11.5 to 0.11.6 in /src/proxy-manager (#1367 )
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.5 to 0.11.6.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.5...v0.11.6 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump reqwest from 0.11.5 to 0.11.6 in /src/agent (#1368 )
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.5 to 0.11.6.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.5...v0.11.6 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump crossterm from 0.21.0 to 0.22.1 in /src/agent (#1369 )
Bumps [crossterm](https://github.com/crossterm-rs/crossterm ) from 0.21.0 to 0.22.1.
- [Release notes](https://github.com/crossterm-rs/crossterm/releases )
- [Changelog](https://github.com/crossterm-rs/crossterm/blob/master/CHANGELOG.md )
- [Commits](https://github.com/crossterm-rs/crossterm/commits )
---
updated-dependencies:
- dependency-name: crossterm
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org >
* Fix validation of `target_exe` blob name (#1371 )
* NSG Updated After CLI Update to Instance_Config (#1375 )
* Creating InstanceConfig Attributes for NSG Refactor (#1331 )
* Updating instance_config
* Updating attribute names.
* Updating list factory.
* Updating config attributes.
Co-authored-by: nharper285 <nharper285@gmail.com >
* NSG deployment on a creation of new debug/repro proxy. (#1340 )
Co-authored-by: stas <statis@microsoft.com >
* Code for updating NSGs when instance_config updated.
* Updating argument to set_allowed_rules
* Temporarily ignore non-actionable `cargo audit` errors (#1365 )
* Updating model to no longer be optional.
* Fixing args for set_allowed_rules
* trying to fix calls to get_nsg
* Updating calls to nsg lib
* Fixing imports.
* Updating calls to set_allowed and creating constructor for NSGConfig type.
* Removing constructor and manually setting default ip
* Fixing models.
* Hopefully fixing docs.
* Fix set_allowed call
* Adding error handling for update config.
* Changing to error check.
* Fixing error call.
* Fixing imports.
* Updating instanceconfig retrieval.
* Fixing imports.
* Adding empty() function on request.
* Fixing name of function.
* Removing empty function.
Co-authored-by: nharper285 <nharper285@gmail.com >
Co-authored-by: Stas <stishkin@live.com >
Co-authored-by: stas <statis@microsoft.com >
Co-authored-by: Joe Ranweiler <joranwei@microsoft.com >
* Revert "NSG Updated After CLI Update to Instance_Config (#1375 )" (#1384 )
This reverts commit 357bc4fcad#1382 )
Bumps [backtrace](https://github.com/rust-lang/backtrace-rs ) from 0.3.61 to 0.3.62.
- [Release notes](https://github.com/rust-lang/backtrace-rs/releases )
- [Commits](https://github.com/rust-lang/backtrace-rs/compare/0.3.61...0.3.62 )
---
updated-dependencies:
- dependency-name: backtrace
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <marc@greisen.org >
* Set compiler env vars to effect Win10 SDK downgrade (#1388 )
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: stas <statis@microsoft.com >
Co-authored-by: Joe Ranweiler <joe@lemma.co >
Co-authored-by: Marc Greisen <marc@greisen.org >
Co-authored-by: Cheick Keita <kcheick@gmail.com >
Co-authored-by: Joe Ranweiler <joranwei@microsoft.com >
Co-authored-by: Noah McGregor Harper <74685766+nharper285@users.noreply.github.com >
Co-authored-by: nharper285 <nharper285@gmail.com >
* Updating configuration.py to check for 'block all' config.
* Fixing error message.
* associate subnets with NSG (#1393 )
* associate subnets with NSG
change NSG rule protocol to ANY
* subnet wait
* Improve NSG update logic
Co-authored-by: stas <statis@microsoft.com >
Co-authored-by: nharper285 <nharper285@gmail.com >
Co-authored-by: Stas <stishkin@live.com >
Co-authored-by: stas <statis@microsoft.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Joe Ranweiler <joe@lemma.co >
Co-authored-by: Marc Greisen <marc@greisen.org >
Co-authored-by: Cheick Keita <kcheick@gmail.com >
Co-authored-by: Joe Ranweiler <joranwei@microsoft.com >
2021-11-04 18:59:23 -07:00
93cee17689
Delete NSG if no resources associated with it ( #1358 )
...
Co-authored-by: stas <statis@microsoft.com >
2021-11-04 18:59:23 -07:00
b470ec2923
NSG deployment on a creation of new debug/repro proxy. ( #1340 )
...
Co-authored-by: stas <statis@microsoft.com >
2021-11-04 18:59:23 -07:00
98cd7c9c56
migrate to msgraph ( #966 )
...
* migrate to msgraph
* add subscription id to query_microsoft_graph
* migrating remaingin references
* formatting
* adding missing dependencies
* flake fix
* fix get_tenant_id
* cleanup
* formatting
* migrate application creation in deploy.py
* foramt
* mypy fix
* isort
* isort
* format
* bug fixes
* specify the correct signInAudience
* fix backing service principal creation
fix preauthorized application
* remove remaining references to graphrbac
* fix ms graph authentication
* formatting
* fix typo
* format
* deployment fix
* set implicitGrantSettings in the deployment
* format
* fix deployment
* fix graph authentication on the server
* use the current cli logged in account to retrive the backend token cache
* assign the the msgraph app role permissions to the web app during the deployment
* formatting
* fix build
* build fix
* fix bandit issue
* mypy fix
* isort
* deploy fixes
* formatting
* remove assign_app_permissions
* mypy fix
* build fix
* mypy fix
* format
* formatting
* flake fix
* remove webapp identity permission assignment
* remove unused reference to assign_app_role
* remove manual registration message
* fixing name and logging
* address PR coments
* address PR comments
* build fix
* lint
* lint
* mypy fix
* mypy fix
* formatting
* address PR comments
* linting
* lint
* remove ONEFUZZ_AAD_GROUP_ID check
* regenerate webhook_events.md
* change return type of query_microsoft_graph_list
* fix tenant_id
Co-authored-by: Marc Greisen <marc@greisen.org >
Co-authored-by: Stas <stishkin@live.com >
2021-10-22 11:59:05 -07:00
b238bfea03
Revert "NSG Updated After CLI Update to Instance_Config ( #1375 )" ( #1384 )
...
This reverts commit 357bc4fcad
2021-10-21 12:51:20 -07:00
357bc4fcad
NSG Updated After CLI Update to Instance_Config ( #1375 )
...
* Creating InstanceConfig Attributes for NSG Refactor (#1331 )
* Updating instance_config
* Updating attribute names.
* Updating list factory.
* Updating config attributes.
Co-authored-by: nharper285 <nharper285@gmail.com >
* NSG deployment on a creation of new debug/repro proxy. (#1340 )
Co-authored-by: stas <statis@microsoft.com >
* Code for updating NSGs when instance_config updated.
* Updating argument to set_allowed_rules
* Temporarily ignore non-actionable `cargo audit` errors (#1365 )
* Updating model to no longer be optional.
* Fixing args for set_allowed_rules
* trying to fix calls to get_nsg
* Updating calls to nsg lib
* Fixing imports.
* Updating calls to set_allowed and creating constructor for NSGConfig type.
* Removing constructor and manually setting default ip
* Fixing models.
* Hopefully fixing docs.
* Fix set_allowed call
* Adding error handling for update config.
* Changing to error check.
* Fixing error call.
* Fixing imports.
* Updating instanceconfig retrieval.
* Fixing imports.
* Adding empty() function on request.
* Fixing name of function.
* Removing empty function.
Co-authored-by: nharper285 <nharper285@gmail.com >
Co-authored-by: Stas <stishkin@live.com >
Co-authored-by: stas <statis@microsoft.com >
Co-authored-by: Joe Ranweiler <joranwei@microsoft.com >
2021-10-21 11:54:09 -07:00
22b2d62e29
enable configurable virtual network ranges ( #1268 )
2021-09-27 18:01:32 +00:00
3d1766271e
backdate SAS URLs to avoid time sync issues ( #1195 )
2021-08-27 17:00:15 +00:00
39bd0d2ca7
don't overload list builtin ( #1120 )
2021-08-02 13:51:35 -04:00
cfe0ec8d5f
address lint issues ( #1117 )
2021-08-02 12:05:10 -04:00
ee3d0871f2
handle azure-mgmt expired auth tokens by clearing the client cache and retrying ( #1099 )
...
In order to reduce how frequently the IMS is hit from the service, the service caches the azure-mgmt clients between API calls. While the management APIs should have some amount of authentication expiration redundancy built in, not all of them do.
This is seen with `ClientAuthenticationError`, most often with the nested exception record of `ExpiredAuthenticationToken`.
This wraps all of the compute layer functionality with a wrapper that checks if there has been an exception, and retries the request.
2021-07-22 18:01:02 +00:00
39beb1591c
use managed identity reader access for scaleset configs ( #1060 )
2021-07-13 13:20:50 -04:00
883c93aaf4
ensure VM IDs are unique before calling Azure reimage/delete APIs ( #1023 )
2021-06-25 11:54:52 -04:00
da931b3a5c
address issues raised from latest mypy ( #972 )
2021-06-09 12:04:24 -04:00
ed289c9a3c
handle scaleset resize exceptions ( #967 )
2021-06-08 09:30:36 -04:00
60ae07c34f
handle azure-storage deleting nonexistent containers ( #948 )
2021-06-02 15:11:33 +00:00
2241dcc7a4
update azure-mgmt-resource to 18.0.0 ( #903 )
2021-05-24 16:33:06 +00:00
6e5f7e4d4c
encode proxy name as base58 to allow full deletion of resources ( #907 )
2021-05-21 20:54:17 -04:00
811264e249
handle issue from azure-mgmt-resource 17.0.0 upgrade ( #893 )
2021-05-14 16:19:52 -04:00
541e745199
handle queues vanishing during peek ( #832 )
...
Handle queues getting deleted during peek_queue. This can happen when
polling the pool for work while the pool is getting shut down.
2021-04-26 15:42:40 -04:00
c5e0163068
catch VM SKU & VM Image generation mismatch failures ( #803 )
2021-04-14 14:34:12 -04:00
ca12904684
add log checking to refactored integration check ( #700 )
...
In practice, Application Insights can take up to 3 minutes before something sent to it is available via KQL.
This PR logs a start and stop marker such that the integration tests only search for logs during the integration tests. This reduces the complexity when using the integration tests during the development process.
Note: this migrated the new functionality from #356 into the latest integration test tools.
2021-04-02 21:49:19 +00:00
3096f99e86
enable using ephemeral disks by default ( #461 )
2021-03-30 18:48:44 -04:00
92c1d0a7a1
only set VM passwords on Windows ( #620 )
2021-03-03 21:27:56 +00:00
78d6adf555
upgrade azure-storage-blob to 12.8.0 ( #625 )
...
Note, this makes use of the new feature, `ContainerClient.exists()` which models our existing mechanism for doing container existence checking.
2021-03-03 10:33:23 +00:00
7f66eeee0d
handle OperationNotAllowed errors when creating VMSS ( #614 )
2021-03-02 16:14:10 -05:00
cebb84b9e7
handle error condition when creating a container that is being deleted ( #582 )
...
When users try to create a container immediately after deleting it, Azure will fail saying the deletion is in-progress.
catching ResourceExistsError during create handles this error.
2021-02-22 01:49:07 +00:00
279629292f
handle SkuNotAvailable errors when creating VM Scalesets ( #557 )
2021-02-17 16:52:37 -05:00
8ee7fae240
use the cached Azure Identity instance for storage operations ( #526 )
2021-02-09 12:20:12 -05:00
91a3690551
fix logging to show corpus accounts found, not a function ref ( #524 )
2021-02-09 11:55:52 -05:00
1d74379a70
use the primitive types in more places ( #514 )
2021-02-05 13:10:37 -05:00
5e2e9448df
add security auditing of python code using Bandit during CICD ( #491 )
2021-02-01 16:51:03 -05:00
0f70ffa3e2
try pushing updates to scaleset configs frequently until the push succeeds ( #489 )
2021-02-01 10:09:40 -05:00
5027745ee2
simplify get/delete for scalesets ( #468 )
2021-01-26 14:43:14 -05:00
165257e989
update python prereqs ( #427 )
...
Updates the following libraries in the service:
* azure-core
* azure-functions
* azure-identity
* azure-keyvault-keys
* azure-keyvault-secrets
* azure-mgmt-compute
* azure-mgmt-core
* azure-mgmt-loganalytics
* azure-mgmt-network
* azure-mgmt-resource
* azure-mgmt-storage
* azure-mgmt-subscription
* azure-storage-blob
* azure-storage-queue
* pydantic
* requests
* jsonpatch
Removes the following libraries in the service:
* azure-cli-core
* azure-cli-nspkg
* azure-mgmt-cosmosdb
* azure-servicebus
Updates the following libraries in the CLI:
* requests
* semver
* asciimatics
* pydantic
* tenacity
Updates the following libraries in onefuzztypes:
* pydantic
The primary "legacy" libraries are [azure-graphrbac](https://pypi.org/project/azure-graphrbac/ ) and azure-cosmosdb-table. The former has not been updated to use azure-identity yet. The later is being rewritten as [azure-data-tables](https://pypi.org/project/azure-data-tables/ ), but is still in early beta.
2021-01-25 20:53:40 +00:00
3f2883d38e
Storing secrets in azure keyvault ( #326 )
2021-01-25 11:12:07 -05:00
e799eb03cd
Shorten the expiry window for the work queue SAS URLs assigned at node registration ( #416 )
...
The underlying impact is that nodes must re-register on a more frequent basis.
Nodes find out they are out-of-date is during registration and immediately prior to starting a new set of work. Requiring nodes re-register on a shortened cycle provides more opportunities for nodes to get re-imaged.
Additionally, this addresses an issue handling the SAS URL expiry in a more clean fashion in the supervisor.
2021-01-07 12:34:26 +00:00
3b26ffef65
support multiple corpus accounts ( #334 )
...
Add support for sharding across multiple storage accounts for blob containers used for corpus management.
Things to note:
1. Additional storage accounts must be in the same resource group, support the "blob" endpoint, and have the tag `storage_type` with the value `corpus`. A utility is provided (`src/utils/add-corpus-storage-accounts`), which adds storage accounts.
2. If any secondary storage accounts exist, they are used by default for containers.
3. Storage account names are cached in memory the Azure Function instance forever. Upon adding new storage accounts, the app needs to be restarted to pick up the new accounts.
2021-01-06 23:11:39 +00:00
9b3ccf37ea
use the correct instrumentation key ( #355 )
2020-12-01 18:44:10 -05:00
7f97c142ed
add the instrumentation key to Info ( #353 )
2020-12-01 11:13:06 -05:00
b2b4a06afa
Address typing issues hidden by memoization.caching ( #322 )
2020-11-18 15:08:40 -05:00
e47e89609a
Use Storage Account types, rather than account_id ( #320 )
...
We need to move to supporting data sharding.
One of the steps towards that is stop passing around `account_id`, rather we need to specify the type of storage we need.
2020-11-18 14:06:14 +00:00
ba59230187
fix create_vmss log message ( #293 )
2020-11-11 12:17:42 -05:00
e638908aac
Add application-insights debug cli ( #281 )
2020-11-11 06:17:43 -05:00
bbee84ab1f
Storing the user assigned managed identity in the scaleset table ( #255 )
2020-11-05 18:36:59 -05:00
b5578381ce
default TTL for queued messages to infinite ( #259 )
2020-11-04 15:41:05 -05:00
