Commit Graph

1360 Commits

Author SHA1 Message Date
8654536749 Bump serde_json from 1.0.73 to 1.0.79 in /src/proxy-manager (#1655)
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.73 to 1.0.79.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.73...v1.0.79)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-21 17:46:22 -07:00
4ce8126de2 Bump futures from 0.3.17 to 0.3.21 in /src/agent (#1646)
Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.21.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.21)

---
updated-dependencies:
- dependency-name: futures
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-21 15:04:51 -07:00
2075d55edf Check for missing shared libs on failed LibFuzzer -help check (#1812) 2022-04-21 12:49:44 -07:00
3e5c6d7658 Bump futures-util from 0.3.17 to 0.3.21 in /src/agent (#1645)
Bumps [futures-util](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.21.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.21)

---
updated-dependencies:
- dependency-name: futures-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-21 11:35:53 -07:00
f82b36d691 Bump futures from 0.3.17 to 0.3.21 in /src/proxy-manager (#1644)
Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.21.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.21)

---
updated-dependencies:
- dependency-name: futures
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-21 08:06:46 -07:00
b7e404fd26 Basic devcontainer configuration (#1768)
* Basic devcontainer configuration

* Bump Rust to 1.60, which is required

* Add some more requirements

* Manually install Rust so that cargo-audit can be installed

* Include settings/extensions that were in Rust feature previously

* Install further Rust requirements (from rust-prereqs.sh)

* Install dotnet "by hand"; this should be a bit faster than multiple steps

* Add Python extension to devcontainer

Co-authored-by: Teo Voinea <58236992+tevoinea@users.noreply.github.com>
2022-04-20 19:22:07 +00:00
16d7694852 Implement new_files (#1794)
* Checkpoint

* Checkpoint

* More merge resolving

* Code complete

* Tested that it works

* Keep the queue name different for now

* Query was wrong, should be and

* Style

* Fix compile issue

* Change report to use string instead of SHA, fixes tests as well

* PR comments

* Comments and formatting
2022-04-20 18:36:50 +00:00
52fcd213a5 Bump serde from 1.0.131 to 1.0.136 in /src/proxy-manager (#1619)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.131 to 1.0.136.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.131...v1.0.136)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-20 10:28:37 -07:00
e32f42cc1b Limited support for polymorphic deserialization (#1814) 2022-04-19 18:36:50 -07:00
4be286ada5 bump azure-cli-core and dependencies to 2.35.0 (#1784)
* bump azure-cli-core and dependencies to 2.35.0

* bump deploy requirements to align with cli

Co-authored-by: stas <statis@microsoft.com>
2022-04-19 13:38:40 -07:00
5827d3b90e Add property based testing (#1813)
* Add property based testing

* comment out failing test (service code will be fixed later)

* add some json serialization tests

Co-authored-by: stas <statis@microsoft.com>
2022-04-19 10:42:14 -07:00
cb45c5685f add tool_name and onfuzz_version to CrashReport (#1635) 2022-04-18 23:56:07 +00:00
e0e6707fd9 Release 5.3.0 update (#1810)
Includes a change in the bicep file. For the upgrade from 5.2 to 5.3 we need to manually delete the python function app. This causes a name clash when redeploying (so it's important that the manual update process is carefully followed).
5.3.0
2022-04-18 12:54:06 -07:00
ebb3c63f9e Update python function name string to manage confict after deleting the function app. (#1808) 2022-04-18 11:26:44 -07:00
3869352b81 Continue inline access search on local error (#1796) 2022-04-16 02:59:10 +00:00
ba579c619e fix event deserialization (#1805)
* fix event deserialization

* addes unit tests
2022-04-16 01:59:41 +00:00
e03d87ffbc handle more serialization/deserialization cases (#1804)
Co-authored-by: stas <statis@microsoft.com>
2022-04-15 17:48:56 -07:00
057eb66ce1 Migrating timer_daily (#1803)
* Migrating timer_daily

* isabling the TimerDaily to prevent ollision with the existing

* adding missing keys

* Adding Report
2022-04-15 16:03:39 -07:00
98875f0531 Switch dependency injection to Scoped (#1801)
Co-authored-by: stas <statis@microsoft.com>
2022-04-15 09:33:59 -07:00
22faa1b5db instance config (#1791)
* instance config

* address PR comments

* make logs scoped

* make logs scoped

Co-authored-by: stas <statis@microsoft.com>
2022-04-14 14:20:28 -07:00
b03d420804 Allow some safe functions with HANDLE arguments (#1792) 2022-04-14 12:29:36 -07:00
9d8d3327d2 Migrating QueueTaskHeartbeat (#1777)
* Migrating QueueTaskHeartbeat

* changing the name of the input queue

* rename type alias Tasks to Async

* Fix property casing

* fixing types

* Removing IStorageProvider

* fix function name

* address PR comments
2022-04-14 00:19:44 +00:00
31b9163514 Release 5.3.0 (#1767)
* Release 5.3.0

* Update CHANGELOG.md

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* Update CHANGELOG.md

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* Update CHANGELOG.md

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* Update CHANGELOG.md

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* Update CHANGELOG.md

Co-authored-by: Joe Ranweiler <joe@lemma.co>

* Update comments

Co-authored-by: Joe Ranweiler <joe@lemma.co>
2022-04-13 15:51:49 -07:00
febaf6e057 make logger immutable (#1783)
Co-authored-by: stas <statis@microsoft.com>
2022-04-12 11:24:48 -07:00
87eb606b35 Delete nodes when they're done (#1763)
* Delete nodes when they're done

* Missed a file

* Load node disposal strategy from env var

* Lint

* Fix subtle bug

* Deleting doesn't work, will 'decomission' nodes once they complete work

* Missed a file

* Remove logging line
2022-04-12 17:32:15 +00:00
faaa5d2d78 bump dependencies to latest (#1782)
remove/implement "cached todo" from some methods,

Co-authored-by: stas <statis@microsoft.com>
2022-04-12 09:48:34 -07:00
50637d4791 switch to our logger (#1780)
* switch to our logger

* preserve correlation id when calling CorpusAccounts

Co-authored-by: Stas Tishkin <statis@microsoft.com>
2022-04-12 08:32:55 -07:00
75039a96eb [C# Port] Adding new Proxy Update Queue Function. (#1757)
* Adding QueueProxyUpdate.

* Setting to serializer.

* Updates.

* Updating with new ORM model and [model]Operation.

* Fixing return type.

* Working on changes.

* Tested and ready for review.

* Formatting.

* Removing test code.

* Update src/ApiService/Tests/OrmTest.cs

Co-authored-by: Cheick Keita <chkeita@microsoft.com>

* Fixing tests.

* Fixing tests again.

* Asserting null in tests.

* Adding null param.

* Removing whitespace.

* syntax error.

Co-authored-by: Cheick Keita <chkeita@microsoft.com>
2022-04-11 13:32:43 -07:00
5aceb25843 Finishing implementation of SendEvent (#1765) 2022-04-11 09:32:09 -07:00
9323d78c19 Bump serde from 1.0.130 to 1.0.136 in /src/agent (#1618)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.130 to 1.0.136.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.130...v1.0.136)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-08 11:44:55 -07:00
d95d46a420 Add formatting step to the build And apply default formatting (#1762)
* Add formatting step to the build

* apply formatting

* Adding .editorconfigfile and option to remove "unused using directive errors"
2022-04-07 21:44:54 +00:00
3d527908fb Update Cobertura Output (#1728)
* Updated cobertura to have directory as package and filename as class name

* Format

* Update to get line-rate

* Update test

* Format

* clean up

* Remove unneeded typing

* Unduplicating work, part 1

* Unduplicate code part 2

* Unduplicate code part 3

* Unduplicate code part 4

* Added in panic message

* Fixed lint errors

* Fixed lint error

* Changing line rate computation function, also changing 32-bit data types to 64-bit

* Create and use new Line Values type

* Pass in slice rather than vector

* Refactor

* Format

* Initial handling of panic

* Updated panic handling for path parent

* Update test to reflect invalid file format checking

* Fixed path error message

* Fixed match statment

* Make paths in test consistent

* Inital attempt to properly deal with paths on different OSs

* Rework of how to deal with different paths on differents OSs

* Updated path handling

* format

* Seperate out function to get directory

* Seperate out conversion to new path

* Updated path coversion to make it into standarized format

* Add in test XML file to compare to

* Adding in unit tests with differing path formats

* Improved type usage

* Adding some additional unit tests to test specific path conversion scenarios

* Commiting suggested changes

* Renaming tests for discovery

* Split out tests

* Determining issue with converting windows to posix paths

* Format

* Determining issue with converting windows to posix paths, update

* Manually converting windows paths to posix paths

* Remove unneeded test

* Initial code for comparing parsed xml

* revert and fix replace method

* make paths lowercase

* make class name only file name

* format
2022-04-07 13:14:00 -07:00
627b401c87 Continue port of QueueNodeHearbeat (#1761)
[WIP ] continue port of  QueueNodeHearbeat
2022-04-07 11:55:12 -07:00
5004b7902a Refactor signal events azure function (#1760) 2022-04-07 11:09:53 -04:00
c5f60dcaec Refactor queue file changes (#1755)
* Untested refactor

* Untested refactor

* It works with some test messages

* Use custom deserializer

* Clean up warnings
2022-04-06 20:37:52 +00:00
8299d8fb57 Using existing auto scale settings isn't an error (#1745) 2022-04-06 12:41:58 +00:00
a603b17436 Re enable Nullable on the test project (#1753) 2022-04-06 07:58:37 -04:00
13b2a6ef80 Add dotnet project to the Continuous integration (#1750) 2022-04-05 23:06:22 +00:00
9eb7f019a9 merge models (#1749)
Co-authored-by: stas <statis@microsoft.com>
2022-04-05 14:54:11 -07:00
2877676f2b partial port of user_credentials.py (#1744)
Co-authored-by: stas <statis@microsoft.com>
2022-04-05 13:47:57 -07:00
78f8e3215f Starting migration of QueueNodeHearbeat (#1742)
* Add support for etag and timestamp
Introducing EntityBase
Starting migration of QueueNodeHearbeat

* rename namespaces

* upgrade Microsoft.Azure.Functions.Worker to 1.6.0
Added support when name contains underscore tot the case converter

* Support for not renaming enum fields

* bug fixes

* Arm client created in the contructor
added null check
2022-04-05 20:08:46 +00:00
0c3d9fcad2 Add CLI command to download agent logs (#1723)
* It does some things

* Download logs from job config

* Lint

* Make mypy happy

* Update to handle the new logs path

* progress

* A job might not have logs set in config

* Mypy wanted a type annotation
2022-04-05 15:35:15 -04:00
be27d430cd Bump structopt from 0.3.25 to 0.3.26 in /src/agent (#1617)
Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.25 to 0.3.26.
- [Release notes](https://github.com/TeXitoi/structopt/releases)
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md)
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.25...v0.3.26)

---
updated-dependencies:
- dependency-name: structopt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-04 15:12:26 -07:00
26911c82db Setting up the ORM (#1738)
* setting up orm

* Add unit tests

* Added support for object serilization
added tests

* moving stuff aroung

* Fix handling of enum flags cases
removing dependency to CaseExtension
Adding more tests

* add support for property rename

* caching EntityInfo

* remove access to environment variable

* formatting

* renaming dbName to columnName
2022-04-04 16:58:52 +00:00
fbff3fc4af Logging (#1737)
* Logging

* Doing dependency injection

* expose GetLoggers for better testing

Co-authored-by: stas <statis@microsoft.com>
2022-04-02 15:36:08 -07:00
f11e79de4b Starting work... - add http client - add package lock - set namespace to Microsoft.OneFuzz.Service - add static class to get environment variables (#1736)
Co-authored-by: stas <statis@microsoft.com>
2022-04-01 13:20:08 -07:00
9cbbf86e36 Add the setup state to the unavailable list (#1731)
* Add the setup state to the unavailable list

* Add the init state to the unavailable list

* Fix integration test

* Wrong import
2022-04-01 14:00:25 -04:00
20d3df0a11 Deploy dotnet Azure function alongside Python Azure function (#1733)
Co-authored-by: stas <statis@microsoft.com>
2022-04-01 09:42:06 -07:00
e2d554da13 ApiService solution in C# (#1734) 2022-04-01 01:14:12 +00:00
2ffeadfa35 switch to bicep template only and bicep refactor (#1732)
* switch to bicep template only and bicep refactor

* correct monitorAccount name

Co-authored-by: stas <statis@microsoft.com>
2022-03-31 13:01:02 -07:00