Commit Graph

1882 Commits

Author SHA1 Message Date
2e0358d77a Refactor timer_repro (#1839)
* Checkpoint

* lint

* PR comments and warnings
2022-04-26 12:56:38 +00:00
c6992698e5 Job model (#1841)
Co-authored-by: stas <statis@microsoft.com>
2022-04-25 15:40:28 -07:00
2d15489196 Add keyvault operations and models (#1838)
Co-authored-by: stas <statis@microsoft.com>
2022-04-25 13:42:27 -07:00
7fe9e3705d Set TSan options based on external symbolizer (#1787)
- Add `LlvmSymbolizer` wrapper around validated paths to external `llvm-symbolizer` exes
- Pivot sanitizer environment variable generation on `LlvmSymbolizer`
- Set external symbolizer path in `TSAN_OPTIONS`
2022-04-25 13:00:26 -07:00
3a93de4801 migrate timer_proxy part 2 (#1836) 2022-04-25 10:14:15 -07:00
66796148c5 Separate llvm-symbolizer setup from sanitizer env var init (#1778) 2022-04-24 13:38:17 -07:00
e86854cf2a - Move some persistent resources into SingletonResources class (#1835)
- Rename ResultOk to ResultVoid

Move environment variables to singleton

Co-authored-by: stas <statis@microsoft.com>
2022-04-22 17:40:11 -07:00
62d824383a Bump tokio from 1.15.0 to 1.17.0 in /src/proxy-manager (#1700)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.15.0 to 1.17.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.15.0...tokio-1.17.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-22 15:41:58 -07:00
d283e989f6 Add implementation to get allowed tenants (#1833)
Co-authored-by: stas <statis@microsoft.com>
2022-04-22 14:45:33 -07:00
ae85d81d76 OneFuzz CLI Docker container (#1831)
* OneFuzz CLI Docker container

* Update docs/OneFuzz-Docker-CLI.md

Co-authored-by: Joe Ranweiler <joe@lemma.co>

Co-authored-by: stas <statis@microsoft.com>
Co-authored-by: Joe Ranweiler <joe@lemma.co>
2022-04-22 13:53:16 -07:00
ddc415c91e more tests (#1832)
Co-authored-by: stas <statis@microsoft.com>
2022-04-22 13:00:57 -07:00
812a6d7517 [WIP] migrate timer_proxy (#1820) 2022-04-22 15:43:44 +00:00
20bd3c3a49 Container converter (#1821)
* Add db translation layer for container

* Remove debugging artifact

* fmt

* Remove unnecessary file

* PR comments

* Format
2022-04-22 11:59:07 +00:00
8654536749 Bump serde_json from 1.0.73 to 1.0.79 in /src/proxy-manager (#1655)
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.73 to 1.0.79.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.73...v1.0.79)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-21 17:46:22 -07:00
4ce8126de2 Bump futures from 0.3.17 to 0.3.21 in /src/agent (#1646)
Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.21.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.21)

---
updated-dependencies:
- dependency-name: futures
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-21 15:04:51 -07:00
2075d55edf Check for missing shared libs on failed LibFuzzer -help check (#1812) 2022-04-21 12:49:44 -07:00
3e5c6d7658 Bump futures-util from 0.3.17 to 0.3.21 in /src/agent (#1645)
Bumps [futures-util](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.21.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.21)

---
updated-dependencies:
- dependency-name: futures-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-21 11:35:53 -07:00
f82b36d691 Bump futures from 0.3.17 to 0.3.21 in /src/proxy-manager (#1644)
Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.21.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.21)

---
updated-dependencies:
- dependency-name: futures
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-21 08:06:46 -07:00
16d7694852 Implement new_files (#1794)
* Checkpoint

* Checkpoint

* More merge resolving

* Code complete

* Tested that it works

* Keep the queue name different for now

* Query was wrong, should be and

* Style

* Fix compile issue

* Change report to use string instead of SHA, fixes tests as well

* PR comments

* Comments and formatting
2022-04-20 18:36:50 +00:00
52fcd213a5 Bump serde from 1.0.131 to 1.0.136 in /src/proxy-manager (#1619)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.131 to 1.0.136.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.131...v1.0.136)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-20 10:28:37 -07:00
e32f42cc1b Limited support for polymorphic deserialization (#1814) 2022-04-19 18:36:50 -07:00
4be286ada5 bump azure-cli-core and dependencies to 2.35.0 (#1784)
* bump azure-cli-core and dependencies to 2.35.0

* bump deploy requirements to align with cli

Co-authored-by: stas <statis@microsoft.com>
2022-04-19 13:38:40 -07:00
5827d3b90e Add property based testing (#1813)
* Add property based testing

* comment out failing test (service code will be fixed later)

* add some json serialization tests

Co-authored-by: stas <statis@microsoft.com>
2022-04-19 10:42:14 -07:00
cb45c5685f add tool_name and onfuzz_version to CrashReport (#1635) 2022-04-18 23:56:07 +00:00
ebb3c63f9e Update python function name string to manage confict after deleting the function app. (#1808) 2022-04-18 11:26:44 -07:00
3869352b81 Continue inline access search on local error (#1796) 2022-04-16 02:59:10 +00:00
ba579c619e fix event deserialization (#1805)
* fix event deserialization

* addes unit tests
2022-04-16 01:59:41 +00:00
e03d87ffbc handle more serialization/deserialization cases (#1804)
Co-authored-by: stas <statis@microsoft.com>
2022-04-15 17:48:56 -07:00
057eb66ce1 Migrating timer_daily (#1803)
* Migrating timer_daily

* isabling the TimerDaily to prevent ollision with the existing

* adding missing keys

* Adding Report
2022-04-15 16:03:39 -07:00
98875f0531 Switch dependency injection to Scoped (#1801)
Co-authored-by: stas <statis@microsoft.com>
2022-04-15 09:33:59 -07:00
22faa1b5db instance config (#1791)
* instance config

* address PR comments

* make logs scoped

* make logs scoped

Co-authored-by: stas <statis@microsoft.com>
2022-04-14 14:20:28 -07:00
b03d420804 Allow some safe functions with HANDLE arguments (#1792) 2022-04-14 12:29:36 -07:00
9d8d3327d2 Migrating QueueTaskHeartbeat (#1777)
* Migrating QueueTaskHeartbeat

* changing the name of the input queue

* rename type alias Tasks to Async

* Fix property casing

* fixing types

* Removing IStorageProvider

* fix function name

* address PR comments
2022-04-14 00:19:44 +00:00
febaf6e057 make logger immutable (#1783)
Co-authored-by: stas <statis@microsoft.com>
2022-04-12 11:24:48 -07:00
87eb606b35 Delete nodes when they're done (#1763)
* Delete nodes when they're done

* Missed a file

* Load node disposal strategy from env var

* Lint

* Fix subtle bug

* Deleting doesn't work, will 'decomission' nodes once they complete work

* Missed a file

* Remove logging line
2022-04-12 17:32:15 +00:00
faaa5d2d78 bump dependencies to latest (#1782)
remove/implement "cached todo" from some methods,

Co-authored-by: stas <statis@microsoft.com>
2022-04-12 09:48:34 -07:00
50637d4791 switch to our logger (#1780)
* switch to our logger

* preserve correlation id when calling CorpusAccounts

Co-authored-by: Stas Tishkin <statis@microsoft.com>
2022-04-12 08:32:55 -07:00
75039a96eb [C# Port] Adding new Proxy Update Queue Function. (#1757)
* Adding QueueProxyUpdate.

* Setting to serializer.

* Updates.

* Updating with new ORM model and [model]Operation.

* Fixing return type.

* Working on changes.

* Tested and ready for review.

* Formatting.

* Removing test code.

* Update src/ApiService/Tests/OrmTest.cs

Co-authored-by: Cheick Keita <chkeita@microsoft.com>

* Fixing tests.

* Fixing tests again.

* Asserting null in tests.

* Adding null param.

* Removing whitespace.

* syntax error.

Co-authored-by: Cheick Keita <chkeita@microsoft.com>
2022-04-11 13:32:43 -07:00
5aceb25843 Finishing implementation of SendEvent (#1765) 2022-04-11 09:32:09 -07:00
9323d78c19 Bump serde from 1.0.130 to 1.0.136 in /src/agent (#1618)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.130 to 1.0.136.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.130...v1.0.136)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Greisen <mgreisen@microsoft.com>
2022-04-08 11:44:55 -07:00
d95d46a420 Add formatting step to the build And apply default formatting (#1762)
* Add formatting step to the build

* apply formatting

* Adding .editorconfigfile and option to remove "unused using directive errors"
2022-04-07 21:44:54 +00:00
3d527908fb Update Cobertura Output (#1728)
* Updated cobertura to have directory as package and filename as class name

* Format

* Update to get line-rate

* Update test

* Format

* clean up

* Remove unneeded typing

* Unduplicating work, part 1

* Unduplicate code part 2

* Unduplicate code part 3

* Unduplicate code part 4

* Added in panic message

* Fixed lint errors

* Fixed lint error

* Changing line rate computation function, also changing 32-bit data types to 64-bit

* Create and use new Line Values type

* Pass in slice rather than vector

* Refactor

* Format

* Initial handling of panic

* Updated panic handling for path parent

* Update test to reflect invalid file format checking

* Fixed path error message

* Fixed match statment

* Make paths in test consistent

* Inital attempt to properly deal with paths on different OSs

* Rework of how to deal with different paths on differents OSs

* Updated path handling

* format

* Seperate out function to get directory

* Seperate out conversion to new path

* Updated path coversion to make it into standarized format

* Add in test XML file to compare to

* Adding in unit tests with differing path formats

* Improved type usage

* Adding some additional unit tests to test specific path conversion scenarios

* Commiting suggested changes

* Renaming tests for discovery

* Split out tests

* Determining issue with converting windows to posix paths

* Format

* Determining issue with converting windows to posix paths, update

* Manually converting windows paths to posix paths

* Remove unneeded test

* Initial code for comparing parsed xml

* revert and fix replace method

* make paths lowercase

* make class name only file name

* format
2022-04-07 13:14:00 -07:00
627b401c87 Continue port of QueueNodeHearbeat (#1761)
[WIP ] continue port of  QueueNodeHearbeat
2022-04-07 11:55:12 -07:00
5004b7902a Refactor signal events azure function (#1760) 2022-04-07 11:09:53 -04:00
c5f60dcaec Refactor queue file changes (#1755)
* Untested refactor

* Untested refactor

* It works with some test messages

* Use custom deserializer

* Clean up warnings
2022-04-06 20:37:52 +00:00
8299d8fb57 Using existing auto scale settings isn't an error (#1745) 2022-04-06 12:41:58 +00:00
a603b17436 Re enable Nullable on the test project (#1753) 2022-04-06 07:58:37 -04:00
13b2a6ef80 Add dotnet project to the Continuous integration (#1750) 2022-04-05 23:06:22 +00:00
9eb7f019a9 merge models (#1749)
Co-authored-by: stas <statis@microsoft.com>
2022-04-05 14:54:11 -07:00
2877676f2b partial port of user_credentials.py (#1744)
Co-authored-by: stas <statis@microsoft.com>
2022-04-05 13:47:57 -07:00