mirror of
https://github.com/AFLplusplus/AFLplusplus.git
synced 2025-06-24 06:42:42 +00:00
* Pure Python (3.6) port of benchmark.sh as benchmark.py, no other changes * Test standard and persistent modes separately * Add support for multi-core benchmarking * Save the results to a json file * Allow config of all experiment params, average across runs * Add start_time_of_run and total_execs_per_sec, cleanup for PR * benchmark: cleanup, add results, add a data exploration notebook * benchmark: add a README, lower default runs from 5 to 3 * benchmark: notebook wording tweaks * copy 'detect_leaks=0' from ASAN to LSAN fix for issue #1733, set "detect_leaks=0" when ASAN_OPTIONS contains it and LSAN_OPTIONS are not set. * fix of fix: make sure ASAN_OPTIONS and LSAN_OPTIONS agree on leak detection * fix lsan fix * clang-format 16->17 * Add missing initialisation for havoc_queued during the custom mutator's stage. * fix dictionary and cmin * Use direct call to write to OpenBSD The linker on OpenBSD emits a warning when linking this file: warning: syscall() may go away, please rewrite code to use direct calls * Fix possible doc inconsistency for custom mutator's queue_get function. * update todos * benchmark: Add support for COMPARISON file * benchmark: show the number of cores used in COMPARISON * benchmark: lower minimum Python version to 3.8 * benchmark: use afl's execs/s; increase CPU model width * benchmark: disallow duplicate entries for the same CPU in COMPARISON * Update benchmark.py * fix inf in stats * Fix benchmark.py * missing closing parenthesis * Update benchmark.py * benchmark: remove self-calculation of execs/sec * benchmark: update COMPARISON * benchmark: Update Jupyter notebook and results file. * benchmark: rename afl_execs_per_sec to execs_per_sec * benchmark: update README * update * add benchmark * nits * add benchmarks * Update unicornafl ref * Pass correct Nyx ID when creating a Nyx runner * Fix typo in docker pull command, add exampe to mount current dir as volume (#1914) * mini fix * add custom_post_run.c * update afl-fuzz-run * update python module * format code * update * merge function * changes * code format * improve cmplog * nit * nit * fix * fix * Stop hardcoding the path /usr/local/lib/afl in afl-ld-lto.c and respect the configured PREFIX. * Add benchmark for Raspberry Pi 5 * ryzen 5950 benchmark * add missing raspery5 * comparison -> comparison.md * removing options "-Wl,-rpath" "LLVM_LIBDIR" when using gcc * fixing -Wl,-rpath=<LLVM_LIBDIR> * nits * fix * afl-cc fixes * nit * add n_fuzz to ignore_timeouts * fix * Fix #1927 * in-depth blog post * add AFL_FUZZER_LOOPCOUNT * AFL_FUZZER_LOOPCOUNT * fix 2 mutation bugs * v4.09c release * v4.10a init * switch to explore powerschedule as default * fix MUT_INSERTASCIINUM * fix MUT_STRATEGY_ARRAY_SIZE * fix bad fix for MUT_STRATEGY_ARRAY_SIZE * remove afl-network-client on uninstall * update nyx * Improve binary-only related docs * llvm 18 build fixes. * code format * Fix custom_send link Add a leading '/' to walk in the repo root instead of current dir. * Use ../ instead * initial simple injection detection support * inject docs * fix for issue #1916, iLLVM crash in split-floatingpoint-compares * LLVM 17 bug workaround * finish injection implementation * remove tmp todo * update changelog * forgot to add the injection pass * Output afl-clang-fast stuffs only if necessary (#1912) * afl-cc header * afl-cc common declarations - Add afl-cc-state.c - Strip includes, find_object, debug/be_quiet/have_*/callname setting from afl-cc.c - Use debugf_args in main - Modify execvp stuffs to fit new aflcc struct * afl-cc show usage * afl-cc mode selecting 1. compiler_mode by callname in argv[0] 2. compiler_mode by env "AFL_CC_COMPILER" 3. compiler_mode/instrument_mode by command line options "--afl-..." 4. instrument_mode/compiler_mode by various env vars including "AFL_LLVM_INSTRUMENT" 5. final checking steps 6. print "... - mode: %s-%s\n" 7. determine real argv[0] according to compiler_mode * afl-cc macro defs * afl-cc linking behaviors * afl-cc fsanitize behaviors * afl-cc misc * afl-cc body update * afl-cc all-in-one formated with custom-format.py * nits --------- Co-authored-by: vanhauser-thc <vh@thc.org> * changelog * update grammar mutator * lto llvm 12+ * docs(custom_mutators): fix missing ':' (#1953) * Fix broken LTO mode and response file support (#1948) * Strip `-Wl,-no-undefined` during compilation (#1952) Make the compiler wrapper stripping `-Wl,-no-undefined` in addition to `-Wl,--no-undefined`. Both versions of the flag are accepted by clang and, therefore, used by building systems in the wild (e.g., samba will not build without this fix). * Remove dead code in write_to_testcase (#1955) The custom_mutators_count check in if case is duplicate with if condition. The else case is custom_mutators_count == 0, neither custom_mutator_list iteration nor sent check needed. Signed-off-by: Xeonacid <h.dwwwwww@gmail.com> * update qemuafl * WIP: Add ability to generate drcov trace using QEMU backend (#1956) * Document new drcov QEMU plugin * Add link to lightkeeper for QEMU drcov file loading --------- Co-authored-by: Jean-Romain Garnier <jean-romain.garnier@airbus.com> * code format * changelog * sleep on uid != 0 afl-system-config * fix segv about skip_next, warn on unsupported cases of linking options (#1958) * todos * ensure afl-cc only allows available compiler modes * update grammar mutator * disable aslr on apple * fix for arm64 * help selective instrumentation * typos * macos * add compiler test script * apple fixes --------- Signed-off-by: Xeonacid <h.dwwwwww@gmail.com> Co-authored-by: Chris Ball <chris@printf.net> Co-authored-by: hexcoder <hexcoder-@users.noreply.github.com> Co-authored-by: hexcoder- <heiko@hexco.de> Co-authored-by: Manuel Carrasco <m.carrasco@imperial.ac.uk> Co-authored-by: Jasper Lievisse Adriaanse <j@jasper.la> Co-authored-by: ifyGecko <26214995+ifyGecko@users.noreply.github.com> Co-authored-by: Dominik Maier <domenukk@gmail.com> Co-authored-by: Christian Holler (:decoder) <choller@mozilla.com> Co-authored-by: Carlo Maragno <ste.maragno@gmail.com> Co-authored-by: yangzao <yangzaocn@outlook.com> Co-authored-by: Romain Geissler <romain.geissler@amadeus.com> Co-authored-by: Jakob Lell <jakob@jakoblell.com> Co-authored-by: vincenzo MEZZELA <vincenzo.mezzela@amadeus.com> Co-authored-by: Andrea Fioraldi <andreafioraldi@gmail.com> Co-authored-by: Bet4 <0xbet4@gmail.com> Co-authored-by: David Carlier <devnexen@gmail.com> Co-authored-by: Xeonacid <h.dwwwwww@gmail.com> Co-authored-by: Sonic <50692172+SonicStark@users.noreply.github.com> Co-authored-by: Nils Bars <nils.bars@rub.de> Co-authored-by: Jean-Romain Garnier <7504819+JRomainG@users.noreply.github.com> Co-authored-by: Jean-Romain Garnier <jean-romain.garnier@airbus.com>
192 lines
7.4 KiB
Markdown
192 lines
7.4 KiB
Markdown
# Building and installing AFL++
|
|
|
|
## Linux on x86
|
|
|
|
An easy way to install AFL++ with everything compiled is available via docker:
|
|
You can use the [Dockerfile](../Dockerfile) or just pull directly from the
|
|
Docker Hub (for x86_64 and arm64):
|
|
|
|
```shell
|
|
docker pull aflplusplus/aflplusplus:latest
|
|
docker run -ti -v /location/of/your/target:/src aflplusplus/aflplusplus
|
|
```
|
|
|
|
This image is automatically generated when a push to the stable branch happens.
|
|
You will find your target source code in `/src` in the container.
|
|
|
|
Note: you can also pull `aflplusplus/aflplusplus:dev` which is the most current
|
|
development state of AFL++.
|
|
|
|
If you want to build AFL++ yourself, you have many options. The easiest choice
|
|
is to build and install everything:
|
|
|
|
NOTE: depending on your Debian/Ubuntu/Kali/... release, replace `-14` with
|
|
whatever llvm version is available. We recommend llvm 13, 14, 15 or 16.
|
|
|
|
```shell
|
|
sudo apt-get update
|
|
sudo apt-get install -y build-essential python3-dev automake cmake git flex bison libglib2.0-dev libpixman-1-dev python3-setuptools cargo libgtk-3-dev
|
|
# try to install llvm 14 and install the distro default if that fails
|
|
sudo apt-get install -y lld-14 llvm-14 llvm-14-dev clang-14 || sudo apt-get install -y lld llvm llvm-dev clang
|
|
sudo apt-get install -y gcc-$(gcc --version|head -n1|sed 's/\..*//'|sed 's/.* //')-plugin-dev libstdc++-$(gcc --version|head -n1|sed 's/\..*//'|sed 's/.* //')-dev
|
|
sudo apt-get install -y ninja-build # for QEMU mode
|
|
git clone https://github.com/AFLplusplus/AFLplusplus
|
|
cd AFLplusplus
|
|
make distrib
|
|
sudo make install
|
|
```
|
|
|
|
It is recommended to install the newest available gcc, clang and llvm-dev
|
|
possible in your distribution!
|
|
|
|
Note that `make distrib` also builds FRIDA mode, QEMU mode, unicorn_mode, and
|
|
more. If you just want plain AFL++, then do `make all`. If you want some
|
|
assisting tooling compiled but are not interested in binary-only targets, then
|
|
instead choose:
|
|
|
|
```shell
|
|
make source-only
|
|
```
|
|
|
|
These build targets exist:
|
|
|
|
* all: the main AFL++ binaries and llvm/gcc instrumentation
|
|
* binary-only: everything for binary-only fuzzing: frida_mode, nyx_mode,
|
|
qemu_mode, frida_mode, unicorn_mode, coresight_mode, libdislocator,
|
|
libtokencap
|
|
* source-only: everything for source code fuzzing: nyx_mode, libdislocator,
|
|
libtokencap
|
|
* distrib: everything (for both binary-only and source code fuzzing)
|
|
* man: creates simple man pages from the help option of the programs
|
|
* install: installs everything you have compiled with the build options above
|
|
* clean: cleans everything compiled, not downloads (unless not on a checkout)
|
|
* deepclean: cleans everything including downloads
|
|
* code-format: format the code, do this before you commit and send a PR please!
|
|
* tests: runs test cases to ensure that all features are still working as they
|
|
should
|
|
* unit: perform unit tests (based on cmocka)
|
|
* help: shows these build options
|
|
|
|
[Unless you are on Mac OS X](https://developer.apple.com/library/archive/qa/qa1118/_index.html),
|
|
you can also build statically linked versions of the AFL++ binaries by passing
|
|
the `STATIC=1` argument to make:
|
|
|
|
```shell
|
|
make STATIC=1
|
|
```
|
|
|
|
These build options exist:
|
|
|
|
* STATIC - compile AFL++ static
|
|
* CODE_COVERAGE - compile the target for code coverage (see docs/instrumentation/README.llvm.md)
|
|
* ASAN_BUILD - compiles AFL++ with memory sanitizer for debug purposes
|
|
* UBSAN_BUILD - compiles AFL++ tools with undefined behaviour sanitizer for debug purposes
|
|
* DEBUG - no optimization, -ggdb3, all warnings and -Werror
|
|
* LLVM_DEBUG - shows llvm deprecation warnings
|
|
* PROFILING - compile afl-fuzz with profiling information
|
|
* INTROSPECTION - compile afl-fuzz with mutation introspection
|
|
* NO_PYTHON - disable python support
|
|
* NO_SPLICING - disables splicing mutation in afl-fuzz, not recommended for normal fuzzing
|
|
* NO_UTF - do not use UTF-8 for line rendering in status screen (fallback to G1 box drawing, of vanilla AFL)
|
|
* NO_NYX - disable building nyx mode dependencies
|
|
* NO_CORESIGHT - disable building coresight (arm64 only)
|
|
* NO_UNICORN_ARM64 - disable building unicorn on arm64
|
|
* AFL_NO_X86 - if compiling on non-intel/amd platforms
|
|
* LLVM_CONFIG - if your distro doesn't use the standard name for llvm-config (e.g., Debian)
|
|
|
|
e.g.: `make LLVM_CONFIG=llvm-config-14`
|
|
|
|
## MacOS X on x86 and arm64 (M1)
|
|
|
|
MacOS has some gotchas due to the idiosyncrasies of the platform.
|
|
|
|
To build AFL, install llvm (and perhaps gcc) from brew and follow the general
|
|
instructions for Linux. If possible, avoid Xcode at all cost.
|
|
|
|
```shell
|
|
brew install wget git make cmake llvm gdb coreutils
|
|
```
|
|
|
|
Be sure to setup `PATH` to point to the correct clang binaries and use the
|
|
freshly installed clang, clang++, llvm-config, gmake and coreutils, e.g.:
|
|
|
|
```shell
|
|
# Depending on your MacOS system + brew version it is either
|
|
export PATH="/opt/homebrew/opt/llvm/bin:$PATH"
|
|
# or
|
|
export PATH="/usr/local/opt/llvm/bin:$PATH"
|
|
# you can check with "brew info llvm"
|
|
|
|
export PATH="/usr/local/opt/coreutils/libexec/gnubin:/usr/local/bin:$PATH"
|
|
export CC=clang
|
|
export CXX=clang++
|
|
gmake
|
|
cd frida_mode
|
|
gmake
|
|
cd ..
|
|
sudo gmake install
|
|
```
|
|
|
|
`afl-gcc` will fail unless you have GCC installed, but that is using outdated
|
|
instrumentation anyway. `afl-clang` might fail too depending on your PATH setup.
|
|
But you don't want neither, you want `afl-clang-fast` anyway :) Note that
|
|
`afl-clang-lto`, `afl-gcc-fast` and `qemu_mode` are not working on MacOS.
|
|
|
|
The crash reporting daemon that comes by default with MacOS X will cause
|
|
problems with fuzzing. You need to turn it off:
|
|
|
|
```
|
|
launchctl unload -w /System/Library/LaunchAgents/com.apple.ReportCrash.plist
|
|
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.ReportCrash.Root.plist
|
|
```
|
|
|
|
The `fork()` semantics on OS X are a bit unusual compared to other unix systems
|
|
and definitely don't look POSIX-compliant. This means two things:
|
|
|
|
- Fuzzing will be probably slower than on Linux. In fact, some folks report
|
|
considerable performance gains by running the jobs inside a Linux VM on
|
|
MacOS X.
|
|
- Some non-portable, platform-specific code may be incompatible with the AFL++
|
|
forkserver. If you run into any problems, set `AFL_NO_FORKSRV=1` in the
|
|
environment before starting afl-fuzz.
|
|
|
|
User emulation mode of QEMU does not appear to be supported on MacOS X, so
|
|
black-box instrumentation mode (`-Q`) will not work. However, FRIDA mode (`-O`)
|
|
works on both x86 and arm64 MacOS boxes.
|
|
|
|
MacOS X supports SYSV shared memory used by AFL's instrumentation, but the
|
|
default settings aren't usable with AFL++. The default settings on 10.14 seem to
|
|
be:
|
|
|
|
```bash
|
|
$ ipcs -M
|
|
IPC status from <running system> as of XXX
|
|
shminfo:
|
|
shmmax: 4194304 (max shared memory segment size)
|
|
shmmin: 1 (min shared memory segment size)
|
|
shmmni: 32 (max number of shared memory identifiers)
|
|
shmseg: 8 (max shared memory segments per process)
|
|
shmall: 1024 (max amount of shared memory in pages)
|
|
```
|
|
|
|
To temporarily change your settings to something minimally usable with AFL++,
|
|
run these commands as root:
|
|
|
|
```bash
|
|
sysctl kern.sysv.shmmax=8388608
|
|
sysctl kern.sysv.shmall=4096
|
|
```
|
|
|
|
If you're running more than one instance of AFL, you likely want to make
|
|
`shmall` bigger and increase `shmseg` as well:
|
|
|
|
```bash
|
|
sysctl kern.sysv.shmmax=8388608
|
|
sysctl kern.sysv.shmseg=48
|
|
sysctl kern.sysv.shmall=98304
|
|
```
|
|
|
|
See
|
|
[http://www.spy-hill.com/help/apple/SharedMemory.html](http://www.spy-hill.com/help/apple/SharedMemory.html)
|
|
for documentation for these settings and how to make them permanent.
|