mirror of
https://github.com/AFLplusplus/AFLplusplus.git
synced 2025-06-23 06:28:51 +00:00
* Output afl-clang-fast stuffs only if necessary (#1912)
* afl-cc header
* afl-cc common declarations
- Add afl-cc-state.c
- Strip includes, find_object, debug/be_quiet/have_*/callname setting from afl-cc.c
- Use debugf_args in main
- Modify execvp stuffs to fit new aflcc struct
* afl-cc show usage
* afl-cc mode selecting
1. compiler_mode by callname in argv[0]
2. compiler_mode by env "AFL_CC_COMPILER"
3. compiler_mode/instrument_mode by command line options "--afl-..."
4. instrument_mode/compiler_mode by various env vars including "AFL_LLVM_INSTRUMENT"
5. final checking steps
6. print "... - mode: %s-%s\n"
7. determine real argv[0] according to compiler_mode
* afl-cc macro defs
* afl-cc linking behaviors
* afl-cc fsanitize behaviors
* afl-cc misc
* afl-cc body update
* afl-cc all-in-one
formated with custom-format.py
* nits
---------
Co-authored-by: vanhauser-thc <vh@thc.org>
* changelog
* update grammar mutator
* lto llvm 12+
* docs(custom_mutators): fix missing ':' (#1953)
* Fix broken LTO mode and response file support (#1948)
* Strip `-Wl,-no-undefined` during compilation (#1952)
Make the compiler wrapper stripping `-Wl,-no-undefined` in addition to `-Wl,--no-undefined`.
Both versions of the flag are accepted by clang and, therefore, used by building systems in the wild (e.g., samba will not build without this fix).
* Remove dead code in write_to_testcase (#1955)
The custom_mutators_count check in if case is duplicate with if condition.
The else case is custom_mutators_count == 0, neither custom_mutator_list iteration nor sent check needed.
Signed-off-by: Xeonacid <h.dwwwwww@gmail.com>
* update qemuafl
* WIP: Add ability to generate drcov trace using QEMU backend (#1956)
* Document new drcov QEMU plugin
* Add link to lightkeeper for QEMU drcov file loading
---------
Co-authored-by: Jean-Romain Garnier <jean-romain.garnier@airbus.com>
* code format
* changelog
* sleep on uid != 0 afl-system-config
* fix segv about skip_next, warn on unsupported cases of linking options (#1958)
* todos
* ensure afl-cc only allows available compiler modes
* update grammar mutator
* disable aslr on apple
* fix for arm64
* help selective instrumentation
* typos
* macos
* add compiler test script
* apple fixes
* bump nyx submodules (#1963)
* fix docs
* update changelog
* update grammar mutator
* improve compiler test script
* gcc asan workaround (#1966)
* fix github merge fuckup
* fix
* Fix afl-cc (#1968)
- Check if too many cmdline params here, each time before insert a new param.
- Check if it is "-fsanitize=..." before we do sth.
- Remove improper param_st transfer.
* Avoid adding llvmnative instrumentation when linking rust sanitizer runtime (#1969)
* Dynamic instrumentation filtering for LLVM native (#1971)
* Add two dynamic instrumentation filter methods to runtime
* Always use pc-table with native pcguard
* Add make_symbol_list.py and README
* changelog
* todos
* new forkserver check
* fix
* nyx test for CI
* improve nyx docs
* Fixes to afl-cc and documentation (#1974)
* Always compile with -ldl when building for CODE_COVERAGE
When building with CODE_COVERAGE, the afl runtime contains code that
calls `dladdr` which requires -ldl. Under most circumstances, clang
already adds this (e.g. when building with pc-table), but there are some
circumstances where it isn't added automatically.
* Add visibility declaration to __afl_connected
When building with hidden visibility, the use of __AFL_LOOP inside such
code can cause linker errors due to __afl_connected being declared
"hidden".
* Update docs to clarify that CODE_COVERAGE=1 is required for dynamic_covfilter
* nits
* nyx build script updates
* test error output
* debug ci
* debug ci
* Improve afl-cc (#1975)
* update response file support
- full support of rsp file
- fix some segv issues
* Improve afl-cc
- remove dead code about allow/denylist options of sancov
- missing `if (!aflcc->have_msan)`
- add docs for each function
- typo
* enable nyx
* debug ci
* debug ci
* debug ci
* debug ci
* debug ci
* debug ci
* debug ci
* debug ci
* fix ci
* clean test script
* NO_NYX
* NO_NYX
* fix ci
* debug ci
* fix ci
* finalize ci fix
* Enhancement on Deterministic stage (#1972)
* fuzzer: init commit based on aflpp 60dc37a8cf
* fuzzers: adding the skip variables and initialize
* log: profile the det/havoc finding
* log: add profile log output
* fuzzers: sperate log/skipdet module
* fuzzers: add quick eff_map calc
* fuzzers: add skip_eff_map in fuzz_one
* fuzzers: mark whole input space in eff_map
* fuzzers: add undet bit threshold to skip some seeds
* fuzzers: fix one byte overflow
* fuzzers: fix overflow
* fix code format
* add havoc only again
* code format
* remove log to INTROSPECTION, rename skipdet module
* rename skipdet module
* remove log to stats
* clean redundant code
* code format
* remove redundant code format check
* remove redundant doc
* remove redundant objects
* clean files
* change -d to default skipdet
* disable deterministic when using CUSTOM_MUTATOR
* revert fix
* final touches for skipdet
* remove unused var
* remove redundant eff struct (#1977)
* update QEMU-Nyx submodule (#1978)
* update QEMU-Nyx submodule (#1980)
* Fix type in AFL_NOOPT env variable in afl-cc help message (#1982)
* nits
* 2024 v4.10c release
* fixes
---------
Signed-off-by: Xeonacid <h.dwwwwww@gmail.com>
Co-authored-by: Sonic <50692172+SonicStark@users.noreply.github.com>
Co-authored-by: Xeonacid <h.dwwwwww@gmail.com>
Co-authored-by: Nils Bars <nils.bars@rub.de>
Co-authored-by: Jean-Romain Garnier <7504819+JRomainG@users.noreply.github.com>
Co-authored-by: Jean-Romain Garnier <jean-romain.garnier@airbus.com>
Co-authored-by: Sergej Schumilo <sergej@schumilo.de>
Co-authored-by: Christian Holler (:decoder) <choller@mozilla.com>
Co-authored-by: Han Zheng <35988108+kdsjZh@users.noreply.github.com>
Co-authored-by: Khaled Yakdan <yakdan@code-intelligence.com>
509 lines
13 KiB
C++
509 lines
13 KiB
C++
/* GCC plugin common infrastructure for AFL++ instrumentation passes.
|
|
|
|
Copyright 2014-2019 Free Software Foundation, Inc
|
|
Copyright 2015, 2016 Google Inc. All rights reserved.
|
|
Copyright 2019-2024 AdaCore
|
|
|
|
Written by Alexandre Oliva <oliva@adacore.com>, based on the AFL++
|
|
GCC plugin.
|
|
|
|
This program is free software: you can redistribute it and/or modify
|
|
it under the terms of the GNU General Public License as published by
|
|
the Free Software Foundation, either version 3 of the License, or
|
|
(at your option) any later version.
|
|
|
|
This program is distributed in the hope that it will be useful,
|
|
but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
GNU General Public License for more details.
|
|
|
|
You should have received a copy of the GNU General Public License
|
|
along with this program. If not, see <http://www.gnu.org/licenses/>.
|
|
|
|
*/
|
|
|
|
#include "../include/config.h"
|
|
#include "../include/debug.h"
|
|
|
|
#include <stdio.h>
|
|
#include <stdlib.h>
|
|
#include <unistd.h>
|
|
|
|
#ifdef likely
|
|
#undef likely
|
|
#endif
|
|
#ifdef unlikely
|
|
#undef unlikely
|
|
#endif
|
|
|
|
#include <list>
|
|
#include <string>
|
|
#include <fstream>
|
|
|
|
#include <algorithm>
|
|
#include <fnmatch.h>
|
|
|
|
#include <gcc-plugin.h>
|
|
#include <plugin-version.h>
|
|
#include <toplev.h>
|
|
#include <tree-pass.h>
|
|
#include <context.h>
|
|
#include <tree.h>
|
|
#include <gimplify.h>
|
|
#include <basic-block.h>
|
|
#include <tree-ssa-alias.h>
|
|
#include <gimple-expr.h>
|
|
#include <gimple.h>
|
|
#include <gimple-iterator.h>
|
|
#include <stringpool.h>
|
|
#include <gimple-ssa.h>
|
|
#if (__GNUC__ * 10000 + __GNUC_MINOR__ * 100 + __GNUC_PATCHLEVEL__) >= \
|
|
60200 /* >= version 6.2.0 */
|
|
#include <tree-vrp.h>
|
|
#endif
|
|
#include <tree-ssanames.h>
|
|
#include <tree-phinodes.h>
|
|
#include <ssa-iterators.h>
|
|
|
|
#include <intl.h>
|
|
|
|
namespace {
|
|
|
|
struct afl_base_pass : gimple_opt_pass {
|
|
|
|
afl_base_pass(bool quiet, bool debug, struct pass_data const &pd)
|
|
: gimple_opt_pass(pd, g), be_quiet(quiet), debug(debug) {
|
|
|
|
initInstrumentList();
|
|
|
|
}
|
|
|
|
/* Are we outputting to a non-terminal, or running with AFL_QUIET
|
|
set? */
|
|
const bool be_quiet;
|
|
|
|
/* Are we running with AFL_DEBUG set? */
|
|
const bool debug;
|
|
|
|
#define report_fatal_error(msg) BADF(msg)
|
|
|
|
std::list<std::string> allowListFiles;
|
|
std::list<std::string> allowListFunctions;
|
|
std::list<std::string> denyListFiles;
|
|
std::list<std::string> denyListFunctions;
|
|
|
|
/* Note: this ignore check is also called in isInInstrumentList() */
|
|
bool isIgnoreFunction(function *F) {
|
|
|
|
// Starting from "LLVMFuzzer" these are functions used in libfuzzer based
|
|
// fuzzing campaign installations, e.g. oss-fuzz
|
|
|
|
static constexpr const char *ignoreList[] = {
|
|
|
|
"asan.",
|
|
"llvm.",
|
|
"sancov.",
|
|
"__ubsan_",
|
|
"ign.",
|
|
"__afl_",
|
|
"_fini",
|
|
"__libc_csu",
|
|
"__asan",
|
|
"__msan",
|
|
"__cmplog",
|
|
"__sancov",
|
|
"msan.",
|
|
"LLVMFuzzerM",
|
|
"LLVMFuzzerC",
|
|
"LLVMFuzzerI",
|
|
"__decide_deferred",
|
|
"maybe_duplicate_stderr",
|
|
"discard_output",
|
|
"close_stdout",
|
|
"dup_and_close_stderr",
|
|
"maybe_close_fd_mask",
|
|
"ExecuteFilesOnyByOne"
|
|
|
|
};
|
|
|
|
const char *name = IDENTIFIER_POINTER(DECL_NAME(F->decl));
|
|
int len = IDENTIFIER_LENGTH(DECL_NAME(F->decl));
|
|
|
|
for (auto const &ignoreListFunc : ignoreList) {
|
|
|
|
if (strncmp(name, ignoreListFunc, len) == 0) { return true; }
|
|
|
|
}
|
|
|
|
return false;
|
|
|
|
}
|
|
|
|
void initInstrumentList() {
|
|
|
|
char *allowlist = getenv("AFL_GCC_ALLOWLIST");
|
|
if (!allowlist) allowlist = getenv("AFL_GCC_INSTRUMENT_FILE");
|
|
if (!allowlist) allowlist = getenv("AFL_GCC_WHITELIST");
|
|
if (!allowlist) allowlist = getenv("AFL_LLVM_ALLOWLIST");
|
|
if (!allowlist) allowlist = getenv("AFL_LLVM_INSTRUMENT_FILE");
|
|
if (!allowlist) allowlist = getenv("AFL_LLVM_WHITELIST");
|
|
char *denylist = getenv("AFL_GCC_DENYLIST");
|
|
if (!denylist) denylist = getenv("AFL_GCC_BLOCKLIST");
|
|
if (!denylist) denylist = getenv("AFL_LLVM_DENYLIST");
|
|
if (!denylist) denylist = getenv("AFL_LLVM_BLOCKLIST");
|
|
|
|
if (allowlist && denylist)
|
|
FATAL(
|
|
"You can only specify either AFL_GCC_ALLOWLIST or AFL_GCC_DENYLIST "
|
|
"but not both!");
|
|
|
|
if (allowlist) {
|
|
|
|
std::string line;
|
|
std::ifstream fileStream;
|
|
fileStream.open(allowlist);
|
|
if (!fileStream) report_fatal_error("Unable to open AFL_GCC_ALLOWLIST");
|
|
getline(fileStream, line);
|
|
|
|
while (fileStream) {
|
|
|
|
int is_file = -1;
|
|
std::size_t npos;
|
|
std::string original_line = line;
|
|
|
|
line.erase(std::remove_if(line.begin(), line.end(), ::isspace),
|
|
line.end());
|
|
|
|
// remove # and following
|
|
if ((npos = line.find("#")) != std::string::npos)
|
|
line = line.substr(0, npos);
|
|
|
|
if (line.compare(0, 4, "fun:") == 0) {
|
|
|
|
is_file = 0;
|
|
line = line.substr(4);
|
|
|
|
} else if (line.compare(0, 9, "function:") == 0) {
|
|
|
|
is_file = 0;
|
|
line = line.substr(9);
|
|
|
|
} else if (line.compare(0, 4, "src:") == 0) {
|
|
|
|
is_file = 1;
|
|
line = line.substr(4);
|
|
|
|
} else if (line.compare(0, 7, "source:") == 0) {
|
|
|
|
is_file = 1;
|
|
line = line.substr(7);
|
|
|
|
}
|
|
|
|
if (line.find(":") != std::string::npos) {
|
|
|
|
FATAL("invalid line in AFL_GCC_ALLOWLIST: %s", original_line.c_str());
|
|
|
|
}
|
|
|
|
if (line.length() > 0) {
|
|
|
|
// if the entry contains / or . it must be a file
|
|
if (is_file == -1)
|
|
if (line.find("/") != std::string::npos ||
|
|
line.find(".") != std::string::npos)
|
|
is_file = 1;
|
|
// otherwise it is a function
|
|
|
|
if (is_file == 1)
|
|
allowListFiles.push_back(line);
|
|
else
|
|
allowListFunctions.push_back(line);
|
|
|
|
}
|
|
|
|
getline(fileStream, line);
|
|
|
|
}
|
|
|
|
if (debug)
|
|
DEBUGF("loaded allowlist with %zu file and %zu function entries\n",
|
|
allowListFiles.size(), allowListFunctions.size());
|
|
|
|
}
|
|
|
|
if (denylist) {
|
|
|
|
std::string line;
|
|
std::ifstream fileStream;
|
|
fileStream.open(denylist);
|
|
if (!fileStream) report_fatal_error("Unable to open AFL_GCC_DENYLIST");
|
|
getline(fileStream, line);
|
|
|
|
while (fileStream) {
|
|
|
|
int is_file = -1;
|
|
std::size_t npos;
|
|
std::string original_line = line;
|
|
|
|
line.erase(std::remove_if(line.begin(), line.end(), ::isspace),
|
|
line.end());
|
|
|
|
// remove # and following
|
|
if ((npos = line.find("#")) != std::string::npos)
|
|
line = line.substr(0, npos);
|
|
|
|
if (line.compare(0, 4, "fun:") == 0) {
|
|
|
|
is_file = 0;
|
|
line = line.substr(4);
|
|
|
|
} else if (line.compare(0, 9, "function:") == 0) {
|
|
|
|
is_file = 0;
|
|
line = line.substr(9);
|
|
|
|
} else if (line.compare(0, 4, "src:") == 0) {
|
|
|
|
is_file = 1;
|
|
line = line.substr(4);
|
|
|
|
} else if (line.compare(0, 7, "source:") == 0) {
|
|
|
|
is_file = 1;
|
|
line = line.substr(7);
|
|
|
|
}
|
|
|
|
if (line.find(":") != std::string::npos) {
|
|
|
|
FATAL("invalid line in AFL_GCC_DENYLIST: %s", original_line.c_str());
|
|
|
|
}
|
|
|
|
if (line.length() > 0) {
|
|
|
|
// if the entry contains / or . it must be a file
|
|
if (is_file == -1)
|
|
if (line.find("/") != std::string::npos ||
|
|
line.find(".") != std::string::npos)
|
|
is_file = 1;
|
|
// otherwise it is a function
|
|
|
|
if (is_file == 1)
|
|
denyListFiles.push_back(line);
|
|
else
|
|
denyListFunctions.push_back(line);
|
|
|
|
}
|
|
|
|
getline(fileStream, line);
|
|
|
|
}
|
|
|
|
if (debug)
|
|
DEBUGF("loaded denylist with %zu file and %zu function entries\n",
|
|
denyListFiles.size(), denyListFunctions.size());
|
|
|
|
}
|
|
|
|
}
|
|
|
|
/* Returns the source file name attached to the function declaration F. If
|
|
there is no source location information, returns an empty string. */
|
|
std::string getSourceName(function *F) {
|
|
|
|
return DECL_SOURCE_FILE(F->decl) ? DECL_SOURCE_FILE(F->decl) : "";
|
|
|
|
}
|
|
|
|
bool isInInstrumentList(function *F) {
|
|
|
|
bool return_default = true;
|
|
|
|
// is this a function with code? If it is external we don't instrument it
|
|
// anyway and it can't be in the instrument file list. Or if it is it is
|
|
// ignored.
|
|
if (isIgnoreFunction(F)) return false;
|
|
|
|
if (!denyListFiles.empty() || !denyListFunctions.empty()) {
|
|
|
|
if (!denyListFunctions.empty()) {
|
|
|
|
std::string instFunction = IDENTIFIER_POINTER(DECL_NAME(F->decl));
|
|
|
|
for (std::list<std::string>::iterator it = denyListFunctions.begin();
|
|
it != denyListFunctions.end(); ++it) {
|
|
|
|
/* We don't check for filename equality here because
|
|
* filenames might actually be full paths. Instead we
|
|
* check that the actual filename ends in the filename
|
|
* specified in the list. We also allow UNIX-style pattern
|
|
* matching */
|
|
|
|
if (instFunction.length() >= it->length()) {
|
|
|
|
if (fnmatch(("*" + *it).c_str(), instFunction.c_str(), 0) == 0) {
|
|
|
|
if (debug)
|
|
DEBUGF(
|
|
"Function %s is in the deny function list, not "
|
|
"instrumenting ... \n",
|
|
instFunction.c_str());
|
|
return false;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
if (!denyListFiles.empty()) {
|
|
|
|
std::string source_file = getSourceName(F);
|
|
|
|
if (!source_file.empty()) {
|
|
|
|
for (std::list<std::string>::iterator it = denyListFiles.begin();
|
|
it != denyListFiles.end(); ++it) {
|
|
|
|
/* We don't check for filename equality here because
|
|
* filenames might actually be full paths. Instead we
|
|
* check that the actual filename ends in the filename
|
|
* specified in the list. We also allow UNIX-style pattern
|
|
* matching */
|
|
|
|
if (source_file.length() >= it->length()) {
|
|
|
|
if (fnmatch(("*" + *it).c_str(), source_file.c_str(), 0) == 0) {
|
|
|
|
return false;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
} else {
|
|
|
|
// we could not find out the location. in this case we say it is not
|
|
// in the instrument file list
|
|
if (!be_quiet)
|
|
WARNF(
|
|
"No debug information found for function %s, will be "
|
|
"instrumented (recompile with -g -O[1-3]).",
|
|
IDENTIFIER_POINTER(DECL_NAME(F->decl)));
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
// if we do not have a instrument file list return true
|
|
if (!allowListFiles.empty() || !allowListFunctions.empty()) {
|
|
|
|
return_default = false;
|
|
|
|
if (!allowListFunctions.empty()) {
|
|
|
|
std::string instFunction = IDENTIFIER_POINTER(DECL_NAME(F->decl));
|
|
|
|
for (std::list<std::string>::iterator it = allowListFunctions.begin();
|
|
it != allowListFunctions.end(); ++it) {
|
|
|
|
/* We don't check for filename equality here because
|
|
* filenames might actually be full paths. Instead we
|
|
* check that the actual filename ends in the filename
|
|
* specified in the list. We also allow UNIX-style pattern
|
|
* matching */
|
|
|
|
if (instFunction.length() >= it->length()) {
|
|
|
|
if (fnmatch(("*" + *it).c_str(), instFunction.c_str(), 0) == 0) {
|
|
|
|
if (debug)
|
|
DEBUGF(
|
|
"Function %s is in the allow function list, instrumenting "
|
|
"... \n",
|
|
instFunction.c_str());
|
|
return true;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
if (!allowListFiles.empty()) {
|
|
|
|
std::string source_file = getSourceName(F);
|
|
|
|
if (!source_file.empty()) {
|
|
|
|
for (std::list<std::string>::iterator it = allowListFiles.begin();
|
|
it != allowListFiles.end(); ++it) {
|
|
|
|
/* We don't check for filename equality here because
|
|
* filenames might actually be full paths. Instead we
|
|
* check that the actual filename ends in the filename
|
|
* specified in the list. We also allow UNIX-style pattern
|
|
* matching */
|
|
|
|
if (source_file.length() >= it->length()) {
|
|
|
|
if (fnmatch(("*" + *it).c_str(), source_file.c_str(), 0) == 0) {
|
|
|
|
if (debug)
|
|
DEBUGF(
|
|
"Function %s is in the allowlist (%s), instrumenting ... "
|
|
"\n",
|
|
IDENTIFIER_POINTER(DECL_NAME(F->decl)),
|
|
source_file.c_str());
|
|
return true;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
} else {
|
|
|
|
// we could not find out the location. In this case we say it is not
|
|
// in the instrument file list
|
|
if (!be_quiet)
|
|
WARNF(
|
|
"No debug information found for function %s, will not be "
|
|
"instrumented (recompile with -g -O[1-3]).",
|
|
IDENTIFIER_POINTER(DECL_NAME(F->decl)));
|
|
return false;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
return return_default;
|
|
|
|
}
|
|
|
|
};
|
|
|
|
} // namespace
|
|
|
|
// compatibility for older gcc versions
|
|
#if (__GNUC__ * 10000 + __GNUC_MINOR__ * 100 + __GNUC_PATCHLEVEL__) >= \
|
|
60200 /* >= version 6.2.0 */
|
|
#define gimple gimple *
|
|
#else
|
|
#define gimple gimple
|
|
#endif
|
|
|