updating report to include mention of utils for which information gathering could not be fully completed

Author: riesentoaster

report/report.pdf

@@ -291,7 +291,7 @@ \subsection{Gathered Metrics}
               \item The total number of errors
           \end{itemize}
     \item Instruction and branch coverage\footnote{KLEE includes library code in its coverage numbers and thus reports significantly lower coverage than \lstinline{gcov}.} as reported by KLEE\footnote{KLEE reports a number of additional metrics such as time spent in the solver, number of instructions analyzed, and number of cache hits, but these were not examined further in this paper.}
-    \item Coverage as measured by \lstinline{gcov}
+    \item Coverage as measured by \lstinline{gcov} for all except three utils: \lstinline{[}, \lstinline{ginstall}, and \lstinline{md5sum} did not produce a \lstinline{.gcno} file, preventing coverage gathering.
 \end{itemize}
 \section{Comparing Experiments Results to the Original Paper}
 \label{Results}
@@ -505,6 +505,14 @@ \subsection{Differences in Test Setup}
     \item Finally, the optimization flags for the LLVM bytecode generation step needed to be changed. According to the documentation, while just using \lstinline{-O0} by itself is fine for LLVM 3.4 (which is what is used for coreutils 6.10), this is no longer recommended for more recent versions.\cite{KLEETutorial, KLEEIssue} However, I could not get the compiler to build coreutils 8.25 using the suggested solution of \lstinline{-O1 -Xclang -disable-llvm-passes}. Specifically, I had to remove the \lstinline{-Xclang} argument to get the build to complete successfully.
 \end{itemize}
 
+Despite all adjustments as described above, certain measurements could not be made:
+\begin{itemize}
+    \item \lstinline{hostname} and \lstinline{setuidgid} do not seem to exist anymore in coreutils 8.25 and 9.4, so no measurements could be performed on them.
+    \item \lstinline{base64} did not produce a \lstinline{.gcno} file on coreutils 8.25 and 9.4, thus making coverage information according to \lstinline{gcov} unavailable.
+    \item \lstinline{cksum} and \lstinline{sum} did not produce \lstinline{.gcno} files in coreutils 9.4.
+    \item \lstinline{wc} did not produce coverage based on \lstinline{gcov} in coreutils 9.4 for an unspecified reason.
+\end{itemize}
+
 \subsection{Findings}
 
 I chose a fixed timeout of 60 minutes as a constant to compare the different versions of coreutils. I then performed three runs on each additional version.