\documentstyle[a4wide,11pt]{article}
\newcommand{\ul}[1]{\underline{#1}}
\begin{document}
\begin{center}
\if_cs1  {\Large CS1 Automatic Testing System: Examples Of Output}
\if_ise1 {\Large ISE1 Automatic Testing System: Examples Of Output}
\if_jmc1 {\Large JMC1 Automatic Testing System: Examples Of Output}
\end{center}
The automatic testing system assists Personal Programming Tutors (PPTs)
with marking of laboratory exercises. It is run overnight at midnight on
the due date of each exercise, so that PPTs have an e-mail test report on their
students' submissions when they arrive the next morning.
\\
\\
For full details on the organisational structure of the labs consult the
main
\if_cs1  CS1
\if_ise1 ISE1
\if_jmc1 JMC1
lab document giving the general background and description of the labs.


\section*{The autotest runs}
These consist of two messages.


\subsection*{Message 1 of 2}
The first message provides a background to the student reports. It contains:

\begin{itemize}
\item
A quick summary of the students' performance in the form of
a score relative to the sample answer (1 for same, 0 for differences, for each
run; added up over all the runs).
This score in no way binds PPTs when marking, and the assessment of
style, readability, design, technical competence of code and similar factors
remains very much a human process.

\item
An explanation of the test cases tried out as input data on the runs.
These test cases are given as input to both the lab sample answer and the
student submissions.

\item
A test report on the sample answer showing its output for each test case.
\end{itemize}


\subsection*{Message 2 of 2}
The second message contains the student test reports themselves. Each report
contains:

\begin{itemize}
\item
A summary of the scores obtained in the various test environments in which
the runs are carried out.

\item
A listing of the student's source code.

\item
A display of any runs that {\em disagreed} with the sample answer.
Runs which agreed are omitted to save space. PPTs do not have to base their
marks solely on which runs agreed or disagreed; they can take other
factors into account as mentioned above.
\end{itemize}


\section*{The example output provided}
The example output consists of two exercises, each with a message 1 and 2,
i.e. four messages altogether. It should be read in the context of the
lab exercise specs and (also available in advance to PPTs) the sample
solutions.


\end{document}