ViewVC Help
View File | Revision Log | Show Annotations | Root Listing
root/cvsroot/UserCode/benhoob/cmsnotes/StopSearch/systematics.tex
(Generate patch)

Comparing UserCode/benhoob/cmsnotes/StopSearch/systematics.tex (file contents):
Revision 1.17 by claudioc, Fri Oct 12 02:41:46 2012 UTC vs.
Revision 1.22 by vimartin, Sat Oct 20 19:57:24 2012 UTC

# Line 14 | Line 14 | The calculation is done for each signal
14   region,
15   for electrons and muons separately.
16  
17 < The choice to normalizing to the peak region of $M_T$ has the
17 > The choice to normalize to the peak region of $M_T$ has the
18   advantage that some uncertainties, e.g., luminosity, cancel.
19   It does however introduce complications because it couples
20   some of the uncertainties in non-trivial ways.  For example,
# Line 25 | Line 25 | for example,
25   the $t\bar{t} \to$ dilepton BG estimate because it changes the
26   $t\bar{t}$ normalization to the peak region (because some of the
27   events in the peak region are from rare processes).  These effects
28 < are carefully accounted for.  The contribution to the overall
29 < uncertainty from each BG source is tabulated in
28 > are carefully accounted for. The contribution to the overall
29 > uncertainty from each background source is tabulated in
30   Section~\ref{sec:bgunc-bottomline}.
31 < First, however, we discuss the uncertainties one-by-one and we comment
31 > Here we discuss the uncertainties one-by-one and comment
32   on their impact on the overall result, at least to first order.
33   Second order effects, such as the one described, are also included.
34  
# Line 37 | Line 37 | peak regions}
37   These vary between 2\% and 20\%, depending on the signal region
38   (different
39   signal regions have different \met\ requirements, thus they also have
40 < different $M_T$ regions used as control.
40 > different $M_T$ regions used as control).
41   Since
42 < the major BG, eg, $t\bar{t}$ are normalized to the peak regions, this
42 > the major backgrounds, eg, $t\bar{t}$ are normalized to the peak regions, this
43   fractional uncertainty is pretty much carried through all the way to
44   the end.  There is also an uncertainty from the finite MC event counts
45   in the $M_T$ peak regions.  This is also included, but it is smaller.
# Line 47 | Line 47 | in the $M_T$ peak regions.  This is also
47   Normalizing to the $M_T$ peak has the distinct advantages that
48   uncertainties on luminosity, cross-sections, trigger efficiency,
49   lepton ID, cancel out.
50 < For the low statistics regions with high \met requirements, the
51 < price to pay in terms of event count statistical uncertainties starts
50 > For the low statistics regions with high \met\ requirements, the
51 > price to pay in terms of event count is that statistical uncertainties start
52   to become significant.  In the future we may consider a different
53   normalization startegy in the low statistics regions.
54  
# Line 58 | Line 58 | This choice affects the scale factors of
58   If the $M_T$ peak region is not well modelled, this would introduce an
59   uncertainty.
60  
61 < We have tested this possibility by recalculating the post veto scale factors for a different
61 > We have tested this possibility by recalculating the post-veto scale factors for a different
62   choice
63   of $M_T$ peak region ($40 < M_T < 100$ GeV instead of the default
64 < $50 < M_T < 80$ GeV.  This is shown in Table~\ref{tab:mtpeaksf2}.  
64 > $50 < M_T < 80$ GeV).  This is shown in Table~\ref{tab:mtpeaksf2}.  
65   The two results for the scale factors are very compatible.
66   We do not take any systematic uncertainty for this possible effect.
67  
# Line 111 | Line 111 | e veto \mt-SF      & $0.97 \pm 0.01$ & $
111   \end{table}
112  
113  
114 < \subsection{Uncertainty on the Wjets cross-section and the rare MC cross-sections}
114 > \subsection{Uncertainty on the \wjets\ cross-section and the rare MC cross-sections}
115   These are taken as 50\%, uncorrelated.  
116   The primary effect is to introduce a 50\%
117   uncertainty
# Line 125 | Line 125 | attributed to $t\bar{t}$ goes down, and
125   scaled to the number of $t\bar{t}$ events in the peak, the $t\bar{t}$
126   BG goes down.  
127  
128 < \subsection{Scale factors for the tail-to-peak ratios for lepton +
128 > \subsection{Tail-to-peak ratios for lepton +
129    jets top and W events}
130 < These tail-to-peak ratios are described in Section~\ref{sec:ttp}.
131 < They are studied in CR1 and CR2.  The studies are described
132 < in Sections~\ref{sec:cr1} and~\ref{sec:cr2}), respectively, where
133 < we also give the uncertainty on the scale factors.  See
134 < Tables~\ref{tab:cr1yields}
135 < and~\ref{tab:cr2yields}, scale factors $SFR_{wjet}$ and $SFR_{top})$.
130 > The tail-to-peak ratios $R_{top}$ and $R_{wjet}$ are described in Section~\ref{sec:ttp}.
131 > The data/MC scale factors are studied in CR1 and CR2 (Sections~\ref{sec:cr1} and~\ref{sec:cr2}).
132 > Only the scale factor for \wjets, $SFR_{wjet}$, is used, and its uncertainty is given in Table~\ref{tab:cr1yields}). This uncertainty affects both $R_{wjet}$ and $R_{top}$.
133 > The additional systematic uncertainty on $R_{top}$ from the variation between optimistic and pessimistic scenarios is given in Section~\ref{sec:ttp}.
134 >
135  
136   \subsection{Uncertainty on extra jet radiation for dilepton
137    background}
# Line 142 | Line 141 | $t\bar{t} \to$
141   dilepton MC is rescaled by the factors $K_3$ and $K_4$ to make
142   it agree with the data.  The 3\% uncertainties on $K_3$ and $K_4$
143   comes from data/MC statistics.  This  
144 < result directly in a 3\% uncertainty on the dilepton BG, which is by far
144 > results directly in a 3\% uncertainty on the dilepton background, which is by far
145   the most important one.
146  
147 + \subsection{Uncertainty from MC statistics}
148 + This affects mostly the \ttll\ background estimate, which is taken
149 + from
150 + Monte Carlo with appropriate correction factors.  This uncertainty
151 + is negligible in the low \met\ signal regions, and grows to about
152 + 15\% in SRG.
153 +
154  
155 < \subsection{Uncertainty on the \ttll\ Acceptance}
155 > \subsection{Uncertainty on the \ttll\ Background}
156  
157   The \ttbar\ background prediction is obtained from MC, with corrections
158   derived from control samples in data. The uncertainty associated with
159 + the \ttbar\ background is derived from the level of closure of the
160 + background prediction in CR4 (Table~\ref{tab:cr4yields}) and
161 + CR5 (Table~\ref{tab:cr5yields}). The results from these control region
162 + checks are shown in Figure~\ref{fig:ttdlunc}. The uncertainties assigned
163 + to the \ttdl\ background prediction based on these tests are
164 + 5\% (SRA), 10\% (SRB), 15\% (SRC), 25\% (SRD), 40\% (SRE-G).
165 +
166 + \begin{figure}[hbt]
167 +  \begin{center}
168 +        \includegraphics[width=0.6\linewidth]{plots/ttdilepton_uncertainty.pdf}
169 +        \caption{
170 +          \label{fig:ttdlunc}%\protect
171 +          Results of the comparison of yields in the \mt\ tail comparing the MC prediction (after
172 +          applying SFs) to data for CR4 and CR5 for all the signal
173 +          region requirements considered (A-G). The bands indicate the
174 +          systematic uncertainties assigned based on these tests,
175 +          ranging from $5\%$ for SRA to $40\%$ for SRE-G.}
176 +      \end{center}
177 + \end{figure}
178 +
179 +
180 + \subsubsection{Check of the uncertainty on the \ttll\ Acceptance}
181 +
182 + The uncertainty associated with
183   the theoretical modeling of the \ttbar\ production and decay is
184 < estimated by comparing the background predictions obtained using
184 > checked by comparing the background predictions obtained using
185   alternative MC samples. It should be noted that the full analysis is
186   performed with the alternative samples under consideration,
187   including the derivation of the various data-to-MC scale factors.
# Line 159 | Line 189 | The variations considered are
189  
190   \begin{itemize}
191   \item Top mass: The alternative values for the top mass differ
192 <  from the central value by $5~\GeV$: $m_{\mathrm{top}} = 178.5~\GeV$ and $m_{\mathrm{top}}
192 >  from the central value by $6~\GeV$: $m_{\mathrm{top}} = 178.5~\GeV$ and $m_{\mathrm{top}}
193    = 166.5~\GeV$.
194   \item Jet-parton matching scale: This corresponds to variations in the
195    scale at which the Matrix Element partons from Madgraph are matched
# Line 176 | Line 206 | The variations considered are
206    Tauola and is otherwise identical to the Powheg sample.
207    This effect was studied earlier using 7~TeV samples and found to be negligible.
208   \item The PDF uncertainty is estimated following the PDF4LHC
209 <  recommendations[CITE]. The events are reweighted using alternative
209 >  recommendations. The events are reweighted using alternative
210    PDF sets for CT10 and MSTW2008 and the uncertainties for each are derived using the
211 <  alternative eigenvector variations and the ``master equation''. In
212 <  addition, the NNPDF2.1 set with 100 replicas. The central value is
211 >  alternative eigenvector variations and the ``master equation''.
212 >  The NNPDF2.1 set with 100 replicas is also used. The central value is
213    determined from the mean and the uncertainty is derived from the
214    $1\sigma$ range. The overall uncertainty is derived from the envelope of the
215    alternative predictions and their uncertainties.
# Line 288 | Line 318 | scale up/scale down variations are incon
318   These are described below.
319  
320   The first piece of information is that the jet multiplicity in the scale
321 < up/scale down sample is the most inconsistent with the data.  This can be shown
321 > up/scale down sample is the most inconsistent with the data.  This is shown
322   in Table~\ref{tab:njetskfactors_met100}, where we tabulate the
323 < $K_3$ and $K_4$ factors of Section~\ref{tab:njetskfactors_met100} for
323 > $K_3$ and $K_4$ factors of Section~\ref{sec:jetmultiplicity} for
324   different \ttbar\ MC samples.  The data/MC disagreement in the $N_{jets}$
325   distribution
326   for the scale up/scale down samples is also shown in Fig.~\ref{fig:dileptonnjets_scaleup}
# Line 353 | Line 383 | down variations by a factor 2, we can se
383   uncertainty
384   of 6\% would fully cover all of the variations from different MC
385   samples in SRA and SRB.
386 < {\bf Thus, we take a 6\% systematic uncertainty,  constant as a
387 < function of signal region, as the systematic due to alternative MC
358 < models.}.
386 > The alternative MC models indicate that a 6\% systematic uncertainty to
387 > cover the range of reasonable variations.
388   Note that this 6\% is also consistent with the level at which we are
389 < able
390 < to test the closure of the method in CR5 for the high statistics
391 < regions
392 < (Table~\ref{tab:hugecr5yields}).
393 <
389 > able to test the closure of the method with alternative samples in CR5 for the high statistics
390 > regions (Table~\ref{tab:hugecr5yields}).
391 > The range of reasonable variations obtained with the alternative
392 > samples are consistent with the uncertainties assigned for
393 > the \ttll\ background based on the closure of the background
394 > predictions and data in CR4 and CR5.
395  
396  
397  
# Line 592 | Line 622 | a second e/$\mu$ or a one prong $\tau \t
622   $P_T > 10$ GeV in $|\eta| < 2.4$.  This fraction is about 1/3, see
623   Table~\ref{tab:trueisotrk}.
624   The uncertainty for these events
625 < is 6\% and is obtained from Tag and Probe studies of Section~\ref{sec:trkveto}
625 > is 6\% and is obtained from tag-and-probe studies, see Section~\ref{sec:trkveto}.
626  
627   \begin{table}[!h]
628   \begin{center}
# Line 641 | Line 671 | decays are well-understood, we currently
671   Second, hadronic tracks may undergo nuclear interactions and hence their tracks may not be reconstructed.
672   As discussed above, independent studies show that the MC reproduces the hadronic tracking efficiency within 4\%,
673   leading to a total background uncertainty of less than 0.5\% (after taking into account the fraction of the total background
674 < due to hadronic $\tau$ decays with \pt\ $>$ 10 GeV tracks), and we hence regard this effect as neglgigible.
674 > due to hadronic $\tau$ decays with \pt\ $>$ 10 GeV tracks), and we hence regard this effect as negligible.
675  
676   The tag-and-probe studies are performed in the full data sample, and compared with the DYJets madgraph sample.
677   All events must contain a tag-probe pair (details below) with opposite-sign and satisfying the Z mass requirement 76--106 GeV.
# Line 698 | Line 728 | The specific criteria for tags and probe
728   The absolute track isolation distributions for passing probes are displayed in Fig.~\ref{fig:tnp}. In general we observe
729   good agreement between data and MC. To be more quantitative, we compare the data vs. MC efficiencies to satisfy
730   absolute track isolation requirements varying from $>$ 1 GeV to $>$ 5 GeV, as summarized in Table~\ref{tab:isotrk}.
731 < In the $\geq$0 and $\geq$1 jet bins where the efficiencies can be tested with statistical precision, the data and MC
731 > In the $\geq 0$ and $\geq 1$ jet bins where the efficiencies can be tested with statistical precision, the data and MC
732   efficiencies agree within 6\%, and we apply this as a systematic uncertainty on the isolated track veto efficiency.
733   For the higher jet multiplicity bins the statistical precision decreases, but we do not observe any evidence for
734   a data vs. MC discrepancy in the isolated track veto efficiency.
# Line 731 | Line 761 | for events with the \njets\ requirement
761  
762   \begin{table}[!ht]
763   \begin{center}
734 \caption{\label{tab:isotrk} Comparison of the data vs. MC efficiencies to satisfy the indicated requirements
735 on the absolute track isolation, and the ratio of these two efficiencies. Results are indicated separately for electrons and muons and for various
736 jet multiplicity requirements.}
764   \begin{tabular}{l|c|c|c|c|c}
765  
766   %Electrons:
# Line 831 | Line 858 | $\mu$ + $\geq$4 jets   &           $>$ 1
858   \hline
859  
860   \end{tabular}
861 + \caption{\label{tab:isotrk} Comparison of the data vs. MC efficiencies to satisfy the indicated requirements
862 + on the absolute track isolation, and the ratio of these two efficiencies. Results are indicated separately for electrons and muons and for various
863 + jet multiplicity requirements.}
864   \end{center}
865   \end{table}
866  
867 + \clearpage
868 + \subsection{Summary of uncertainties}
869 + \label{sec:bgunc-bottomline}.
870 + \input{uncertainties_table.tex}
871  
872   %Figure.~\ref{fig:reliso} compares the relative track isolation
873   %for events with a track with $\pt > 10~\GeV$ in addition to a selected
# Line 915 | Line 949 | $\mu$ + $\geq$4 jets   &           $>$ 1
949   %      \end{center}
950   %\end{figure}
951  
952 < % \subsection{Summary of uncertainties}
919 < % \label{sec:bgunc-bottomline}.
952 >
953  
954   % THIS NEEDS TO BE WRITTEN

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines