ViewVC Help
View File | Revision Log | Show Annotations | Root Listing
root/cvsroot/UserCode/benhoob/cmsnotes/StopSearch/systematics.tex
(Generate patch)

Comparing UserCode/benhoob/cmsnotes/StopSearch/systematics.tex (file contents):
Revision 1.18 by claudioc, Fri Oct 12 04:55:23 2012 UTC vs.
Revision 1.23 by linacre, Sat Oct 20 21:21:34 2012 UTC

# Line 14 | Line 14 | The calculation is done for each signal
14   region,
15   for electrons and muons separately.
16  
17 < The choice to normalizing to the peak region of $M_T$ has the
17 > The choice to normalize to the peak region of $M_T$ has the
18   advantage that some uncertainties, e.g., luminosity, cancel.
19   It does however introduce complications because it couples
20   some of the uncertainties in non-trivial ways.  For example,
# Line 25 | Line 25 | for example,
25   the $t\bar{t} \to$ dilepton BG estimate because it changes the
26   $t\bar{t}$ normalization to the peak region (because some of the
27   events in the peak region are from rare processes).  These effects
28 < are carefully accounted for.  The contribution to the overall
29 < uncertainty from each BG source is tabulated in
28 > are carefully accounted for. The contribution to the overall
29 > uncertainty from each background source is tabulated in
30   Section~\ref{sec:bgunc-bottomline}.
31 < First, however, we discuss the uncertainties one-by-one and we comment
31 > Here we discuss the uncertainties one-by-one and comment
32   on their impact on the overall result, at least to first order.
33   Second order effects, such as the one described, are also included.
34  
# Line 37 | Line 37 | peak regions}
37   These vary between 2\% and 20\%, depending on the signal region
38   (different
39   signal regions have different \met\ requirements, thus they also have
40 < different $M_T$ regions used as control.
40 > different $M_T$ regions used as control).
41   Since
42 < the major BG, eg, $t\bar{t}$ are normalized to the peak regions, this
42 > the major backgrounds, eg, $t\bar{t}$ are normalized to the peak regions, this
43   fractional uncertainty is pretty much carried through all the way to
44   the end.  There is also an uncertainty from the finite MC event counts
45   in the $M_T$ peak regions.  This is also included, but it is smaller.
# Line 47 | Line 47 | in the $M_T$ peak regions.  This is also
47   Normalizing to the $M_T$ peak has the distinct advantages that
48   uncertainties on luminosity, cross-sections, trigger efficiency,
49   lepton ID, cancel out.
50 < For the low statistics regions with high \met requirements, the
51 < price to pay in terms of event count statistical uncertainties starts
50 > For the low statistics regions with high \met\ requirements, the
51 > price to pay in terms of event count is that statistical uncertainties start
52   to become significant.  In the future we may consider a different
53   normalization startegy in the low statistics regions.
54  
# Line 58 | Line 58 | This choice affects the scale factors of
58   If the $M_T$ peak region is not well modelled, this would introduce an
59   uncertainty.
60  
61 < We have tested this possibility by recalculating the post veto scale factors for a different
61 > We have tested this possibility by recalculating the post-veto scale factors for a different
62   choice
63   of $M_T$ peak region ($40 < M_T < 100$ GeV instead of the default
64 < $50 < M_T < 80$ GeV.  This is shown in Table~\ref{tab:mtpeaksf2}.  
64 > $50 < M_T < 80$ GeV).  This is shown in Table~\ref{tab:mtpeaksf2}.  
65   The two results for the scale factors are very compatible.
66   We do not take any systematic uncertainty for this possible effect.
67  
# Line 111 | Line 111 | e veto \mt-SF      & $0.97 \pm 0.01$ & $
111   \end{table}
112  
113  
114 < \subsection{Uncertainty on the Wjets cross-section and the rare MC cross-sections}
114 > \subsection{Uncertainty on the \wjets\ cross-section and the rare MC cross-sections}
115   These are taken as 50\%, uncorrelated.  
116   The primary effect is to introduce a 50\%
117   uncertainty
# Line 125 | Line 125 | attributed to $t\bar{t}$ goes down, and
125   scaled to the number of $t\bar{t}$ events in the peak, the $t\bar{t}$
126   BG goes down.  
127  
128 < \subsection{Scale factors for the tail-to-peak ratios for lepton +
128 > \subsection{Tail-to-peak ratios for lepton +
129    jets top and W events}
130 < These tail-to-peak ratios are described in Section~\ref{sec:ttp}.
131 < They are studied in CR1 and CR2.  The studies are described
132 < in Sections~\ref{sec:cr1} and~\ref{sec:cr2}), respectively, where
133 < we also give the uncertainty on the scale factors.  See
134 < Tables~\ref{tab:cr1yields}
135 < and~\ref{tab:cr2yields}, scale factors $SFR_{wjet}$ and $SFR_{top})$.
130 > The tail-to-peak ratios $R_{top}$ and $R_{wjet}$ are described in Section~\ref{sec:ttp}.
131 > The data/MC scale factors are studied in CR1 and CR2 (Sections~\ref{sec:cr1} and~\ref{sec:cr2}).
132 > Only the scale factor for \wjets, $SFR_{wjet}$, is used, and its uncertainty is given in Table~\ref{tab:cr1yields}). This uncertainty affects both $R_{wjet}$ and $R_{top}$.
133 > The additional systematic uncertainty on $R_{top}$ from the variation between optimistic and pessimistic scenarios is given in Section~\ref{sec:ttp}.
134 >
135  
136   \subsection{Uncertainty on extra jet radiation for dilepton
137    background}
# Line 142 | Line 141 | $t\bar{t} \to$
141   dilepton MC is rescaled by the factors $K_3$ and $K_4$ to make
142   it agree with the data.  The 3\% uncertainties on $K_3$ and $K_4$
143   comes from data/MC statistics.  This  
144 < result directly in a 3\% uncertainty on the dilepton BG, which is by far
144 > results directly in a 3\% uncertainty on the dilepton background, which is by far
145   the most important one.
146  
147   \subsection{Uncertainty from MC statistics}
# Line 153 | Line 152 | is negligible in the low \met\ signal re
152   15\% in SRG.
153  
154  
155 < \subsection{Uncertainty on the \ttll\ Acceptance}
156 <
155 > \subsection{Uncertainty on the \ttll\ Background}
156 > \label{sec:ttdilbkgunc}
157   The \ttbar\ background prediction is obtained from MC, with corrections
158   derived from control samples in data. The uncertainty associated with
159 < the theoretical modeling of the \ttbar\ production and decay is
160 < estimated by comparing the background predictions obtained using
159 > the \ttbar\ background is derived from the level of closure of the
160 > background prediction in CR4 (Table~\ref{tab:cr4yields}) and
161 > CR5 (Table~\ref{tab:cr5yields}). The results from these control region
162 > checks are shown in Figure~\ref{fig:ttdlunc}. The uncertainties assigned
163 > to the \ttdl\ background prediction based on these tests are
164 > 5\% (SRA), 10\% (SRB), 15\% (SRC), 25\% (SRD), 40\% (SRE-G).
165 >
166 > \begin{figure}[hbt]
167 >  \begin{center}
168 >        \includegraphics[width=0.6\linewidth]{plots/ttdilepton_uncertainty.pdf}
169 >        \caption{
170 >          \label{fig:ttdlunc}%\protect
171 >          Results of the comparison of yields in the \mt\ tail comparing the MC prediction (after
172 >          applying SFs) to data for CR4 and CR5 for all the signal
173 >          region requirements considered (A-G). The bands indicate the
174 >          systematic uncertainties assigned based on these tests,
175 >          ranging from $5\%$ for SRA to $40\%$ for SRE-G.}
176 >      \end{center}
177 > \end{figure}
178 >
179 >
180 > \subsubsection{Check of the uncertainty on the \ttll\ Background}
181 >
182 > We check that the systematic uncertainty assigned to the \ttll\ background prediction
183 > covers the uncertainty associated with
184 > the theoretical modeling of the \ttbar\ production and decay
185 > by comparing the background predictions obtained using
186   alternative MC samples. It should be noted that the full analysis is
187   performed with the alternative samples under consideration,
188   including the derivation of the various data-to-MC scale factors.
# Line 166 | Line 190 | The variations considered are
190  
191   \begin{itemize}
192   \item Top mass: The alternative values for the top mass differ
193 <  from the central value by $5~\GeV$: $m_{\mathrm{top}} = 178.5~\GeV$ and $m_{\mathrm{top}}
193 >  from the central value by $6~\GeV$: $m_{\mathrm{top}} = 178.5~\GeV$ and $m_{\mathrm{top}}
194    = 166.5~\GeV$.
195   \item Jet-parton matching scale: This corresponds to variations in the
196    scale at which the Matrix Element partons from Madgraph are matched
# Line 183 | Line 207 | The variations considered are
207    Tauola and is otherwise identical to the Powheg sample.
208    This effect was studied earlier using 7~TeV samples and found to be negligible.
209   \item The PDF uncertainty is estimated following the PDF4LHC
210 <  recommendations[CITE]. The events are reweighted using alternative
210 >  recommendations. The events are reweighted using alternative
211    PDF sets for CT10 and MSTW2008 and the uncertainties for each are derived using the
212 <  alternative eigenvector variations and the ``master equation''. In
213 <  addition, the NNPDF2.1 set with 100 replicas. The central value is
212 >  alternative eigenvector variations and the ``master equation''.
213 >  The NNPDF2.1 set with 100 replicas is also used. The central value is
214    determined from the mean and the uncertainty is derived from the
215    $1\sigma$ range. The overall uncertainty is derived from the envelope of the
216    alternative predictions and their uncertainties.
# Line 254 | Line 278 | on this Figure.
278    statistics.    
279   \item Within the limited statistics, there is no evidence that the
280    situation changes as we go from signal region A to signal region E.
281 < Therefore, we assess a systematic based on the relatively high
282 < statistics
283 < test in signal region A, and apply the same systematic uncertainty
284 < to all other regions.
281 > %Therefore, we assess a systematic based on the relatively high
282 > %statistics
283 > %test in signal region A, and apply the same systematic uncertainty
284 > %to all other regions.
285 > \item In signal regions B and above, the uncertainties assigned in Section~\ref{sec:ttdilbkgunc}
286 > fully cover the alternative MC variations.
287   \item In order to fully (as opposed as 1$\sigma$) cover the
288   alternative MC variations in region A we would have to take a
289   systematic
290 < uncertainty of $\approx 10\%$.  This would be driven by the
290 > uncertainty of $\approx 10\%$ instead of $5\%$.  This would be driven by the
291   scale up/scale down variations, see Table~\ref{tab:fracdiff}.
292   \end{itemize}
293  
# Line 295 | Line 321 | scale up/scale down variations are incon
321   These are described below.
322  
323   The first piece of information is that the jet multiplicity in the scale
324 < up/scale down sample is the most inconsistent with the data.  This can be shown
324 > up/scale down sample is the most inconsistent with the data.  This is shown
325   in Table~\ref{tab:njetskfactors_met100}, where we tabulate the
326 < $K_3$ and $K_4$ factors of Section~\ref{tab:njetskfactors_met100} for
326 > $K_3$ and $K_4$ factors of Section~\ref{sec:jetmultiplicity} for
327   different \ttbar\ MC samples.  The data/MC disagreement in the $N_{jets}$
328   distribution
329   for the scale up/scale down samples is also shown in Fig.~\ref{fig:dileptonnjets_scaleup}
# Line 358 | Line 384 | Then, going back to Table~\ref{tab:fracd
384   up/scale
385   down variations by a factor 2, we can see that a systematic
386   uncertainty
387 < of 6\% would fully cover all of the variations from different MC
388 < samples in SRA and SRB.
389 < {\bf Thus, we take a 6\% systematic uncertainty,  constant as a
390 < function of signal region, as the systematic due to alternative MC
391 < models.}.
392 < Note that this 6\% is also consistent with the level at which we are
393 < able
394 < to test the closure of the method in CR5 for the high statistics
395 < regions
396 < (Table~\ref{tab:hugecr5yields}).
397 <
387 > of 5\% covers the range of reasonable variations from different MC
388 > models in SRA and SRB.
389 > %The alternative MC models indicate that a 6\% systematic uncertainty
390 > %covers the range of reasonable variations.
391 > Note that this 5\% is also consistent with the level at which we are
392 > able to test the closure of the method with alternative samples in CR5 for the high statistics
393 > regions (Table~\ref{tab:hugecr5yields}).
394 > The range of reasonable variations obtained with the alternative
395 > samples are consistent with the uncertainties assigned for
396 > the \ttll\ background based on the closure of the background
397 > predictions and data in CR4 and CR5.
398  
399  
400  
# Line 599 | Line 625 | a second e/$\mu$ or a one prong $\tau \t
625   $P_T > 10$ GeV in $|\eta| < 2.4$.  This fraction is about 1/3, see
626   Table~\ref{tab:trueisotrk}.
627   The uncertainty for these events
628 < is 6\% and is obtained from Tag and Probe studies of Section~\ref{sec:trkveto}
628 > is 6\% and is obtained from tag-and-probe studies, see Section~\ref{sec:trkveto}.
629  
630   \begin{table}[!h]
631   \begin{center}
# Line 648 | Line 674 | decays are well-understood, we currently
674   Second, hadronic tracks may undergo nuclear interactions and hence their tracks may not be reconstructed.
675   As discussed above, independent studies show that the MC reproduces the hadronic tracking efficiency within 4\%,
676   leading to a total background uncertainty of less than 0.5\% (after taking into account the fraction of the total background
677 < due to hadronic $\tau$ decays with \pt\ $>$ 10 GeV tracks), and we hence regard this effect as neglgigible.
677 > due to hadronic $\tau$ decays with \pt\ $>$ 10 GeV tracks), and we hence regard this effect as negligible.
678  
679   The tag-and-probe studies are performed in the full data sample, and compared with the DYJets madgraph sample.
680   All events must contain a tag-probe pair (details below) with opposite-sign and satisfying the Z mass requirement 76--106 GeV.
# Line 705 | Line 731 | The specific criteria for tags and probe
731   The absolute track isolation distributions for passing probes are displayed in Fig.~\ref{fig:tnp}. In general we observe
732   good agreement between data and MC. To be more quantitative, we compare the data vs. MC efficiencies to satisfy
733   absolute track isolation requirements varying from $>$ 1 GeV to $>$ 5 GeV, as summarized in Table~\ref{tab:isotrk}.
734 < In the $\geq$0 and $\geq$1 jet bins where the efficiencies can be tested with statistical precision, the data and MC
734 > In the $\geq 0$ and $\geq 1$ jet bins where the efficiencies can be tested with statistical precision, the data and MC
735   efficiencies agree within 6\%, and we apply this as a systematic uncertainty on the isolated track veto efficiency.
736   For the higher jet multiplicity bins the statistical precision decreases, but we do not observe any evidence for
737   a data vs. MC discrepancy in the isolated track veto efficiency.
# Line 738 | Line 764 | for events with the \njets\ requirement
764  
765   \begin{table}[!ht]
766   \begin{center}
741 \caption{\label{tab:isotrk} Comparison of the data vs. MC efficiencies to satisfy the indicated requirements
742 on the absolute track isolation, and the ratio of these two efficiencies. Results are indicated separately for electrons and muons and for various
743 jet multiplicity requirements.}
767   \begin{tabular}{l|c|c|c|c|c}
768  
769   %Electrons:
# Line 838 | Line 861 | $\mu$ + $\geq$4 jets   &           $>$ 1
861   \hline
862  
863   \end{tabular}
864 + \caption{\label{tab:isotrk} Comparison of the data vs. MC efficiencies to satisfy the indicated requirements
865 + on the absolute track isolation, and the ratio of these two efficiencies. Results are indicated separately for electrons and muons and for various
866 + jet multiplicity requirements.}
867   \end{center}
868   \end{table}
869  
870 + \clearpage
871 + \subsection{Summary of uncertainties}
872 + \label{sec:bgunc-bottomline}.
873 + \input{uncertainties_table.tex}
874  
875   %Figure.~\ref{fig:reliso} compares the relative track isolation
876   %for events with a track with $\pt > 10~\GeV$ in addition to a selected
# Line 922 | Line 952 | $\mu$ + $\geq$4 jets   &           $>$ 1
952   %      \end{center}
953   %\end{figure}
954  
955 < % \subsection{Summary of uncertainties}
926 < % \label{sec:bgunc-bottomline}.
955 >
956  
957   % THIS NEEDS TO BE WRITTEN

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines