ViewVC Help
View File | Revision Log | Show Annotations | Root Listing
root/cvsroot/UserCode/claudioc/OSNote2010/datadriven.tex
Revision: 1.5
Committed: Tue Nov 2 22:04:41 2010 UTC (14 years, 6 months ago) by dbarge
Content type: application/x-tex
Branch: MAIN
Changes since 1.4: +10 -11 lines
Log Message:
p 4,6 updated

File Contents

# Content
1 \section{Data Driven Background Estimation Methods}
2 \label{sec:datadriven}
3 We have developed two data-driven methods to
4 estimate the background in the signal region.
5 The first one explouts the fact that
6 \met and \met$/\sqrt{\rm SumJetPt}$ are nearly
7 uncorrelated for the $t\bar{t}$ background
8 (Section~\ref{sec:abcd}); the second one
9 is based on the fact that in $t\bar{t}$ the
10 $P_T$ of the dilepton pair is on average
11 nearly the same as the $P_T$ of the pair of neutrinos
12 from $W$-decays, which is reconstructed as \met in the
13 detector.
14
15 In 30 pb$^{-1}$ we expect $\approx$ 1 SM event in
16 the signal region. The expectations from the LMO
17 and LM1 SUSY benchmark points are 5.6 and
18 2.2 events respectively. {\color{red} I took these
19 numbers from the twiki, rescaling from 11.06 to 30/pb.
20 They seem too large...are they really right?}
21
22
23 \subsection{ABCD method}
24 \label{sec:abcd}
25
26 We find that in $t\bar{t}$ events \met and
27 \met$/\sqrt{\rm SumJetPt}$ are nearly uncorrelated.
28 This is demonstrated in Figure~\ref{fig:uncor}.
29 Thus, we can use an ABCD method in the \met$/\sqrt{\rm SumJetPt}$ vs
30 sumJetPt plane to estimate the background in a data driven way.
31
32 \begin{figure}[tb]
33 \begin{center}
34 \includegraphics[width=0.75\linewidth]{uncorrelated.pdf}
35 \caption{\label{fig:uncor}\protect Distributions of SumJetPt
36 in MC $t\bar{t}$ events for different intervals of
37 MET$/\sqrt{\rm SumJetPt}$.}
38 \end{center}
39 \end{figure}
40
41 \begin{figure}[bt]
42 \begin{center}
43 \includegraphics[width=0.5\linewidth, angle=90]{abcdMC.pdf}
44 \caption{\label{fig:abcdMC}\protect Distributions of SumJetPt
45 vs. MET$/\sqrt{\rm SumJetPt}$ for SM Monte Carlo. Here we also
46 show our choice of ABCD regions.}
47 \end{center}
48 \end{figure}
49
50
51 Our choice of ABCD regions is shown in Figure~\ref{fig:abcdMC}.
52 The signal region is region D. The expected number of events
53 in the four regions for the SM Monte Carlo, as well as the BG
54 prediction AC/B are given in Table~\ref{tab:abcdMC} for an integrated
55 luminosity of 30 pb$^{-1}$. The ABCD method is accurate
56 to about 10\%. {\color{red} Avi wants some statement about stability
57 wrt changes in regions. I am not sure that we have done it and
58 I am not sure it is necessary (Claudio).}
59
60 \begin{table}[htb]
61 \begin{center}
62 \caption{\label{tab:abcdMC} Expected SM Monte Carlo yields for
63 30 pb$^{-1}$ in the ABCD regions.}
64 \begin{tabular}{|l|c|c|c|c||c|}
65 \hline
66 Sample & A & B & C & D & AC/D \\ \hline
67 ttdil & 6.9 & 28.6 & 4.2 & 1.0 & 1.0 \\
68 Zjets & 0.0 & 1.3 & 0.1 & 0.1 & 0.0 \\
69 Other SM & 0.5 & 2.0 & 0.1 & 0.1 & 0.0 \\ \hline
70 total MC & 7.4 & 31.9 & 4.4 & 1.2 & 1.0 \\ \hline
71 \end{tabular}
72 \end{center}
73 \end{table}
74
75 \subsection{Dilepton $P_T$ method}
76 \label{sec:victory}
77 This method is based on a suggestion by V. Pavlunin\cite{ref:victory},
78 and was investigated by our group in 2009\cite{ref:ourvictory}.
79 The idea is that in dilepton $t\bar{t}$ events the lepton and neutrinos
80 from $W$ decays have the same $P_T$ spectrum (modulo $W$ polarization
81 effects). One can then use the observed
82 $P_T(\ell\ell)$ distribution to model the sum of neutrino $P_T$'s which
83 is identified with the \met.
84
85 Then, in order to predict the $t\bar{t} \to$ dilepton contribution to a
86 selection with \met$+$X, one applies a cut on $P_T(\ell\ell)+$X instead.
87 In practice one has to rescale the result of the $P_T(\ell\ell)+$X selection
88 to account for the fact that any dilepton selection must include a
89 moderate \met cut in order to reduce Drell Yan backgrounds. This
90 is discussed in Section 5.3 of Reference~\cite{ref:ourvictory}; for a \met
91 cut of 50 GeV, the rescaling factor is obtained from the data as
92
93 \newcommand{\ptll} {\ensuremath{P_T(\ell\ell)}}
94 \begin{center}
95 $ K = \frac{\int_0^{\infty} {\cal N}(\ptll)~~d\ptll~}{\int_{50}^{\infty} {\cal N}(\ptll)~~d\ptll~}$
96 \end{center}
97
98
99 Monte Carlo studies give values of $K$ that are typically between 1.5 and 1.6,
100 depending on selection details.
101
102 There are several effects that spoil the correspondance between \met and
103 $P_T(\ell\ell)$:
104 \begin{itemize}
105 \item $Ws$ in top events are polarized. Neutrinos are emitted preferentially
106 forward in the $W$ rest frame, thus the $P_T(\nu\nu)$ distribution is harder
107 than the $P_T(\ell\ell)$ distribution for top dilepton events.
108 \item The lepton selections results in $P_T$ and $\eta$ cuts on the individual
109 leptons that have no simple correspondance to the neutrino requirements.
110 \item Similarly, the \met$>$50 GeV cut introduces an asymmetry between leptons and
111 neutrinos which is only partially compensated by the $K$ factor above.
112 \item The \met resolution is much worse than the dilepton $P_T$ resolution.
113 When convoluted with a falling spectrum in the tails of \met, this result
114 in a harder spectrum for \met than the original $P_T(\nu\nu)$.
115 \item The \met response in CMS is not exactly 1. This causes a distortion
116 in the \met distribution that is not present in the $P_T(\ell\ell)$ distribution.
117 \item The $t\bar{t} \to$ dilepton signal includes contributions from
118 $W \to \tau \to \ell$. For these events the arguments about the equivalence
119 of $P_T(\ell\ell)$ and $P_T(\nu\nu)$ do not apply.
120 \item A dilepton selection will include SM events from non $t\bar{t}$
121 sources. These events can affect the background prediction. Particularly
122 dangerous are high $P_T$ Drell Yan events that barely pass the \met$>$ 50
123 GeV selection. They will tend to push the data-driven background prediction up.
124 \end{itemize}
125
126 We have studied these effects in SM Monte Carlo, using a mixture of generator and
127 reconstruction level studies, putting the various effects in one at a time.
128 For each configuration, we apply the data-driven method and report as figure
129 of merit the ratio of observed and predicted events in the signal region.
130 The results are summarized in Table~\ref{tab:victorybad}.
131
132 \begin{table}[htb]
133 \begin{center}
134 \caption{\label{tab:victorybad} Test of the data driven method in Monte Carlo
135 under different assumptions. See text for details.}
136 \begin{tabular}{|l|c|c|c|c|c|c|c|}
137 \hline
138 & True $t\bar{t}$ dilepton & $t\to W\to\tau$& other SM & GEN or & Z Veto, Lepton $P_T$ & \met $>$ 50& obs/pred \\
139 & included & included & included & RECOSIM & and $\eta$ cuts & & \\ \hline
140 1&Y & N & N & GEN & N & N & 2.16 \\
141 2&Y & N & N & GEN & Y & N & 1.48 \\
142 3&Y & N & N & GEN & Y & Y & 1.52 \\
143 4&Y & N & N & RECOSIM & Y & Y & 1.51 \\
144 5&Y & Y & N & RECOSIM & Y & Y & 1.58 \\
145 6&Y & Y & Y & RECOSIM & Y & Y & 1.18 \\
146 \hline
147 \end{tabular}
148 \end{center}
149 \end{table}
150
151
152 The largest discrepancy between prediction and observation occurs on the first
153 line of Table~\ref{tab:victorybad}, {\em i.e.}, at the generator level with no
154 cuts. We have verified that this effect is due to the polarization of
155 the $W$ (we remove the polarization by reweighting the events and we get
156 good agreement between prediction and observation). The kinematical
157 requirements (lines 2 and 3) do not have a significant additional effect.
158 Going from GEN to RECOSIM there is a significant change in observed/predicted.
159 We have tracked this down to the fact that tcMET underestimates the true \met
160 by $\approx 4\%$\footnote{We find that observed/predicted changes by roughly 0.1
161 for each 1.5\% change in \met response.}. Finally, contamination from non $t\bar{t}$
162 events can have a significant impact on the BG prediction. The changes between
163 lines 5 and 6 of Table~\ref{tab:victorybad} is driven by only {\color{red} 3}
164 Drell Yan events that pass the \met selection.
165
166 An additional source of concern is that the CMS Madgraph $t\bar{t}$ MC does
167 not include effects of spin correlations between the two top quarks.
168 We have studied this effect at the generator level using Alpgen. We find
169 that the bias is a the few percent level.
170
171 Based on the results of Table~\ref{tab:victorybad}, we conclude that the
172 naive data driven background estimate based on $P_T{\ell\ell)}$ needs to
173 be corrected by a factor of {\color{red} $1.4 \pm 0.3$ (We need to
174 decide what this number should be)}. The quoted
175 uncertainty is based on the stability of the Monte Carlo tests under
176 variations of event selections, choices of \met algorithm, etc.
177
178
179 \subsection{Signal Contamination}
180 \label{sec:sigcont}
181
182 All data-driven methods are principle subject to signal contaminations
183 in the control regions, and the methods described in
184 Sections~\ref{sec:abcd} and~\ref{sec:victory} are not exceptions.
185 Signal contamination tends to dilute the significance of a signal
186 present in the data by inflating the background prediction.
187
188 It is hard to quantify how important these effects are because we
189 do not know what signal may be hiding in the data. Having two
190 independent methods (in addition to Monte Carlo ``dead-reckoning'')
191 adds redundancy because signal contamination can have different effects
192 in the different control regions for the two methods.
193 For example, in the extreme case of a
194 new physics signal
195 with $P_T(\ell \ell) = \met$, an excess of ev ents would be seen
196 in the ABCD method but not in the $P_T(\ell \ell)$ method.
197
198
199 The LM points are benchmarks for SUSY analyses at CMS. The effects
200 of signal contaminations for a couple such points are summarized
201 in Table~\ref{tab:sigcontABCD} and~\ref{tab:sigcontPT}.
202 Signal contamination is definitely an important
203 effect for these two LM points, but it does not totally hide the
204 presence of the signal.
205
206
207 \begin{table}[htb]
208 \begin{center}
209 \caption{\label{tab:sigcontABCD} Effects of signal contamination
210 for the background predictions of the ABCD method including LM0 or
211 LM1. Results
212 are normalized to 30 pb$^{-1}$.}
213 \begin{tabular}{|c||c|c||c|c|}
214 \hline
215 SM & LM0 & BG Prediction & LM1 & BG Prediction \\
216 Background & Contribution& Including LM0 & Contribution & Including LM1 \\ \hline
217 x & x & x & x & x \\
218 \hline
219 \end{tabular}
220 \end{center}
221 \end{table}
222
223 \begin{table}[htb]
224 \begin{center}
225 \caption{\label{tab:sigcontPT} Effects of signal contamination
226 for the background predictions of the $P_T(\ell\ell)$ method including LM0 or
227 LM1. Results
228 are normalized to 30 pb$^{-1}$.}
229 \begin{tabular}{|c||c|c||c|c|}
230 \hline
231 SM & LM0 & BG Prediction & LM1 & BG Prediction \\
232 Background & Contribution& Including LM0 & Contribution & Including LM1 \\ \hline
233 x & x & x & x & x \\
234 \hline
235 \end{tabular}
236 \end{center}
237 \end{table}
238