ViewVC Help
View File | Revision Log | Show Annotations | Root Listing
root/cvsroot/UserCode/claudioc/OSNote2010/datadriven.tex
Revision: 1.22
Committed: Mon Nov 15 10:07:57 2010 UTC (14 years, 5 months ago) by benhoob
Content type: application/x-tex
Branch: MAIN
Changes since 1.21: +6 -6 lines
Log Message:
Minor updates

File Contents

# User Rev Content
1 claudioc 1.1 \section{Data Driven Background Estimation Methods}
2     \label{sec:datadriven}
3     We have developed two data-driven methods to
4     estimate the background in the signal region.
5 benhoob 1.10 The first one exploits the fact that
6 benhoob 1.22 SumJetPt and \met$/\sqrt{\rm SumJetPt}$ are nearly
7 claudioc 1.1 uncorrelated for the $t\bar{t}$ background
8     (Section~\ref{sec:abcd}); the second one
9     is based on the fact that in $t\bar{t}$ the
10     $P_T$ of the dilepton pair is on average
11     nearly the same as the $P_T$ of the pair of neutrinos
12     from $W$-decays, which is reconstructed as \met in the
13     detector.
14    
15 benhoob 1.15
16 claudioc 1.6 %{\color{red} I took these
17     %numbers from the twiki, rescaling from 11.06 to 30/pb.
18     %They seem too large...are they really right?}
19 claudioc 1.1
20    
21     \subsection{ABCD method}
22     \label{sec:abcd}
23    
24 benhoob 1.22 We find that in $t\bar{t}$ events SumJetPt and
25 benhoob 1.16 \met$/\sqrt{\rm SumJetPt}$ are nearly uncorrelated,
26     as demonstrated in Figure~\ref{fig:uncor}.
27 claudioc 1.1 Thus, we can use an ABCD method in the \met$/\sqrt{\rm SumJetPt}$ vs
28     sumJetPt plane to estimate the background in a data driven way.
29    
30 claudioc 1.21 \begin{figure}[bht]
31 claudioc 1.1 \begin{center}
32     \includegraphics[width=0.75\linewidth]{uncorrelated.pdf}
33     \caption{\label{fig:uncor}\protect Distributions of SumJetPt
34     in MC $t\bar{t}$ events for different intervals of
35     MET$/\sqrt{\rm SumJetPt}$.}
36     \end{center}
37     \end{figure}
38    
39 claudioc 1.21 \begin{figure}[tb]
40 claudioc 1.1 \begin{center}
41 claudioc 1.3 \includegraphics[width=0.5\linewidth, angle=90]{abcdMC.pdf}
42 benhoob 1.22 \caption{\label{fig:abcdMC}\protect Distributions of MET$/\sqrt{\rm SumJetPt}$ vs.
43     SumJetPt for SM Monte Carlo. Here we also show our choice of ABCD regions.}
44 claudioc 1.1 \end{center}
45     \end{figure}
46    
47    
48     Our choice of ABCD regions is shown in Figure~\ref{fig:abcdMC}.
49     The signal region is region D. The expected number of events
50     in the four regions for the SM Monte Carlo, as well as the BG
51 claudioc 1.2 prediction AC/B are given in Table~\ref{tab:abcdMC} for an integrated
52 benhoob 1.12 luminosity of 35 pb$^{-1}$. The ABCD method is accurate
53     to about 20\%.
54 claudioc 1.9 %{\color{red} Avi wants some statement about stability
55     %wrt changes in regions. I am not sure that we have done it and
56     %I am not sure it is necessary (Claudio).}
57 claudioc 1.1
58 claudioc 1.21 \begin{table}[ht]
59 claudioc 1.1 \begin{center}
60     \caption{\label{tab:abcdMC} Expected SM Monte Carlo yields for
61 benhoob 1.13 35 pb$^{-1}$ in the ABCD regions, as well as the predicted yield in
62 benhoob 1.16 the signal region given by A $\times$ C / B. Here `SM other' is the sum
63 benhoob 1.13 of non-dileptonic $t\bar{t}$ decays, $W^{\pm}$+jets, $W^+W^-$,
64     $W^{\pm}Z^0$, $Z^0Z^0$ and single top.}
65 benhoob 1.16 \begin{tabular}{lccccc}
66 benhoob 1.13 \hline
67 benhoob 1.16 sample & A & B & C & D & A $\times$ C / B \\
68 benhoob 1.13 \hline
69 benhoob 1.17
70    
71     \hline
72 benhoob 1.13 $t\bar{t}\rightarrow \ell^{+}\ell^{-}$ & 7.96 & 33.07 & 4.81 & 1.20 & 1.16 \\
73 benhoob 1.17 $Z^0 \rightarrow \ell^{+}\ell^{-}$ & 0.03 & 1.47 & 0.10 & 0.10 & 0.00 \\
74 benhoob 1.13 SM other & 0.65 & 2.31 & 0.17 & 0.14 & 0.05 \\
75     \hline
76 benhoob 1.17 total SM MC & 8.63 & 36.85 & 5.07 & 1.43 & 1.19 \\
77 claudioc 1.1 \hline
78     \end{tabular}
79     \end{center}
80     \end{table}
81    
82 claudioc 1.2 \subsection{Dilepton $P_T$ method}
83     \label{sec:victory}
84     This method is based on a suggestion by V. Pavlunin\cite{ref:victory},
85     and was investigated by our group in 2009\cite{ref:ourvictory}.
86     The idea is that in dilepton $t\bar{t}$ events the lepton and neutrinos
87     from $W$ decays have the same $P_T$ spectrum (modulo $W$ polarization
88     effects). One can then use the observed
89     $P_T(\ell\ell)$ distribution to model the sum of neutrino $P_T$'s which
90     is identified with the \met.
91    
92     Then, in order to predict the $t\bar{t} \to$ dilepton contribution to a
93     selection with \met$+$X, one applies a cut on $P_T(\ell\ell)+$X instead.
94     In practice one has to rescale the result of the $P_T(\ell\ell)+$X selection
95     to account for the fact that any dilepton selection must include a
96     moderate \met cut in order to reduce Drell Yan backgrounds. This
97     is discussed in Section 5.3 of Reference~\cite{ref:ourvictory}; for a \met
98 benhoob 1.16 cut of 50 GeV, the rescaling factor is obtained from the MC as
99 claudioc 1.2
100     \newcommand{\ptll} {\ensuremath{P_T(\ell\ell)}}
101     \begin{center}
102     $ K = \frac{\int_0^{\infty} {\cal N}(\ptll)~~d\ptll~}{\int_{50}^{\infty} {\cal N}(\ptll)~~d\ptll~}$
103     \end{center}
104    
105    
106     Monte Carlo studies give values of $K$ that are typically between 1.5 and 1.6,
107 benhoob 1.10 depending on selection details.
108     %%%TO BE REPLACED
109     %Given the integrated luminosity of the
110     %present dataset, the determination of $K$ in data is severely statistics
111     %limited. Thus, we take $K$ from $t\bar{t}$ Monte Carlo as
112    
113     %\begin{center}
114     %$ K_{MC} = \frac{\int_0^{\infty} {\cal N}(\met)~~d\met~}{\int_{50}^{\infty} {\cal N}(\met)~~d\met~}$
115     %\end{center}
116 claudioc 1.9
117 benhoob 1.10 %\noindent {\color{red} For the 11 pb result we have used $K$ from data.}
118 claudioc 1.2
119     There are several effects that spoil the correspondance between \met and
120     $P_T(\ell\ell)$:
121     \begin{itemize}
122     \item $Ws$ in top events are polarized. Neutrinos are emitted preferentially
123 benhoob 1.22 parallel to the $W$ velocity while charged leptons are emitted prefertially
124     anti-parallel. Thus the $P_T(\nu\nu)$ distribution is harder
125 claudioc 1.2 than the $P_T(\ell\ell)$ distribution for top dilepton events.
126     \item The lepton selections results in $P_T$ and $\eta$ cuts on the individual
127     leptons that have no simple correspondance to the neutrino requirements.
128     \item Similarly, the \met$>$50 GeV cut introduces an asymmetry between leptons and
129     neutrinos which is only partially compensated by the $K$ factor above.
130     \item The \met resolution is much worse than the dilepton $P_T$ resolution.
131 benhoob 1.16 When convoluted with a falling spectrum in the tails of \met, this results
132 claudioc 1.2 in a harder spectrum for \met than the original $P_T(\nu\nu)$.
133     \item The \met response in CMS is not exactly 1. This causes a distortion
134     in the \met distribution that is not present in the $P_T(\ell\ell)$ distribution.
135     \item The $t\bar{t} \to$ dilepton signal includes contributions from
136     $W \to \tau \to \ell$. For these events the arguments about the equivalence
137     of $P_T(\ell\ell)$ and $P_T(\nu\nu)$ do not apply.
138     \item A dilepton selection will include SM events from non $t\bar{t}$
139     sources. These events can affect the background prediction. Particularly
140     dangerous are high $P_T$ Drell Yan events that barely pass the \met$>$ 50
141     GeV selection. They will tend to push the data-driven background prediction up.
142 benhoob 1.16 Therefore we estimate the number of DY events entering the background prediction
143     using the $R_{out/in}$ method as described in Sec.~\ref{sec:othBG}.
144 claudioc 1.2 \end{itemize}
145    
146     We have studied these effects in SM Monte Carlo, using a mixture of generator and
147     reconstruction level studies, putting the various effects in one at a time.
148     For each configuration, we apply the data-driven method and report as figure
149     of merit the ratio of observed and predicted events in the signal region.
150     The results are summarized in Table~\ref{tab:victorybad}.
151    
152     \begin{table}[htb]
153     \begin{center}
154     \caption{\label{tab:victorybad} Test of the data driven method in Monte Carlo
155     under different assumptions. See text for details.}
156 claudioc 1.6 \begin{tabular}{|l|c|c|c|c|c|c|c|c|}
157 claudioc 1.2 \hline
158 claudioc 1.6 & True $t\bar{t}$ dilepton & $t\to W\to\tau$& other SM & GEN or & Lepton $P_T$ & Z veto & \met $>$ 50& obs/pred \\
159     & included & included & included & RECOSIM & and $\eta$ cuts & & & \\ \hline
160     1&Y & N & N & GEN & N & N & N & 1.90 \\
161     2&Y & N & N & GEN & Y & N & N & 1.64 \\
162     3&Y & N & N & GEN & Y & Y & N & 1.59 \\
163     4&Y & N & N & GEN & Y & Y & Y & 1.55 \\
164     5&Y & N & N & RECOSIM & Y & Y & Y & 1.51 \\
165     6&Y & Y & N & RECOSIM & Y & Y & Y & 1.58 \\
166 benhoob 1.17 7&Y & Y & Y & RECOSIM & Y & Y & Y & 1.38 \\
167 benhoob 1.16 %%%NOTE: updated value 1.18 -> 1.46 since 2/3 DY events have been removed by updated analysis selections,
168     %%%dpt/pt cut and general lepton veto
169 claudioc 1.2 \hline
170     \end{tabular}
171     \end{center}
172     \end{table}
173    
174    
175     The largest discrepancy between prediction and observation occurs on the first
176     line of Table~\ref{tab:victorybad}, {\em i.e.}, at the generator level with no
177     cuts. We have verified that this effect is due to the polarization of
178     the $W$ (we remove the polarization by reweighting the events and we get
179     good agreement between prediction and observation). The kinematical
180 claudioc 1.6 requirements (lines 2,3,4) compensate somewhat for the effect of W polarization.
181     Going from GEN to RECOSIM, the change in observed/predicted is small.
182     % We have tracked this down to the fact that tcMET underestimates the true \met
183     % by $\approx 4\%$\footnote{We find that observed/predicted changes by roughly 0.1
184     %for each 1.5\% change in \met response.}.
185     Finally, contamination from non $t\bar{t}$
186 benhoob 1.16 events can have a significant impact on the BG prediction.
187     %The changes between
188     %lines 6 and 7 of Table~\ref{tab:victorybad} is driven by 3
189     %Drell Yan events that pass the \met selection in Monte Carlo (thus the effect
190     %is statistically not well quantified).
191 claudioc 1.2
192     An additional source of concern is that the CMS Madgraph $t\bar{t}$ MC does
193     not include effects of spin correlations between the two top quarks.
194     We have studied this effect at the generator level using Alpgen. We find
195 claudioc 1.7 that the bias is at the few percent level.
196 claudioc 1.2
197 benhoob 1.10 %%%TO BE REPLACED
198     %Based on the results of Table~\ref{tab:victorybad}, we conclude that the
199     %naive data driven background estimate based on $P_T{(\ell\ell)}$ needs to
200     %be corrected by a factor of {\color{red} $ K_{\rm{fudge}} =1.2 \pm 0.3$
201     %(We still need to settle on thie exact value of this.
202     %For the 11 pb analysis it is taken as =1.)} . The quoted
203     %uncertainty is based on the stability of the Monte Carlo tests under
204     %variations of event selections, choices of \met algorithm, etc.
205     %For example, we find that observed/predicted changes by roughly 0.1
206     %for each 1.5\% change in the average \met response.
207    
208 claudioc 1.2 Based on the results of Table~\ref{tab:victorybad}, we conclude that the
209 claudioc 1.6 naive data driven background estimate based on $P_T{(\ell\ell)}$ needs to
210 benhoob 1.11 be corrected by a factor of $ K_C = X \pm Y$.
211 benhoob 1.10 The value of this correction factor as well as the systematic uncertainty
212     will be assessed using 38X ttbar madgraph MC. In the following we use
213 benhoob 1.11 $K_C = 1$ for simplicity. Based on previous MC studies we foresee a correction
214 benhoob 1.14 factor of $K_C \approx 1.2 - 1.5$, and we will assess an uncertainty
215 benhoob 1.10 based on the stability of the Monte Carlo tests under
216 claudioc 1.2 variations of event selections, choices of \met algorithm, etc.
217 claudioc 1.8 For example, we find that observed/predicted changes by roughly 0.1
218 benhoob 1.10 for each 1.5\% change in the average \met response.
219 claudioc 1.2
220    
221 claudioc 1.6
222 claudioc 1.2 \subsection{Signal Contamination}
223     \label{sec:sigcont}
224    
225 claudioc 1.6 All data-driven methods are in principle subject to signal contaminations
226 claudioc 1.2 in the control regions, and the methods described in
227     Sections~\ref{sec:abcd} and~\ref{sec:victory} are not exceptions.
228     Signal contamination tends to dilute the significance of a signal
229     present in the data by inflating the background prediction.
230    
231     It is hard to quantify how important these effects are because we
232     do not know what signal may be hiding in the data. Having two
233     independent methods (in addition to Monte Carlo ``dead-reckoning'')
234     adds redundancy because signal contamination can have different effects
235     in the different control regions for the two methods.
236     For example, in the extreme case of a
237     new physics signal
238 claudioc 1.6 with $P_T(\ell \ell) = \met$, an excess of events would be seen
239 claudioc 1.2 in the ABCD method but not in the $P_T(\ell \ell)$ method.
240    
241 claudioc 1.4
242 claudioc 1.2 The LM points are benchmarks for SUSY analyses at CMS. The effects
243     of signal contaminations for a couple such points are summarized
244 benhoob 1.14 in Table~\ref{tab:sigcont}. Signal contamination is definitely an important
245 claudioc 1.2 effect for these two LM points, but it does not totally hide the
246     presence of the signal.
247 claudioc 1.1
248    
249 claudioc 1.2 \begin{table}[htb]
250     \begin{center}
251 benhoob 1.14 \caption{\label{tab:sigcont} Effects of signal contamination
252     for the two data-driven background estimates. The three columns give
253     the expected yield in the signal region and the background estimates
254 benhoob 1.20 using the ABCD and $P_T(\ell \ell)$ methods. Results are normalized to 35~pb$^{-1}$.}
255 benhoob 1.14 \begin{tabular}{lccc}
256 claudioc 1.2 \hline
257 benhoob 1.14 & Yield & ABCD & $P_T(\ell \ell)$ \\
258     \hline
259 benhoob 1.17 SM only & 1.43 & 1.19 & 1.03 \\
260 benhoob 1.19 SM + LM0 & 7.90 & 4.23 & 2.35 \\
261     SM + LM1 & 4.00 & 1.53 & 1.51 \\
262 claudioc 1.2 \hline
263     \end{tabular}
264     \end{center}
265     \end{table}
266    
267 benhoob 1.14
268    
269     %\begin{table}[htb]
270     %\begin{center}
271     %\caption{\label{tab:sigcontABCD} Effects of signal contamination
272     %for the background predictions of the ABCD method including LM0 or
273     %LM1. Results
274     %are normalized to 30 pb$^{-1}$.}
275     %\begin{tabular}{|c|c||c|c||c|c|}
276     %\hline
277     %SM & BG Prediction & SM$+$LM0 & BG Prediction & SM$+$LM1 & BG Prediction \\
278     %Background & SM Only & Contribution & Including LM0 & Contribution & Including LM1 \\ \hline
279     %1.2 & 1.0 & 6.8 & 3.7 & 3.4 & 1.3 \\
280     %\hline
281     %\end{tabular}
282     %\end{center}
283     %\end{table}
284    
285     %\begin{table}[htb]
286     %\begin{center}
287     %\caption{\label{tab:sigcontPT} Effects of signal contamination
288     %for the background predictions of the $P_T(\ell\ell)$ method including LM0 or
289     %LM1. Results
290     %are normalized to 30 pb$^{-1}$.}
291     %\begin{tabular}{|c|c||c|c||c|c|}
292     %\hline
293     %SM & BG Prediction & SM$+$LM0 & BG Prediction & SM$+$LM1 & BG Prediction \\
294     %Background & SM Only & Contribution & Including LM0 & Contribution & Including LM1 \\ \hline
295     %1.2 & 1.0 & 6.8 & 2.2 & 3.4 & 1.5 \\
296     %\hline
297     %\end{tabular}
298     %\end{center}
299     %\end{table}
300 claudioc 1.1