ViewVC Help
View File | Revision Log | Show Annotations | Root Listing
root/cvsroot/UserCode/claudioc/OSNote2010/limit.tex
(Generate patch)

Comparing UserCode/claudioc/OSNote2010/limit.tex (file contents):
Revision 1.24 by benhoob, Thu Dec 9 10:21:39 2010 UTC vs.
Revision 1.37 by claudioc, Fri Jan 21 03:47:11 2011 UTC

# Line 3 | Line 3
3  
4   %{\bf \color{red} The numbers in this Section need to be double checked.}
5  
6 + \subsection{Limit on number of events}
7 + \label{sec:limnumevents}
8   As discussed in Section~\ref{sec:results}, we see one event
9   in the signal region, defined as SumJetPt$>$300 GeV and
10   \met/$\sqrt{\rm SumJetPt}>8.5$ GeV$^{\frac{1}{2}}$.
# Line 22 | Line 24 | These three predictions are in good agre
24   and with the observation of one event in the signal region.
25   We calculate a Bayesian 95\% CL upper limit\cite{ref:bayes.f}
26   on the number of non SM events in the signal region to be 4.1.
27 < We have also calculated this limit using a profile likelihood method
28 < as implemented in the cl95cms software, and we also find 4.1.
27 > We have also calculated this limit using
28 > % a profile likelihood method
29 > % as implemented in
30 > the cl95cms software\cite{ref:cl95cms},
31 > and we also find 4.1.  (This is not surprising, since cl95cms
32 > also gives baysean upper limits with a flat prior).
33   These limits were calculated using a background prediction of $N_{BG} = 1.4 \pm 0.8$
34   events, the error-weighted average of the ABCD and $P_T(\ell\ell)$ background
35   predictions.  The upper limit is not very sensitive to the choice of
# Line 36 | Line 42 | events and $3.6 \pm 0.5$ events respecti
42   are from energy scale (Section~\ref{sec:systematics}), luminosity,
43   and lepton efficiency.
44  
39 We also performed a scan of the mSUGRA parameter space. We set $\tan\beta=10$,
40 sign of $\mu = +$, $A_{0}=0$~GeV, and scan the $m_{0}$ and $m_{1/2}$ parameters
41 in steps of 10~GeV. For each scan point, we exclude the point if the expected
42 yield in the signal region exceeds 4.7, which is the 95\% CL upper limit
43 based on an expected background of $N_{BG}=1.4 \pm 0.8$ and a 20\% acceptance
44 uncertainty. The results are shown in Fig.~\ref{fig:msugra}.
45
46 \begin{figure}[tbh]
47 \begin{center}
48 \includegraphics[width=0.6\linewidth]{msugra.png}
49 \caption{\label{fig:msugra}\protect Exclusion curve in the mSUGRA parameter space,
50 assuming $\tan\beta=10$, sign of $\mu = +$ and $A_{0}=0$~GeVs.}
51 \end{center}
52 \end{figure}
53
45  
46 + \subsection{Outreach}
47 + \label{sec:outreach}
48   Conveying additional useful information about the results of
49   a generic ``signature-based'' search such as the one described
50 < in this note is a difficult issue.  The next paragraph represent
51 < our attempt at doing so.
50 > in this note is a difficult issue.  
51 > Here we attempt to present our result in the most general
52 > way.
53  
54 < Other models of new physics in the dilepton final state
54 > Models of new physics in the dilepton final state
55   can be confronted in an approximate way by simple
56   generator-level studies that
57   compare the expected number of events in 34.0~pb$^{-1}$
# Line 65 | Line 59 | with our upper limit of 4.1 events.  The
59   of such studies are the kinematical cuts described
60   in this note, the lepton efficiencies, and the detector
61   responses for SumJetPt and \met/$\sqrt{\rm SumJetPt}$.
68 {LOOKING AT THE 38X MC PLOTS BY EYE, THE FOLLOWING QUANTITIES LOOK ABOUT RIGHT.}
62   The muon identification efficiency is $\approx 95\%$;
63   the electron identification efficiency varies from $\approx$ 63\% at
64   $P_T = 10$ GeV to 91\% for $P_T > 30$ GeV.  The isolation
65   efficiency in top events varies from $\approx 83\%$ (muons)
66   and $\approx 89\%$ (electrons) at $P_T=10$ GeV to
67 < $\approx 95\%$ for $P_T>60$ GeV. {\bf \color{red} The following quantities were calculated
68 < with Spring10 samples. } The average detector
67 > $\approx 95\%$ for $P_T>60$ GeV.
68 > %{\bf \color{red} The following numbers were derived from Fall 10 samples. }
69 > The average detector
70   responses for SumJetPt and $\met/\sqrt{\rm SumJetPt}$ are
71 < $1.00 \pm 0.05$ and $0.94 \pm 0.05$ respectively, where
71 > $1.02 \pm 0.05$ and $0.94 \pm 0.05$ respectively, where
72   the uncertainties are from the jet energy scale uncertainty.
73 < The experimental resolutions on these quantities are 10\% and
74 < 14\% respectively.
73 > The experimental resolutions on these quantities are 11\% and
74 > 16\% respectively.
75  
76   To justify the statements in the previous paragraph
77   about the detector responses, we plot
# Line 87 | Line 81 | efficiency for the cuts on these quantit
81   signal region.
82   % (SumJetPt $>$ 300 GeV and \met/$\sqrt{\rm SumJetPt} > 8.5$
83   % Gev$^{\frac{1}{2}}$).  
84 < {\bf \color{red} The following numbers were derived from Spring10 samples.}
84 > %{\bf \color{red} The following numbers were derived from Fall10 samples }
85   We find that the average SumJetPt response
86 < in the Monte Carlo is very close to one, with an RMS of order 10\% while
86 > in the Monte Carlo is about 1.02, with an RMS of order 11\% while
87   the response of \met/$\sqrt{\rm SumJetPt}$ is approximately 0.94 with an
88 < RMS of 14\%.
88 > RMS of 16\%.
89  
90   %Using this information as well as the kinematical
91   %cuts described in Section~\ref{sec:eventSel} and the lepton efficiencies
# Line 102 | Line 96 | RMS of 14\%.
96  
97   \begin{figure}[tbh]
98   \begin{center}
99 < \includegraphics[width=\linewidth]{selectionEff.png}
99 > \includegraphics[width=\linewidth]{selectionEffDec10.png}
100   \caption{\label{fig:response} Left plots: the efficiencies
101   as a function of the true quantities for the SumJetPt (top) and
102   tcMET/$\sqrt{\rm SumJetPt}$ (bottom) requirements for the signal
# Line 114 | Line 108 | The response is defined as the ratio of
108   to the true quantity in MC.  These plots are done using the LM0
109   Monte Carlo, but they are not expected to depend strongly on
110   the underlying physics.
111 < {\bf \color{red} These plots were made with Spring10 samples. } }
111 > %{\bf \color{red} These plots were made with Fall10 samples. }
112 > }
113   \end{center}
114   \end{figure}
115  
# Line 150 | Line 145 | the underlying physics.
145   % Are the above correct? y
146   %    1  29.995     0.50457E-06
147   %
148 < % limit: less than     4.689 signal events
148 > % limit: less than     4.689 signal events
149 >
150 >
151 >
152 > \subsection{mSUGRA scan}
153 > \label{sec:mSUGRA}
154 > We also perform a scan of the mSUGRA parameter space, as recomended
155 > by the SUSY group convenors\cite{ref:scan}.
156 > The goal of the scan is to determine an exclusion region in the
157 > $m_0$ vs. $m_{1/2}$ plane for
158 > $\tan\beta=3$,
159 > sign of $\mu = +$, and $A_{0}=0$~GeV.  This scan is based on events
160 > generated with FastSim.
161 >
162 > The first order of business is to verify that results using
163 > Fastsim and Fullsim are compatible.  To this end we compare the
164 > expected yield for the LM1 point in FullSim (3.56 $\pm$ 0.06) and
165 > FastSim (3.29 $\pm$ 0.27), where the uncertainties are statistical only.
166 > These two numbers are in agreement, which gives us confidence in
167 > using FastSim for this study.
168 >
169 > The FastSim events are generated with different values of $m_0$
170 > and $m_{1/2}$ in steps of 10 GeV.  For each point in the
171 > $m_0$ vs. $m_{1/2}$ plane, we compute the expected number of
172 > events at NLO.  We then also calculate an upper limit $N_{UL}$
173 > using cl95cms at each point using the following inputs:
174 > \begin{itemize}
175 > \item Number of BG events = 1.40 $\pm$ 0.77
176 > \item Luminosity uncertainty = 11\%
177 > \item The acceptance uncertainty is calculated at each point
178 > as the quadrature sum of
179 > \begin{itemize}
180 > \item The uncertainty due to JES for that point, as calculated
181 > using the method described in Section~\ref{sec:systematics}
182 > \item A 5\% uncertainty due to lepton efficiencies
183 > \item An uncertaity on the NLO cross-section obtained by varying the
184 > factorization and renormalization scale by a factor of two\cite{ref:sanjay}.
185 > \item A 13\% PDF uncertainty on the product of cross-section and acceptance.
186 > This uncertainty was calculated using the method of Reference~\cite{ref:pdf} for a
187 > number of points in the $m_0$ vs. $m_{1/2}$ plane, and was found to be
188 > approximately independent of mSUGRA parameters, see Table~\ref{tab:pdf}.
189 > \end{itemize}
190 > \item We use the ``log-normal'' model for the nuisance parameters
191 > in cl95cms
192 > \end{itemize}
193 > We actually calculate three different values of $N_{UL}$:
194 > \begin{enumerate}
195 > \item Observed $N_{UL}$ asssuming the NLO cross-section.
196 > \item Observed $N_{UL}$ asssuming the LO cross-section. In this case
197 > uncertainties due to PDFs and renormlization/factorization scales are not
198 > included.
199 > \item Expected $N_{UL}$ sssuming the NLO cross-section.  This is
200 > calculated using the the CLA function also available in cl95cms.
201 > \end{enumerate}
202 >
203 > \begin{table}[hbt]
204 > \begin{center}
205 > \caption{\label{tab:pdf} PDF uncertainties on the product of
206 > cross-section and acceptance for a number of representative points
207 > in the mSUGRA plane.}
208 > \begin{tabular}{c|c|c|c|c|c}
209 > $\tan\beta$ & $m_0$ & $m_{1/2}$ & sign of $\mu$ & $A_0$ & uncertanity (\%)   \\ \hline
210 > 3           & 50    & 260       & +             &  0    & $^{+13}_{-9}$ \\
211 > 3           & 50    & 270       & +             &  0    & $^{+13}_{-9}$ \\
212 > 3           & 60    & 260       & +             &  0    & $^{+14}_{-9}$ \\
213 > 3           & 200   & 200       & +             &  0    & $^{+12}_{-9}$ \\
214 > 3           & 200   & 210       & +             &  0    & $^{+13}_{-10}$ \\
215 > 3           & 210   & 200       & +             &  0    & $^{+11}_{-8}$ \\
216 > 3           & 200   & 140       & +             &  0    & $^{+16}_{-12}$ \\
217 > 3           & 140   & 150       & +             &  0    & $^{+08}_{-8}$ \\
218 > 3           & 150   & 140       & +             &  0    & $^{+14}_{-10}$ \\
219 > 10          & 60    & 260       & +             &  0    & $^{+16}_{-11}$ \\
220 > 10          & 100   & 260       & +             &  0    & $^{+14}_{-10}$ \\
221 > 10          & 100   & 260       & +             &  0    & $^{+12}_{-9}$ \\
222 > 10          & 90    & 260       & +             &  0    & $^{+15}_{-10}$ \\
223 > 10          & 240   & 260       & +             &  0    & $^{+10}_{-8}$ \\
224 > 10          & 240   & 260       & +             &  0    & $^{+13}_{-10}$  \\ \hline
225 > \end{tabular}
226 > \end{center}
227 > \end{table}
228 >
229 >
230 > An mSUGRA point is excluded if the resulting $N_{UL}$ is smaller
231 > than the expected number of events.  Because of the quantization
232 > of the available MC points in the $m_0$ vs $m_{1/2}$ plane, the
233 > boundaries of the excluded region are also quantized.  The excluded points
234 > are shown in Figure~\ref{fig:tanbeta3raw}; in this Figure we also show
235 > ad-hoc curves that represent the excluded regions.
236 > In Figure~\ref{fig:msugra} we show our results compared with
237 > results from previous experiments.
238 >
239 >
240 > \begin{figure}[tbh]
241 > \begin{center}
242 > \includegraphics[width=0.4\linewidth]{tanbeta3_NLO_observed.png}
243 > \includegraphics[width=0.4\linewidth]{tanbeta3_NLO_expected.png}
244 > \includegraphics[width=0.4\linewidth]{tanbeta3_LO_observed.png}
245 > \caption{\label{fig:tanbeta3raw}\protect Excluded points in the
246 > $m_0$ vs. $m_{1/2}$ plane for $\tan\beta=3$, sign of $\mu = +$ and $A_{0}=0$~GeVs.
247 > Top left: observed, using the NLO cross-section.
248 > Top right: expected using the NLO cross-section.
249 > Bottom left: observed, using the LO cross-section.
250 > The curves are meant to represent the excluded regions.}
251 > \end{center}
252 > \end{figure}
253 >
254 >
255 > \begin{figure}[tbh]
256 > \begin{center}
257 > \includegraphics[width=\linewidth]{exclusion.pdf}
258 > \caption{\label{fig:msugra}\protect Exclusion curves in the mSUGRA parameter space,
259 > assuming $\tan\beta=3$, sign of $\mu = +$ and $A_{0}=0$~GeVs.}  
260 > \end{center}
261 > \end{figure}
262 >
263 >
264 >
265 > \clearpage
266 >
267 > \subsubsection{Check of the nuisance parameter models}
268 > We repeat the procedure outlined above but changing the
269 > lognormal nuisance parameter model to a gaussian or
270 > gamma-function model.  The results are shown in
271 > Figure~\ref{fig:nuisance}.  (In this case,
272 > to avoid smoothing artifacts, we
273 > show the raw results, without smoothing).
274 >
275 > \begin{figure}[tbh]
276 > \begin{center}
277 > \includegraphics[width=0.5\linewidth]{nuissance.png}
278 > \caption{\label{fig:nuisance}\protect Observed NLO exclusion curves in the
279 > mSUGRA parameter space,
280 > assuming $\tan\beta=3$, sign of $\mu = +$ and $A_{0}=0$~GeVs
281 > using different models for the nuisance parameters. (Note: this
282 > plot was made without the PDF uncertainties.}
283 > \end{center}
284 > \end{figure}
285 >
286 > We find that different assumptions on the PDFs for the nuisance
287 > parameters make very small differences to the set of excluded
288 > points.
289 > Following the recommendation of Reference~\cite{ref:cousins},
290 > we use the lognormal nuisance parameter model as the default.
291 >
292 >
293 > % \clearpage
294 >
295 >
296 > \subsubsection{Effect of signal contamination}
297 > \label{sec:contlimit}
298 >
299 > Signal contamination could affect the limit by inflating the
300 > background expectation.  In our case we see no evidence of signal
301 > contamination, within statistics.
302 > The yields in the control regions  
303 > $A$, $B$, and $C$ (Table~\ref{tab:datayield}) are just
304 > as expected in the SM, and the check
305 > of the $P_T(\ell \ell)$ method in the control region is
306 > also consistent with expectations (Table~\ref{tab:victory}).
307 > Since we have two data driven methods, with different
308 > signal contamination issues, giving consistent
309 > results that are in agreement with the SM, we
310 > argue for not making any correction to our procedure
311 > because of signal contamination.  In some sense this would
312 > be equivalent to using the SM background prediction, and using
313 > the data driven methods as confirmations of that prediction.
314 >
315 > Nevertheless, here we explore the possible effect of
316 > signal contamination.  The procedure suggested to us
317 > for the ABCD method is to modify the
318 > ABCD background prediction from $A_D \cdot C_D/B_D$ to
319 > $(A_D-A_S) \cdot (C_D-C_S) / (B_D - B_S)$, where the
320 > subscripts $D$ and $S$ refer to the number of observed data
321 > events and expected SUSY events, respectively, in a given region.
322 > We then recalculate $N_{UL}$ at each point using this modified
323 > ABCD background estimation.  For simplicity we ignore
324 > information from the $P_T(\ell \ell)$
325 > background estimation.  This is conservative, since
326 > the $P_T(\ell\ell)$ background estimation happens to
327 > be numerically larger than the one from ABCD.
328 >
329 > Note, however, that in some cases this procedure is
330 > nonsensical.  For example, take LM0 as a SUSY
331 > point.  In region $C$ we have a SM prediction of 5.1
332 > events and $C_D = 4$ in agreement with the Standard Model,
333 > see Table~\ref{tab:datayield}.  From the LM0 Monte Carlo,
334 > we find $C_S = 8.6$ events.   Thus, including information
335 > on $C_D$ and $C_S$ should {\bf strengthen} the limit, since there
336 > is clearly a deficit of events in the $C$ region in the
337 > LM0 hypothesis.  Instead, we now get a negative ABCD
338 > BG prediction (which is nonsense, so we set it to zero),
339 > and therefore a weaker limit.
340 >
341 >
342 >
343 >
344 > \begin{figure}[tbh]
345 > \begin{center}
346 > \includegraphics[width=0.5\linewidth]{sigcont.png}
347 > \caption{\label{fig:sigcont}\protect Observed NLO exclusion curves in the
348 > mSUGRA parameter space,
349 > assuming $\tan\beta=3$, sign of $\mu = +$ and $A_{0}=0$~GeVs
350 > with and without the effects of signal contamination.
351 > Note: PDF uncertainties are not included.}  
352 > \end{center}
353 > \end{figure}
354 >
355 > A comparison of the exclusion region with and without
356 > signal contamination is shown in Figure~\ref{fig:sigcont}
357 > (with no smoothing).  The effect of signal contamination is
358 > small, of the same order as the quantization of the scan.
359 >
360 >
361 > \subsubsection{mSUGRA scans with different values of tan$\beta$}
362 > \label{sec:tanbetascan}
363 >
364 > For completeness, we also show the exclusion region calculated
365 > using $\tan\beta = 10$ (Figure~\ref{fig:msugratb10}).
366 >
367 >
368 > \begin{figure}[tbh]
369 > \begin{center}
370 > \includegraphics[width=0.4\linewidth]{tanbeta10_NLO_observed.png}
371 > \caption{\label{fig:tanbeta10raw}\protect Excluded points in the
372 > $m_0$ vs. $m_{1/2}$ plane for $\tan\beta=10$, sign of $\mu = +$ and $A_{0}=0$~GeVs.
373 > This plot is made using the NLO cross-sections.
374 > The curves is meant to represent the excluded region.}
375 > \end{center}
376 > \end{figure}
377 >
378 > \begin{figure}[tbh]
379 > \begin{center}
380 > \includegraphics[width=\linewidth]{exclusion_tanbeta10.pdf}
381 > \caption{\label{fig:msugratb10}\protect Exclusion curve in the mSUGRA parameter space,
382 > assuming $\tan\beta=10$, sign of $\mu = +$ and $A_{0}=0$~GeVs.}  
383 > \end{center}
384 > \end{figure}
385 >
386 >
387 >
388 >
389 >
390 >

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines