Simulated dataset QCD_Pt_300to470_TuneCP5_13TeV_pythia8 in NANOAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.

The dataset consists of particle jets extracted from simulated proton-proton collision events at a center-of-mass energy of 13 TeV generated with Pythia 8. The particles emerging from the collisions traverse through a simulation of the CMS detector. The particles were reconstructed from the simulated detector signals using the particle-flow (PF) algorithm. The reconstructed particles are also called PF candidates. The jets in this dataset were clustered from the PF candidates of each collision event using the anti-$k_t$ algorithm with distance parameter $R = 0.4$. The standard L1+L2+L3+residual jet energy corrections are applied to the jets and pileup contamination is mitigated using the charged hadron subtraction (CHS) algorithm.

From each collision event, only those jets with transverse momentum exceeding 30 GeV were saved to file. The jets were also required to have pseudorapidity of less than 2.5 (this indicates the jet's position in the detector). For each jet, there are variables describing the jet on a high-level, particle-level and generator-level. There are also some variables describing the collision event and the conditions of its simulation. All of the variables are saved on a jet-by-jet basis, which means that one row of data corresponds to one jet.

The origin of a jet is particularly interesting. This so-called flavor of the jet is obtained from the generator-level particles by a jet flavor algorithm, which attempts to match a reconstructed jet to a single initiating particle. As a consequence, the jet flavor definition depends on the chosen algorithm. Here three different flavor definitions are available. The ‘hadron’ definition identifies b- and c-hadrons from the jet’s constituents, so it is only useful for b-tagging studies. The ‘parton’ definition extends this to include the light jet flavors (u, d, s and gluon). Finally there is the ‘physics’ definition, which looks at the quarks and gluons of the initial collision. The ‘parton’ and ‘physics’ definitions both identify all jet flavors, but the former is more biased towards b- and c-quarks. If in doubt, it is recommended to use the ‘physics’ definition.

Disclaimer: All these dataset are collected from opendata CERN and are converted from root files to hdf5. All neccesary citing is included for each dataset beneath:

This is a number of datasets used for the task: "Search for new physics at the Large Hadron Collider"

These datasets are simulations of various particle physics processes that could occur in a collider like the Large Hadron Collider (LHC). They are used for training and testing machine learning algorithms to distinguish between different types of events. All dataset simulations were generated using the Monte Carlo event creator.

Here's what each dataset represents:

mc_105986.ZZ.hdf5: Events where a pair of Z bosons are produced. This is a type of diboson production, a standard model process. Source: ATLAS Collaboration (2016). MC:Diboson process ZZ, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.MW2E.VY3R

mc_105987.WZ.hdf5: Events where a W boson and a Z boson are produced together. Another diboson process. Source: ATLAS Collaboration (2016). MC:Diboson process WZ, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.7X9L.ZZ8H

mc_110090.stop_tchan_top.hdf5: Single top quark production through the t-channel. Source: ATLAS Collaboration (2016). MC:Single top t-channel top, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.ZKB4.7X2E

mc_110091.stop_tchan_antitop.hdf5: Single antitop quark production through the t-channel. Source: ATLAS Collaboration (2016). MC:Single top t-channel antitop, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.LD9U.V7P9

mc_110119.stop_schan.hdf5: Single top (or antitop) quark production via the s-channel. Source: ATLAS Collaboration (2016). MC:Single top s-channel, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.9ZQW.R5SC

mc_110140.stop_wtchan.hdf5: Single top quark production associated with a W boson, known as the tW-channel or associated production. Source: ATLAS Collaboration (2016). MC:Single top Wt-channel, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.D5RX.N4F8

The datasets Zprime500 to Zprime 2500 are events simulating the production of a hypothetical Z' boson, a heavy gauge boson predicted by some extensions of the standard model. The numbers (500, 750, 1000, etc.) refer to the mass of the Z' boson in GeV/c².

mc_110901.ZPrime500.hdf5: Source: ATLAS Collaboration (2016). MC:Z' → tt with MZ' = 500 GeV, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.UJC5.DF2N

mc_110902.ZPrime750.hdf5: Source: ATLAS Collaboration (2016). MC:Z' → tt with MZ' = 750 GeV, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.W8VJ.NRVQ

mc_110903.ZPrime1000.hdf5: Source: ATLAS Collaboration (2016). MC:Z' → tt with MZ' = 1000 GeV, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.ERXL.ZU41

mc_110905.ZPrime1500.hdf5: Source: ATLAS Collaboration (2016). MC:Z' → tt with MZ' = 1500 GeV, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.G38J.HVDL

mc_110906.ZPrime1750.hdf5: Source: ATLAS Collaboration (2016). MC:Z' → tt with MZ' = 1750 GeV, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.YSUF.NRUE

mc_110907.ZPrime2000.hdf5: Source: ATLAS Collaboration (2016). MC:Z' → tt with MZ' = 2000 GeV, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.TMVL.VTP7

mc_110909.ZPrime2500.hdf5: Source: ATLAS Collaboration (2016). MC:Z' → tt with MZ' = 2500 GeV, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.9XY3.CWJK

mc_117049.ttbar_had.hdf5: Top-antitop quark pair production where both top quarks decay hadronically. Source: ATLAS Collaboration (2016). MC:tt → Jets, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.UZA2.CJH2

mc_117050.ttbar_lep.hdf5: Top-antitop quark pair production where at least one of the top quarks decays leptonically. Source: ATLAS Collaboration (2016). MC:tt → l + X, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.FSPW.5CA5

mc_147770.Zee.hdf5: Z boson production with a decay into an electron-positron pair. Source: ATLAS Collaboration (2016). MC:Zee + Jets, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.TC5G.AC24

mc_147771.Zmumu.hdf5: Z boson production with a decay into a muon-antimuon pair. Source: ATLAS Collaboration (2016). MC:Zee + Jets, for 2016 ATLAS open data release. CERN Open Data Portal. DOI:10.7483/OPENDATA.ATLAS.TC5G.AC24

mc_147772.Ztautau.hdf5: Z boson production with a decay into a tau-antitau pair. Source: ATLAS Collab...

Simulated dataset QCD_Pt_300to470_TuneCP5_13TeV_pythia8 in MINIAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.

Boosted top tagging is an essential binary classification task for experiments at the Large Hadron Collider (LHC) to measure the properties of the top quark. The ATLAS Top Tagging Open Data Set is a publicly available data set for the development of Machine Learning (ML) based boosted top tagging algorithms. The data are split into two orthogonal sets, named train and test and stored in the HDF5 file format, containing 42 million and 2.5 million jets respectively. Both sets are composed of equal parts signal (jets initiated by a boosted top quark) and background (jets initiated by light quarks or gluons). For each jet, the data set contains:

• The four vectors of constituent particles
• 15 high level summary quantities evaluated on the jet
• The four vector of the whole jet
• A training weight
• A signal (1) vs background (0) label.

There is one rule in using this data set: the contribution to a loss function from any jet should always be weighted by the training weight. Apart from this a model should separate the signal jets from background by whatever means necessary.

Updated on July 26th 2024. This dataset has been superseeded by a new dataset which also includes systematic uncertainties. Please use the new dataset instead of this one.

Simulated dataset TTJets_HadronicMGDecays_8TeV-madgraph with boosted jets, enriched with simulated tracks and tracker hit data for tracking algorithm studies in AODSIM format for 2012 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated data correspond to the collision data collected by the CMS experiment in 2012. They are in the standard CMS AODSIM format plus a series of low-level tracker-related collections that allow the extraction of the tracker hits. They were released in the context of data science sample production.

The dataset has been built from official ATLAS full-detector simulation, with "Higgs to tautau" events mixed with different backgrounds. The simulator has two parts. In the first, random proton-proton collisions are simulated based on the knowledge that we have accumulated on particle physics. It reproduces the random microscopic explosions resulting from the proton-proton collisions. In the second part, the resulting particles are tracked through a virtual model of the detector. The process yields simulated events with properties that mimic the statistical properties of the real events with additional information on what has happened during the collision, before particles are measured in the detector.

The signal sample contains events in which Higgs bosons (with a fixed mass of 125 GeV) were produced. The background sample was generated by other known processes that can produce events with at least one electron or muon and a hadronic tau, mimicking the signal. For the sake of simplicity, only three background processes were retained for the Challenge. The first comes from the decay of the Z boson (with a mass of 91.2 GeV) into two taus. This decay produces events with a topology very similar to that produced by the decay of a Higgs. The second set contains events with a pair of top quarks, which can have a lepton and a hadronic tau among their decay. The third set involves the decay of the W boson, where one electron or muon and a hadronic tau can appear simultaneously only through imperfections of the particle identification procedure.

Due to the complexity of the simulation process, each simulated event has a weight that is proportional to the conditional density divided by the instrumental density used by the simulator (an importance-sampling flavour), and normalised for integrated luminosity such that, in any region, the sum of the weights of events falling in the region is an unbiased estimate of the expected number of events falling in the same region during a given fixed time interval. In our case, the weights correspond to the quantity of real data taken during the year 2012. The weights are an artifact of the way the simulation works and so they are not part of the input to the classifier. For the Challenge, weights have been provided in the training set so the AMS can be properly evaluated. Weights were not provided in the qualifying set since the weight distribution of the signal and background sets are very different and so they would give away the label immediately. However, in the opendata.cern.ch dataset, weights and labels have been provided for the complete dataset.

The evaluation metric is the approximate median significance (AMS):

\[ \text{AMS} = \sqrt{2\left((s+b+b_r) \log \left(1 + \frac{s}{b + b_r}\right)-s\right)}\]

where

• $s, b$: unnormalised true positive and false positive rates, respectively,
• $b_r =10$ is the constant regularisation term,
• $\log$ is the natural log.

More precisely, let $(y_1, \ldots, y_n) \in \{\text{b},\text{s}\}^n$ be the vector of true test labels, let $(\hat{y}_1, \ldots, \hat{y}_n) \in \{\text{b},\text{s}\}^n$ be the vector of predicted (submitted) test labels, and let $(w_1, \ldots, w_n) \in {\mathbb{R}^+}^n$ be the vector of weights. Then

\[ s = \sum_{i=1}^n w_i\mathbb{1}\{y_i = \text{s}\} \mathbb{1}\{\hat{y}_i = \text{s}\} \]

and

\[ b = \sum_{i=1}^n w_i\mathbb{1}\{y_i = \text{b}\} \mathbb{1}\{\hat{y}_i = \text{s}\}, \]

where the indicator function $\mathbb{1}\{A\}$ is 1 if its argument $A$ is true and 0 otherwise.

For more information on the statistical model and the derivation of the metric, see the documentation.

Simulated dataset ZHiggs0Mf05ph0ToZZTo4L_M-125p6_7TeV-JHUGenV4 in AODSIM format for 2011 collision data (BSM Higgs)

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2011.

SingleElectron primary dataset in NANOAOD format from RunH of 2016. Run period from run number 281613 to 284044.

The list of validated runs, which must be applied to all analyses, either with the full validation or for an analysis requiring only muons, can be found in:

Simulated dataset SMHiggsToZZTo4L_M-125_8TeV-powheg15-JHUgenV3-pythia6 in AODSIM format for 2012 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2012.

Simulated dataset TT_TuneCUETP8M1_13TeV-powheg-pythia8 in MINIAODSIM format for 2015 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2015.

Simulated dataset G_Pt-30to50_TuneZ2star_8TeV_pythia6 in AODSIM format for 2012 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2012.

The ATLAS Collaboration has released 10/fb of collision data at a centre-of-mass energy of 13 TeV from the 2016 data-taking period, intended solely for educational purposes, to the general public. This set of real data is accompanied by matching simulated samples of Standard Model processes and a selection of Beyond the Standard Model signals.

Simulated dataset CEPDijets_M-500_13TeV-superchic in NANOAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.

Simulated dataset CGToBHpm_MH-350_TuneCP5_13TeV_G2HDM-rhott06_rhotc04_rhotu00-madgraphMLM-pythia8 in MINIAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.

Simulated dataset TprimeBToTH_M-800_LH_TuneCP5_13TeV-madgraph_pythia8 in MINIAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.

Simulated dataset CGToBHpm_MH-300_TuneCP5_13TeV_G2HDM-rhott06_rhotc04_rhotu00-madgraphMLM-pythia8 in MINIAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.

Simulated dataset QCD_Pt-800To1000_MuEnrichedPt5_TuneCP5_13TeV-pythia8 in NANOAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.

Simulated dataset GluGluHToWWToLNuQQ_M-140_TuneCP5_13TeV_powheg_jhugen751_pythia8 in NANOAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.

Simulated dataset GluGluHToWWToLNuQQ_M-150_TuneCP5_13TeV_powheg_jhugen751_pythia8 in NANOAODSIM format for 2016 collision data.

See the description of the simulated dataset names in: About CMS simulated dataset names.

These simulated datasets correspond to the collision data collected by the CMS experiment in 2016.