[New Commondata Format] Old Jets datasets#1886
Conversation
|
See #1813 |
scarlehoff
left a comment
There was a problem hiding this comment.
Thank you very much! (and thank you as well for the very detailed report!). I've left some comments with some modifications. Some of them I've added locally to add the report with the plot (like the kinematics_override key in CMS_1JET_8TEV which might make the plot look differently to what you expected)
Please have a look at the plot and check whether everything looks as you expected:
https://vp.nnpdf.science/yWSiPUzmTfyZwHKQttJY-g==
(please add units for the different m12/pt)
As per the datasets themselves:
ATLAS_1JET_8TEV_R06:- no variant: the t0 chi2 is different, which points to some difference in the treatment of MULT / ADD
- decorrelated: the covmats are quite different (shouldn't they be the same for
DEC?) which obviously leads to a very different chi2
CMS_1JET_8TEV_PTY: there is a difference of a factor of two between the computed chi2, the off-diagonal entries of the covmat is different. They are also different with thebuggedversion which I expected would reproduce the old dataset (or maybe I should not expect the old one to be reproducible at all?)
For these two the results are completely equivalent (including t0 and everything)
ATLAS_2JET_7TEV_R06_M12Y: I needed to use thebuggedvariant (so I've added that todataset_names.yamlCMS_2JET_7TEV_M12Y
| plot_x: y | ||
| figure_by: | ||
| - p_T2 | ||
| kinematic_coverage: [y, p_T2, sqrt_s] |
There was a problem hiding this comment.
You are missing plotting information for this one from PLOTTINGTYPE_JET
kinematics_override: jet_sqrt_scale
This should have been fixed now.
The covariance matrices are supposed to be quite different (see https://vp.nnpdf.science/5DpNBePRSne1TZ1Sfky6Kg==/#dataset-atlas_1jet_8tev_r06_dec-variant-decorrelated) and the chi2 too (old value ~ 0.7, new value = 2.6). |
This I find surprising and it is possibly a mistake. I had found a bug for this dataset that was changing the chi2, but not by a factor of 2. Did you compute the chi2 with the cuts applied? |
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
…F/nnpdf into 071223_mnc_old_jet_data_new
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
…F/nnpdf into 071223_mnc_old_jet_data_new
This PR converts the following datasets (and versions therein) into the new commondata format
A report comparing legacy vs New:
https://vp.nnpdf.science/BAIRR312QyuMF3hKa5-9HQ==