laura is hosted by Hepforge, IPPP Durham

Opened 6 years ago

Last modified 4 years ago

#14 new task

Reorganise the data storage

Reported by: Thomas Latham Owned by: Thomas Latham
Priority: minor Milestone: v4r0
Version: Keywords:


At present the data is read in via a TTree in LauFitDataTree. Then when all the PDFs are asked to cache information they make their own local copies of their abscissas as well as the likelihood value or some intermediate calculated values. In fits with very large data samples this could cause memory problems.

Better to have only one copy of the data in memory and give the PDFs references to their abscissa values. They can still store locally their likelihood values and/or intermediate values.

In the case of extremely large statistics even this might break down so think about what to do then. Perhaps just use the TTree (with tweaked buffering options)?

Change History (3)

comment:1 Changed 6 years ago by Thomas Latham

Milestone: v3r0

comment:2 Changed 5 years ago by Thomas Latham

Milestone: v3r0v3r1

comment:3 Changed 4 years ago by Thomas Latham

Milestone: v3r1v4r0
Note: See TracTickets for help on using tickets.