Opened 9 years ago

Closed 9 years ago

#388 closed task (fixed)

Handling of very large event files

Reported by: srkline Owned by: srkline
Priority: minor Milestone: TISANE
Component: SANS Reduction Keywords:
Cc: Blocking:
Task:

Description

Need a way to handle very large event files. Files that are much larger than 200MB will cause an out-of-memory crash/error if you try to load them. 'split' works on unix, if you've got it - but a solution within Igor would be better. Then also provide tools to either add the split files together at the 128x128xnslice level, or tools to quickly add the exported raw data file for each slice in the reduction protocol.

Change History (1)

comment:1 Changed 9 years ago by srkline

  • Resolution set to fixed
  • Status changed from new to closed

Added commands to mimic the unix 'split' command to chunk up a file that is too large. Then added commands to accumulate the histogrammed set of slices as each chunk is processed, so that the entire file worth of events can be exported together.

Note: See TracTickets for help on using tickets.