Opened 5 years ago

Closed 2 years ago

#600 closed task (wontfix)

Data file catalog speedup

Reported by: srkline Owned by: srkline
Priority: major Milestone: VSANS Reduction
Component: All Components Keywords:
Cc: Blocking:

Description (last modified by srkline)

Currently it is slow to read in data files for the data catalog. I'm reading from local disk, fast machine, and it still takes ≈0.6 s + to read in each data file. There is a terribly long lag where the table sits blank before it is all dumped into place.

How to "fake" the speedup of the filling in the table, and let the user know that something is still in progress. (a progress bar?)

Also, can I run some sort of WM function timing profiler to see where the bottleneck is, so that I can try to eliminate it.

Change History (2)

comment:1 Changed 5 years ago by srkline

  • Description modified (diff)

comment:2 Changed 2 years ago by srkline

  • Resolution set to wontfix
  • Status changed from new to closed

keep as-is -- robust is better than any minimal speed improvement I could spend days trying to successfully implement.

Note: See TracTickets for help on using tickets.