Simulating XCache on historical data

Rucio Traces

Rucio runs a REST API that collects data from diffent clients requesting the data. This can be a user trying to download a file or dataset or Pilot trying to get path to data. Records are described here.

To destinguish type of access one uses field "eventType". The most important are: get_sm - production job input download get_sm_a - analysis job input download put_sm - production job output upload put_sm_a - analysis job output upload

Results

  • understanding formats, simulation of single site slides.
  • understanding multilayer cache, throughput needed, simulation of US network slides.
  • simulation of cache optimized job scheduling.

AB testing

  • effect on jobs wall times
  • effect on tasks turn-around times