jialinsong/apps_metric

add option to use a subset of test cases

enable reliability guard

make return values consistent

update apps_metric to provide outputs

fix _temp_run can't be pickled; pass indices to allow evaluation on subset

Duplicate from codeparrot/apps_metric