You are designing a data parallel parameter server, and want to determine which update strategy to use based on the execution time.

The workflow executes 3 batches of data on 3 workers. In the table bellow you are given the execution time of each batch per worker. For each update strategy calculate the total execution time for the update strategies listed bellow. Assume no time-gaps between batches.

Batch 1 (s) Batch 2 (s) Batch 3 (s) Worker 1 20 35 28 Worker 2 27 32 30 Worker 3 25 38 33

Total execution time - BSP (s) Total execution time - ASP (s) Total execution time - Sync w/ Backup Workers - 1 backup worker (s)