The bottom line in memory system design is the average memory access time, AMAT. For a simple cache:
Average memory access time = Hit time + Miss rate Miss penalty