For transporting water outside the cities the Romans built aqueducts to bring the water from far to the city. Though these are mighty constructions, the longer parts were underground.