It's not meant to save money.
The majority of the government hasn't been budgeted; no money allocated. This means they have no money to pay workers, pay for things, etc.
So in response, all departments were given one day to go into "emergency shutdown mode," and then furloughed everyone that wasn't essential.