The expression "It's all up hill from here!" and "It's all down hill from here!" mean that things will only get better or things will only get worst.
Metaphorically going uphill can provide for a better position, while going down hill is easier.
Which expression represents which way?