Yeah, but you could head over to FedEx and pick the package up anytime after 5:00 or 5:30. Plus, they should be open until 9:00 or so this evening. That's what I usually do if they've made a delivery attempt and I wasn't home that day.
Also, I've had a driver come back for a 2nd time in the same day - and caught me at home on the 2nd trip. I guess they didn't have many packages on the truck at the times, so he did the 2nd visit thing.